CN113760858A - Dynamic migration method and device for memory database data, computing equipment and storage equipment - Google Patents
Dynamic migration method and device for memory database data, computing equipment and storage equipment Download PDFInfo
- Publication number
- CN113760858A CN113760858A CN202010505942.0A CN202010505942A CN113760858A CN 113760858 A CN113760858 A CN 113760858A CN 202010505942 A CN202010505942 A CN 202010505942A CN 113760858 A CN113760858 A CN 113760858A
- Authority
- CN
- China
- Prior art keywords
- client
- data
- migration
- migrated
- fragment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000013508 migration Methods 0.000 title claims abstract description 209
- 230000005012 migration Effects 0.000 title claims abstract description 209
- 230000015654 memory Effects 0.000 title claims abstract description 74
- 238000000034 method Methods 0.000 title claims abstract description 61
- 238000003860 storage Methods 0.000 title claims abstract description 11
- 239000012634 fragment Substances 0.000 claims abstract description 158
- 238000012545 processing Methods 0.000 claims description 38
- 238000013467 fragmentation Methods 0.000 claims description 25
- 238000006062 fragmentation reaction Methods 0.000 claims description 25
- 238000004891 communication Methods 0.000 claims description 16
- 230000008569 process Effects 0.000 abstract description 22
- 238000013523 data management Methods 0.000 abstract description 19
- 238000005192 partition Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 230000008901 benefit Effects 0.000 description 4
- 238000004590 computer program Methods 0.000 description 4
- 230000011218 segmentation Effects 0.000 description 3
- 230000009191 jumping Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000011022 operating instruction Methods 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 238000007711 solidification Methods 0.000 description 1
- 230000008023 solidification Effects 0.000 description 1
- 239000000725 suspension Substances 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 238000013024 troubleshooting Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/214—Database migration support
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention relates to the technical field of business support, and discloses a dynamic migration method, a dynamic migration device, computing equipment and storage equipment for database data, wherein the method comprises the following steps: acquiring data to be migrated and the number of clients to be migrated corresponding to the client fragments from a distributed cluster cache according to the client fragments; for any client fragment, acquiring the data to be migrated corresponding to a client in sequence and migrating the data; and accumulating the number of the migration clients until the number of the migration clients is equal to the data of the clients to be migrated. Through the mode, the embodiment of the invention can convert the data management unit from a single client to a batch of clients with the same client fragment, improve the data management efficiency, simplify the migration process and simultaneously realize dynamic migration of the memory database without being waited.
Description
Technical Field
The embodiment of the invention relates to the technical field of business support, in particular to a dynamic migration method and device for memory database data, computing equipment and storage equipment.
Background
With the development of the pound part of mobile internet service and the speed-increasing and fee-reducing of the mobile internet service in China, it is more and more common for users to use mobile phones to surf the internet, and the amount of client data received by the corresponding charging system increases rapidly. The rapid increase of the traffic and the data volume of the client makes the phenomena of unbalanced load of the memory database caused by the increase difference of the regional traffic more obvious, and the data expansion is more frequent, thereby having higher requirements on the routing processing capacity, particularly the load capacity, the concurrent processing capacity and the automatic expansion capacity of the service support system.
The existing technology deals with the rapid increase of customer data by frequently carrying out complex memory bank expansion and data migration, and the measures really relieve the pressure of the increase of data volume. However, in the prior art, capacity expansion and data migration operations need to be performed without service, and frequent service suspension can lead to overstock of service data, thereby bringing negative effects of untimely charging processing, untimely flow reminding and untimely arrearage processing for part of users; in addition, in the client data management mode using a single client as a unit, in the process of capacity expansion of a large number of manually operated memories, the process is complex, the workload is huge, the problem troubleshooting is difficult, and the risk coefficient is high.
Disclosure of Invention
In view of the foregoing problems, embodiments of the present invention provide a method, an apparatus, a computing device, and a storage device for dynamically migrating database data, which overcome or at least partially solve the above problems.
According to an aspect of the embodiments of the present invention, a method for dynamically migrating database data is provided, where the method includes: acquiring data to be migrated and the number of clients to be migrated corresponding to the client fragments from a distributed cluster cache according to the client fragments; for any client fragment, acquiring the data to be migrated corresponding to a client in sequence and migrating the data; and accumulating the number of the migration clients until the number of the migration clients is equal to the data of the clients to be migrated.
In an optional manner, the obtaining and migrating the to-be-migrated data corresponding to a client in order for any client partition includes: sequentially fetching the data to be migrated of the client in the client fragment; judging whether the associated customer field of the customer is empty or not according to the data to be migrated; if the associated client field is not empty, acquiring the data to be migrated of the associated client corresponding to the associated client field; and if the client is empty, merging and migrating the to-be-migrated data of the client and the associated client in a distributed cluster cache.
In an optional manner, before acquiring data to be migrated and the number of clients to be migrated corresponding to a client fragment from a distributed cluster cache according to the client fragment, the method includes: when the state of newly added customer data or stock customer data changes, the newly added customer data and the stock customer data are subjected to one-time fragmentation processing through decoupling according to a preset fragmentation rule and are solidified from a business base to enter a data physical base; and storing the newly added customer data and the stock customer data after fragmentation processing from the data physical library to a distributed memory database through loading or refreshing.
In an optional manner, the method further comprises:
responding to an access request initiated by an application to a data node of a client, and inquiring whether a region fragment where the client is located is in a region balance state list or not according to a region number corresponding to the client; if the zone fragment where the client is located is not in the zone equilibrium state list, acquiring a data node from a distributed cluster cache, and if the distributed cluster cache does not have the data node, acquiring the data node through a routing service; and if the region fragment where the client is located is in the region balance state list, acquiring the data node through a routing service.
In an optional manner, the acquiring the data node through the routing service includes: starting a routing service, and locking data of all migration areas in the memory parameter library; judging whether the client fragment belongs to the migration area fragment or not according to the client fragment to which the client belongs; if the client fragment belongs to the non-migration zone fragment, acquiring the data node according to the migration state of the associated client; and if the client fragment belongs to the migration zone fragment, inquiring the migration state in a client migration state table in the memory parameter library, trying to access the data node of the client, and returning an access result according to the migration state of the client.
In an optional manner, the acquiring the data node according to the migration status of the associated client includes: inquiring whether the associated data is migrated or not according to the associated client service table; if yes, returning that the current data is being migrated; and if the client is in a service processing state, directly returning to the data node.
In an optional manner, the returning an access result according to the migration status of the client includes: if the customer migration is completed, the access is successful, and the data node is returned; if the client is migrating, the query fails, returning that the migration/processing is failing.
According to another aspect of the embodiments of the present invention, there is provided a device for dynamically migrating database data, where the device includes: the data acquisition unit is used for acquiring data to be migrated and the number of clients to be migrated corresponding to the client fragments from the distributed cluster cache according to the client fragments; the dynamic migration unit is used for acquiring the data to be migrated corresponding to a client in sequence and migrating the data to be migrated aiming at any client fragment; and the migration finishing unit is used for accumulating the number of the migration clients until the number of the migration clients is equal to the data of the clients to be migrated.
According to another aspect of embodiments of the present invention, there is provided a computing device including: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus;
the memory is used for storing at least one executable instruction, and the executable instruction enables the processor to execute the steps of the dynamic migration method of the database data.
According to another aspect of the embodiments of the present invention, a computer storage medium is provided, where at least one executable instruction is stored in the storage medium, and the executable instruction causes the processor to execute the steps of the above dynamic migration method for database data.
The embodiment of the invention obtains the data to be migrated and the number of the clients to be migrated corresponding to the client fragments from the distributed cluster cache according to the client fragments; for any client fragment, acquiring the data to be migrated corresponding to a client in sequence and migrating the data; and accumulating the number of the migration clients until the number of the migration clients is equal to the data of the clients to be migrated, so that a data management unit can be changed from a single client to a group of clients with the same client fragment, the data management efficiency is improved, the migration process is simplified, and meanwhile, dynamic migration of the memory database data without service interruption can be realized.
The foregoing description is only an overview of the technical solutions of the embodiments of the present invention, and the embodiments of the present invention can be implemented according to the content of the description in order to make the technical means of the embodiments of the present invention more clearly understood, and the detailed description of the present invention is provided below in order to make the foregoing and other objects, features, and advantages of the embodiments of the present invention more clearly understandable.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
fig. 1 is a schematic flow chart illustrating a method for dynamically migrating memory database data according to an embodiment of the present invention;
fig. 2 is a schematic diagram illustrating a client partition of a dynamic migration method for database data according to an embodiment of the present invention;
fig. 3 is a schematic diagram illustrating a dynamic migration process of a method for dynamically migrating memory database according to an embodiment of the present invention;
fig. 4 is a schematic diagram illustrating a routing service access process of a dynamic migration method for database data according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram illustrating a dynamic migration apparatus for database data according to an embodiment of the present invention;
fig. 6 shows a schematic structural diagram of a computing device provided by an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the invention are shown in the drawings, it should be understood that the invention can be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.
Fig. 1 is a schematic flow chart illustrating a method for dynamically migrating memory database data according to an embodiment of the present invention. The dynamic migration method of the memory database data is mainly applied to the server. As shown in fig. 1, the method for dynamically migrating the database data includes:
step S11: and acquiring data to be migrated and the number of clients to be migrated corresponding to the client fragments from the distributed cluster cache according to the client fragments.
In the present invention, before step S11, a client partition is obtained according to a preset partition rule in a memory parameter library, where the client partition is the number of client partitions, i.e., the area code + the routing client code (ID) mod. When initializing the customer data stored in the distributed memory database, namely starting the function for the first time, the newly added business data and the stock customer data are separated again through decoupling to enter a data physical library, and then are refreshed/loaded into the distributed memory database. Initializing the data information of the memory parameter library and the data physical library fragment. Newly-added customer data and stock customer data are subjected to customer segmentation, as shown in fig. 2, the newly-added business customer data and the stock customer data are subjected to one-time segmentation processing and solidification according to a segmentation rule defined by a memory parameter library through decoupling, and then enter a data physical library; the fragmentation information is stored in a distributed cluster cache (distributed memory database) by loading/refreshing.
When the state of the newly added client data or the stock client data changes, the newly added client data and the stock client data are subjected to one-time fragmentation processing through decoupling according to a preset fragmentation rule and are solidified from a business base to enter a data physical base; and storing the newly added customer data and the stock customer data after fragmentation processing from the data physical library to a distributed memory database through loading or refreshing. Although the amount of data stored in the client is huge, the data storage is simple, and meanwhile, the stability of the system can be improved by adopting a distributed memory database to store the data.
In the embodiment of the invention, the application transformation is carried out on the client Data, the applications of routing service, a Data Communication Router (dccRouter), an online charging process, decoupling refreshing and the like are transformed, the client fragment is supported to be obtained through the routing service, and then the Data node is further obtained. The memory parameter base and the data physical base maintain the fragment data information, which mainly comprises a newly added migration state table, a service processing table and the like.
In step S11, when access bottleneck is caused by unbalanced distribution in the memory parameter library, dynamic migration of the memory database data is realized based on the client data segment routing, and segment migration is started. Firstly, initializing data, acquiring data to be migrated of any client fragment according to records of inconsistency of new and old containers in a client fragment definition table, and generating the data to be migrated of the client fragment according to a client migration table. Specifically, records with inconsistent IDs of new and old containers in the client fragment definition table of the memory parameter library are obtained, and data to be migrated are obtained. And after the data in the area balance state table is initialized, changing the state of the area to be migrated, and generating the client data to be migrated according to the client migration table. This completes the data initialization preparation. Wherein, the new and old container refers to the new and old data nodes for storing the client data.
Step S12: and aiming at any client fragment, acquiring the data to be migrated corresponding to a client in sequence and migrating the data.
And after data is initialized, carrying out fragment migration in sequence. Firstly, judging the state in the client migration table, and screening out the client data to be migrated. Further, performing associated client judgment, namely judging whether the data to be migrated is associated data of the service access locking data; and merging and migrating the data to be migrated meeting the conditions in the distributed cluster cache, and accumulating the successfully migrated client data volume after the data to be migrated succeeds. Judging the data volume of the migrated client, if not, repeating the steps, and waiting for unlocking of the service locking data; and after the number is satisfied, completing the dynamic migration. Specifically, the data to be migrated of any client and the associated client are sequentially fetched in the client fragment, and merged migration is performed in the distributed cluster cache. In step S12, the data to be migrated of the client is taken in order in the client partition; judging whether the associated customer field of the customer is empty or not according to the data to be migrated; if the associated client field is not empty, acquiring the data to be migrated of the associated client corresponding to the associated client field; and if the client is empty, merging and migrating the to-be-migrated data of the client and the associated client in a distributed cluster cache.
Step S13: and accumulating the number of the migration clients until the number of the migration clients is equal to the data of the clients to be migrated.
And finally, accumulating the number of the migration clients, and if the number of the migration clients is smaller than the data of the clients to be migrated, repeating the step S12 until the number of the migration clients is equal to the data of the clients to be migrated. Thus, the dynamic data migration of the memory base without stopping service is completed.
A more detailed live migration process is shown in FIG. 3, which includes:
step S301: data migration is initiated.
Step S302: the data is initialized.
And acquiring the data to be migrated of any client fragment according to the inconsistent records of the new container and the old container in the client fragment definition table, and generating the data to be migrated of the client fragment according to the client migration table.
Step S303: and taking the data to be migrated of any client in sequence.
And sequentially fetching the data to be migrated of any client in the client fragment.
Step S304: and judging the transition state. If the migration state is the completion of the migration, directly returning to the step S303; if the migration status is migration failure, executing step S305; if the migration status is to be migrated, step S306 is executed.
And judging the migration state of the acquired data to be migrated. If the migration state of the data to be migrated is completed, which indicates that the data to be migrated has been completed, directly jumping to step S303, and sequentially fetching the data to be migrated of the next client.
Step S305: the migration status table is changed. And then returns to step S303.
And when the migration state of the data to be migrated is failure, changing the migration state table of the data to be migrated, for example, changing the migration state table into the state to be migrated.
Step S306: it is determined whether the associated client field is empty. If yes, go to step S307; if not, return to step S303.
When the migration state of the data to be migrated is the state to be migrated, it is described that the data to be migrated needs to be migrated, and at this time, it is determined whether the associated client field is empty to obtain the associated client of the client. If the field of the associated client is empty, the data to be migrated of the associated client of the client is obtained completely, or the client does not have the associated client. If the associated client field is not empty, which indicates that the piece of data to be migrated is associated data of the service access locking data, the step S303 is skipped to obtain associated data of the associated client.
Step S307: merging and migrating the data to be migrated.
And after the data to be migrated of the client and the associated client are obtained, merging and migrating the data to be migrated of the client and the associated client in the distributed cluster cache.
Step S308: the number of migration clients is accumulated.
After migration is completed, the number of migration clients is accumulated.
Step S309: and judging whether the number of the migration clients is met. If yes, go to step S310; if not, return to step S303.
Namely, whether the number of the migration clients is equal to the previously acquired data of the clients to be migrated is judged. If the data to be migrated of the client fragment is equal, the migration of the data to be migrated of the client fragment is completed. If not, it indicates that the migration of the to-be-migrated data of the client segment is not completed, and the process jumps to step S303, and sequentially obtains the to-be-migrated data of the next client, and continues to perform the dynamic migration.
Step S310: and (4) finishing.
And then, completing the dynamic migration of the data to be migrated of the client fragment, and subsequently continuing the dynamic migration of the data to be migrated of other client fragments in sequence.
The embodiment of the invention fragments according to the client routing ID and the defined fragmentation rule, supports the fragmentation processing mode, converts a data management unit from a single client to a batch of clients with the same client fragments, and applies the dynamic migration and routing access to the data of the memory bank, thereby improving the data management efficiency, simplifying the migration process, reducing the interface calling times and basically realizing the automatic capacity expansion; the distributed cache has the advantages of high performance, high reliability and high concurrency, and the distributed memory database is adopted to store the client routing information, so that the processing efficiency of the routing can be greatly improved, the performance, the reliability and the concurrency capability of data access are improved, the reliability of the system is improved, and the high availability of the system is realized.
In the embodiment of the invention, after the application initiates the access request, the access request initiated by the application is responded, and the routing access query is carried out according to the migration state of the client. Specifically, responding to an access request initiated by an application to a data node of a client, and inquiring whether a region fragment where the client is located is in a region balance state list or not according to a region number corresponding to the client; if the zone fragment where the client is located is not in the zone equilibrium state list, acquiring a data node from a distributed cluster cache, and if the distributed cluster cache does not have the data node, acquiring the data node through a routing service; and if the region fragment where the client is located is in the region balance state list, acquiring the data node through a routing service. Therefore, the number of times of calling the routing service is reduced, and meanwhile, the access efficiency is improved. And acquiring the data nodes through a routing service, and simultaneously placing the acquired data nodes into the distributed cluster cache.
And when the data node is acquired through the routing service, starting the routing service, and locking the data of all the migration areas in the memory parameter library. Obtaining client fragments from the distributed cluster cache, and judging whether the client fragments belong to migration region fragments according to the client fragments to which the clients belong; if the client fragment belongs to the non-migration zone fragment, acquiring the data node according to the migration state of the associated client; and if the client fragment belongs to the migration zone fragment, inquiring the migration state in a client migration state table in the memory parameter library, trying to access the data node of the client, and returning an access result according to the migration state of the client. If the customer migration is completed, the access is successful, and the data node is returned; if the client is migrating, the query fails, returning that the migration/processing is failing.
If the client fragment belongs to the non-migration zone fragment, acquiring the data node according to the migration state of the associated client, and specifically inquiring whether the associated data is migrating according to the associated client service table; if yes, returning that the current data is being migrated; and if the client is in a service processing state, directly returning to the data node.
In the embodiment of the present invention, a complete process of performing routing service access is shown in fig. 4, and includes:
step S401: the application initiates an access request.
Step S402: and judging whether the current city is in equilibrium or not. If not, go to step S403; if so, the process jumps to step S405.
And inquiring a region balance state table of the parameter library, and judging whether the current city is migrated or not.
Step S403: the cache is accessed.
And accessing the distributed cluster cache to acquire the data nodes from the distributed cluster cache when the current local city is not migrated. If the distributed cluster cache does not have the data node to be queried, the step S405 is executed.
Step S404: and returning the data node.
And returning the data nodes obtained from the distributed cluster cache.
Step S405: the routing service is initiated.
Step S406: and locking the migration area.
And locking the data of all the migration areas in the memory parameter library.
Step S407: and acquiring the client fragment from the REDIS.
The client shards are obtained from a distributed cluster cache (REDIS). And meanwhile, acquiring the migration region fragment.
Step S408: and judging whether the client belongs to the migration fragment. If not, executing step S409; if so, it jumps to execute step S412.
And judging whether the client is in the migration zone fragment.
Step S409: and querying a client associated service table.
And if the client belongs to the non-migration zone partition, directly inquiring the client associated service table.
Step S410: and judging the service type.
Specifically, a query is made as to whether there is associated data that is being migrated. If the associated data is being migrated, executing step S411; if no associated data is being migrated, i.e. the client is in a business process state, it jumps to execute step S415.
Step S411: returning to being migrated.
And returning that the current data is migrating when the related data is migrating.
Step S412: the memory parameter library queries the client migration status table.
And if the client belongs to the migration zone fragment, inquiring the state in a client migration state table in the memory parameter library, and performing an access attempt. The states in the client migration state table can be mainly divided into a migrated state, a migrating state and a to-be-migrated state, wherein the new client can be regarded as the migrated state.
Step S413: and judging a query result.
And acquiring a query result of the access attempt, and judging whether the query is successful. If yes, jumping to execute step S405; if not, step S414 is performed.
Step S414: return processing fails/is migrating.
If the client is in the migration state, the client refuses the access, fails to inquire and returns that the current data is failing to migrate/process. And then jumps to step S408.
Step S415: and returning the data node.
And if the client is in the migrated state or the state to be migrated, the query is successful, and the acquired data node is returned. Specifically, when the client is in the migrated state, returning to the target data node; and when the client is in the state to be migrated, returning to the current data node.
Step S416: and unlocking the client data.
And unlocking the client data after the required data nodes are obtained. The embodiment of the invention changes a data management unit from a single client to a batch of clients with the same client fragment, and applies the data management unit to dynamic migration of the data in the memory bank and route access, simplifies the migration process, reduces the interface calling times, accurately identifies the data in service access and the related client data, and locks the data through the route service, realizes the data migration of the dynamic memory bank and the parallel operation of the service access, can effectively prevent the data from being accessed by the data migration service, and realizes the dynamic migration without being waited; and the distributed memory database is adopted to store the client routing information, so that the performance, reliability and concurrency capability of data access are improved.
The embodiment of the invention obtains the data to be migrated and the number of the clients to be migrated corresponding to the client fragments from the distributed cluster cache according to the client fragments; for any client fragment, acquiring the data to be migrated corresponding to a client in sequence and migrating the data; and accumulating the number of the migration clients until the number of the migration clients is equal to the data of the clients to be migrated, so that a data management unit can be changed from a single client to a group of clients with the same client fragment, the data management efficiency is improved, the migration process is simplified, and meanwhile, dynamic migration of the memory database data without service interruption can be realized.
Fig. 5 is a schematic structural diagram illustrating a dynamic migration apparatus of database data according to an embodiment of the present invention. As shown in fig. 5, the dynamic migration apparatus for database data includes: a data acquisition unit 501, a dynamic migration unit 502, a migration completion unit 503, a client fragmentation unit 504, and a routing service unit 505. Wherein:
the data obtaining unit 501 is configured to obtain data to be migrated and the number of clients to be migrated corresponding to client shards from the distributed cluster cache according to the client shards; the dynamic migration unit 502 is configured to, for any one of the client segments, sequentially obtain the data to be migrated corresponding to a client and perform migration; the migration completion unit 503 is configured to accumulate the number of migration clients until the number of migration clients is equal to the data of the client to be migrated.
In an alternative manner, the live migration unit 502 is configured to: sequentially fetching the data to be migrated of the client in the client fragment; judging whether the associated customer field of the customer is empty or not according to the data to be migrated; if the associated client field is not empty, acquiring the data to be migrated of the associated client corresponding to the associated client field; and if the client is empty, merging and migrating the to-be-migrated data of the client and the associated client in a distributed cluster cache.
In an alternative approach, the client sharding unit 504 is configured to: when the state of newly added customer data or stock customer data changes, the newly added customer data and the stock customer data are subjected to one-time fragmentation processing through decoupling according to a preset fragmentation rule and are solidified from a business base to enter a data physical base; and storing the newly added customer data and the stock customer data after fragmentation processing from the data physical library to a distributed memory database through loading or refreshing.
In an alternative manner, the routing service unit 505 is configured to: responding to an access request initiated by an application to a data node of a client, and inquiring whether a region fragment where the client is located is in a region balance state list or not according to a region number corresponding to the client; if the zone fragment where the client is located is not in the zone equilibrium state list, acquiring a data node from a distributed cluster cache, and if the distributed cluster cache does not have the data node, acquiring the data node through a routing service; and if the region fragment where the client is located is in the region balance state list, acquiring the data node through a routing service.
In an optional manner, the routing service unit 505 is further configured to: starting a routing service, and locking data of all migration areas in the memory parameter library; judging whether the client fragment belongs to the migration area fragment or not according to the client fragment to which the client belongs; if the client fragment belongs to the non-migration zone fragment, acquiring the data node according to the migration state of the associated client; and if the client fragment belongs to the migration zone fragment, inquiring the migration state in a client migration state table in the memory parameter library, trying to access the data node of the client, and returning an access result according to the migration state of the client.
In an optional manner, the routing service unit 505 is further configured to: inquiring whether the associated data is migrated or not according to the associated client service table; if yes, returning that the current data is being migrated; and if the client is in a service processing state, directly returning to the data node.
In an optional manner, the routing service unit 505 is further configured to: if the customer migration is completed, the access is successful, and the data node is returned; if the client is migrating, the query fails, returning that the migration/processing is failing.
The embodiment of the invention obtains the data to be migrated and the number of the clients to be migrated corresponding to the client fragments from the distributed cluster cache according to the client fragments; for any client fragment, acquiring the data to be migrated corresponding to a client in sequence and migrating the data; and accumulating the number of the migration clients until the number of the migration clients is equal to the data of the clients to be migrated, so that a data management unit can be changed from a single client to a group of clients with the same client fragment, the data management efficiency is improved, the migration process is simplified, and meanwhile, dynamic migration of the memory database data without service interruption can be realized.
The embodiment of the invention provides a nonvolatile computer storage medium, wherein the computer storage medium stores at least one executable instruction, and the computer executable instruction can execute the dynamic migration method of the memory database in any method embodiment.
The executable instructions may be specifically configured to cause the processor to:
acquiring data to be migrated and the number of clients to be migrated corresponding to the client fragments from a distributed cluster cache according to the client fragments;
for any client fragment, acquiring the data to be migrated corresponding to a client in sequence and migrating the data;
and accumulating the number of the migration clients until the number of the migration clients is equal to the data of the clients to be migrated.
In an alternative, the executable instructions cause the processor to:
sequentially fetching the data to be migrated of the client in the client fragment;
judging whether the associated customer field of the customer is empty or not according to the data to be migrated;
if the associated client field is not empty, acquiring the data to be migrated of the associated client corresponding to the associated client field;
and if the client is empty, merging and migrating the to-be-migrated data of the client and the associated client in a distributed cluster cache.
In an alternative, the executable instructions cause the processor to:
when the state of newly added customer data or stock customer data changes, the newly added customer data and the stock customer data are subjected to one-time fragmentation processing through decoupling according to a preset fragmentation rule and are solidified from a business base to enter a data physical base;
and storing the newly added customer data and the stock customer data after fragmentation processing from the data physical library to a distributed memory database through loading or refreshing.
In an alternative, the executable instructions cause the processor to:
responding to an access request initiated by an application to a data node of a client, and inquiring whether a region fragment where the client is located is in a region balance state list or not according to a region number corresponding to the client;
if the zone fragment where the client is located is not in the zone equilibrium state list, acquiring a data node from a distributed cluster cache, and if the distributed cluster cache does not have the data node, acquiring the data node through a routing service;
and if the region fragment where the client is located is in the region balance state list, acquiring the data node through a routing service.
In an alternative, the executable instructions cause the processor to:
starting a routing service, and locking data of all migration areas in the memory parameter library;
judging whether the client fragment belongs to the migration area fragment or not according to the client fragment to which the client belongs;
if the client fragment belongs to the non-migration zone fragment, acquiring the data node according to the migration state of the associated client;
and if the client fragment belongs to the migration zone fragment, inquiring the migration state in a client migration state table in the memory parameter library, trying to access the data node of the client, and returning an access result according to the migration state of the client.
In an alternative, the executable instructions cause the processor to:
inquiring whether the associated data is migrated or not according to the associated client service table;
if yes, returning that the current data is being migrated;
and if the client is in a service processing state, directly returning to the data node.
In an alternative, the executable instructions cause the processor to:
if the customer migration is completed, the access is successful, and the data node is returned;
if the client is migrating, the query fails, returning that the migration/processing is failing.
The embodiment of the invention obtains the data to be migrated and the number of the clients to be migrated corresponding to the client fragments from the distributed cluster cache according to the client fragments; for any client fragment, acquiring the data to be migrated corresponding to a client in sequence and migrating the data; and accumulating the number of the migration clients until the number of the migration clients is equal to the data of the clients to be migrated, so that a data management unit can be changed from a single client to a group of clients with the same client fragment, the data management efficiency is improved, the migration process is simplified, and meanwhile, dynamic migration of the memory database data without service interruption can be realized.
An embodiment of the present invention provides a computer program product, where the computer program product includes a computer program stored on a computer storage medium, where the computer program includes program instructions, and when the program instructions are executed by a computer, the computer is caused to execute the dynamic migration method for memory database in any of the above method embodiments.
The executable instructions may be specifically configured to cause the processor to:
acquiring data to be migrated and the number of clients to be migrated corresponding to the client fragments from a distributed cluster cache according to the client fragments;
for any client fragment, acquiring the data to be migrated corresponding to a client in sequence and migrating the data;
and accumulating the number of the migration clients until the number of the migration clients is equal to the data of the clients to be migrated.
In an alternative, the executable instructions cause the processor to:
sequentially fetching the data to be migrated of the client in the client fragment;
judging whether the associated customer field of the customer is empty or not according to the data to be migrated;
if the associated client field is not empty, acquiring the data to be migrated of the associated client corresponding to the associated client field;
and if the client is empty, merging and migrating the to-be-migrated data of the client and the associated client in a distributed cluster cache.
In an alternative, the executable instructions cause the processor to:
when the state of newly added customer data or stock customer data changes, the newly added customer data and the stock customer data are subjected to one-time fragmentation processing through decoupling according to a preset fragmentation rule and are solidified from a business base to enter a data physical base;
and storing the newly added customer data and the stock customer data after fragmentation processing from the data physical library to a distributed memory database through loading or refreshing.
In an alternative, the executable instructions cause the processor to:
responding to an access request initiated by an application to a data node of a client, and inquiring whether a region fragment where the client is located is in a region balance state list or not according to a region number corresponding to the client;
if the zone fragment where the client is located is not in the zone equilibrium state list, acquiring a data node from a distributed cluster cache, and if the distributed cluster cache does not have the data node, acquiring the data node through a routing service;
and if the region fragment where the client is located is in the region balance state list, acquiring the data node through a routing service.
In an alternative, the executable instructions cause the processor to:
starting a routing service, and locking data of all migration areas in the memory parameter library;
judging whether the client fragment belongs to the migration area fragment or not according to the client fragment to which the client belongs;
if the client fragment belongs to the non-migration zone fragment, acquiring the data node according to the migration state of the associated client;
and if the client fragment belongs to the migration zone fragment, inquiring the migration state in a client migration state table in the memory parameter library, trying to access the data node of the client, and returning an access result according to the migration state of the client.
In an alternative, the executable instructions cause the processor to:
inquiring whether the associated data is migrated or not according to the associated client service table;
if yes, returning that the current data is being migrated;
and if the client is in a service processing state, directly returning to the data node.
In an alternative, the executable instructions cause the processor to:
if the customer migration is completed, the access is successful, and the data node is returned;
if the client is migrating, the query fails, returning that the migration/processing is failing.
The embodiment of the invention obtains the data to be migrated and the number of the clients to be migrated corresponding to the client fragments from the distributed cluster cache according to the client fragments; for any client fragment, acquiring the data to be migrated corresponding to a client in sequence and migrating the data; and accumulating the number of the migration clients until the number of the migration clients is equal to the data of the clients to be migrated, so that a data management unit can be changed from a single client to a group of clients with the same client fragment, the data management efficiency is improved, the migration process is simplified, and meanwhile, dynamic migration of the memory database data without service interruption can be realized.
Fig. 6 is a schematic structural diagram of a computing device according to an embodiment of the present invention, and a specific embodiment of the present invention does not limit a specific implementation of the device.
As shown in fig. 6, the computing device may include: a processor (processor)602, a communication Interface 604, a memory 606, and a communication bus 608.
Wherein: the processor 602, communication interface 604, and memory 606 communicate with one another via a communication bus 608. A communication interface 604 for communicating with network elements of other devices, such as clients or other servers. The processor 602 is configured to execute the program 610, and may specifically execute the relevant steps in the embodiment of the dynamic migration method for database data.
In particular, program 610 may include program code comprising computer operating instructions.
The processor 602 may be a central processing unit CPU or an application Specific Integrated circuit asic or an Integrated circuit or Integrated circuits configured to implement embodiments of the present invention. The one or each processor included in the device may be the same type of processor, such as one or each CPU; or may be different types of processors such as one or each CPU and one or each ASIC.
And a memory 606 for storing a program 610. Memory 606 may comprise high-speed RAM memory, and may also include non-volatile memory (non-volatile memory), such as at least one disk memory.
The program 610 may specifically be configured to cause the processor 602 to perform the following operations:
acquiring data to be migrated and the number of clients to be migrated corresponding to the client fragments from a distributed cluster cache according to the client fragments;
for any client fragment, acquiring the data to be migrated corresponding to a client in sequence and migrating the data;
and accumulating the number of the migration clients until the number of the migration clients is equal to the data of the clients to be migrated.
In an alternative, the program 610 causes the processor to:
sequentially fetching the data to be migrated of the client in the client fragment;
judging whether the associated customer field of the customer is empty or not according to the data to be migrated;
if the associated client field is not empty, acquiring the data to be migrated of the associated client corresponding to the associated client field;
and if the client is empty, merging and migrating the to-be-migrated data of the client and the associated client in a distributed cluster cache.
In an alternative, the program 610 causes the processor to:
when the state of newly added customer data or stock customer data changes, the newly added customer data and the stock customer data are subjected to one-time fragmentation processing through decoupling according to a preset fragmentation rule and are solidified from a business base to enter a data physical base;
and storing the newly added customer data and the stock customer data after fragmentation processing from the data physical library to a distributed memory database through loading or refreshing.
In an alternative, the program 610 causes the processor to:
responding to an access request initiated by an application to a data node of a client, and inquiring whether a region fragment where the client is located is in a region balance state list or not according to a region number corresponding to the client;
if the zone fragment where the client is located is not in the zone equilibrium state list, acquiring a data node from a distributed cluster cache, and if the distributed cluster cache does not have the data node, acquiring the data node through a routing service;
and if the region fragment where the client is located is in the region balance state list, acquiring the data node through a routing service.
In an alternative, the program 610 causes the processor to:
starting a routing service, and locking data of all migration areas in the memory parameter library;
judging whether the client fragment belongs to the migration area fragment or not according to the client fragment to which the client belongs;
if the client fragment belongs to the non-migration zone fragment, acquiring the data node according to the migration state of the associated client;
and if the client fragment belongs to the migration zone fragment, inquiring the migration state in a client migration state table in the memory parameter library, trying to access the data node of the client, and returning an access result according to the migration state of the client.
In an alternative, the program 610 causes the processor to:
inquiring whether the associated data is migrated or not according to the associated client service table;
if yes, returning that the current data is being migrated;
and if the client is in a service processing state, directly returning to the data node.
In an alternative, the program 610 causes the processor to:
if the customer migration is completed, the access is successful, and the data node is returned;
if the client is migrating, the query fails, returning that the migration/processing is failing.
The embodiment of the invention obtains the data to be migrated and the number of the clients to be migrated corresponding to the client fragments from the distributed cluster cache according to the client fragments; for any client fragment, acquiring the data to be migrated corresponding to a client in sequence and migrating the data; and accumulating the number of the migration clients until the number of the migration clients is equal to the data of the clients to be migrated, so that a data management unit can be changed from a single client to a group of clients with the same client fragment, the data management efficiency is improved, the migration process is simplified, and meanwhile, dynamic migration of the memory database data without service interruption can be realized.
The algorithms or displays presented herein are not inherently related to any particular computer, virtual system, or other apparatus. Various general purpose systems may also be used with the teachings herein. The required structure for constructing such a system will be apparent from the description above. In addition, embodiments of the present invention are not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.
In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the embodiments of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the invention and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.
Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
Furthermore, those skilled in the art will appreciate that while some embodiments herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names. The steps in the above embodiments should not be construed as limiting the order of execution unless specified otherwise.
Claims (10)
1. A method for dynamically migrating database data, the method comprising:
acquiring data to be migrated and the number of clients to be migrated corresponding to the client fragments from a distributed cluster cache according to the client fragments;
for any client fragment, acquiring the data to be migrated corresponding to a client in sequence and migrating the data;
and accumulating the number of the migration clients until the number of the migration clients is equal to the data of the clients to be migrated.
2. The method according to claim 1, wherein the obtaining and migrating the to-be-migrated data corresponding to a client in order for any client slice comprises:
sequentially fetching the data to be migrated of the client in the client fragment;
judging whether the associated customer field of the customer is empty or not according to the data to be migrated;
if the associated client field is not empty, acquiring the data to be migrated of the associated client corresponding to the associated client field;
and if the client is empty, merging and migrating the to-be-migrated data of the client and the associated client in a distributed cluster cache.
3. The method of claim 1, wherein before obtaining the data to be migrated and the number of clients to be migrated corresponding to the client shards from the distributed cluster cache by client shards, the method comprises:
when the state of newly added customer data or stock customer data changes, the newly added customer data and the stock customer data are subjected to one-time fragmentation processing through decoupling according to a preset fragmentation rule and are solidified from a business base to enter a data physical base;
and storing the newly added customer data and the stock customer data after fragmentation processing from the data physical library to a distributed memory database through loading or refreshing.
4. The method of claim 1, further comprising:
responding to an access request initiated by an application to a data node of a client, and inquiring whether a region fragment where the client is located is in a region balance state list or not according to a region number corresponding to the client;
if the zone fragment where the client is located is not in the zone equilibrium state list, acquiring a data node from a distributed cluster cache, and if the distributed cluster cache does not have the data node, acquiring the data node through a routing service;
and if the region fragment where the client is located is in the region balance state list, acquiring the data node through a routing service.
5. The method of claim 4, wherein the obtaining the data node via the routing service comprises:
starting a routing service, and locking data of all migration areas in the memory parameter library;
judging whether the client fragment belongs to the migration area fragment or not according to the client fragment to which the client belongs;
if the client fragment belongs to the non-migration zone fragment, acquiring the data node according to the migration state of the associated client;
and if the client fragment belongs to the migration zone fragment, inquiring the migration state in a client migration state table in the memory parameter library, trying to access the data node of the client, and returning an access result according to the migration state of the client.
6. The method of claim 5, wherein obtaining the data node according to the migration status of the associated client comprises:
inquiring whether the associated data is migrated or not according to the associated client service table;
if yes, returning that the current data is being migrated;
and if the client is in a service processing state, directly returning to the data node.
7. The method of claim 5, wherein returning access results based on the migration status of the client comprises:
if the customer migration is completed, the access is successful, and the data node is returned;
if the client is migrating, the query fails, returning that the migration/processing is failing.
8. An apparatus for dynamically migrating database data, the apparatus comprising:
the data acquisition unit is used for acquiring data to be migrated and the number of clients to be migrated corresponding to the client fragments from the distributed cluster cache according to the client fragments;
the dynamic migration unit is used for acquiring the data to be migrated corresponding to a client in sequence and migrating the data to be migrated aiming at any client fragment;
and the migration finishing unit is used for accumulating the number of the migration clients until the number of the migration clients is equal to the data of the clients to be migrated.
9. A computing device, comprising: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus;
the memory is used for storing at least one executable instruction, which causes the processor to execute the steps of the dynamic migration method of the database data according to any one of claims 1 to 7.
10. A computer storage medium having stored therein at least one executable instruction for causing a processor to perform the steps of the method for dynamically migrating database data according to any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010505942.0A CN113760858B (en) | 2020-06-05 | 2020-06-05 | Dynamic migration method and device for memory database data, computing equipment and storage equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010505942.0A CN113760858B (en) | 2020-06-05 | 2020-06-05 | Dynamic migration method and device for memory database data, computing equipment and storage equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113760858A true CN113760858A (en) | 2021-12-07 |
| CN113760858B CN113760858B (en) | 2024-03-19 |
Family
ID=78784989
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010505942.0A Active CN113760858B (en) | 2020-06-05 | 2020-06-05 | Dynamic migration method and device for memory database data, computing equipment and storage equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113760858B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115118604A (en) * | 2022-07-01 | 2022-09-27 | 杭州宇信数字科技有限公司 | Data migration method, equipment, system and medium for dynamic scaling |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103345519A (en) * | 2013-07-11 | 2013-10-09 | 华为技术有限公司 | Method and device for data distribution of shared-nothing distributed database |
| CN103810265A (en) * | 2014-01-27 | 2014-05-21 | 南京邮电大学 | Database optimization method based on WiMAX local routing |
| CN105930389A (en) * | 2016-04-14 | 2016-09-07 | 北京京东尚科信息技术有限公司 | Method and system for transferring data |
| CN106844510A (en) * | 2016-12-28 | 2017-06-13 | 北京五八信息技术有限公司 | The data migration method and device of a kind of distributed experiment ＆ measurement system |
| CN107153680A (en) * | 2017-04-18 | 2017-09-12 | 北京思特奇信息技术股份有限公司 | A kind of method and system of the online expanding node of distributed memory database |
| WO2018059032A1 (en) * | 2016-09-30 | 2018-04-05 | 华为技术有限公司 | Data migration method for virtual node, and virtual node |
| US20180095953A1 (en) * | 2016-10-05 | 2018-04-05 | Sap Se | Multi-procedure support in data migration |
| CN109246198A (en) * | 2018-08-16 | 2019-01-18 | 杭州数梦工场科技有限公司 | A kind of cloud host-initiated control method and system based on distributed storage cluster |
| US20190179808A1 (en) * | 2016-12-01 | 2019-06-13 | Tencent Technology (Shenzhen) Company Limited | Method and apparatus for data migration in database cluster, and storage medium |
| CN110580246A (en) * | 2019-07-30 | 2019-12-17 | 平安科技（深圳）有限公司 | Method and device for migrating data, computer equipment and storage medium |
| CN110674108A (en) * | 2019-08-30 | 2020-01-10 | 中国人民财产保险股份有限公司 | Data processing method and device |
| CN111125059A (en) * | 2019-12-17 | 2020-05-08 | 南京甄视智能科技有限公司 | Data migration method and device, storage medium and server |
-
2020
- 2020-06-05 CN CN202010505942.0A patent/CN113760858B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103345519A (en) * | 2013-07-11 | 2013-10-09 | 华为技术有限公司 | Method and device for data distribution of shared-nothing distributed database |
| CN103810265A (en) * | 2014-01-27 | 2014-05-21 | 南京邮电大学 | Database optimization method based on WiMAX local routing |
| CN105930389A (en) * | 2016-04-14 | 2016-09-07 | 北京京东尚科信息技术有限公司 | Method and system for transferring data |
| CN107885758A (en) * | 2016-09-30 | 2018-04-06 | 华为技术有限公司 | The data migration method and dummy node of a kind of dummy node |
| WO2018059032A1 (en) * | 2016-09-30 | 2018-04-05 | 华为技术有限公司 | Data migration method for virtual node, and virtual node |
| US20180095953A1 (en) * | 2016-10-05 | 2018-04-05 | Sap Se | Multi-procedure support in data migration |
| US20190179808A1 (en) * | 2016-12-01 | 2019-06-13 | Tencent Technology (Shenzhen) Company Limited | Method and apparatus for data migration in database cluster, and storage medium |
| CN106844510A (en) * | 2016-12-28 | 2017-06-13 | 北京五八信息技术有限公司 | The data migration method and device of a kind of distributed experiment ＆ measurement system |
| CN107153680A (en) * | 2017-04-18 | 2017-09-12 | 北京思特奇信息技术股份有限公司 | A kind of method and system of the online expanding node of distributed memory database |
| CN109246198A (en) * | 2018-08-16 | 2019-01-18 | 杭州数梦工场科技有限公司 | A kind of cloud host-initiated control method and system based on distributed storage cluster |
| CN110580246A (en) * | 2019-07-30 | 2019-12-17 | 平安科技（深圳）有限公司 | Method and device for migrating data, computer equipment and storage medium |
| CN110674108A (en) * | 2019-08-30 | 2020-01-10 | 中国人民财产保险股份有限公司 | Data processing method and device |
| CN111125059A (en) * | 2019-12-17 | 2020-05-08 | 南京甄视智能科技有限公司 | Data migration method and device, storage medium and server |
Non-Patent Citations (2)
| Title |
|---|
| 尹君: "非关系型数据库负载均衡策略研究", 云南电力技术, vol. 45, no. 03, pages 121 - 124 * |
| 李璋琪: "内存数据库迁移方法改进研究", 电子技术与软件工程, vol. 163, no. 17, pages 172 - 174 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115118604A (en) * | 2022-07-01 | 2022-09-27 | 杭州宇信数字科技有限公司 | Data migration method, equipment, system and medium for dynamic scaling |
| CN115118604B (en) * | 2022-07-01 | 2023-04-11 | 杭州宇信数字科技有限公司 | Dynamic capacity expansion data migration method, device, system and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113760858B (en) | 2024-03-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107391629B (en) | Method, system, server and computer storage medium for data migration between clusters | |
| US10373284B2 (en) | Capacity reservation for virtualized graphics processing | |
| US10997177B1 (en) | Distributed real-time partitioned MapReduce for a data fabric | |
| US9747341B2 (en) | System and method for providing a shareable global cache for use with a database environment | |
| US10599677B2 (en) | Methods and systems of splitting database indexes and digests | |
| US9888065B2 (en) | Defragmenting clusters with reserved resources | |
| US10223253B2 (en) | Allocation systems and method for partitioning lockless list structures | |
| CN107391033B (en) | Data migration method and device, computing equipment and computer storage medium | |
| CN111597148A (en) | Distributed metadata management method for distributed file system | |
| CN110806942B (en) | Data processing method and device | |
| US20240314021A1 (en) | Method, apparatus, electronic device and storage medium for resource operation | |
| CN110837499B (en) | Data access processing method, device, electronic equipment and storage medium | |
| CN113760858B (en) | Dynamic migration method and device for memory database data, computing equipment and storage equipment | |
| WO2017143929A1 (en) | Methods and systems for cloud database resource extension and service extension | |
| CN115599532A (en) | Index access method and computer cluster | |
| CN112596669A (en) | Data processing method and device based on distributed storage | |
| CN116661690A (en) | Method, device, computer equipment and storage medium for recording memory state | |
| CN114780246A (en) | Method for determining memory access information, storage medium, and program product | |
| US11474846B2 (en) | Controller for bridging database architectures | |
| EP3686751A1 (en) | Method and system for data handling | |
| CN106878414B (en) | Data write request processing method, device and distributed data-storage system | |
| CN111880895A (en) | Data reading and writing method and device based on Kubernetes platform | |
| CN112068948A (en) | Data hashing method, readable storage medium and electronic device | |
| US10929388B1 (en) | Distributed multi-version partitioned mapreduce for a data fabric | |
| CN110515959B (en) | Data consistency implementation method and device and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |