CN113535087B - Data processing method, server and storage system in data migration process - Google Patents
Data processing method, server and storage system in data migration process Download PDFInfo
- Publication number
- CN113535087B CN113535087B CN202110791646.6A CN202110791646A CN113535087B CN 113535087 B CN113535087 B CN 113535087B CN 202110791646 A CN202110791646 A CN 202110791646A CN 113535087 B CN113535087 B CN 113535087B
- Authority
- CN
- China
- Prior art keywords
- server
- data
- migration
- target
- pool
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0647—Migration mechanisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data processing method, a server and a storage system in a data migration process, and relates to the field of Internet. A method of data processing in a data migration process, comprising: in the data migration process, receiving a data processing request of a user; obtaining a target data pool corresponding to the data processing request; determining a server to be processed from a source server and a target server according to the migration state of the target data pool; the source server is a server to which the target data pool belongs before being migrated, and the target server is a server to which the target data pool belongs after being migrated; and carrying out corresponding data processing on the server to be processed. The invention can normally process the data processing request in the process of data migration.
Description
Technical Field
The present invention relates to the field of the internet, and in particular, to a data processing method, a server, and a storage system in a data migration process.
Background
In the related art, when data migration is performed, in order to not generate dirty data, new data to be migrated is generated during data migration, or original data is modified during migration, service needs to be suspended, and service is re-opened after data migration is completed.
Disclosure of Invention
The invention mainly aims to provide a data processing method, a server and a storage system in a data migration process, and aims to solve the technical problem that service needs to be suspended in the data migration process.
In order to achieve the above object, the present invention provides a data processing method in a data migration process, the method comprising the steps of:
in the data migration process, receiving a data processing request of a user;
obtaining a target data pool corresponding to the data processing request;
determining a server to be processed from a source server and a target server according to the migration state of the target data pool; the source server is a server to which the target data pool belongs before being migrated, and the target server is a server to which the target data pool belongs after being migrated;
and carrying out corresponding data processing on the server to be processed.
In an embodiment, the data processing request is a write request;
the step of determining the server to be processed from the source server and the target server according to the migration state of the target data pool comprises the following steps:
and if the target data pool is in the migration state, taking the target server as a server to be processed.
In one embodiment, the data processing request is a read request;
the step of determining the server to be processed from the source server and the target server according to the migration state of the target data pool comprises the following steps:
and if the target data pool is in a migration state, the source server is used as a server to be processed.
In an embodiment, the step of obtaining the target data pool corresponding to the data processing request includes:
analyzing the read request to obtain a target data file corresponding to the read request;
taking a data pool to which the target data file belongs as the target data pool;
and if the target data pool is in a migration state, the step of taking the source server as a server to be processed comprises the following steps:
if the target data pool is in the migration state, determining the migration state of the target data file;
and if the migration state is the in-migration state or the pre-migration state, the source server is used as a server to be processed.
In an embodiment, after determining the migration status of the target data file if the target data pool is in the in-migration status, the method further includes:
And if the migration state is a stable state, the target server is used as a server to be processed.
In one embodiment, when the number of servers in the storage system increases after the data migration, before the step of receiving the data processing request of the user during the data migration, the method further includes:
determining a newly added server from the storage system;
according to the server storage space utilization rate table, a first storage server with the highest space utilization rate is screened out of all the servers and all the newly-added servers, and a second storage server with the largest disk space is screened out of all the newly-added servers; the server storage space utilization rate table stores storage space utilization rate information of all servers and all newly-added servers, and disk space information of all the newly-added servers;
screening out the data pool to be allocated with the largest space occupation from all the data pools of the first storage server;
distributing the second storage server as a target server of the data pool to be distributed, and generating migration distribution information;
updating the server storage space utilization rate table based on the migration allocation information, and returning to execute the step of screening the first storage server with the highest space utilization rate from all the servers and all the newly added servers according to the server storage space utilization rate table, and circulating the step to the server storage space utilization rate table, wherein the mean square error of the storage space utilization rates of all the storage servers and all the newly added servers does not exceed a preset threshold value so as to allocate the servers to which the data migration is performed to all the data pools in the storage system.
In an embodiment, after data migration, when the number of servers in the storage system is reduced, the server reserved after data migration is information of the third server, and the deleted server is a fourth server;
before the step of receiving the data processing request of the user in the data migration process, the method further comprises the following steps:
screening a fifth server with the lowest space utilization rate from all the third servers according to a server storage space utilization rate table;
screening out the data pool to be allocated with the largest space occupation from all the data pools of all the fourth servers;
distributing the fifth server as a target server of the data pool to be distributed, and generating migration distribution information;
updating the server storage space utilization rate table based on the migration allocation information, and returning to execute the step of screening a fifth server with the lowest space utilization rate from all the third servers according to the server storage space utilization rate table, and circulating to the server storage space utilization rate table that the mean square error of the storage space utilization rates of all the third servers does not exceed a preset threshold value so as to allocate the servers to which the data migration belongs to all the data pools in the storage system.
In a second aspect, the present invention further provides a data processing apparatus in a data migration process, including:
the request receiving module is used for receiving a data processing request of a user in the data migration process; the data processing request comprises a read request or a write request;
the request analysis module is used for analyzing the data processing request to obtain a target data pool corresponding to the data processing request;
the server determining module is used for determining a server to be processed from the source server and the target server according to the migration state of the target data pool; the source server is a server to which the target data pool belongs before being migrated, and the target server is a server to which the target data pool belongs after being migrated; and the data processing module is used for carrying out corresponding data processing on the server to be processed.
In a third aspect, the present invention further provides a metadata server, including a memory, a processor, and a data processing program stored on the memory and capable of running on the processor in a data migration process, where the data processing program in the data migration process is configured to implement the steps of the above method.
In a fourth aspect, the present invention also proposes a distributed storage system, comprising:
a metadata server; and
and the at least one server is connected with the metadata server.
In a fifth aspect, the invention also proposes a computer program product comprising executable program code, wherein the program code, when executed by a processor, performs a data processing method in a data migration process as described above.
The data processing method in the data migration process provided by the embodiment of the invention comprises the steps of determining a server to be processed from a source server before data migration and a target server after data migration when a target data pool corresponding to a data processing request is in a migration state, and processing the data of the server to be processed. Therefore, in the data migration process, the read request and the write request can be normally processed, dirty data is not generated, and the normal data migration and no interruption are ensured.
Drawings
FIG. 1 is a diagram of a metadata server according to an embodiment of the present invention;
FIG. 2 is a flow chart of a first embodiment of a data processing method in a data migration process according to the present invention;
FIG. 3 is a flow chart of a second embodiment of a data processing method in a data migration process according to the present invention;
FIG. 4 is a flow chart of a third embodiment of a data processing method in a data migration process according to the present invention;
FIG. 5 is a flowchart illustrating a fourth embodiment of a data processing method during data migration according to the present invention;
FIG. 6 is a schematic diagram of functional modules of a first embodiment of a data processing apparatus during data migration according to the present invention;
FIG. 7 is a schematic diagram of a refinement function module of a first embodiment of a data processing apparatus in a data migration process according to the present invention.
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
In the related art, when data migration is performed, in order to not generate dirty data, new data to be migrated is generated during data migration, or original data is modified during migration, service needs to be suspended, and service is re-opened after data migration is completed.
To solve this problem, various embodiments of the data processing method in the data migration process of the present invention are presented. When a target data pool corresponding to a data processing request is in a migration state, determining a server to be processed from a source server before data migration and a target server after data migration, and processing the data. In this way, during the data migration process, the read request and the write request can be processed normally, dirty data is not generated, and the normal operation and interruption of the migration process are guaranteed.
Referring to fig. 1, fig. 1 is a schematic diagram of a recommended device structure of a metadata server of a hardware running environment according to an embodiment of the present invention.
In general, the metadata server includes at least one processor 301, memory 302, and data processing programs stored on the memory and operable on the processor during data migration.
Processor 301 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 301 may be implemented in at least one hardware form of DSP (Digital Signal Processing ), FPGA (Field-Programmable Gate Array, field programmable gate array), PLA (Programmable LogicArray ). The processor 301 may also include a main processor, which is a processor for processing data in an awake state, also called a CPU (Central ProcessingUnit ), and a coprocessor; a coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 301 may integrate a GPU (Graphics Processing Unit, image processor) for rendering and drawing of content required to be displayed by the display screen.
Memory 302 may include one or more computer-readable storage media, which may be non-transitory. Memory 302 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in memory 302 is used to store at least one instruction for execution by processor 801 to implement the data processing method in a data migration process provided by the method embodiments of the present application.
In some embodiments, the metadata server may further optionally include: a communication interface 303, and at least one peripheral device. The processor 301, the memory 302 and the communication interface 303 may be connected by a bus or signal lines. The respective peripheral devices may be connected to the communication interface 303 through a bus, signal line, or circuit board. The communication interface 303 is used for receiving a data processing request sent by a user. In some embodiments, processor 301, memory 302, and communication interface 303 are integrated on the same chip or circuit board; in some other embodiments, either or both of the processor 301, the memory 302, and the communication interface 303 may be implemented on separate chips or circuit boards, which is not limited in this embodiment.
Those skilled in the art will appreciate that the structure shown in fig. 1 does not constitute a limitation of the metadata server, and may include more or fewer components than shown, or may combine certain components, or may be a different arrangement of components.
Further, the application also provides a storage system, which further comprises the metadata server and at least one storage server. Wherein all storage servers are connected with the metadata server.
An embodiment of the present application provides a data processing method in a data migration process, and referring to fig. 2, fig. 2 is a flow chart of a first embodiment of the data processing method in the data migration process of the present application.
In this embodiment, the data processing method in the data migration process may be applied to a metadata server in a distributed storage system, where the distributed storage system further includes at least one storage server. The metadata server used in the distributed storage system according to this embodiment is further described below as an example. Those skilled in the art will readily recognize that the method is used in a conventional centralized storage system, a cloud storage system, or other storage systems, and this embodiment is not repeated herein.
The metadata server has only one server S 0 In this case, the server S 0 Owning the entire data pool set C p . When there are two servers, server S 0 、S 1 Commonly owned across data pool set C p Wherein S is 0 Owned data pool set C p0 ，S 1 Owned data pool set C p1 ，C p0 ∈C p ，C p1 ∈C p ，C p0 ∩C p1 ＝φ，C p0 ∪C p1 ＝C p . Multiple servers and so on.
In this embodiment, the data processing method in the data migration process includes the following steps:
step S101, in the data migration process, a data processing request of a user is received.
The data migration process indicates that at least a part of all data needing to be migrated is not migrated yet. In this step, the data processing request of the user handling the service is received in the data migration process, and in this process, the data migration task is not suspended, and the data processing request initiated by the user is not suspended. Wherein the data processing request comprises a read request or a write request.
Step S102, a target data pool corresponding to the data processing request is obtained.
The data processing request carries information of the data file to which it is directed, the data file having a unique ID. The unique ID may be generated from the storage server network card physical MAC address + filename. The data pool pointed by the data file in the data processing request is the target data pool.
In this step, the target data pool may be obtained by parsing the data processing request, or the target data pool may be directly extracted from the target data pool.
Step S103, determining a server to be processed from a source server and a target server according to the migration state of the target data pool; the source server is a server to which the target data pool belongs before being migrated, and the target server is a server to which the target data pool belongs after being migrated.
In this embodiment, the metadata server has a first state information table built therein. The first state information table stores migration state information of all data pools and storage server information of any data pool, and the storage server information comprises source server information of the data pool before migration and target server information of the data pool after migration.
For example, the first state information table is a mapping relationship table between the data pool and the server shown in table 1.
TABLE 1
The first state information table stores migration state information of all data pools and storage server information of the data pools.
The migration state information comprises a stable state, a state to be migrated and a state in migration:
the stable state is that the data is already migrated or is already completely copied to the target server on the migration path. At this time, the storage server mapped by the data pool in the first state information table is the current server, that is, the target server to which the migration is performed. For example, in a column of the storage server of the first state information table, for the data pool P i The information of the storage server which the server belongs to is S k ”，S k And the target server is the target server to which the migration is completed.
The state to be migrated is that the data pool has been assigned a corresponding target server, but has not yet begun to migrate. At this time, the storage server mapped by the data pool in the first state information table includes the source server to which the data of the data pool belongs before the migration and the target server to which the data of the data pool belongs after the migration. For example, in a column of the storage server of the first state information table, for the data pool P i The information of the storage server which the server belongs to is S i |S k ", thereby reflecting the migration path, S i For data pool P i Source server to which data is to be migrated, S k Is the target server to which the migration belongs.
The in-migration state is that the data in the data pool is being migrated, but there are some incomplete migrates. At this time, the storage server mapped by the data pool in the first state information table includes the source server to which the data of the data pool belongs before the migration and the target server to which the data of the data pool belongs after the migration.
The three states may be represented by using different assignments in the data pool and server mapping tables. If PState0 represents a steady state, PState1 represents a state to be migrated, and PState2 represents a state in migration.
In this step, the metadata server may read the assignment of the migration status information of the target data pool in the first status information table, so as to determine which of the stable status, the to-be-migrated status, and the in-migration status the target data pool is in.
After the migration state of the target data pool is determined, a server to be processed can be determined from the source server and the target server. The server to be processed can perform corresponding operation, so that corresponding data processing can be performed in response to the data processing request in the data migration process.
Step S104, corresponding data processing is carried out on the server to be processed.
After determining the server to be processed which needs to execute the data processing, executing the corresponding data processing on the corresponding server to be processed, for example, writing the data file according to the writing request or reading the data file according to the reading request.
In this embodiment, after determining the migration status of the target data pool, a server to be processed is determined from the source server before data migration and the target server after data migration, and data processing is performed. Therefore, in the process of data migration, the data processing request can be processed normally, dirty data is not generated, and the normal operation and interruption of the migration process are guaranteed.
It is easy to understand that if the target data pool is in the state to be migrated, at this time, the data file in the target data pool has not yet been migrated, so that the source server of the target data pool can be read as the server to be processed, and the generated data can be migrated together in the subsequent migration, so that dirty data cannot be generated, and data processing can be normally executed.
If the target data pool is in a stable state, all data files of the target data pool are migrated, so that a target server of the target data pool can be used as a server to be processed for reading and writing. At this time, since the state of the target data pool is stable, dirty data is not generated, and data processing can be normally performed.
In a specific embodiment, the data processing request is a write request. At this time, in this embodiment, the method includes:
step S101', during the data migration process, a write request of a user is received.
Step S102', a target data pool corresponding to the write request is obtained.
Since the data processing request is a write request, the write request is a new data file in the storage system. The metadata server may parse the data processing request to obtain a target data pool to which the data file to be written by the write request will belong.
And step 103', if the target data pool is in a migration state, taking the target server as a server to be processed.
Step S104, corresponding data processing is carried out on the server to be processed.
Specifically, if the data processing request is a write request, the target server after the migration of the target data pool is used as a to-be-processed server to perform data processing, namely, writing the newly added data file into the target server to be migrated of the data pool.
And determining that the server to be processed of the write request is the target server after the migration of the target data pool, namely directly writing the newly added data file into the target server, so as to prevent the source server from generating dirty data in the migration process. The specific location where the written newly added data file is written may be the storage space allocated to the target data pool. Therefore, in the process of data migration, read requests and write requests can be normally processed, dirty data is not generated, and the normal operation and interruption of the migration process are ensured.
In a specific embodiment, the data processing request is a read request. At this time, in this embodiment, the method includes:
step S101', during the data migration process, a read request of a user is received.
Step S102', a target data pool corresponding to the write request is obtained.
Because the data processing request is a read request, the read request reads the stored data file, and the metadata server can analyze the data processing request to obtain the target data pool to which the data file to be read by the read request belongs.
And step S103', if the target data pool is in a migration state, taking the source server as a server to be processed.
Step S104, corresponding data processing is carried out on the server to be processed.
Specifically, when the data processing request is a read request, the source server before the migration of the target data pool is used as a to-be-processed server to perform data processing, namely, the target file is read from the source server.
The server to be processed of the read request is determined to be the source server before the migration of the target data pool, namely, the required data file is read from the source server, so that the read failure is prevented.
In this embodiment, after determining the migration status of the target data pool, if the data processing request is a write request, the target server after the migration of the target data pool is used as a server to be processed to perform data processing, that is, a new data file is written into the target server to be migrated to the data pool, and if the data processing request is a read request, the source server before the migration of the target data pool is used as the server to be processed to perform data processing, that is, the target file is read from the source server. Therefore, in the process of data migration, read requests and write requests can be normally processed, dirty data is not generated, and the normal operation and interruption of the migration process are ensured.
In addition, based on the first embodiment of the data processing method in the data migration process of the present invention, a second embodiment of the data processing method in the data migration process of the present invention is provided. Referring to fig. 3, fig. 3 is a flowchart illustrating a second embodiment of a data processing method in a data migration process according to the present invention. It is easy to understand that, because the space occupation of the data pool is different, there are more target data files in the data pool with higher space occupation rate, and further determining the migration state of the target data files is needed to avoid data reading failure.
The data processing method in the data migration process in this embodiment includes the following steps:
step S201, in the data migration process, a read request of a user is received.
Step S202, analyzing the read request to obtain a target data file corresponding to the read request.
Step S203, the data pool to which the target data file belongs is used as a target data pool.
Step S204, if the target data pool is in the migration state, determining the migration state of the target data file.
The target data file is the data file to be read by the read request. In this embodiment, the metadata server may read migration status information of any one data file through the second status information table.
As shown in table 2, the second state information table is a mapping relationship table between data files and data pools built in the metadata server.
TABLE 2
The second state information table stores migration state information of all data files and data pool information to which any data file belongs. The migration state information comprises a stable state, a state to be migrated and a state in migration.
Wherein the steady state is that the data file has been migrated or has been entirely copied to the target server on the migration path. At this time, the server information mapped by the data pool to which the data file belongs in the second state information table may be obtained by reading the first state information table in real time.
The state to be migrated enters the state to be migrated or the state in migration of the data pool to which the data file belongs, but the data file is not migrated yet.
The in-migration state is that the data file is being migrated.
It is readily understood that the three states may be represented by using different assignments in the second state information table. Such as: FState0 represents a steady state, FState1 represents a state to be migrated, and FState2 represents an in-migration state.
In this step, the metadata server may determine the migration status information of the target data file by reading the second status information table, so as to determine which of the stable status, the to-be-migrated status and the in-migration status the target data file is specifically in.
Step S205, if the target data file is in the in-migration state or the pre-migration state, the source server is used as the server to be processed.
Specifically, if the metadata server determines that the target data file is in the migration state by reading the second state information table, the metadata server may determine server information mapped by the data pool to which the target data file belongs by reading the first state information table.
And if the target data pool is in a migration state, the server information mapped by the target data pool comprises a source server to which the target data pool belongs before data migration and a target server to which the target data pool belongs after migration. In this case, in order to avoid the reading failure, the source server to which the target data pool data before migration belongs may be used as a server to be processed, so that the target data file may be successfully read.
And when the target data pool belongs to the pre-migration state, the server information mapped by the target data pool also comprises the source server to which the target data pool belongs before migration and the target server to which the target data pool belongs after migration. In this case, in order to avoid the reading failure, the source server to which the target data pool data before migration belongs may be used as a server to be processed, so that the target data file may be successfully read.
It is easy to understand that if the target data file is in a stable state, at this time, the target data file has already been migrated, and at this time, the target server to which the target data pool data after being migrated belongs may be used as a server to be processed, so that the target data file may be successfully read.
Step S206, corresponding data processing is carried out on the server to be processed.
After determining the server to be processed which needs to execute data processing, the target data file is read from the corresponding server to be processed.
In this embodiment, the migration status information of the target data file in the data pool is further determined for the data pool in the migration status, so that the successful data processing in the data migration process can be further ensured, and the reliability of the data processing is ensured.
In some embodiments, a first state information table is disposed in the metadata server, in which migration state information of all data pools and storage server information of any data pool are stored, and the storage server information includes source server information of the data pool before migration and target server information of the data pool after migration. After the data migration is completed, any data file and any data pool are in a stable state, and at this time, the metadata server can update the storage server information in the first state information table according to the target server to which the data pool belongs. After updating, the storage server information mapped by any data pool in the first state information table only has the information of the target server to which the storage server information belongs after migration, namely the information of the server to which the storage server information belongs currently.
In addition, an embodiment of the present invention provides a third embodiment of a data processing method in a data migration method, and referring to fig. 4, fig. 4 is a schematic flow chart of the third embodiment of the data processing method in the data migration method of the present invention.
It is easy to understand that in a distributed storage system, migration tasks are generated in the distributed storage system due to an increase in the number of storage servers, that is, a change in the state of the distributed storage system.
In this embodiment, the following steps are further included before step S101:
and step A10, determining a newly added server from the storage system.
In this embodiment, first state change information of the storage system may be received. The first state change information is used for indicating that the number of servers in the storage system is increased, and the first state change information comprises newly-increased server information, wherein the newly-increased server information comprises disk space information of the newly-increased server.
So that a newly added server of the storage system can be determined based on the first state information.
After the metadata server receives the first state change information of the storage system, the number, address, disk space size of each newly added server, data pool of each newly added server, disk space size of each data pool and the like can be obtained. The disk space information of the newly added server can be recorded by creating a temporary table.
The number of data storage servers n becomes m, where m>n>0. The number of the newly added data storage servers k=m-n, and the newly added data storage servers are assembled into C s Newly added data storage server S n0 、S n1 、……S nk-1 ∈C s 。
And step A20, screening a first storage server with the highest space utilization rate from all storage servers and all newly-added servers according to the server storage space utilization rate table, and screening a second storage server with the largest disk space from all newly-added servers. The server storage space utilization rate table stores storage space utilization rate information of all servers and all newly-added servers, and disk space information of all the newly-added servers.
The metadata server is internally provided with a server storage space utilization table, the storage space utilization of each storage server is ρ, and ρ=u/D, wherein U is the disk space of the storage server occupied by the data file, and D is the total disk space of the storage server.
And the metadata server can update the storage space utilization rate table of the server according to the first state change information so that the storage space utilization rate table of the server stores the storage space utilization rate information of all the storage servers and all the newly-added servers. At this time, the metadata server adds the storage space utilization information of the newly added servers and the total disk space information of each newly added server to the server storage space utilization table according to the received first state change information, so that the use condition of each storage server can be mastered.
In this step, the metadata server reads the value of ρ in the server storage space utilization table, and ρ can be screened from all storage servers and all newly added servers max The first storage server S to which it belongs m . The metadata server is from all newly added server sets C s Second storage server S with largest disk space is screened out ni 。
Wherein, if ρ max When there are a plurality of storage servers, the storage server that reaches the space utilization first is determined as the first storage server.
And step A30, screening the data pool to be allocated with the largest space occupation from all the data pools of the first storage server.
And step A40, distributing the second storage server as a target server to which the data pool with the largest space occupation in the data pool to be distributed belongs after migration, and generating migration distribution information.
The metadata server may further have a space occupation statistics table of the data pool, and reads the space occupation statistics table of the data pool, so that the first storage server S may be screened out m Data pool P with largest space occupied by internal disk m 。P m For the data pool to be migrated, the target object to be migrated is allocated as the second storage server S ni . The metadata server may generate migration allocation information based on the allocation result and save it. The migration allocation information may be saved as a temporary file.
And A50, updating a server storage space utilization rate table based on migration allocation information, and returning to execute the step A20, wherein the mean square error of the storage space utilization rates of all the storage servers and all the newly added servers in the server storage space utilization rate table does not exceed a preset threshold value, so that the servers to which the data migration belongs are allocated for all the data pools in the storage system.
In this step, due to P m Assigned to S ni Resulting in S m The storage space utilization of (a) may change after migration. At this point, the server storage utilization table may be updated to counter the changeIs applied to the server storage space utilization table. And due to P m Assigned to S ni ，S ni The disk space of the newly added server may be updated by the metadata server according to the migration allocation information, such as the temporary table described above.
The metadata server executes step A20 again, and the first storage server S can be screened out m2 Second storage server S with largest disk space after allocation ni2 . And then S is carried out m2 Data pool P with largest occupied space of medium disk m2 As a data pool to be migrated, the target object of the migration is allocated as a second storage server S ni2 . It is easily understood that during the screening process S m May belong to newly added server set C s . Thus, the loop is repeated until the mean square error of the storage space utilization of all the storage servers in the storage system does not exceed a preset threshold, such as 10%. The metadata server can obtain a piece of migration allocation information after each execution of the steps, and after the circulation is finished, a plurality of pieces of migration allocation information can be obtained, and the allocation result of the corresponding data pool is stored. Thereby distributing the server to which the data migration belongs to all data pools in the storage system
At this time, the storage server information of the corresponding data pool in the first state information table may be updated according to the plurality of migration allocation information, so that the storage server information includes source server information of the data pool before migration and target server information of the data pool after migration.
The metadata server adds the migration paths formed after the allocation as storage server information of the data pool to the first state information table based on all migration allocation information, so that the relative average of the disk utilization rates of all servers in the storage system can be ensured after the data migration, and server resources can be fully utilized. After updating the first state information table, all migration allocation information may be deleted.
For example, in a column of the storage server of the first state information table, for the data pool P m Can store the server information by S m Update to S m |S ni ", thereby reflecting its migration path.
Furthermore, on the basis of the third embodiment of the data processing method in data migration of the present invention, a fourth embodiment of the data processing method in data migration of the present invention is presented. Referring to fig. 5, fig. 5 is a flowchart of a fourth embodiment of a method for data processing in data migration according to the present invention.
It will be readily appreciated that in a distributed storage system, as the number of storage servers is reduced, i.e., a portion of the storage servers remain in the distributed storage system, but another portion of the storage servers leave the distributed storage system, resulting in migration tasks occurring in the distributed storage system, the reduced data in the portion of the storage servers needs to be migrated to the reserved storage servers.
In this embodiment, the data migration method further includes the following steps before step S101:
and step B10, screening a fifth storage server with the lowest space utilization rate from all the third storage servers according to the server storage space utilization rate table.
In this step, the metadata server may receive second state change information of the storage system; the second state change information is used for indicating that the number of servers in the storage system is reduced, and the second state change information comprises information of a third storage server reserved after the number of servers in the storage system is reduced, information of a reduced fourth storage server and a mapping table of a data pool and the servers in the fourth storage.
After the metadata server receives the state change information of the storage system, the metadata server can acquire the information such as the number and the address of the reduced storage servers, the data pool of each reduced storage server, the disk space size of each data pool and the like.
The number of data storage servers n becomes m, where n>m>0. Reducing the number of data storage servers k=n-m, all fourth storage servers being grouped as C d Fourth storage server S d0 、S d1 、……S dk-1 ∈C d 。
The mapping table of the data pools and the servers in the fourth storage is used for indicating which fourth storage server any data pool in all fourth storage servers belongs to.
The metadata server screens the space utilization rate rho from all the third storage servers reserved after capacity shrinkage according to the value of rho in the server storage space utilization rate table min A fifth storage server to which the data is assigned.
And step B20, screening the data pool to be allocated with the largest space occupation from all the data pools of all the fourth servers.
And step B30, the fifth storage server is allocated as a target server of the data pool to be allocated, and migration allocation information is generated.
The metadata server may also have a space occupation statistics table of the data pool therein, and the metadata server reads the space occupation statistics table of the data pool so that the data storage server set C can be reduced d Data pool P with largest occupied space is screened out dm 。P dm And (3) distributing the target object to be migrated as a fifth storage server for the data pool to be migrated. The metadata server may generate migration allocation information based on the allocation result and save it. The migration allocation information may be a temporary file.
And B40, updating a server storage space utilization rate table and a mapping table of the data pool and the server in a fourth memory based on migration allocation information, and returning to execute the step B10, wherein the mean square error of the storage space utilization rates of all third storage servers in the server storage space utilization rate table does not exceed a preset threshold value, so that the servers to which all data pools in the storage system belong after data migration are allocated.
In this step, due to P dm The allocation to the fifth storage server results in a change in storage space utilization of the fifth storage server after migration. At this point, the server storage utilization table may be updated to reflect the change to the server storage utilization table. And due to P dm Assigned to the fifth storage server, a fourth storage server set C d The metadata server may update the mapping table between the data pool and the server in the fourth storage according to the migration allocation information. For example, P as described above dm Deleted from the table.
The metadata server executes step B10 again, and a new fifth storage server may be screened out. Allocating a new fifth storage server as a data pool P with the largest space occupation among all data pools of all fourth storage servers after initial allocation dm2 And generating migration allocation information by the target server to which the migration belongs.
Thus, the loop is repeated until the mean square error of the storage space utilization of all the storage servers in the storage system does not exceed a preset threshold, such as 10%. The metadata server can obtain a piece of migration allocation information after each execution of the steps, and after the circulation is finished, a plurality of pieces of migration allocation information can be obtained, and the allocation result of the corresponding data pool is stored. And distributing servers to which data migration belongs for all data pools in the storage system.
In this embodiment, the storage server information of the corresponding data pool in the first state information table may be updated according to the plurality of migration allocation information, so that the storage server information includes the source server of the data pool before the migration and the target server of the data pool after the migration.
The metadata server updates all migration allocation information, and the migration paths formed after allocation are used as storage server information to which the data pool belongs to be added into the first state information table, so that the relative average of the disk utilization rates of all servers in the storage system can be ensured after data migration, and server resources can be fully utilized.
With reference to fig. 6, fig. 6 is a block diagram illustrating a first embodiment of a data processing apparatus during data migration according to the present invention.
As shown in the drawing, the data processing apparatus 100 in the data migration process in this embodiment includes:
a request receiving module 110, configured to receive a data processing request of a user during a data migration process;
a data pool obtaining module 120, configured to obtain a target data pool corresponding to the data processing request;
a server determining module 130, configured to determine a server to be processed from the source server and the target server according to the migration status of the target data pool; the source server is a server to which the target data pool belongs before being migrated, and the target server is a server to which the target data pool belongs after being migrated; and
and the data processing module 140 is used for performing corresponding data processing on the server to be processed.
In this embodiment, after the server determining module 130 in the data processing device in the data migration process determines the migration status of the target data pool, the server to be processed is determined from the source server before data migration and the target server after data migration, and data processing is performed by the data processing module 140, so that in the data migration process, a read request and a write request can be normally processed, dirty data is not generated, and normal running and no interruption of the migration process are ensured.
In one embodiment, if the data processing request is a write request, the server determining module 130 is configured to use the target server as the server to be processed if the target data pool is in a migration state.
In one embodiment, if the data processing request is a read request, the server determining module 130 is configured to use the source server as the server to be processed if the target data pool is in a migration state.
As an implementation manner, the data pool obtaining module 120 is further configured to parse the read request to obtain a target data file corresponding to the read request; and taking the data pool to which the target data file belongs as the target data pool.
The server determining module 130 is configured to determine a migration status of the target data file; and if the migration state is the in-migration state or the pre-migration state, the source server is used as a server to be processed.
As an embodiment, referring to fig. 7, the data processing apparatus in the data migration process further includes:
the newly added server determining module 400 is configured to determine a newly added server from the storage system.
The screening module 600 is configured to screen, according to a server storage space utilization table, a first storage server with a highest space utilization from all the servers and all the newly added servers, and screen a second storage server with a largest disk space from all the newly added servers; the server storage space utilization rate table stores storage space utilization rate information of all servers and all newly-added servers, and disk space information of all the newly-added servers;
A data pool screening module, configured to screen a data pool to be allocated with the largest space occupation from all the data pools of the first storage server
The migration allocation module 700 is configured to allocate the second storage server as a target server of the data pool to be allocated, and generate migration allocation information;
the loop execution module 800 is configured to update the disk space information of the server storage space utilization table and the newly added servers based on the migration allocation information, and return to execute the steps of screening the first storage server with the highest space utilization from all the servers and all the newly added servers according to the server storage space utilization table, and screening the second storage server with the largest disk space from all the newly added servers, and loop to the step that the mean square error of the storage space utilization of all the storage servers and all the newly added servers in the server storage space utilization table does not exceed a preset threshold, so as to allocate the servers to which all the data pools in the storage system belong after migration of data.
As one embodiment, in a data processing apparatus in a data migration process:
the screening module 500 is further configured to screen, according to the server storage space utilization table, a fifth storage server with the lowest space utilization from all the third storage servers; screening out the data pool to be allocated with the largest space occupation from all the data pools of all the fourth servers;
The migration distribution module 600 is further configured to distribute the fifth storage server as a target server of the server to be distributed, and generate migration distribution information;
the loop execution module 700 is further configured to update the server storage space utilization table based on the migration allocation information, and return to execute a step of screening a fifth server with a lowest space utilization rate from all the third servers according to the server storage space utilization table, and loop to the server storage space utilization table that the mean square error of the storage space utilization rates of all the third servers does not exceed a preset threshold, so as to allocate the servers to which all the data pools in the storage system belong after data migration.
Other embodiments or specific implementation manners of the data processing apparatus in the data migration process of the present application may refer to the above method embodiments, and will not be described herein again.
Further, the present application also provides a computer readable storage medium, on which a data processing program in a data migration process is stored, where the data processing program in the data migration process is configured to implement the steps of the data processing method in the data migration process. Therefore, a detailed description will not be given here. In addition, the description of the beneficial effects of the same method is omitted. For technical details not disclosed in the embodiments of the computer-readable storage medium according to the present application, please refer to the description of the method embodiments of the present application. The program instructions may be deployed to be executed on one computing device or on multiple computing devices at one site or distributed across multiple sites and interconnected by a communication network.
Those skilled in the art will appreciate that implementing all or part of the above-described methods may be accomplished by way of computer programs, which may be stored on a computer-readable storage medium, and which, when executed, may comprise the steps of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a random access Memory (RandomAccessMemory, RAM), or the like.
Further, the present invention also provides a computer program product comprising executable program code, wherein the program code, when executed by a processor, performs a data processing method in a data migration process as in the above embodiments.
It should be further noted that the above-described apparatus embodiments are merely illustrative, where elements described as separate elements may or may not be physically separate, and elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. In addition, in the drawings of the embodiment of the device provided by the invention, the connection relation between the modules represents that the modules have communication connection, and can be specifically implemented as one or more communication buses or signal lines. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
Claims (13)
1. A method of data processing in a data migration process, the method comprising the steps of:
in the data migration process, receiving a data processing request of a user;
obtaining a target data pool corresponding to the data processing request;
determining a server to be processed from a source server and a target server according to the migration state of the target data pool; the source server is a server to which the target data pool belongs before being migrated, and the target server is a server to which the target data pool belongs after being migrated;
corresponding data processing is carried out on the server to be processed;
when the number of servers in the storage system increases after data migration, before the step of receiving the data processing request of the user in the data migration process, the method further includes:
determining a newly added server from the storage system;
according to the server storage space utilization rate table, a first storage server with the highest space utilization rate is screened out of all storage servers and all newly-added servers, and a second storage server with the largest disk space is screened out of all the newly-added servers; the server storage space utilization rate table stores storage space utilization rate information of all storage servers and all newly-added servers, and disk space information of all the newly-added servers;
Screening out the data pool to be allocated with the largest space occupation from all the data pools of the first storage server;
distributing the second storage server as a target server of the data pool to be distributed, and generating migration distribution information;
updating the server storage space utilization rate table based on the migration allocation information, and returning to execute the step of screening the first storage server with the highest space utilization rate from all the storage servers and all the newly added servers according to the server storage space utilization rate table, and circulating to the server storage space utilization rate table, wherein the mean square error of the storage space utilization rates of all the storage servers and all the newly added servers does not exceed a preset threshold value, so as to allocate the servers to which the data migration is performed to all the data pools in the storage system.
2. The method for data processing in a data migration process according to claim 1, wherein the data processing request is a write request;
the step of determining the server to be processed from the source server and the target server according to the migration state of the target data pool comprises the following steps:
and if the target data pool is in the migration state, taking the target server as a server to be processed.
3. The method for data processing in a data migration process according to claim 1, wherein the data processing request is a read request;
the step of determining the server to be processed from the source server and the target server according to the migration state of the target data pool comprises the following steps:
and if the target data pool is in a migration state, the source server is used as a server to be processed.
4. A method of data processing in a data migration process according to claim 3, wherein:
the step of obtaining the target data pool corresponding to the data processing request comprises the following steps:
analyzing the read request to obtain a target data file corresponding to the read request;
taking the data pool to which the target data file belongs as a target data pool;
and if the target data pool is in a migration state, the step of taking the source server as a server to be processed comprises the following steps:
if the target data pool is in the migration state, determining the migration state of the target data file;
and if the migration state is the in-migration state or the pre-migration state, the source server is used as a server to be processed.
5. The method according to claim 4, wherein after determining the migration status of the target data file if the target data pool is in the in-migration status, the method further comprises:
and if the migration state is a stable state, taking the target server as a server to be processed.
6. A method of data processing in a data migration process, the method comprising the steps of:
in the data migration process, receiving a data processing request of a user;
obtaining a target data pool corresponding to the data processing request;
determining a server to be processed from a source server and a target server according to the migration state of the target data pool; the source server is a server to which the target data pool belongs before being migrated, and the target server is a server to which the target data pool belongs after being migrated;
corresponding data processing is carried out on the server to be processed;
before the step of receiving the data processing request of the user in the data migration process, the method further comprises the following steps:
screening a fifth server with the lowest space utilization rate from all third servers according to the server storage space utilization rate table; after data migration, when the number of servers in the storage system is reduced, the server reserved after the data migration is a third server, and the deleted server is a fourth server;
Screening out the data pool to be allocated with the largest space occupation from all the data pools of all the fourth servers;
distributing the fifth server as a target server of the data pool to be distributed, and generating migration distribution information;
updating the server storage space utilization rate table based on the migration allocation information, and returning to execute the step of screening a fifth server with the lowest space utilization rate from all third servers according to the server storage space utilization rate table, and circulating to the server storage space utilization rate table that the mean square error of the storage space utilization rates of all third servers does not exceed a preset threshold value so as to allocate the servers to which all data pools in the storage system belong after data migration.
7. The method for data processing during data migration of claim 6, wherein the data processing request is a write request;
the step of determining the server to be processed from the source server and the target server according to the migration state of the target data pool comprises the following steps:
and if the target data pool is in the migration state, taking the target server as a server to be processed.
8. The method for data processing during data migration of claim 6, wherein the data processing request is a read request;
the step of determining the server to be processed from the source server and the target server according to the migration state of the target data pool comprises the following steps:
and if the target data pool is in a migration state, the source server is used as a server to be processed.
9. The method for data processing in a data migration process according to claim 8, wherein:
the step of obtaining the target data pool corresponding to the data processing request comprises the following steps:
analyzing the read request to obtain a target data file corresponding to the read request;
taking the data pool to which the target data file belongs as a target data pool;
and if the target data pool is in a migration state, the step of taking the source server as a server to be processed comprises the following steps:
if the target data pool is in the migration state, determining the migration state of the target data file;
and if the migration state is the in-migration state or the pre-migration state, the source server is used as a server to be processed.
10. The method for processing data in a data migration process according to claim 9, wherein after determining the migration status of the target data file if the target data pool is in the in-migration status, the method further comprises:
and if the migration state is a stable state, taking the target server as a server to be processed.
11. A metadata server comprising a memory, a processor and a data processing program stored on the memory and operable on the processor during data migration, the data processing program during data migration being configured to implement the steps of the data processing method during data migration of any one of claims 1 to 10.
12. A distributed storage system, comprising:
the metadata server of claim 11; and
and the at least one server is connected with the metadata server.
13. A computer readable storage medium comprising executable program code, wherein the program code when executed by a processor performs a data processing method in a data migration process according to any of claims 1 to 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110791646.6A CN113535087B (en) | 2021-07-13 | 2021-07-13 | Data processing method, server and storage system in data migration process |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110791646.6A CN113535087B (en) | 2021-07-13 | 2021-07-13 | Data processing method, server and storage system in data migration process |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113535087A CN113535087A (en) | 2021-10-22 |
| CN113535087B true CN113535087B (en) | 2023-10-17 |
Family
ID=78127752
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110791646.6A Active CN113535087B (en) | 2021-07-13 | 2021-07-13 | Data processing method, server and storage system in data migration process |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113535087B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115454932A (en) * | 2022-09-16 | 2022-12-09 | 北京火山引擎科技有限公司 | Data processing method and device |
| CN115543225B (en) * | 2022-11-30 | 2023-03-24 | 苏州浪潮智能科技有限公司 | Data processing method, system, device, computer storage medium and electronic equipment |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101557320A (en) * | 2009-05-25 | 2009-10-14 | 杭州华三通信技术有限公司 | Disaster tolerance realizing method and communication equipment thereof |
| CN102541467A (en) * | 2011-12-06 | 2012-07-04 | 华中科技大学 | Scheduling method for read-write requests of object data server |
| CN104731905A (en) * | 2015-03-24 | 2015-06-24 | 浪潮集团有限公司 | Volume reducing method for simplified storage pool |
| CN108268501A (en) * | 2016-12-30 | 2018-07-10 | 中国移动通信集团北京有限公司 | Method for processing business and device in a kind of online data transition process |
| WO2018177107A1 (en) * | 2017-03-29 | 2018-10-04 | 腾讯科技（深圳）有限公司 | Data migration method, migration server, and storage medium |
| CN108924202A (en) * | 2018-06-25 | 2018-11-30 | 郑州云海信息技术有限公司 | A kind of the data disaster tolerance method and relevant apparatus of distributed type assemblies |
| US10146467B1 (en) * | 2012-08-14 | 2018-12-04 | EMC IP Holding Company LLC | Method and system for archival load balancing |
| CN110196752A (en) * | 2018-06-07 | 2019-09-03 | 腾讯科技（深圳）有限公司 | Data processing method, device and storage medium |
| CN111013131A (en) * | 2019-10-31 | 2020-04-17 | 咪咕互动娱乐有限公司 | Delayed data acquisition method, electronic device, and storage medium |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8200771B2 (en) * | 2008-10-10 | 2012-06-12 | International Business Machines Corporation | Workload migration using on demand remote paging |
| US9223510B2 (en) * | 2013-06-26 | 2015-12-29 | Globalfoundries Inc. | Optimizing storage utilization by modifying a logical volume offset |
| US11086662B2 (en) * | 2016-08-24 | 2021-08-10 | Ashish Khurange | Method and system of migrating applications to a cloud-computing environment |
-
2021
- 2021-07-13 CN CN202110791646.6A patent/CN113535087B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101557320A (en) * | 2009-05-25 | 2009-10-14 | 杭州华三通信技术有限公司 | Disaster tolerance realizing method and communication equipment thereof |
| CN102541467A (en) * | 2011-12-06 | 2012-07-04 | 华中科技大学 | Scheduling method for read-write requests of object data server |
| US10146467B1 (en) * | 2012-08-14 | 2018-12-04 | EMC IP Holding Company LLC | Method and system for archival load balancing |
| CN104731905A (en) * | 2015-03-24 | 2015-06-24 | 浪潮集团有限公司 | Volume reducing method for simplified storage pool |
| CN108268501A (en) * | 2016-12-30 | 2018-07-10 | 中国移动通信集团北京有限公司 | Method for processing business and device in a kind of online data transition process |
| WO2018177107A1 (en) * | 2017-03-29 | 2018-10-04 | 腾讯科技（深圳）有限公司 | Data migration method, migration server, and storage medium |
| CN110196752A (en) * | 2018-06-07 | 2019-09-03 | 腾讯科技（深圳）有限公司 | Data processing method, device and storage medium |
| CN108924202A (en) * | 2018-06-25 | 2018-11-30 | 郑州云海信息技术有限公司 | A kind of the data disaster tolerance method and relevant apparatus of distributed type assemblies |
| CN111013131A (en) * | 2019-10-31 | 2020-04-17 | 咪咕互动娱乐有限公司 | Delayed data acquisition method, electronic device, and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 多虚拟机下基于内存缓存的动态块迁移算法;刘典型;;计算机应用与软件(第03期);17-21+129 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113535087A (en) | 2021-10-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107943421B (en) | Partition division method and device based on distributed storage system | |
| US11297130B2 (en) | Cluster resource management in distributed computing systems | |
| JP5932043B2 (en) | Volatile memory representation of non-volatile storage set | |
| CN104111897A (en) | Data processing method, data processing device and computer system | |
| CN113535087B (en) | Data processing method, server and storage system in data migration process | |
| CN108334396A (en) | The creation method and device of a kind of data processing method and device, resource group | |
| US20170185340A1 (en) | Memory allocation method and apparatus | |
| US10853128B2 (en) | Virtual machine management device and virtual machine management method | |
| WO2017050064A1 (en) | Memory management method and device for shared memory database | |
| US9218198B2 (en) | Method and system for specifying the layout of computer system resources | |
| WO2023000673A1 (en) | Hardware accelerator device management method and apparatus, and electronic device and storage medium | |
| CN113110938A (en) | Resource allocation method and device, computer equipment and storage medium | |
| CN111104219A (en) | Binding method, device, equipment and storage medium of virtual core and physical core | |
| CN111737212A (en) | Method and equipment for improving performance of distributed file system | |
| CN115421787A (en) | Instruction execution method, apparatus, device, system, program product, and medium | |
| US11403026B2 (en) | Method, device and computer program product for managing storage system | |
| CN107329798B (en) | Data replication method and device and virtualization system | |
| US9405470B2 (en) | Data processing system and data processing method | |
| CN111475277A (en) | Resource allocation method, system, equipment and machine readable storage medium | |
| CN115080242A (en) | Method, device and medium for unified scheduling of PCI equipment resources | |
| CN112130977B (en) | Task scheduling method, device, equipment and medium | |
| CN115150268A (en) | Network configuration method and device of Kubernetes cluster and electronic equipment | |
| CN111078407B (en) | Memory management method and device, storage medium and electronic equipment | |
| CN112988696B (en) | File sorting method and device and related equipment | |
| CN114020214A (en) | Storage cluster capacity expansion method and device, electronic equipment and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |