CN109407964A - A kind of moving method of data, device and equipment - Google Patents
A kind of moving method of data, device and equipment Download PDFInfo
- Publication number
- CN109407964A CN109407964A CN201710713324.3A CN201710713324A CN109407964A CN 109407964 A CN109407964 A CN 109407964A CN 201710713324 A CN201710713324 A CN 201710713324A CN 109407964 A CN109407964 A CN 109407964A
- Authority
- CN
- China
- Prior art keywords
- equipment
- data
- storage
- migrated
- migration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
- G06F3/0607—Improving or facilitating administration, e.g. storage management by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0647—Migration mechanisms
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the present application discloses the moving method, device and equipment of a kind of data, this method comprises: adding target migration equipment within the storage system according to the capacity of storage equipment to be migrated in storage system to carry out dilatation processing to the storage system；The storage equipment to be migrated is carried out that write operation is forbidden to handle, by the Data Migration stored in the storage equipment to be migrated into target migration equipment；Remove the storage equipment to be migrated within the storage system to carry out capacity reducing processing to the storage system.Utilize the embodiment of the present application, it can be handled by dilatation processing and capacity reducing, it does not influence in continual service and in the case where the service quality of line service, complete the migration of data and the replacement of equipment, it will not influence read-write of the user to data in storage system, furthermore, it is possible to improve the speed of Data Migration, the time consumed by Data Migration is reduced.
Description
Technical field
This application involves field of computer technology more particularly to a kind of moving methods of data, device and equipment.
Background technique
Distributed Storage is that data dispersion is stored in more independent storage equipment, is set using more storages
For the memory technology for carrying out load sharing.In distributed data-storage system storing data, data distribution formula is routed to accordingly
Storage equipment in, realize the distributed storage of data.In some cases (for example, distributed data-storage system is corresponding
Entire server cluster carries out regional migration, entire server cluster crosses the complete of the server protected or in entire server cluster
Portion or part replacement etc.), need to carry out the migration of data, without traffic affecting normal use.
In general, the storage equipment using replacement builds new cluster, the data of former cluster are migrated into new cluster, example
Such as, with the continuous development of hardware, the hardware performance in equipment is higher and higher, if the server in former cluster is SATA
(Serial Advanced Technology Attachment, serial high-tech configure interface) server, and current former cluster
Guarantor is already expired, needs SATA server in former cluster being changed to HYBRID server, specifically include the following contents: former cluster is normal
Service is externally provided, meanwhile, the new cluster of HYBRID server is built, the data in former cluster are with snap shot from former cluster
SATA server replicates to new cluster HYBRID server.During being replicated, for being newly written in former cluster
Data, then carry out data increment migration.Function is write by double in distributed data-storage system, by the migration of above-mentioned data
The data received in the process are respectively written into new cluster and former cluster.When in cluster former on the data driven stored in new cluster
When the data of storage, whole read-write capabilities are switched on new cluster, then, modify label attribute information, so that itself and new collection
HYBRID server in group is adapted (i.e. function is write in the mixing storage of unlatching HYBRID server), to complete moving for data
Move the replacement with cluster.
However, needing when the data stored in the data stored in new cluster and former cluster reach consistent by whole readings
It writes in function switch to new cluster, in the process, needs to execute number when the data stored in new cluster and former cluster are consistent
According to migration, the service of former cluster can be stopped at this time, and start new cluster with to distributed data-storage system provide service, and
Being will cause in distributed data-storage system certain time length in above-mentioned handoff procedure cannot use, so that user can not read and write point
Data in cloth data-storage system.
Summary of the invention
The purpose of the embodiment of the present application is to provide the moving method, device and equipment of a kind of data, to be handled by dilatation
With capacity reducing processing, the migration that data are completed in the case where the service quality of line service can be influenced in continual service and not
With the replacement of equipment, read-write of the user to data in storage system will not influence, furthermore, it is possible to the speed of Data Migration is improved,
Reduce the time consumed by Data Migration.
In order to solve the above technical problems, the embodiment of the present application is achieved in that
A kind of moving method of data provided by the embodiments of the present application, which comprises
According in storage system it is to be migrated storage equipment capacity, within the storage system add target migration equipment with
Dilatation processing is carried out to the storage system；
The storage equipment to be migrated is carried out that write operation is forbidden to handle, the number that will be stored in the storage equipment to be migrated
It is migrated in equipment according to the target is moved to；
Remove the storage equipment to be migrated within the storage system to carry out capacity reducing processing to the storage system.
A kind of moving apparatus of data provided by the embodiments of the present application, described device include:
Dilatation module is added within the storage system for the capacity according to storage equipment to be migrated in storage system
Target migrates equipment to carry out dilatation processing to the storage system；
Data Migration module will be described to be migrated for the storage equipment to be migrated carrying out that write operation is forbidden to handle
The Data Migration stored in storage equipment is into target migration equipment；
Capacity reducing module, for remove within the storage system the storage equipment to be migrated with to the storage system into
The processing of row capacity reducing.
A kind of migration equipment for data that the embodiment of the present application separately provides, the equipment include:
Processor；And
It is arranged to the memory of storage computer executable instructions, the executable instruction makes the place when executed
Manage device:
According in storage system it is to be migrated storage equipment capacity, within the storage system add target migration equipment with
Dilatation processing is carried out to the storage system；
The storage equipment to be migrated is carried out that write operation is forbidden to handle, the number that will be stored in the storage equipment to be migrated
It is migrated in equipment according to the target is moved to；
Remove the storage equipment to be migrated within the storage system to carry out capacity reducing processing to the storage system.
As can be seen from the technical scheme provided by the above embodiments of the present application, the embodiment of the present application passes through to be migrated in storage system
The capacity for storing equipment carries out dilatation processing to storage system and is added in storage system so that target is migrated equipment, then, right
Storage equipment to be migrated carries out that write operation is forbidden to handle, and the Data Migration stored in storage equipment to be migrated is migrated to target
In equipment, finally, capacity reducing processing is carried out removing storage equipment to be migrated from storage system to storage system again, in this way,
It is handled, can be influenced in continual service and not in the case where the service quality of line service by dilatation processing and capacity reducing, it is complete
At the migration of data and the replacement of equipment, read-write of the user to data in storage system will not influence, furthermore, it is possible to improve data
The speed of migration reduces the time consumed by Data Migration.
Detailed description of the invention
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
The some embodiments recorded in application, for those of ordinary skill in the art, in the premise of not making the creative labor property
Under, it is also possible to obtain other drawings based on these drawings.
Fig. 1 is a kind of moving method embodiment of data of the application；
Fig. 2A is a kind of schematic diagram of storage system dilatation of the application；
Fig. 2 B is a kind of schematic diagram of storage system capacity reducing of the application；
Fig. 3 is a kind of moving method embodiment of data of the application；
Fig. 4 A is the schematic diagram of the application another kind storage system dilatation；
Fig. 4 B is the schematic diagram of the application another kind storage system capacity reducing；
Fig. 5 A is the schematic diagram of another storage system dilatation of the application；
Fig. 5 B is the schematic diagram of another storage system capacity reducing of the application；
Fig. 6 is a kind of moving apparatus embodiment of data of the application；
Fig. 7 is a kind of migration apparatus embodiments of data of the application.
Specific embodiment
The embodiment of the present application provides the moving method, device and equipment of a kind of data.
In order to make those skilled in the art better understand the technical solutions in the application, below in conjunction with the application reality
The attached drawing in example is applied, the technical scheme in the embodiment of the application is clearly and completely described, it is clear that described implementation
Example is merely a part but not all of the embodiments of the present application.Based on the embodiment in the application, this field is common
The application protection all should belong in technical staff's every other embodiment obtained without creative efforts
Range.
Embodiment one
As shown in Figure 1, the embodiment of the present application provides a kind of moving method of data, the executing subject of this method can be clothes
Business device or terminal device, server therein can be the meta data server in storage system, be also possible to pre-set
For the server of Data Migration, terminal device can be personal computer etc..This method can specifically include following steps:
In step s101, according to the capacity of storage equipment to be migrated in storage system, mesh is added in the storage system
Mark migration equipment is to carry out dilatation processing to the storage system.
Wherein, storage system can be distributed data-storage system, be also possible to centralized data-storage system.Wait move
It moves storage equipment and can be in storage system any one storage equipment or can be and set by multiple storages in storage system
Standby (including all storage equipment in storage system) are constituted.Storage equipment to be migrated can be the storage for needing to be replaced
Equipment.Target migration equipment can be the equipment for replacing storage equipment to be migrated, and the memory space that target migrates equipment is big
In or equal to the memory space to be migrated for storing equipment.Dilatation processing can be the addition storage equipment into storage system, and
The processing serviced provided by the storage equipment.
In an implementation, it may include multiple storage equipment in storage system, can be stored needs by storage equipment
Data are stored.In order to guarantee the safety of data, more parts of (such as 3 parts or 5 parts can be stored for same data in storage system
Deng), which is separately positioned in different storage equipment, and more parts of data are used as Backup Data between each other, in this way, working as
Storage unit exception where certain data then can continue as using by the storage equipment where other Backup Datas of the data
Family provides service.
With the continuous development of hardware, the update of hardware device is getting faster, and performance is also become better and better, for storage
For equipment, the storage equipment of distinct interface, performance is not also identical, for example, IDE (Integrated Drive
Electronics, electronic integrated driver) the storage equipment of interface, SCSI (Small Computer System
Interface, small computer system interface) storage of storage equipment, the storage equipment of SATA interface or HYBRID interface sets
Standby etc., the corresponding performance for storing equipment successively enhances with the tandem of above-mentioned displaying.In order to preferably be provided for user
Relevant service, storage equipment that can be more backward to performance in storage system are replaced, and in view of being commonly stored system
Middle to store equipment comprising a large amount of, the storage equipment needed replacing is often also more, such as all storages in storage system are set
A part storage equipment etc., the storage equipment (storage i.e. to be migrated for thus needing to need replacing in standby or storage system
Equipment) in store Data Migration to newly store equipment (i.e. target migration equipment) in.In order to during Data Migration not
Influence the Service Quality in line service (can not interrupt the business of service, can be with the business of real-time perfoming read operation and write operation)
Amount can be handled, specifically, as shown in Figure 2 A, if necessary by way of the dilatation processing of storage system and capacity reducing processing
7 storage equipment in storage system are replaced, then can calculate the memory capacity of the 7 storage equipment needed replacing, such as 120TB
Or 100TB etc..Target migration equipment of the memory capacity more than or equal to above-mentioned memory capacity can be chosen, and target migration is set
It is standby to be added in the topological structure of storage system.Target migration equipment can be chosen, and starts the dilatation processing of storage system, this
When, target can be migrated into equipment and be added in storage system, the storage system after obtaining dilatation can be as shown in Figure 2 A.
It should be noted that within the storage system often including management equipment (such as Metadata Service in management level
Device) and data storage device, wherein management equipment be used to be managed the data in data storage device (such as data distribution,
Data query, data deletion etc.), data storage device can be used for storing data.If necessary to which management equipment and data are deposited
It stores up equipment all to replace, then can first pass through above-mentioned processing mode replacement management equipment, it, can be with after management equipment replacement
Data storage device is replaced by above-mentioned processing mode by the management equipment after replacing.If only needing replacing management equipment or number
According to storage equipment, then can directly be executed by above-mentioned processing mode.
In step s 102, above-mentioned storage equipment to be migrated is carried out that write operation is forbidden to handle, which is set
The Data Migration of standby middle storage is into above-mentioned target migration equipment.
Wherein, write operation can be the operation that data are written into storage equipment to be migrated.
In an implementation, the priority assignation choosing of priority assignation option and write operation that read operation can be set in equipment is stored
, by above-mentioned two option, the read operation and/or write operation for storing equipment can be controlled, for example, when certain storage is set
It, can be by read operation when not allowing user to modify or delete for the data of middle storage, but user being allowed to download, replicate or check
Priority assignation option is positioned to allow for, and the priority assignation option of write operation is set as refusing, in this way, user will be unable to this
It stores equipment and carries out write operation.Since storage equipment to be migrated needs are replaced, when user needs that number is written into storage system
When according to (i.e. execution write operation), it can write the data in target migration equipment, for this purpose, can stop to storage to be migrated
Equipment executes write operation, it can is positioned to allow for the priority assignation option of the read operation of storage equipment to be migrated, and will write
The priority assignation option of operation is set as refusing.After above-mentioned processing, write operation is needed to be implemented when storing equipment, and be this
When write operation distribution storage equipment, which can be distributed to target migration equipment, and storage equipment to be migrated is no longer held
Row write operation, but at this point, user still can check or download the data stored in storage equipment to be migrated.
Same data can be stored in storage system more based on above-mentioned related content in order to guarantee the safety of data
Part (such as 3 parts or 5 parts), the more parts of data are separately positioned in different storage equipment.In order not to interrupt in line service, and
The service quality in line service is not influenced, and the storage where can searching each data stored in storage equipment to be migrated is set
It is standby, it is always ensured that any data all has one or more parts data and is not carried out Data Migration behaviour during carrying out Data Migration
Make, for example, including 5 different data in storage equipment to be migrated, each data include 3 parts, wherein storage equipment A, storage are set
Any storage equipment in standby B and storage equipment C all stores data 1, data 2, data 3, data 4 and data 5, is being counted
According to migration when, storage equipment A, storage equipment B and storage equipment C cannot carry out Data Migration simultaneously, and can only store equipment A,
Storage equipment B and storage equipment C successively carry out Data Migration, i.e., any advanced row Data Migration of storage equipment therein is completed
Afterwards, then to any storage equipment in remaining storage equipment Data Migration is carried out, finally remaining storage equipment is counted
The advanced row Data Migration of equipment is stored according to any two in migration, or storage equipment A, storage equipment B and storage equipment C, it is complete
Cheng Hou, then remaining storage equipment is carried out any in Data Migration, or storage equipment A, storage equipment B and storage equipment C
One advanced row Data Migration of storage equipment after the completion, then carries out Data Migration to remaining storage equipment simultaneously.
It should be noted that the triggering mode for executing data migration operation may include a variety of, for example, can preset
Trigger condition executes data migration operation, wherein holding when certain storage equipment in storage system meets the trigger condition
Before row data migration operation, the storage equipment for needing to carry out Data Migration can be chosen and be arranged, and receive the number of migration
According to storage equipment；For another example triggering state can be set for each storage equipment, it can be with each storage equipment of real-time detection
State can carry out Data Migration to the storage equipment when the state of certain storage equipment is converted to above-mentioned triggering state.In addition to
Outside above-mentioned triggering mode, it can also include a variety of triggering modes, can be determined according to the actual situation, details are not described herein.
In step s 103, above-mentioned storage equipment to be migrated is removed in above-mentioned storage system to carry out to the storage system
Capacity reducing processing.
Wherein, capacity reducing processing can be deletes clothes provided by storage equipment and the storage equipment from storage system
The processing of business.
In an implementation, after the Data Migration for completing above-mentioned steps S102, it can determine and to be stored in storage equipment to be migrated
Data have all moved in target migration equipment, are written into target migration equipment with the data in stylish write-in storage system
In, at this point, storage equipment to be migrated loses existing meaning within the storage system, therefore, above-mentioned storage system can be held
The processing of row capacity reducing, which is removed from the storage system, in this way, as shown in Figure 2 B, in storage system
No longer include storage equipment to be migrated, but include target migration equipment, in this way, can by dilatation processing and capacity reducing processing
In the case where not needing to interrupt service and do not influence the service quality in line service, the migration of data is completed, data are improved
The speed of migration reduces the time consumed by Data Migration.
Further, since the interface of storage equipment or the data memory format of the storage unit (such as disk) in storage equipment
Difference, the format for storing the data stored in equipment also can be different, therefore, if storage equipment to be migrated and target migrate equipment
There are above-mentioned differences, then after the Data Migration stored in storage equipment to be migrated being migrated equipment to target, can modify migration
The configuration parameter of data afterwards makes it match with target migration equipment, if storage equipment to be migrated and target migrate equipment
There is no above-mentioned differences, then the configuration parameter of the data after can not needing modification migration.
It should be noted that above-mentioned steps S101~step S103 processing can be applied to a certain Stored Data Type
Storage equipment, such as the management equipment (such as meta data server) or data storage device of management level that above content is mentioned
Deng also can be applied to the storage equipment of different data storage class, in this case, it is possible to which different data storage class is deposited
Storage equipment is performed simultaneously above-mentioned steps S101~step S103 processing, can also preset depositing for different data storage class
Storage equipment executes the priority of above-mentioned processing, for example, such as above content, the priority that management equipment can be set is deposited higher than data
The priority of equipment is stored up, in this way, can first replace to management equipment, that is, executes the place above-mentioned steps S101~step S103
Reason, then, then replaces data storage device.
The embodiment of the present application provides a kind of moving method of data, passes through the appearance of storage equipment to be migrated in storage system
Amount carries out dilatation processing to storage system target migration equipment to be added in storage system, then, sets to storage to be migrated
It is standby to carry out that write operation is forbidden to handle, and by the Data Migration stored in storage equipment to be migrated into target migration equipment, finally,
Capacity reducing processing is carried out to remove storage equipment to be migrated from storage system, in this way, handling by dilatation to storage system again
With capacity reducing processing, the migration that data are completed in the case where the service quality of line service can be influenced in continual service and not
With the replacement of equipment, read-write of the user to data in storage system will not influence, furthermore, it is possible to the speed of Data Migration is improved,
Reduce the time consumed by Data Migration.
Embodiment two
As shown in figure 3, the embodiment of the present application provides a kind of moving method of data, the executing subject of this method can be
Server or terminal device, server therein can be the meta data server in storage system, be also possible to preset
The server for Data Migration, terminal device can be personal computer etc..
The moving method of explanation data provided by the embodiments of the present application for greater clarity, the embodiment of the present application with
It is illustrated for all storage equipment in replacement storage system, it is contemplated that HYBRID stores equipment, and data will not during power down
It loses, and data may lose SATA storage device during power down, therefore, storage equipment to be migrated can set for SATA storage
Standby, target migrates equipment can store equipment for HYBRID, and storage equipment to be migrated is the meta data server in storage system
And/or data storage server, wherein meta data server is used to manage first number of the data stored in data storage server
According to.By taking storage equipment to be migrated is meta data server and data storage server in storage system as an example, the application is implemented
The moving method for the data that example provides can specifically include following steps:
In step S301, according to the capacity of storage equipment to be migrated in storage system, mesh is added in the storage system
Mark migration equipment is to carry out dilatation processing to the storage system.
The step content of above-mentioned steps S301 is identical as the step content of step S101 in above-described embodiment one, step S301
Specific processing may refer to the related content in above-mentioned steps S101, details are not described herein.
In step s 302, above-mentioned storage equipment to be migrated is carried out that write operation is forbidden to handle, is set according to storage to be migrated
The storage space utilization of standby and target migration equipment, determines in storage equipment to be migrated according to scheduled load balancing rule
Data to be migrated.
Wherein, storage space utilization can be used for characterizing between used memory space and not used memory space
Relationship, storage space utilization is higher, then shows to store that equipment use is more frequent accordingly, the read operation of data and/or writes
It operates more frequent.Load balancing rule can be lower for the data loaded in higher storage equipment to be transferred to load
The rule in equipment is stored, it is balanced the purpose is to carry out the load of storage equipment to be migrated and target migration equipment, to reach
The equiblibrium mass distribution of data, load balancing rule specifically may be set according to actual conditions.Data to be migrated can be according to above-mentioned
The data that load balancing rule determines, needs will load in higher storage equipment are transferred in the lower storage equipment of load
Data, data to be migrated can be a part of data of all data stored in storage equipment to be migrated.
In an implementation, stopping can to the processing mode that above-mentioned meta data server and data storage server execute write operation
To include a kind of a variety of, feasible processing mode presented below, meta data server and data storage server can be distinguished
Blacklist is added, at this point, meta data server and data storage server can execute read operation, and write operation cannot be executed,
At this point, user is without being written data in normal direction meta data server and data storage server, in this way, as shown in Figure 4 A, storage system
The write operation of system can only be migrated equipment by target, and (in order to distinguish with aforementioned names, it is target metadata service that target, which migrates equipment,
Device and target data storage server) it executes.When user needs that data are written into storage system, number can be written into this
Target metadata server is distributed to according to corresponding write operation and target data storage server executes, meta data server sum number
The services such as reading or the downloading of the data of its storage can be provided for user according to storage server.
It can be previously provided with load balancing rule in storage system, such as Rebalance (rebalancing) mechanism, moved treating
It moves storage equipment to carry out after forbidding write operation to handle, can star the Rebalance mechanism of storage system, at this point, due to target
The storage space utilization (or disk utilization) of meta data server and target data storage server is lower, and first
The storage space utilization of data server and data storage server is higher, to cause to load unevenness in storage system, opens
After dynamic Rebalance mechanism, meta data server and data storage server can be determined (i.e. according to above-mentioned load balancing rule
Storage equipment to be migrated) in need to move to target metadata server and target data storage server (i.e. target migration set
It is standby) in data to be migrated, for example, data volume be 1TB data A etc..
In step S303, above-mentioned Data Migration to be migrated to target migration is set by scheduled load balancing rule
It is standby, and by down status subject to storage equipment to be migrated setting, controlling storage equipment to be migrated will be surplus other than data to be migrated
Remaining Data Migration to target migrates equipment.
Wherein, quasi- down status (i.e. ShutDown state) can be a kind of state before down status, can also manage
To prepare a kind of offline state, quasi- down status needs to store equipment and completes predetermined operation solution, after the completion of predetermined operation, storage
Equipment is offline.
In an implementation, start Rebalance mechanism, and determine storage equipment to be migrated according to scheduled load balancing rule
In data to be migrated after, the data to be migrated stored in meta data server and data storage server will be migrated to mesh
It marks in meta data server and target data storage server.
For being in the storage equipment of quasi- down status, one or more operations needed to be implemented, example can be preset
Such as, data migration operation, the flow control of Data Migration or network bandwidth control etc..Above-mentioned storage equipment to be migrated can be set
It is set to quasi- down status, at this point, storage equipment to be migrated is still within and readable not writeable (can execute read operation, but cannot
Execute write operation) state.It can search and determine the meta data server in quasi- down status and/or data storage service
Device counts the data volume of the remaining data in the data wherein stored in addition to data to be migrated, it is then possible to determine corresponding
Target metadata server and/or target data storage server, can be by meta data server and/or data storage server
In data to be migrated other than remaining data move to corresponding target metadata server and/or target data storage service
In device, while the uninterrupted of Data Migration, such as 30MB/s or 35MB/s can be controlled by pre-set network bandwidth.
The processing mode of above-mentioned steps S303 can be varied, a kind of feasible processing mode presented below, then above-mentioned
The processing of step S303 is specifically as follows: successively according in storage system it is above-mentioned it is to be migrated storage equipment where preset rack,
Respectively by down status subject to the storage equipment to be migrated setting in the preset rack, and controls the storage equipment to be migrated and will deposit
The remaining data of storage moves in target migration equipment.
Wherein, it may include multiple storage equipment in preset rack (i.e. Rack), may include multiple pre- in storage system
Rack is set, moreover, the more parts of data are separately positioned on based on that can store more parts (such as 3 parts) for same data in storage system
In different storage equipment, the considerations of more parts of data are used as Backup Data between each other, can store in each preset rack and appoint
A data in a kind of more parts of data of data, for example, including 3 preset racks, respectively rack 1, machine in storage system
Frame 2 and rack 3, and include three kinds of data, respectively data 1, data 2 and data 3, data 1,2 sum number of data in storage system
3 parts of data are respectively included according to 3, then any preset rack in rack 1, rack 2 and rack 3 all stores data 1,2 and of data
Data 3 store data 1, data 2 and data 3, data 1, data 2 and data 3, rack 3 are stored in rack 2 in rack 1
In store data 1, data 2 and data 3.
In an implementation, in order not to interrupt in line service, and the service quality in line service is not influenced, it can be with preset machine
Frame is that unit carries out data migration operation, for example, any preset rack based on above-mentioned example, in rack 1, rack 2 and rack 3
All store data 1, data 2 and data 3, then can first by rack 1 meta data server or data storage server it is complete
Down status subject to portion's setting, and will be other than the data to be migrated that stored in meta data server and/or data storage server
Remaining data move in corresponding target metadata server and/or target data storage server, can after the completion of migration
With by rack 2 meta data server or data storage server be all set to quasi- down status, and by Metadata Service
Remaining data other than the data to be migrated stored in device and/or data storage server moves to corresponding target metadata clothes
It is engaged in device and/or target data storage server, finally, again by the meta data server or data storage server in rack 3
Be all set to quasi- down status, and by the data to be migrated stored in meta data server and/or data storage server with
Outer remaining data moves in corresponding target metadata server and/or target data storage server, to complete number
According to migration operation.It is therein that meta data server or data storage server are all set to quasi- down status, and will be first
Remaining data other than the data to be migrated stored in data server and/or data storage server moves to corresponding target
Concrete processing procedure in meta data server and/or target data storage server may refer to above-mentioned related content, herein
It repeats no more.
It should be noted that the storage according to storage equipment to be migrated and target migration equipment in above-mentioned steps S302 is empty
Between utilization rate, the data that store in storage equipment to be migrated are moved by scheduled load balancing rule into target migration equipment
The purpose of the processing of shifting is the migration in order to accelerate data, and reducing the time consumed by Data Migration in practical applications can also
Not need to execute above-mentioned processing, and directly execute the processing of above-mentioned steps S303.
Above-mentioned steps S302~step S303 treatment process is the specific place of one kind of step S102 in above-described embodiment one
Reason mode often encounters the meta data server and data storage server needed in storage system in practical applications
In Data Migration to corresponding target migration equipment in, based on this situation, above-mentioned storage equipment to be migrated may include store
Meta data server and data storage server in system, correspondingly, target migration equipment may include target metadata clothes
Business device and target data storage server, then the processing mode of above-mentioned steps S102 can also be accomplished by the following way, specifically
It may include the following contents: meta data server being carried out write operation is forbidden to handle, the data that will be stored in meta data server
It moves in target metadata server；Data storage server is carried out write operation is forbidden to handle, by data storage server
The Data Migration of middle storage is into target data storage server.The concrete processing procedure of above content may refer to above-mentioned steps
The related content of S102 or step S302 and step S303, details are not described herein.
Furthermore it is also possible to execute above-mentioned steps S301~step respectively to meta data server and data storage server
S303 and following step S304~step S305.
In step s 304, above-mentioned storage equipment to be migrated is removed in above-mentioned storage system to carry out to the storage system
Capacity reducing processing.
The step content of above-mentioned steps S304 is identical as the step content of step S103 in above-described embodiment one, step S304
Specific processing may refer to the related content in above-mentioned steps S103, details are not described herein.The processing knot of above-mentioned steps S304
Fruit can be as shown in Figure 4 B.
It should be noted that first data can be carried out to meta data server during executing above-mentioned Data Migration
Then migration and equipment replacement, then carry out Data Migration and equipment replacement to data storage server, can also be simultaneously to first number
Carry out Data Migration and equipment replacement respectively according to server and data storage server, can also first to data storage server into
Then row Data Migration and equipment replacement, then carry out Data Migration and equipment replacement, the embodiment of the present application to meta data server
Without limitation to the execution of the two sequence.
In addition, Data Migration and equipment replacement for meta data server, can be handled otherwise, for example,
Function is write by double, the data of user's write-in are written in target metadata server and meta data server simultaneously, work as target
When the data stored in meta data server on the data driven stored in meta data server, then whole read-write capabilities are switched
Onto target metadata server, and the place above-mentioned steps S301~step S304 can be executed for data storage server
Reason.
In step S305, it is revised as the label attribute information that storage equipment to be migrated matches to migrate equipment with target
The label attribute information to match.
Wherein, label attribute information is for recording the information such as the configuration parameter of data, label attribute information and storage equipment
It is adapted.
In an implementation, since storage equipment (i.e. meta data server and/or data storage server) to be migrated is SATA
Equipment is stored, target migrates equipment (i.e. target metadata server and/or target data storage server) as HYBRID storage
The interfaces of equipment, two kinds of storage equipment are different, then the format of the data of its storage also can be different, and therefore, it is necessary to will be to be migrated
After the Data Migration stored in storage equipment migrates equipment to target, the label attribute information of the data after modification migration (is such as matched
Set parameter etc.), so that it is matched with target migration equipment.
In addition, the moving method of data provided by the above embodiment, is to replace whole storage equipment in storage system
For the explanation that carries out, in practical applications, the moving method of data provided by the embodiments of the present application can also be applied to replacement
In the case where part storage equipment in storage system, as shown in Figure 5A, storage equipment to be migrated is the part in storage system
Data storage server, storage equipment to be migrated can also be SATA storage device, and it can also be HYBRID that target, which migrates equipment,
Store equipment.
Based on above content, the moving method of data provided by the embodiments of the present application can specifically include the following contents: root
According to the capacity of storage equipment (data storage server in Fig. 5 A) to be migrated in storage system, target is added within the storage system
Data storage server is to carry out dilatation processing to storage system；Storage equipment to be migrated is carried out that write operation is forbidden to handle, root
According to the storage space utilization of storage equipment to be migrated and target migration equipment, determine according to scheduled load balancing rule wait move
The data to be migrated in storage equipment are moved, are set Data Migration to be migrated to target migration by scheduled load balancing rule
It is standby, and successively according in storage system it is to be migrated storage equipment where preset rack, respectively by the preset rack wait move
Move down status subject to storage equipment setting, control storage equipment to be migrated by the remaining data other than data to be migrated migrate to
Target migrates equipment.Remove storage equipment (data storage server in Fig. 5 A) to be migrated within the storage system to be to storage
System carries out capacity reducing processing, as shown in Figure 5 B.The label attribute information that matches of storage equipment to be migrated is revised as and number of targets
The label attribute information to match according to storage server (i.e. HYBRID stores equipment).
The specific processing mode of above-mentioned treatment process may refer to the related content in above-described embodiment one and embodiment two,
Details are not described herein.
It should be noted that it is serial high that above-mentioned steps S301~step S305 processing, which is based on storage equipment to be migrated,
Technology configuration interface SATA storage device, target migration equipment are that the case where mixing HYBRID stores equipment carries out specifically
It is bright, in practical applications, however it is not limited to which above situation, storage equipment and target migration equipment to be migrated can be serial high-tech
Any two kinds in interface SATA storage device, mixing HYBRID storage equipment and solid-state hard disk SSD storage equipment are configured, i.e., such as
Fruit storage equipment to be migrated is SATA storage device, HYBRID stores equipment and SSD is stored in the storage equipment of 3 seed type of equipment
Any one type storage equipment, then target migration equipment can store equipment and SSD for SATA storage device, HYBRID
The storage equipment for storing any one type in equipment in addition to storage equipment type to be migrated, for example, if to be migrated
Storage equipment is SATA storage device, then target migration equipment can store equipment for HYBRID and SSD stores appointing in equipment
A kind of storage equipment, i.e. HYBRID stores equipment or SSD stores equipment.
The embodiment of the present application provides a kind of moving method of data, passes through the appearance of storage equipment to be migrated in storage system
Amount carries out dilatation processing to storage system target migration equipment to be added in storage system, then, sets to storage to be migrated
It is standby to carry out that write operation is forbidden to handle, and by the Data Migration stored in storage equipment to be migrated into target migration equipment, finally,
Capacity reducing processing is carried out to remove storage equipment to be migrated from storage system, in this way, handling by dilatation to storage system again
With capacity reducing processing, the migration that data are completed in the case where the service quality of line service can be influenced in continual service and not
With the replacement of equipment, read-write of the user to data in storage system will not influence, furthermore, it is possible to the speed of Data Migration is improved,
Reduce the time consumed by Data Migration.
Embodiment three
The above are the moving methods of data provided by the embodiments of the present application, are based on same thinking, the embodiment of the present application is also
A kind of moving apparatus of data is provided, as shown in Figure 6.
The moving apparatus of the data includes: dilatation module 601, Data Migration module 602 and capacity reducing module 603, in which:
Dilatation module 601 adds within the storage system for the capacity according to storage equipment to be migrated in storage system
Add target migration equipment to carry out dilatation processing to the storage system；
Data Migration module 602, for the storage equipment to be migrated carrying out that write operation is forbidden to handle, by described wait move
The Data Migration stored in storage equipment is moved into target migration equipment；
Capacity reducing module 603, for removing the storage equipment to be migrated within the storage system to be to the storage
System carries out capacity reducing processing.
In the embodiment of the present application, the Data Migration module 602, comprising:
Data determination unit to be migrated, for the storage according to the storage equipment to be migrated and target migration equipment
Space utilization rate determines the data to be migrated in the storage equipment to be migrated according to scheduled load balancing rule；
Data migration unit, for by the scheduled load balancing rule by the Data Migration to be migrated to described
Target migrates equipment, and by down status subject to the storage equipment setting to be migrated, controlling the storage equipment to be migrated will
Remaining data other than the data to be migrated migrates to the target and migrates equipment.
In the embodiment of the present application, the storage equipment to be migrated and target migration equipment are that the configuration of serial high-tech connects
Any two kinds in mouth SATA storage device, mixing HYBRID storage equipment and solid-state hard disk SSD storage equipment.
In the embodiment of the present application, described device further include:
Information modified module, for by the label attribute information that matches of storage equipment to be migrated be revised as with it is described
The label attribute information that target migration equipment matches.
In the embodiment of the present application, the data migration unit, for successively according to be migrated described in the storage system
The preset rack where equipment is stored, respectively by offline shape subject to the storage equipment setting to be migrated in the preset rack
Remaining data other than the data to be migrated is migrated to target migration and is set by state, the control storage equipment to be migrated
It is standby.
In the embodiment of the present application, the storage equipment to be migrated is meta data server or data in the storage system
Storage server, wherein the meta data server is used to manage first number of the data stored in the data storage server
According to.
In the embodiment of the present application, the storage equipment to be migrated includes the meta data server sum number in the storage system
According to storage server, target migration equipment includes target metadata server and target data storage server,
Correspondingly, the Data Migration module 602, forbids write operation to handle for carrying out to the meta data server,
By the Data Migration stored in the meta data server into the target metadata server；To the data storage service
Device carries out that write operation is forbidden to handle, and the Data Migration stored in the data storage server to the target data is stored and is taken
It is engaged in device.
The embodiment of the present application provides a kind of moving apparatus of data, passes through the appearance of storage equipment to be migrated in storage system
Amount carries out dilatation processing to storage system target migration equipment to be added in storage system, then, sets to storage to be migrated
It is standby to carry out that write operation is forbidden to handle, and by the Data Migration stored in storage equipment to be migrated into target migration equipment, finally,
Capacity reducing processing is carried out to remove storage equipment to be migrated from storage system, in this way, handling by dilatation to storage system again
With capacity reducing processing, the migration that data are completed in the case where the service quality of line service can be influenced in continual service and not
With the replacement of equipment, read-write of the user to data in storage system will not influence, furthermore, it is possible to the speed of Data Migration is improved,
Reduce the time consumed by Data Migration.
Example IV
The above are the moving apparatus of data provided by the embodiments of the present application, are based on same thinking, the embodiment of the present application is also
A kind of migration equipment of data is provided, as shown in Figure 7.
The migration equipment of the data can be provided by the above embodiment
The migration equipment of data can generate bigger difference because configuration or performance are different, may include one or one
Above processor 701 and memory 702, can store in memory 702 one or more storage application programs or
Data.Wherein, memory 702 can be of short duration storage or persistent storage.The application program for being stored in memory 702 may include
One or more modules (diagram is not shown), each module may include the series of computation in the migration equipment to data
Machine executable instruction.Further, processor 701 can be set to communicate with memory 702, in the migration equipment of data
Execute the series of computation machine executable instruction in memory 702.The migration equipment of data can also include one or one with
Upper power supply 703, one or more wired or wireless network interfaces 704, one or more input/output interfaces 705,
One or more keyboards 706.
Specifically in the present embodiment, the migration equipment of data includes memory and one or more program,
Perhaps more than one program is stored in memory and one or more than one program may include one or one for one of them
It is a with upper module, and each module may include the series of computation machine executable instruction in migration equipment to data, and pass through
Configuration includes for carrying out following calculate to execute this or more than one program by one or more than one processor
Machine executable instruction:
According in storage system it is to be migrated storage equipment capacity, within the storage system add target migration equipment with
Dilatation processing is carried out to the storage system；
The storage equipment to be migrated is carried out that write operation is forbidden to handle, the number that will be stored in the storage equipment to be migrated
It is migrated in equipment according to the target is moved to；
Remove the storage equipment to be migrated within the storage system to carry out capacity reducing processing to the storage system.
Optionally, the executable instruction when executed, can also make the processor:
According to the storage space utilization of the storage equipment to be migrated and target migration equipment, according to scheduled negative
It carries balanced rule and determines the data to be migrated to be migrated stored in equipment；
The Data Migration to be migrated to the target is migrated into equipment by the scheduled load balancing rule, and will
Down status subject to the storage equipment setting to be migrated, controlling the storage equipment to be migrated will be other than the data to be migrated
Remaining data migrate to the target migrate equipment.
In the embodiment of the present application, the storage equipment to be migrated and target migration equipment are that the configuration of serial high-tech connects
Any two kinds in mouth SATA storage device, mixing HYBRID storage equipment and solid-state hard disk SSD storage equipment.
Optionally, the executable instruction when executed, can also make the processor:
It is revised as the label attribute information that the storage equipment to be migrated matches to migrate equipment phase with the target
The label attribute information matched.
Optionally, the executable instruction when executed, can also make the processor:
It, respectively will be described preset successively according to the preset rack where storage to be migrated equipment described in the storage system
Down status subject to the storage equipment setting to be migrated in rack, controlling the storage equipment to be migrated will be described to be migrated
Remaining data other than data migrates to the target and migrates equipment.
In the embodiment of the present application, the storage equipment to be migrated is meta data server or data in the storage system
Storage server, wherein the meta data server is used to manage first number of the data stored in the data storage server
According to.
Optionally, the executable instruction when executed, can also make the processor:
The storage equipment to be migrated includes meta data server and data storage server in the storage system, institute
Stating target migration equipment includes target metadata server and target data storage server,
Correspondingly, described to the storage equipment to be migrated carry out that write operation is forbidden to handle, the storage to be migrated is set
The Data Migration of standby middle storage is into target migration equipment, comprising:
The meta data server is carried out write operation is forbidden to handle, the data stored in the meta data server are moved
It moves on in the target metadata server；
The data storage server is carried out write operation is forbidden to handle, the number that will be stored in the data storage server
According to moving in the target data storage server.
The embodiment of the present application provides a kind of migration equipment of data, passes through the appearance of storage equipment to be migrated in storage system
Amount carries out dilatation processing to storage system target migration equipment to be added in storage system, then, sets to storage to be migrated
It is standby to carry out that write operation is forbidden to handle, and by the Data Migration stored in storage equipment to be migrated into target migration equipment, finally,
Capacity reducing processing is carried out to remove storage equipment to be migrated from storage system, in this way, handling by dilatation to storage system again
With capacity reducing processing, the migration that data are completed in the case where the service quality of line service can be influenced in continual service and not
With the replacement of equipment, read-write of the user to data in storage system will not influence, furthermore, it is possible to the speed of Data Migration is improved,
Reduce the time consumed by Data Migration.
It is above-mentioned that this specification specific embodiment is described.Other embodiments are in the scope of the appended claims
It is interior.In some cases, the movement recorded in detail in the claims or step can be come according to the sequence being different from embodiment
It executes and desired result still may be implemented.In addition, process depicted in the drawing not necessarily require show it is specific suitable
Sequence or consecutive order are just able to achieve desired result.In some embodiments, multitasking and parallel processing be also can
With or may be advantageous.
In the 1990s, the improvement of a technology can be distinguished clearly be on hardware improvement (for example,
Improvement to circuit structures such as diode, transistor, switches) or software on improvement (improvement for method flow).So
And with the development of technology, the improvement of current many method flows can be considered as directly improving for hardware circuit.
Designer nearly all obtains corresponding hardware circuit by the way that improved method flow to be programmed into hardware circuit.Cause
This, it cannot be said that the improvement of a method flow cannot be realized with hardware entities module.For example, programmable logic device
(Programmable Logic Device, PLD) (such as field programmable gate array (Field Programmable Gate
Array, FPGA)) it is exactly such a integrated circuit, logic function determines device programming by user.By designer
Voluntarily programming comes a digital display circuit " integrated " on a piece of PLD, designs and makes without asking chip maker
Dedicated IC chip.Moreover, nowadays, substitution manually makes IC chip, this programming is also used instead mostly " is patrolled
Volume compiler (logic compiler) " software realizes that software compiler used is similar when it writes with program development,
And the source code before compiling also write by handy specific programming language, this is referred to as hardware description language
(Hardware Description Language, HDL), and HDL is also not only a kind of, but there are many kind, such as ABEL
(Advanced Boolean Expression Language)、AHDL(Altera Hardware Description
Language)、Confluence、CUPL(Cornell University Programming Language)、HDCal、JHDL
(Java Hardware Description Language)、Lava、Lola、MyHDL、PALASM、RHDL(Ruby
Hardware Description Language) etc., VHDL (Very-High-Speed is most generally used at present
Integrated Circuit Hardware Description Language) and Verilog.Those skilled in the art also answer
This understands, it is only necessary to method flow slightly programming in logic and is programmed into integrated circuit with above-mentioned several hardware description languages,
The hardware circuit for realizing the logical method process can be readily available.
Controller can be implemented in any suitable manner, for example, controller can take such as microprocessor or processing
The computer for the computer readable program code (such as software or firmware) that device and storage can be executed by (micro-) processor can
Read medium, logic gate, switch, specific integrated circuit (Application Specific Integrated Circuit,
ASIC), the form of programmable logic controller (PLC) and insertion microcontroller, the example of controller includes but is not limited to following microcontroller
Device: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20 and Silicone Labs C8051F320 are deposited
Memory controller is also implemented as a part of the control logic of memory.It is also known in the art that in addition to
Pure computer readable program code mode is realized other than controller, can be made completely by the way that method and step is carried out programming in logic
Controller is obtained to come in fact in the form of logic gate, switch, specific integrated circuit, programmable logic controller (PLC) and insertion microcontroller etc.
Existing identical function.Therefore this controller is considered a kind of hardware component, and to including for realizing various in it
The device of function can also be considered as the structure in hardware component.Or even, it can will be regarded for realizing the device of various functions
For either the software module of implementation method can be the structure in hardware component again.
System, device, module or the unit that above-described embodiment illustrates can specifically realize by computer chip or entity,
Or it is realized by the product with certain function.It is a kind of typically to realize that equipment is computer.Specifically, computer for example may be used
Think personal computer, laptop computer, cellular phone, camera phone, smart phone, personal digital assistant, media play
It is any in device, navigation equipment, electronic mail equipment, game console, tablet computer, wearable device or these equipment
The combination of equipment.
For convenience of description, it is divided into various units when description apparatus above with function to describe respectively.Certainly, implementing this
The function of each unit can be realized in the same or multiple software and or hardware when application.
It should be understood by those skilled in the art that, the embodiment of the present invention can provide as method, system or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the present invention
Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the present invention, which can be used in one or more,
The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces
The form of product.
The present invention be referring to according to the method for the embodiment of the present invention, the process of equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions
The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs
Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real
The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates,
Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or
The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one
The step of function of being specified in a box or multiple boxes.
In a typical configuration, calculating equipment includes one or more processors (CPU), input/output interface, net
Network interface and memory.
Memory may include the non-volatile memory in computer-readable medium, random access memory (RAM) and/or
The forms such as Nonvolatile memory, such as read-only memory (ROM) or flash memory (flash RAM).Memory is computer-readable medium
Example.
Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be by any method
Or technology come realize information store.Information can be computer readable instructions, data structure, the module of program or other data.
The example of the storage medium of computer includes, but are not limited to phase change memory (PRAM), static random access memory (SRAM), moves
State random access memory (DRAM), other kinds of random access memory (RAM), read-only memory (ROM), electric erasable
Programmable read only memory (EEPROM), flash memory or other memory techniques, read-only disc read only memory (CD-ROM) (CD-ROM),
Digital versatile disc (DVD) or other optical storage, magnetic cassettes, tape magnetic disk storage or other magnetic storage devices
Or any other non-transmission medium, can be used for storage can be accessed by a computing device information.As defined in this article, it calculates
Machine readable medium does not include temporary computer readable media (transitory media), such as the data-signal and carrier wave of modulation.
It should also be noted that, the terms "include", "comprise" or its any other variant are intended to nonexcludability
It include so that the process, method, commodity or the equipment that include a series of elements not only include those elements, but also to wrap
Include other elements that are not explicitly listed, or further include for this process, method, commodity or equipment intrinsic want
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including described want
There is also other identical elements in the process, method of element, commodity or equipment.
It will be understood by those skilled in the art that embodiments herein can provide as method, system or computer program product.
Therefore, complete hardware embodiment, complete software embodiment or embodiment combining software and hardware aspects can be used in the application
Form.It is deposited moreover, the application can be used to can be used in the computer that one or more wherein includes computer usable program code
The shape for the computer program product implemented on storage media (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.)
Formula.
The application can describe in the general context of computer-executable instructions executed by a computer, such as program
Module.Generally, program module includes routines performing specific tasks or implementing specific abstract data types, programs, objects, group
Part, data structure etc..The application can also be practiced in a distributed computing environment, in these distributed computing environments, by
Task is executed by the connected remote processing devices of communication network.In a distributed computing environment, program module can be with
In the local and remote computer storage media including storage equipment.
All the embodiments in this specification are described in a progressive manner, same and similar portion between each embodiment
Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Especially for system reality
For applying example, since it is substantially similar to the method embodiment, so being described relatively simple, related place is referring to embodiment of the method
Part explanation.
The above description is only an example of the present application, is not intended to limit this application.For those skilled in the art
For, various changes and changes are possible in this application.All any modifications made within the spirit and principles of the present application are equal
Replacement, improvement etc., should be included within the scope of the claims of this application.
Claims (10)
1. a kind of moving method of data, which is characterized in that the described method includes:
According to the capacity of storage equipment to be migrated in storage system, target migration equipment is added within the storage system to institute
It states storage system and carries out dilatation processing；
The storage equipment to be migrated is carried out that write operation is forbidden to handle, the data stored in the storage equipment to be migrated are moved
It moves on in the target migration equipment；
Remove the storage equipment to be migrated within the storage system to carry out capacity reducing processing to the storage system.
2. the method according to claim 1, wherein the data that will be stored in the storage equipment to be migrated
It moves in the target migration equipment, comprising:
It is equal according to scheduled load according to the storage space utilization of the storage equipment to be migrated and target migration equipment
Weighing apparatus rule determines the data to be migrated in the storage equipment to be migrated；
The Data Migration to be migrated to the target is migrated into equipment by the scheduled load balancing rule, and will be described
Down status subject to storage equipment setting to be migrated, controlling the storage equipment to be migrated will be surplus other than the data to be migrated
Remaining Data Migration to the target migrates equipment.
3. the method according to claim 1, wherein the storage equipment to be migrated and the target migrate equipment
Interface SATA storage device is configured for serial high-tech, mixing HYBRID stores equipment and solid-state hard disk SSD stores in equipment
Any two kinds.
4. according to the method described in claim 3, it is characterized in that, the method also includes:
It is revised as the label attribute information that the storage equipment to be migrated matches to migrate what equipment matched with the target
Label attribute information.
5. according to the method described in claim 2, it is characterized in that, described will be offline subject to the storage equipment setting to be migrated
Remaining data other than the data to be migrated is migrated to target migration and is set by state, the control storage equipment to be migrated
It is standby, comprising:
Successively according to the preset rack where storage to be migrated equipment described in the storage system, respectively by the preset rack
In the storage equipment to be migrated setting subject to down status, control the storage equipment to be migrated for the data to be migrated
Remaining data in addition migrates to the target and migrates equipment.
6. the method according to claim 1, wherein the storage equipment to be migrated is in the storage system
Meta data server or data storage server, wherein the meta data server is for managing the data storage server
The metadata of the data of middle storage.
7. according to the method described in claim 6, it is characterized in that, the storage equipment to be migrated includes in the storage system
Meta data server and data storage server, target migration equipment includes target metadata server and target data
Storage server,
Correspondingly, described to the storage equipment to be migrated carry out that write operation is forbidden to handle, it will be in the storage equipment to be migrated
The Data Migration of storage is into target migration equipment, comprising:
The meta data server is carried out write operation is forbidden to handle, the Data Migration stored in the meta data server is arrived
In the target metadata server；
The data storage server is carried out write operation is forbidden to handle, the data stored in the data storage server are moved
It moves on in the target data storage server.
8. a kind of moving apparatus of data, which is characterized in that described device includes:
Dilatation module adds target for the capacity according to storage equipment to be migrated in storage system within the storage system
Equipment is migrated to carry out dilatation processing to the storage system；
Data Migration module, for the storage equipment to be migrated carrying out that write operation is forbidden to handle, by the storage to be migrated
The Data Migration stored in equipment is into target migration equipment；
Capacity reducing module, for removing the storage equipment to be migrated within the storage system to contract to the storage system
Appearance processing.
9. device according to claim 8, which is characterized in that the Data Migration module, comprising:
Data determination unit to be migrated, for the memory space according to the storage equipment to be migrated and target migration equipment
Utilization rate determines the data to be migrated in the storage equipment to be migrated according to scheduled load balancing rule；
Data migration unit, for by the scheduled load balancing rule by the Data Migration to be migrated to the target
Equipment is migrated, and by down status subject to the storage equipment setting to be migrated, controlling the storage equipment to be migrated will be described
Remaining data other than data to be migrated migrates to the target and migrates equipment.
10. a kind of migration equipment of data, which is characterized in that the equipment includes:
Processor；And
It is arranged to the memory of storage computer executable instructions, the executable instruction makes the processing when executed
Device:
According to the capacity of storage equipment to be migrated in storage system, target migration equipment is added within the storage system to institute
It states storage system and carries out dilatation processing；
The storage equipment to be migrated is carried out that write operation is forbidden to handle, the data stored in the storage equipment to be migrated are moved
It moves on in the target migration equipment；
Remove the storage equipment to be migrated within the storage system to carry out capacity reducing processing to the storage system.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710713324.3A CN109407964A (en) | 2017-08-18 | 2017-08-18 | A kind of moving method of data, device and equipment |
| PCT/CN2018/098981 WO2019033949A1 (en) | 2017-08-18 | 2018-08-06 | Data migration method, apparatus and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710713324.3A CN109407964A (en) | 2017-08-18 | 2017-08-18 | A kind of moving method of data, device and equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109407964A true CN109407964A (en) | 2019-03-01 |
Family
ID=65361920
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710713324.3A Pending CN109407964A (en) | 2017-08-18 | 2017-08-18 | A kind of moving method of data, device and equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN109407964A (en) |
| WO (1) | WO2019033949A1 (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109918026A (en) * | 2019-03-14 | 2019-06-21 | 厦门大学嘉庚学院 | A kind of data distributing method and system based on vehicle-mounted storage |
| CN110069222A (en) * | 2019-04-30 | 2019-07-30 | 北京百度网讯科技有限公司 | Using data migration method, device, new storage system and medium |
| CN110535946A (en) * | 2019-08-30 | 2019-12-03 | 北京浪潮数据技术有限公司 | A kind of distributed memory system and data transmission method, device, equipment, medium |
| CN111399763A (en) * | 2019-12-24 | 2020-07-10 | 杭州海康威视系统技术有限公司 | Data storage method, device, system, equipment and storage medium |
| CN112583864A (en) * | 2019-09-27 | 2021-03-30 | 中国移动通信集团广东有限公司 | Data migration method and device |
| CN112667148A (en) * | 2020-11-30 | 2021-04-16 | 上海七牛信息技术有限公司 | Method and system for cluster storage data online migration |
| CN112817935A (en) * | 2021-01-22 | 2021-05-18 | 平安普惠企业管理有限公司 | Data processing method, device and equipment based on field type and storage medium |
| CN113515502A (en) * | 2021-07-14 | 2021-10-19 | 重庆度小满优扬科技有限公司 | Data migration method, device, equipment and storage medium |
| CN113553314A (en) * | 2021-07-16 | 2021-10-26 | 北京天融信网络安全技术有限公司 | Service processing method, device, equipment and medium of super-convergence system |
| CN114501057A (en) * | 2021-12-17 | 2022-05-13 | 阿里巴巴（中国）有限公司 | Data processing method, storage medium, processor and system |
| CN115454932A (en) * | 2022-09-16 | 2022-12-09 | 北京火山引擎科技有限公司 | Data processing method and device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103034664A (en) * | 2011-10-10 | 2013-04-10 | 上海盛霄云计算技术有限公司 | Method, system and device for controlling data migration of database |
| CN104615657A (en) * | 2014-12-31 | 2015-05-13 | 天津南大通用数据技术股份有限公司 | Expanding and shrinking method for distributed cluster with nodes supporting multiple data fragments |
| US9626246B1 (en) * | 2015-09-10 | 2017-04-18 | Datadirect Networks, Inc. | System and method for I/O optimized data migration between high performance computing entities and a data storage supported by a de-clustered raid (DCR)architecture with vertical execution of I/O commands |
| CN106777225A (en) * | 2016-12-26 | 2017-05-31 | 腾讯科技（深圳）有限公司 | The moving method and system of a kind of data |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6530004B1 (en) * | 2000-06-20 | 2003-03-04 | International Business Machines Corporation | Efficient fault-tolerant preservation of data integrity during dynamic RAID data migration |
| TWI334564B (en) * | 2007-02-14 | 2010-12-11 | Via Tech Inc | Data migration systems and methods for independent storage device expansion and adaptation |
| CN106302607B (en) * | 2015-06-05 | 2019-08-16 | 腾讯科技（深圳）有限公司 | Block storage system and method applied to cloud computing |
| CN105260376B (en) * | 2015-08-17 | 2018-08-14 | 北京京东尚科信息技术有限公司 | Method, apparatus and system for clustered node reducing and expansion |
| CN105607873A (en) * | 2015-12-23 | 2016-05-25 | 浪潮电子信息产业股份有限公司 | Method for carrying out LUN capacity expansion by using data migration |
| CN106843755B (en) * | 2017-01-04 | 2019-10-11 | 北京百度网讯科技有限公司 | Data balancing method and device for server cluster |
-
2017
- 2017-08-18 CN CN201710713324.3A patent/CN109407964A/en active Pending
-
2018
- 2018-08-06 WO PCT/CN2018/098981 patent/WO2019033949A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103034664A (en) * | 2011-10-10 | 2013-04-10 | 上海盛霄云计算技术有限公司 | Method, system and device for controlling data migration of database |
| CN104615657A (en) * | 2014-12-31 | 2015-05-13 | 天津南大通用数据技术股份有限公司 | Expanding and shrinking method for distributed cluster with nodes supporting multiple data fragments |
| US9626246B1 (en) * | 2015-09-10 | 2017-04-18 | Datadirect Networks, Inc. | System and method for I/O optimized data migration between high performance computing entities and a data storage supported by a de-clustered raid (DCR)architecture with vertical execution of I/O commands |
| CN106777225A (en) * | 2016-12-26 | 2017-05-31 | 腾讯科技（深圳）有限公司 | The moving method and system of a kind of data |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109918026B (en) * | 2019-03-14 | 2022-03-08 | 厦门大学嘉庚学院 | Data distribution method and system based on vehicle-mounted storage |
| CN109918026A (en) * | 2019-03-14 | 2019-06-21 | 厦门大学嘉庚学院 | A kind of data distributing method and system based on vehicle-mounted storage |
| CN110069222A (en) * | 2019-04-30 | 2019-07-30 | 北京百度网讯科技有限公司 | Using data migration method, device, new storage system and medium |
| CN110535946A (en) * | 2019-08-30 | 2019-12-03 | 北京浪潮数据技术有限公司 | A kind of distributed memory system and data transmission method, device, equipment, medium |
| CN112583864A (en) * | 2019-09-27 | 2021-03-30 | 中国移动通信集团广东有限公司 | Data migration method and device |
| CN111399763A (en) * | 2019-12-24 | 2020-07-10 | 杭州海康威视系统技术有限公司 | Data storage method, device, system, equipment and storage medium |
| CN111399763B (en) * | 2019-12-24 | 2023-05-16 | 杭州海康威视系统技术有限公司 | Method, device, system, equipment and storage medium for data storage |
| CN112667148A (en) * | 2020-11-30 | 2021-04-16 | 上海七牛信息技术有限公司 | Method and system for cluster storage data online migration |
| CN112817935A (en) * | 2021-01-22 | 2021-05-18 | 平安普惠企业管理有限公司 | Data processing method, device and equipment based on field type and storage medium |
| CN113515502A (en) * | 2021-07-14 | 2021-10-19 | 重庆度小满优扬科技有限公司 | Data migration method, device, equipment and storage medium |
| CN113515502B (en) * | 2021-07-14 | 2023-11-21 | 重庆度小满优扬科技有限公司 | Data migration method, device, equipment and storage medium |
| CN113553314A (en) * | 2021-07-16 | 2021-10-26 | 北京天融信网络安全技术有限公司 | Service processing method, device, equipment and medium of super-convergence system |
| CN114501057A (en) * | 2021-12-17 | 2022-05-13 | 阿里巴巴（中国）有限公司 | Data processing method, storage medium, processor and system |
| CN115454932A (en) * | 2022-09-16 | 2022-12-09 | 北京火山引擎科技有限公司 | Data processing method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019033949A1 (en) | 2019-02-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109407964A (en) | A kind of moving method of data, device and equipment | |
| CN110008262A (en) | A kind of data export method and device | |
| CN108228672A (en) | A kind of metadata migration method, apparatus, system and equipment | |
| CN103370691B (en) | Managing buffer overflow conditions | |
| CN108712454A (en) | A kind of document handling method, device and equipment | |
| CN110134668A (en) | Data migration method, device and equipment applied to block chain | |
| CN107577694A (en) | A kind of data processing method and equipment based on block chain | |
| CN110096528A (en) | The method, apparatus and system of formation sequence in a kind of distributed system | |
| CN108959341A (en) | A kind of method, device and equipment that data are synchronous | |
| CN110401700A (en) | Model loading method and system, control node and execution node | |
| CN104869140B (en) | The method of the data storage of multi-cluster system and control multi-cluster system | |
| CN109617829A (en) | A kind of processing method of service request data, apparatus and system | |
| CN109343956A (en) | A kind of operating system configuration method and device | |
| CN110033130A (en) | The monitoring method and device of abnormal traffic | |
| KR101859115B1 (en) | Virtual machine migration in a cloud fabric | |
| CN108268289A (en) | Method for parameter configuration, the apparatus and system of web applications | |
| CN109922298A (en) | Meeting room monitoring method and device | |
| CN109343793A (en) | Data migration method and device | |
| CN109284066A (en) | A kind of data processing method, device, equipment and system | |
| CN109739627A (en) | Dispatching method, electronic equipment and the medium of task | |
| CN107368367A (en) | Processing method, device and the electronic equipment of resource allocation | |
| CN107038058A (en) | A kind of code process method and device | |
| CN108390914A (en) | A kind of service update method and device, system | |
| CN108255471A (en) | A kind of system configuration item configuration device based on configuration external member, method and apparatus | |
| CN103927215A (en) | kvm virtual machine scheduling optimization method and system based on memory disk and SSD disk |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20210906 Address after: Room 508, floor 5, building 4, No. 699, Wangshang Road, Changhe street, Binjiang District, Hangzhou City, Zhejiang Province Applicant after: Alibaba (China) Co.,Ltd. Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands Applicant before: ALIBABA GROUP HOLDING Ltd. |
|
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20211228 Address after: 310000 No. 12, Zhuantang science and technology economic block, Xihu District, Hangzhou City, Zhejiang Province Applicant after: Aliyun Computing Co.,Ltd. Address before: 310000 room 508, 5th floor, building 4, No.699 Wangshang Road, Changhe street, Binjiang District, Hangzhou City, Zhejiang Province Applicant before: Alibaba (China) Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190301 |
|
| RJ01 | Rejection of invention patent application after publication |