CN109086005A - A kind of method and device of data processing - Google Patents

A kind of method and device of data processing Download PDF

Info

Publication number
CN109086005A
CN109086005A CN201810798604.3A CN201810798604A CN109086005A CN 109086005 A CN109086005 A CN 109086005A CN 201810798604 A CN201810798604 A CN 201810798604A CN 109086005 A CN109086005 A CN 109086005A
Authority
CN
China
Prior art keywords
block number
transition state
data
storage region
evidence
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810798604.3A
Other languages
Chinese (zh)
Inventor
徐洪志
甄凤远
郭平加
王艳清
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhengzhou Yunhai Information Technology Co Ltd
Original Assignee
Zhengzhou Yunhai Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhengzhou Yunhai Information Technology Co Ltd filed Critical Zhengzhou Yunhai Information Technology Co Ltd
Priority to CN201810798604.3A priority Critical patent/CN109086005A/en
Publication of CN109086005A publication Critical patent/CN109086005A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604Improving or facilitating administration, e.g. storage management
    • G06F3/0607Improving or facilitating administration, e.g. storage management by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/0647Migration mechanisms
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

The embodiment of the present application discloses a kind of method and device of data processing, pending data is obtained from the first storage region, pending data is split, form multiple block number evidences, multiple block numbers are migrated according to from the first storage region to the second storage region, according to the transition state of block number evidence, to block number according to handling.Since pending data may include multiple block number evidences, and the transition state of multiple block number evidences is different, according to the transition state of block number evidence to block number according to handling, can be to avoid error in data is led to pending data progress migration operation and processing operation simultaneously in the prior art the problem of, therefore it will not influence the operation of related application, improve user experience.

Description

A kind of method and device of data processing
Technical field
This application involves computer field more particularly to a kind of method and devices of data processing.
Background technique
With the development of information technology, information storage means is also gradually diversified, and Network storage technology is come into being.Its In, Network storage technology can be divided into three kinds: Direct Attached Storage (Direct Attached Storage, DAS), memory block Domain network (Storage Area Network, SAN), network connection storage (Network Attached Storage, NAS).
In SAN storage equipment, there can be multiple resource pools (Pool), it, can be hard by adding in each resource pool Disk creates disk array (Redundant Arrays of Independent Disks, RAID), and wherein hard disk can be string Row advanced techniques interface (Serial Advanced Technology Attachment, SATA) hard disk, Serial Attached SCSI (SAS) (Serial Attached SCSI, SAS) and solid state hard disk (Solid State Drive, SSD) etc..It, can in disk array It to there is memory space for users to use, is indicated with logical unit number (Logical Unit Number, LUN), LUN again can be with It referred to as rolls up, can store data in LUN.
In the prior art, the case where being stored in data in LUN there may be migrations, for example, from a resource pool migrate to Another resource pool.While being migrated to data, if (Input) operation is written to the LUN of migration in host system And/or (Output) operation is read, the data after data and migration before may cause migration are inconsistent, even result in data mistake Accidentally, therefore, it will usually stop the operation of application relevant to the LUN of migration, to stop reading of the host system to migrating data It takes and write operation, will lead to some applications in this way and be not normally functioning, user is needed to wait the long period, certain crucial When using being not normally functioning, in some instances it may even be possible to will cause the economic loss of user, therefore, lead to poor user experience.
Summary of the invention
In order to solve in the prior art, the problem of stopping the operation of related application when Data Migration, lead to poor user experience, The embodiment of the present application provides a kind of data processing method and device.
The embodiment of the present application provides a kind of method of data processing, which comprises
Pending data is obtained from the first storage region;
The pending data is split, multiple block number evidences are formed;
The block number is migrated according to from first storage region to the second storage region;
According to the transition state of the block number evidence, to the block number according to handling.
Optionally, the transition state according to the block number evidence, to the block number according to handling, comprising:
If the transition state of the block number evidence is non-transition state, to the block number according to execution write operation;
If the transition state of the block number evidence is that will be stored in the write operation of the block number evidence just in transition state In caching;
If the transition state of the block number evidence is to complete transition state, to the block number according in second storage region In corresponding block number according to execute write operation.
Optionally, the transition state according to the block number evidence, to the block number according to handling, comprising:
If the transition state of the block number evidence is non-transition state or just in transition state, to the block number according to executing reading Extract operation;
If the transition state of the block number evidence is to complete transition state, to the block number according in second storage region In corresponding block number according to execute read operation.
Optionally, described that the pending data is split, form multiple block number evidences, comprising:
The pending data is split, multiple area's data are formed;
Each area's data are split, multiple block number evidences are formed.
Optionally, the transition state according to the block number evidence, to the block number according to handling, comprising:
Generation is identified with the block number according to corresponding migration, the migration of the migration mark and the block number evidence of the block number evidence State is related;
It is identified according to the migration of the block number evidence, to the block number according to handling.
Optionally, the method also includes:
Generate the corresponding migration mark of area's data, the migration shape of the migration mark and area's data of area's data State is related.
Optionally, the method also includes:
According to the corresponding transition state of area's data, the migration progress of the pending data is generated.
The embodiment of the present application also provides a kind of device of data processing, described device includes:
Data capture unit, for obtaining pending data from the first storage region;
Data split cells forms multiple block number evidences for splitting to the pending data;
Data migration unit, for migrating the block number according to from first storage region to the second storage region;
Data processing unit, for the transition state according to the block number evidence, to the block number according to handling.
Optionally, the data processing unit is specifically used for:
If the transition state of the block number evidence is non-transition state, to the block number according to execution write operation;
If the transition state of the block number evidence is that will be stored in the write operation of the block number evidence just in transition state In caching;
If the transition state of the block number evidence is to complete transition state, to the block number according in second storage region In corresponding block number according to execute write operation.
Optionally, the data processing unit is specifically used for:
If the transition state of the block number evidence is non-transition state or just in transition state, to the block number according to executing reading Extract operation;
If the transition state of the block number evidence is to complete transition state, to the block number according in second storage region In corresponding block number according to execute read operation.
Optionally, the data split cells, comprising:
First split cells forms multiple area's data for splitting to the pending data;
Second split cells forms multiple block number evidences for splitting to each area's data.
Optionally, the data processing unit, comprising:
First identifier generation unit is identified with the block number according to corresponding migration, the migration of the block number evidence for generating It identifies related to the transition state of the block number evidence;
Data processing subelement, for being identified according to the migration of the block number evidence, to the block number according to handling.
Optionally, described device further include:
Second identifier generation unit, for generating the corresponding migration mark of area's data, the migration mark of area's data Know related to the transition state of area's data.
Optionally, described device further include:
Progress generation unit, for generating moving for the pending data according to the corresponding transition state of area's data Shift-in degree.
The embodiment of the present application provides a kind of method and device of data processing, obtains from the first storage region to be processed Data split pending data, form multiple block number evidences, and multiple block numbers are stored according to from the first storage region to second Zone migration, according to the transition state of block number evidence, to block number according to handling.Since pending data may include multiple block numbers According to, and the transition state of multiple block number evidences is different, it, can be to avoid existing according to the transition state of block number evidence to block number according to handling There is the problem of error in data is caused to pending data progress migration operation and processing operation simultaneously in technology, therefore will not influence The operation of related application improves user experience.
Detailed description of the invention
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this The some embodiments recorded in application, for those of ordinary skill in the art, without creative efforts, It can also be obtained according to these attached drawings other attached drawings.
Fig. 1 is a kind of flow chart of the method for data processing provided by the embodiments of the present application;
Fig. 2 is a kind of fractionation schematic diagram of pending data provided by the embodiments of the present application;
Fig. 3 is a kind of data handling procedure schematic diagram provided by the embodiments of the present application;
Fig. 4 is a kind of structural block diagram of data processing equipment provided by the embodiments of the present application.
Specific embodiment
In order to make those skilled in the art more fully understand application scheme, below in conjunction in the embodiment of the present application Attached drawing, the technical scheme in the embodiment of the application is clearly and completely described, it is clear that described embodiment is only this Apply for a part of the embodiment, instead of all the embodiments.Based on the embodiment in the application, those of ordinary skill in the art exist Every other embodiment obtained under the premise of creative work is not made, shall fall in the protection scope of this application.
In the prior art, data can store in SAN storage equipment, in the use process of data, it may be desirable to Data in SAN storage equipment are migrated, data are migrated from the first storage region to the second storage region.To data into Row migration, it will usually when influencing the operation of application relevant to the data of migration, such as being migrated to data, if being deposited to first Data in storage area domain are written and/or are read (IO) operation, then the data in the first storage region have passed through modification, still Data corresponding with the data are not modified in second storage region, and the data in the second storage region are as subsequent use In the data of processing, that is to say, that use unmodified data as subsequent, be equivalent to the write-in failure of data.Cause This, can stop the operation of application relevant to migrating data, to the write-in of migrating data and read behaviour to avoid host system Make, will lead to some applications in this way and be not normally functioning, cause user experience poor.
In order to solve the above-mentioned technical problem, the embodiment of the present application provides a kind of method and device of data processing, from Obtain pending data in one storage region, pending data split, form multiple block number evidences, by multiple block numbers according to from First storage region is migrated to the second storage region, according to the transition state of block number evidence, to block number according to handling.Due to wait locate Managing data may include multiple block number evidences, and the transition state of multiple block number evidences is different, according to the transition state of block number evidence to block Data are handled, and can lead to data to avoid migration operation and processing operation is carried out to pending data simultaneously in the prior art The problem of mistake, therefore will not influence the operation of related application, improve user experience.
Referring to Fig. 1, which is a kind of flow chart of the method for data processing provided by the embodiments of the present application, and this method can be with Include the following steps.
S101 obtains pending data from the first storage region.
Since pending data is stored in the data in SAN equipment, the smallest storage unit can be block number evidence, to Processing data can store in LUN, will store the LUN of pending data as the first storage region, from the first storage region Middle acquisition pending data.
In the prior art, pending data can be migrated from the first storage region to the second storage region, is being migrated In the process, it will usually stop the operation of application relevant to pending data, to stop host system to the place of pending data Reason.
Processing to pending data can be host system in the operation of application program corresponding with pending data Pair Cheng Zhong is written new data to the storage region where pending data and/or executes read operation to pending data, i.e., Pending data carries out I O process.
S102 splits pending data, forms multiple block number evidences.
Pending data is stored in the data in SAN equipment, therefore pending data can be split to form multiple pieces Data.Specifically, can first split to pending data, multiple area's data are formed, the area Zai Dui data are split, and are formed Multiple block number evidences.
Splitting for pending data can be realized by be split to the storage region for storing pending data.It lifts For example, pending data is stored in LUN, refering to what is shown in Fig. 2, LUN is split as multiple memory blocks (Extent), Mei Gecun The data stored in storage area are area's data, then are split to the 4th memory block therein, and multiple memory blocks (Chunk) is formed, The data stored in each memory block are block number evidence.
In actual operation, the size of memory block can be determined by the resource pool of the memory block, it is generally the case that same The size of memory block in resource pool is identical.The size of memory block can be determined by predefining, such as can be 16MB, It can be other sizes, the size of the memory block of same memory block can be identical.It is understood that the size of memory block can be with It is the integral multiple of the size of memory block, becomes integer memory block uniformly to split memory block, for example, memory block is big Small when being 16MB, the size of memory block is the integral multiple of 16MB, such as can be 160MB, therefore the memory block can be split As 10 memory blocks.
S103 migrates block number according to from the first storage region to the second storage region.
In the embodiment of the present application, block number evidence can be migrated from the first storage region to the second storage region, multiple block numbers According to migration can be according to certain order, such as carried out according to the order of storage region, that is to say, that one wherein When block number is according to being migrated, other block numbers evidence is waiting to be migrated or is completing to migrate.
When it is implemented, the first storage region and the second storage region can be located in different resource pools, such as first Storage region is located in first resource pond, and the second storage region is located in Secondary resource pond;First storage region and the second storage Region can also be located at the different disk array in same resource pool, such as the first storage region can be in first resource pond First RAID, the second storage region can be the 2nd RAID in first resource pond.
It should be noted that the size phase of the memory block in the second storage region and the memory block in the first storage region Together, so that area's data in the first storage region can be migrated into the memory block of the second storage region.
In multiple block numbers according to migrating from the first storage region to the second storage region, the first storage region can also be carried out In block number evidence deletion, specifically, can area's data complete migration after, carry out area's data deletion.It, can when specific implementation To change the corresponding relationship of area's data and memory block.
S104, according to the transition state of block number evidence, to block number according to handling.
The transition state of block number evidence may include non-transition state, just in transition state and completion transition state etc., may be used also To include other transition states, such as the transition state that is near completion, transition state etc. will be carried out.Processing to block number evidence is led to It is that can specifically include and grasped to block number according to write-in is executed by the running come what is carried out according to relevant application to block number in normal situation Work and/or read operation.
When it is implemented, can be according to the transition state of block number evidence, to block number according to progress write operation.
It, can be to block number according to write operation is executed, due to block number evidence if the transition state of block number evidence is non-transition state Be stored in the first storage region, to the block number according to carry out write operation after, by the block Data Migration into the second storage region, Error in data or write-in failure are not will cause.Refering to what is shown in Fig. 3, the migration of the block number evidence in the region C in the first storage region State is non-transition state, then can be to the block number in the region C according to execution write operation.
If the transition state of block number evidence is that can will be stored in caching to the write operation of block number evidence just in transition state In, to block number according to completing to migrate, then the transition state of block number evidence is changed to complete transition state, can be to block number according to executing completion Write operation under transition state.Refering to what is shown in Fig. 3, the transition state of the block number evidence in B area in the first storage region is Just in transition state, then the write operation of the block number evidence in B area will can be stored in the buffer.
If the transition state of block number evidence be complete transition state, illustrated block data completed from the first storage region to The migration of second storage region, at this point, the data in the second storage region can be used as the subsequent data used.It therefore, can be with To the block number in the first storage region according to corresponding block number in corresponding second storage region according to execution write operation.For reality Existing data are consistent, can also be to the block number in the first storage region according to execution write operation.Refering to what is shown in Fig. 3, the first memory block The transition state of block number evidence in a-quadrant in domain is to complete transition state, then can be to the area A corresponding in the second storage region Block number in domain, can also be simultaneously to the block number in the a-quadrant in the first storage region according to executing write-in according to executing write operation Operation.
When it is implemented, can also be read according to the transition state of block number evidence to block number evidence.
If the transition state in block number evidence is non-transition state, just in transition state, can be in the first storage region Data execute read operation.Such as it can be to the block number in B area and the region C according to execution read operation.
If can be to complete according to the transition state to block number evidence when the transition state of block number evidence is to complete transition state Depending on write operation situation when transition state.Specifically, if the transition state of block number evidence is when completing transition state, only to the Corresponding block number, then at this time can be to the block number in the second storage region according to executing reading according to write operation is executed in two storage regions Operation;If the transition state of block number evidence is when completing transition state, while to the block number in the first storage region according to executing write-in Operation, then can be to the block number evidence in the first storage region and/or the block number in the second storage region according to execution read operation.
In the embodiment of the present application, in order to improve the efficiency of data processing, multiple block numbers can also deposited according to from first Before storage area domain is migrated to the second storage region, it is multiple block numbers according to corresponding bitmap is arranged, may include each in the bitmap Block number is identified according to corresponding migration, for embodying the transition state of each block number evidence.Specifically, by multiple block numbers according to from first Before storage region is migrated to the second storage region, the migration mark in the bitmap is the corresponding mark of non-transition state, example It such as can be 0, when to one of block number according to migrating, which is changed to migrating shape according to corresponding migration mark The corresponding mark of state, such as can be 1, after the block number is according to migration is completed, which has been changed to according to corresponding migration mark At the corresponding mark of transition state, such as it can be 2.
It is identified based on above-mentioned migration, can be specially basis to block number according to handling according to the transition state of block number evidence Block number is identified according to corresponding migration, to block number according to handling, is repeated no more to the processing of block number evidence.
In the embodiment of the present application, in order to improve the efficiency of data processing, multiple block numbers can also deposited according to from first Before storage area domain is migrated to the second storage region, corresponding bitmap is set for multiple area's data, may include each in the bitmap The corresponding migration mark of area's data, for embodying the transition state of each area's data.The migration mark of area's data can be according to block The transition state of data determines, for example, if the transition state of all block number evidences in area's data is to complete transition state, The transition state of the area Ze Gai data is to complete transition state, and corresponding migration mark can be 0, if existing in area's data not complete At the block number evidence of transition state, then the transition state of the data is not complete transition state, and corresponding migration mark can be 1.
In the embodiment of the present application, it in order to improve user experience, can also be generated according to the transition state of area's data wait locate The migration progress for managing data, is checked for user.Specifically, can identify according to the corresponding migration of area's data, number to be processed is generated According to migration progress, such as can by calculate be completed transition state area's data quantity and area's data total quantity ratio Value, to obtain the migration progress of pending data.
The embodiment of the present application provides a kind of method of data processing, obtains pending data from the first storage region, Pending data is split, multiple block number evidences are formed, by multiple block numbers according to from the first storage region to the second storage region Migration, according to the transition state of block number evidence, to block number according to handling.Since pending data may include multiple block number evidences, And the transition state of multiple block number evidences is different, it, can be to avoid existing according to the transition state of block number evidence to block number according to handling The problem of error in data is caused to pending data progress migration operation and processing operation simultaneously in technology, therefore will not influence phase The operation of application is closed, user experience is improved.
Method based on a kind of data processing that above embodiments provide, the embodiment of the present application also provides at a kind of data Its working principle is described in detail with reference to the accompanying drawing in the device of reason.
Referring to fig. 4, which is a kind of structural block diagram of the device of data processing provided by the embodiments of the present application, the device packet It includes:
Data capture unit 110, for obtaining pending data from the first storage region;
Data split cells 120 forms multiple block number evidences for splitting to the pending data;
Data migration unit 130, for migrating the block number according to from first storage region to the second storage region;
Data processing unit 140, for the transition state according to the block number evidence, to the block number according to handling.
Optionally, the data processing unit is specifically used for:
If the transition state of the block number evidence is non-transition state, to the block number according to execution write operation;
If the transition state of the block number evidence is that will be stored in the write operation of the block number evidence just in transition state In caching;
If the transition state of the block number evidence is to complete transition state, to the block number according in second storage region In corresponding block number according to execute write operation.
Optionally, the data processing unit is specifically used for:
If the transition state of the block number evidence is non-transition state or just in transition state, to the block number according to executing reading Extract operation;
If the transition state of the block number evidence is to complete transition state, to the block number according in second storage region In corresponding block number according to execute read operation.
Optionally, the data split cells, comprising:
First split cells forms multiple area's data for splitting to the pending data;
Second split cells forms multiple block number evidences for splitting to each area's data.
Optionally, the data processing unit, comprising:
First identifier generation unit is identified with the block number according to corresponding migration, the migration of the block number evidence for generating It identifies related to the transition state of the block number evidence;
Data processing subelement, for being identified according to the migration of the block number evidence, to the block number according to handling.
Optionally, described device further include:
Second identifier generation unit, for generating the corresponding migration mark of area's data, the migration mark of area's data Know related to the transition state of area's data.
Optionally, described device further include:
Progress generation unit, for generating moving for the pending data according to the corresponding transition state of area's data Shift-in degree.
The embodiment of the present application provides a kind of method of data processing, obtains pending data from the first storage region, Pending data is split, multiple block number evidences are formed, by multiple block numbers according to from the first storage region to the second storage region Migration, according to the transition state of block number evidence, to block number according to handling.Since pending data may include multiple block number evidences, And the transition state of multiple block number evidences is different, it, can be to avoid existing according to the transition state of block number evidence to block number according to handling The problem of error in data is caused to pending data progress migration operation and processing operation simultaneously in technology, therefore will not influence phase The operation of application is closed, user experience is improved.
When introducing the element of various embodiments of the application, the article " one ", "one", " this " and " described " be intended to Indicate one or more elements.Word "include", "comprise" and " having " are all inclusive and mean in addition to listing Except element, there can also be other elements.
It should be noted that those of ordinary skill in the art will appreciate that realizing the whole in above method embodiment or portion Split flow is relevant hardware can be instructed to complete by computer program, and the program can be stored in a computer In read/write memory medium, the program is when being executed, it may include such as the process of above-mentioned each method embodiment.Wherein, the storage Medium can be magnetic disk, CD, read-only memory (Read-Only Memory, ROM) or random access memory (Random AccessMemory, RAM) etc..
All the embodiments in this specification are described in a progressive manner, same and similar portion between each embodiment Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Especially for device reality For applying example, since it is substantially similar to the method embodiment, so describing fairly simple, related place is referring to embodiment of the method Part explanation.The apparatus embodiments described above are merely exemplary, wherein described be used as separate part description Unit and module may or may not be physically separated.Furthermore it is also possible to select it according to the actual needs In some or all of unit and module achieve the purpose of the solution of this embodiment.Those of ordinary skill in the art are not paying In the case where creative work, it can understand and implement.
The above is only the specific embodiment of the application, it is noted that for the ordinary skill people of the art For member, under the premise of not departing from the application principle, several improvements and modifications can also be made, these improvements and modifications are also answered It is considered as the protection scope of the application.

Claims (14)

1. a kind of method of data processing, which is characterized in that the described method includes:
Pending data is obtained from the first storage region;
The pending data is split, multiple block number evidences are formed;
The block number is migrated according to from first storage region to the second storage region;
According to the transition state of the block number evidence, to the block number according to handling.
2. the method according to claim 1, wherein the transition state according to the block number evidence, to described Block number is according to being handled, comprising:
If the transition state of the block number evidence is non-transition state, to the block number according to execution write operation;
If the transition state of the block number evidence is that will be stored in caching to the write operation of the block number evidence just in transition state In;
If the transition state of the block number evidence is to complete transition state, to the block number according to right in second storage region The block number answered is according to execution write operation.
3. the method according to claim 1, wherein the transition state according to the block number evidence, to described Block number is according to being handled, comprising:
If the transition state of the block number evidence grasps the block number according to reading is executed for non-transition state or just in transition state Make;
If the transition state of the block number evidence is to complete transition state, to the block number according to right in second storage region The block number answered is according to execution read operation.
4. being formed more the method according to claim 1, wherein described split the pending data A block number evidence, comprising:
The pending data is split, multiple area's data are formed;
Each area's data are split, multiple block number evidences are formed.
5. the method according to claim 1, wherein the transition state according to the block number evidence, to described Block number is according to being handled, comprising:
Generation is identified with the block number according to corresponding migration, the transition state of the migration mark and the block number evidence of the block number evidence It is related;
It is identified according to the migration of the block number evidence, to the block number according to handling.
6. according to claim 1 to method described in 5 any one, which is characterized in that the method also includes:
Generate the corresponding migration mark of area's data, the transition state phase of the migration mark and area's data of area's data It closes.
7. according to claim 1 to method described in 5 any one, which is characterized in that the method also includes:
According to the corresponding transition state of area's data, the migration progress of the pending data is generated.
8. a kind of device of data processing, which is characterized in that described device includes:
Data capture unit, for obtaining pending data from the first storage region;
Data split cells forms multiple block number evidences for splitting to the pending data;
Data migration unit, for migrating the block number according to from first storage region to the second storage region;
Data processing unit, for the transition state according to the block number evidence, to the block number according to handling.
9. device according to claim 8, which is characterized in that the data processing unit is specifically used for:
If the transition state of the block number evidence is non-transition state, to the block number according to execution write operation;
If the transition state of the block number evidence is that will be stored in caching to the write operation of the block number evidence just in transition state In;
If the transition state of the block number evidence is to complete transition state, to the block number according to right in second storage region The block number answered is according to execution write operation.
10. device according to claim 8, which is characterized in that the data processing unit is specifically used for:
If the transition state of the block number evidence grasps the block number according to reading is executed for non-transition state or just in transition state Make;
If the transition state of the block number evidence is to complete transition state, to the block number according to right in second storage region The block number answered is according to execution read operation.
11. device according to claim 8, which is characterized in that the data split cells, comprising:
First split cells forms multiple area's data for splitting to the pending data;
Second split cells forms multiple block number evidences for splitting to each area's data.
12. device according to claim 8, which is characterized in that the data processing unit, comprising:
First identifier generation unit is identified with the block number according to corresponding migration for generating, the migration mark of the block number evidence It is related to the transition state of the block number evidence;
Data processing subelement, for being identified according to the migration of the block number evidence, to the block number according to handling.
13. according to device described in claim 8 to 12 any one, which is characterized in that described device further include:
Second identifier generation unit, for generating area's data corresponding migration mark, the migration mark of area's data with The transition state of area's data is related.
14. according to device described in claim 8 to 12 any one, which is characterized in that described device further include:
Progress generation unit, for generating migrating into for the pending data according to the corresponding transition state of area's data Degree.
CN201810798604.3A 2018-07-19 2018-07-19 A kind of method and device of data processing Pending CN109086005A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810798604.3A CN109086005A (en) 2018-07-19 2018-07-19 A kind of method and device of data processing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810798604.3A CN109086005A (en) 2018-07-19 2018-07-19 A kind of method and device of data processing

Publications (1)

Publication Number Publication Date
CN109086005A true CN109086005A (en) 2018-12-25

Family

ID=64838006

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810798604.3A Pending CN109086005A (en) 2018-07-19 2018-07-19 A kind of method and device of data processing

Country Status (1)

Country Link
CN (1) CN109086005A (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106445421A (en) * 2016-10-14 2017-02-22 郑州云海信息技术有限公司 Storage system data migration method and system
CN106648468A (en) * 2016-12-29 2017-05-10 郑州云海信息技术有限公司 Control method and system for IO request during data migration process
CN108268501A (en) * 2016-12-30 2018-07-10 中国移动通信集团北京有限公司 Method for processing business and device in a kind of online data transition process

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106445421A (en) * 2016-10-14 2017-02-22 郑州云海信息技术有限公司 Storage system data migration method and system
CN106648468A (en) * 2016-12-29 2017-05-10 郑州云海信息技术有限公司 Control method and system for IO request during data migration process
CN108268501A (en) * 2016-12-30 2018-07-10 中国移动通信集团北京有限公司 Method for processing business and device in a kind of online data transition process

Similar Documents

Publication Publication Date Title
US8423739B2 (en) Apparatus, system, and method for relocating logical array hot spots
Goda et al. The history of storage systems
US7395396B2 (en) Storage system and data relocation control device
JP4643395B2 (en) Storage system and data migration method
US10031703B1 (en) Extent-based tiering for virtual storage using full LUNs
US9274723B2 (en) Storage apparatus and its control method
US8527720B2 (en) Methods of capturing and naming dynamic storage tiering configurations to support data pre-staging
US8914340B2 (en) Apparatus, system, and method for relocating storage pool hot spots
US10719274B2 (en) Consistent replication of virtual computing instance data
US20080104349A1 (en) Computer system, data migration method and storage management server
CN103761053B (en) A kind of data processing method and device
US8984027B1 (en) Systems and methods for migrating files to tiered storage systems
JP4643597B2 (en) Storage system and data relocation control device
US9135262B2 (en) Systems and methods for parallel batch processing of write transactions
JP2008047156A (en) Storage system, and data rearrangement controller
CN102722340A (en) Data processing method, apparatus and system
CN106445421A (en) Storage system data migration method and system
US20200310644A1 (en) Division raid for disk array expansion
CN109388347A (en) A kind of data migration method and device
CN103488431A (en) Data-writing method and storage device
US8055835B2 (en) Apparatus, system, and method for migrating wear spots
Oe et al. On-The-Fly Automated Storage Tiering (OTF-AST)
CN109086005A (en) A kind of method and device of data processing
CN101876884A (en) Volume extension method of virtual hard disk
CN106469174B (en) Method for reading data and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20181225