CN105260264A - Snapshot implementation method and snapshot system - Google Patents
Snapshot implementation method and snapshot system Download PDFInfo
- Publication number
- CN105260264A CN105260264A CN201510612490.5A CN201510612490A CN105260264A CN 105260264 A CN105260264 A CN 105260264A CN 201510612490 A CN201510612490 A CN 201510612490A CN 105260264 A CN105260264 A CN 105260264A
- Authority
- CN
- China
- Prior art keywords
- data
- new
- block
- data block
- book
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention discloses a snapshot implementation method and a snapshot system. The snapshot implementation method comprises the following steps: when a user sends new IO (Input/Output) data to the snapshot system to utilize the new IO data to replace original IO data in a target data block, carrying out caching processing on the new IO data to obtain corresponding cache data; and when the snapshot system is under an idle state that no users read or write data, migrating the original IO data to a data volume, and migrating the cache data to the target data block. Obviously, when the new IO data is issued, the new IO data is firstly written into a cache so as to greatly shorten data latency time during the issuing of the new IO data and improve the issuing speed of the new IO data. Under the idle state, the original IO data is migrated to the data volume, and then, the cache data is migrated to the target data block so as to improve the write performance of a COW (Copy-On-Write) mechanism on the basis of guaranteeing the favorable write performance of the COW mechanism.
Description
Technical field
The present invention relates to technical field of data storage, particularly a kind of snapshot implementing method and fast photographic system.
Background technology
In field of storage, snapping technique is the important component part of storage server.By promoting the performance of snapping technique, the performance of whole fast photographic system effectively can be promoted, to meet the demand of user better.
At present, widely used snapping technique is COW mechanism (COW, i.e. CopyOnWrite, copy-on-write).The principal feature of COW mechanism is after having beaten snapshot to book, when there being new I/O data to issue, above-mentioned new I/O data can not be written in the specified data block of source book at once, but first copy the former I/O data of preserving in above-mentioned specified data block to book, newer I/O data is written to above-mentioned specified data block.Visible, utilize COW mechanism carry out data writing operation before need to carry out data copy operation, this obviously can reduce the write performance of data under COW mechanism, thus have impact on the overall performance of fast photographic system.Especially when needing to write a large amount of data, also just meaning and needing in advance to carry out a large amount of data copy operations, undoubtedly by greatly increasing the stand-by period before data write, reducing the data write performance of fast photographic system.
Summary of the invention
In view of this, the object of the present invention is to provide a kind of snapshot implementing method and fast photographic system, the problem that the write performance existed under solving common COW mechanism is poor, thus improve the overall performance of fast photographic system.Its concrete scheme is as follows:
A kind of snapshot implementing method, be applied to fast photographic system, described fast photographic system comprises source book and book, and described source book comprises N number of data block, and N is positive integer; Described method comprises:
When new I/O data is sent to described fast photographic system by user, when replacing the former I/O data in target data block to utilize described new I/O data, caching process is carried out to described new I/O data, obtains data cached accordingly, wherein, described target data block is the arbitrary data block in described source book;
When described fast photographic system is in the idle condition that no user reads and writes data, described former I/O data is migrated to described book, then data cachedly migrate to described target data block by described.
Preferably, described caching process is carried out to described new I/O data, obtains process data cached accordingly, specifically comprise:
Caching process is carried out to described new I/O data, obtains described data cached, and record the block message of described target data block.
Preferably, described described former I/O data is migrated to described book, then by the described data cached process migrating to described target data block, specifically comprises:
According to the block message of the described target data block recorded, in described source book, find described target data block, and the former I/O data of preserving in described target data block is migrated to described book, then data cachedly migrate to described target data block by described.
Preferably, described method also comprises:
Judging whether the utilization rate for storing described data cached storage space is greater than default utilization rate, if so, then generating corresponding information.
Preferably, described method also comprises:
When after the described information of generation, extension process is carried out to described storage space volume.
The invention also discloses a kind of fast photographic system, comprise source book and book, described source book comprises N number of data block, and N is positive integer; Described fast photographic system also comprises:
Buffer memory is rolled up, for new I/O data being sent to described fast photographic system as user, when replacing the former I/O data in target data block to utilize described new I/O data, caching process is carried out to described new I/O data, obtain data cached accordingly, wherein, described target data block is the arbitrary data block in described source book;
First data migration unit, during for being in idle condition that no user reads and writes data when described fast photographic system, migrates to described book by described former I/O data;
Second data migration unit, for after described former I/O data migrates to described book, data cachedly migrates to described target data block by described.
Preferably, described system also comprises:
Block message record cell, for carrying out caching process when described buffer memory volume to described new I/O data, obtain described data cached after, record the block message of described target data block.
Preferably, described first data migration unit, specifically for the block message of the described target data block according to described block message recording unit records, in described source book, find described target data block, and the former I/O data of preserving in described target data block is migrated to described book;
Described second data migration unit, specifically for after the former I/O data of preserving in described target data block is migrated to described book by described first data migration unit, data cachedly migrates to described target data block by described.
Preferably, described system also comprises:
Judging unit, for judging whether the utilization rate of the storage space that described buffer memory is rolled up is greater than default utilization rate, if so, then generates corresponding information.
Preferably, described system also comprises:
Buffer memory volume dilatation unit, for after described judging unit generates described information, carries out extension process to the capacity that described buffer memory is rolled up.
In the present invention, when new I/O data is sent to fast photographic system by user, during the former I/O data of replacing in target data block to utilize new I/O data, caching process is carried out to new I/O data, obtain data cached accordingly, wherein, target data block is the arbitrary data block in source book; When fast photographic system is in the idle condition that no user reads and writes data, former I/O data is migrated to book, then migrates to target data block by data cached.In visible the present invention, after new I/O data issues, can't be write direct new I/O data source book, but first by new I/O data write buffer memory, also namely first caching process is carried out to new I/O data, obtain data cached accordingly, and due to the process of new I/O data write buffer memory is not related to any data copy operation, thus the data latency time significantly reduced when new I/O data issues, improve the downloading speed of new I/O data, also namely improve the write performance of new I/O data.After new I/O data has issued, can when fast photographic system be in the idle condition that no user reads and writes data, former I/O data is migrated to book, then target data block is migrated to by data cached, thus make the present invention read on the basis of performance ensure that COW mechanism is good, improve the write performance of COW mechanism, and then improve the overall performance of fast photographic system.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is only embodiments of the invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to the accompanying drawing provided.
Fig. 1 is a kind of snapshot implementing method process flow diagram disclosed in the embodiment of the present invention;
Fig. 2 is a kind of fast photographic system structural representation disclosed in the embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
The embodiment of the invention discloses a kind of snapshot implementing method, be applied to fast photographic system, fast photographic system comprises source book and book, and source book comprises N number of data block, and N is positive integer; Shown in Figure 1, the method comprises:
Step S101: when new I/O data is sent to fast photographic system by user, during the former I/O data of replacing in target data block to utilize new I/O data, caching process is carried out to new I/O data, obtains data cached accordingly, wherein, target data block is the arbitrary data block in source book;
Step S102: when fast photographic system is in the idle condition that no user reads and writes data, former I/O data is migrated to book, then migrates to target data block by data cached.
In the embodiment of the present invention, when new I/O data is sent to fast photographic system by user, during the former I/O data of replacing in target data block to utilize new I/O data, caching process is carried out to new I/O data, obtain data cached accordingly, wherein, target data block is the arbitrary data block in source book; When fast photographic system is in the idle condition that no user reads and writes data, former I/O data is migrated to book, then migrates to target data block by data cached.
In the visible embodiment of the present invention, after new I/O data issues, can't be write direct new I/O data source book, but first by new I/O data write buffer memory, also namely first caching process is carried out to new I/O data, obtain data cached accordingly, and due to the process of new I/O data write buffer memory is not related to any data copy operation, thus the data latency time significantly reduced when new I/O data issues, improve the downloading speed of new I/O data, also namely improve the write performance of new I/O data.After new I/O data has issued, can when fast photographic system be in the idle condition that no user reads and writes data, former I/O data is migrated to book, then target data block is migrated to by data cached, thus make the embodiment of the present invention read on the basis of performance ensure that COW mechanism is good, improve the write performance of COW mechanism, and then improve the overall performance of fast photographic system.
The embodiment of the invention discloses a kind of concrete snapshot implementing method, relative to a upper embodiment, the present embodiment has done further instruction and optimization to technical scheme.Concrete:
In a upper embodiment step S101, caching process is carried out to new I/O data, obtain process data cached accordingly, specifically comprise: caching process is carried out to new I/O data, obtain data cached, and the block message of record object data block.Be understandable that, the block message of target data block comprises block number, certainly can also comprise the information such as block capacity.
Further, in a upper embodiment step S102, former I/O data is migrated to book, then by the data cached process migrating to target data block, specifically comprise: according to the block message of the target data block recorded, target data block is found in source book, and the former I/O data of preserving in target data block is migrated to book, then migrate to target data block by data cached.
In addition, disclosed in the present embodiment, method can further include: judge whether the utilization rate of the storage space being used for memory buffers data is greater than default utilization rate, if so, then generates corresponding information.When after generation information, extension process can be carried out to the capacity of storage space.
The embodiment of the invention also discloses a kind of fast photographic system, shown in Figure 2, this fast photographic system comprises source book 21 and book 22, and source book 21 comprises N number of data block, and N is positive integer; Further, this fast photographic system also comprises:
Buffer memory volume 23, for new I/O data being sent to fast photographic system as user, during the former I/O data of replacing in target data block to utilize new I/O data, caching process is carried out to new I/O data, obtain data cached accordingly, wherein, target data block is the arbitrary data block in source book 21;
First data migration unit 24, during for being in idle condition that no user reads and writes data when fast photographic system, migrates to book 22 by former I/O data;
Second data migration unit 25, for after former I/O data migrates to book 22, migrates to target data block by data cached.
It is pointed out that fast photographic system disclosed in the present embodiment can also comprise block message record cell, for 23 carrying out caching process to new I/O data when buffer memory volume, obtain data cached after, the block message of record object data block.Be understandable that, the block message of target data block comprises block number, certainly can also comprise the information such as block capacity.
In addition, in the present embodiment, the first data migration unit 24 specifically may be used for the block message of the target data block according to block message recording unit records, in source book 21, find target data block, and the former I/O data of preserving in target data block is migrated to book 22; Second data migration unit 25 specifically may be used for, after the former I/O data of preserving in target data block is migrated to book 22 by the first data migration unit 24, migrating to target data block by data cached.
System in the present embodiment can further include judging unit and buffer memory volume dilatation unit, and wherein, whether the utilization rate that judging unit can be used for the storage space judging buffer memory volume 23 is greater than default utilization rate, if so, then generates corresponding information; Buffer memory volume dilatation unit can be used for after judging unit generates information, carries out extension process to the capacity of buffer memory volume 23.
In the embodiment of the present invention, buffer memory volume is used for, as user, new I/O data is sent to fast photographic system, during the former I/O data of replacing in target data block to utilize new I/O data, caching process is carried out to new I/O data, obtain data cached accordingly, wherein, target data block is the arbitrary data block in source book; When fast photographic system is in the idle condition that no user reads and writes data, the first data migration unit is used for former I/O data to migrate to book, and the second data migration unit is then for migrating to target data block by data cached.
In the visible embodiment of the present invention, after new I/O data issues, can't be write direct new I/O data source book, but first by new I/O data write buffer memory volume, also namely first caching process is carried out to new I/O data, obtain data cached accordingly, and due to the process of new I/O data write buffer memory is not related to any data copy operation, thus the data latency time significantly reduced when new I/O data issues, improve the downloading speed of new I/O data, also namely improve the write performance of new I/O data.After new I/O data has issued, can when fast photographic system be in the idle condition that no user reads and writes data, utilize the first data migration unit and the second data migration unit respectively, former I/O data is migrated to book, then target data block is migrated to by data cached, thus make the embodiment of the present invention read on the basis of performance ensure that COW mechanism is good, improve the write performance of COW mechanism, and then improve the overall performance of fast photographic system.
Finally, also it should be noted that, in this article, the such as relational terms of first and second grades and so on is only used for an entity or operation to separate with another entity or operational zone, and not necessarily requires or imply the relation that there is any this reality between these entities or operation or sequentially.And, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thus make to comprise the process of a series of key element, method, article or equipment and not only comprise those key elements, but also comprise other key elements clearly do not listed, or also comprise by the intrinsic key element of this process, method, article or equipment.When not more restrictions, the key element limited by statement " comprising ... ", and be not precluded within process, method, article or the equipment comprising described key element and also there is other identical element.
Above a kind of snapshot implementing method provided by the present invention and fast photographic system are described in detail, apply specific case herein to set forth principle of the present invention and embodiment, the explanation of above embodiment just understands method of the present invention and core concept thereof for helping; Meanwhile, for one of ordinary skill in the art, according to thought of the present invention, all will change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention.
Claims (10)
1. a snapshot implementing method, is characterized in that, is applied to fast photographic system, and described fast photographic system comprises source book and book, and described source book comprises N number of data block, and N is positive integer; Described method comprises:
When new I/O data is sent to described fast photographic system by user, when replacing the former I/O data in target data block to utilize described new I/O data, caching process is carried out to described new I/O data, obtains data cached accordingly, wherein, described target data block is the arbitrary data block in described source book;
When described fast photographic system is in the idle condition that no user reads and writes data, described former I/O data is migrated to described book, then data cachedly migrate to described target data block by described.
2. snapshot implementing method according to claim 1, is characterized in that, describedly carries out caching process to described new I/O data, obtains process data cached accordingly, specifically comprises:
Caching process is carried out to described new I/O data, obtains described data cached, and record the block message of described target data block.
3. snapshot implementing method according to claim 2, is characterized in that, described described former I/O data is migrated to described book, then by the described data cached process migrating to described target data block, specifically comprises:
According to the block message of the described target data block recorded, in described source book, find described target data block, and the former I/O data of preserving in described target data block is migrated to described book, then data cachedly migrate to described target data block by described.
4. the snapshot implementing method according to any one of claims 1 to 3, is characterized in that, also comprises:
Judging whether the utilization rate for storing described data cached storage space is greater than default utilization rate, if so, then generating corresponding information.
5. snapshot implementing method according to claim 4, is characterized in that, also comprises:
When after the described information of generation, extension process is carried out to the capacity of described storage space.
6. a fast photographic system, is characterized in that, comprises source book and book, and described source book comprises N number of data block, and N is positive integer; Described fast photographic system also comprises:
Buffer memory is rolled up, for new I/O data being sent to described fast photographic system as user, when replacing the former I/O data in target data block to utilize described new I/O data, caching process is carried out to described new I/O data, obtain data cached accordingly, wherein, described target data block is the arbitrary data block in described source book;
First data migration unit, during for being in idle condition that no user reads and writes data when described fast photographic system, migrates to described book by described former I/O data;
Second data migration unit, for after described former I/O data migrates to described book, data cachedly migrates to described target data block by described.
7. fast photographic system according to claim 6, is characterized in that, also comprises:
Block message record cell, for carrying out caching process when described buffer memory volume to described new I/O data, obtain described data cached after, record the block message of described target data block.
8. fast photographic system according to claim 7, is characterized in that,
Described first data migration unit, specifically for the block message of the described target data block according to described block message recording unit records, in described source book, find described target data block, and the former I/O data of preserving in described target data block is migrated to described book;
Described second data migration unit, specifically for after the former I/O data of preserving in described target data block is migrated to described book by described first data migration unit, data cachedly migrates to described target data block by described.
9. the fast photographic system according to any one of claim 6 to 8, is characterized in that, also comprises:
Judging unit, for judging whether the utilization rate of the storage space that described buffer memory is rolled up is greater than default utilization rate, if so, then generates corresponding information.
10. fast photographic system according to claim 9, is characterized in that, also comprises:
Buffer memory volume dilatation unit, for after described judging unit generates described information, carries out extension process to the capacity that described buffer memory is rolled up.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510612490.5A CN105260264A (en) | 2015-09-23 | 2015-09-23 | Snapshot implementation method and snapshot system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510612490.5A CN105260264A (en) | 2015-09-23 | 2015-09-23 | Snapshot implementation method and snapshot system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105260264A true CN105260264A (en) | 2016-01-20 |
Family
ID=55099964
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510612490.5A Pending CN105260264A (en) | 2015-09-23 | 2015-09-23 | Snapshot implementation method and snapshot system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105260264A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106598786A (en) * | 2016-12-30 | 2017-04-26 | 郑州云海信息技术有限公司 | Snapshot-storing copy-on-write processing system and method |
| CN110147296A (en) * | 2018-02-11 | 2019-08-20 | 华为技术有限公司 | Data processing method, device, equipment and readable storage medium storing program for executing |
| CN110941511A (en) * | 2019-11-21 | 2020-03-31 | 深信服科技股份有限公司 | Snapshot merging method, device, equipment and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1658168A (en) * | 2004-02-19 | 2005-08-24 | 华为技术有限公司 | Method for writing data on source film in pistolgraph process |
| CN101140542A (en) * | 2007-10-19 | 2008-03-12 | 华中科技大学 | Method for copying snapshot writing response time in the time of shortening writing time |
| CN101408854A (en) * | 2007-10-10 | 2009-04-15 | 英业达股份有限公司 | System and method for data backup of logical volume manager |
| CN101482838A (en) * | 2009-02-06 | 2009-07-15 | 杭州华三通信技术有限公司 | Data write-in method and apparatus based on copy-on-write |
| CN103631726A (en) * | 2013-11-28 | 2014-03-12 | 北京锐安科技有限公司 | File processing method and device of series-connection streaming computational nodes |
| CN103902593A (en) * | 2012-12-27 | 2014-07-02 | 中国移动通信集团河南有限公司 | Data transfer method and device |
| CN104331344A (en) * | 2014-11-11 | 2015-02-04 | 浪潮(北京)电子信息产业有限公司 | Data backup method and device |
| CN104407933A (en) * | 2014-10-31 | 2015-03-11 | 华为技术有限公司 | Data backup method and device |
-
2015
- 2015-09-23 CN CN201510612490.5A patent/CN105260264A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1658168A (en) * | 2004-02-19 | 2005-08-24 | 华为技术有限公司 | Method for writing data on source film in pistolgraph process |
| CN101408854A (en) * | 2007-10-10 | 2009-04-15 | 英业达股份有限公司 | System and method for data backup of logical volume manager |
| CN101140542A (en) * | 2007-10-19 | 2008-03-12 | 华中科技大学 | Method for copying snapshot writing response time in the time of shortening writing time |
| CN101482838A (en) * | 2009-02-06 | 2009-07-15 | 杭州华三通信技术有限公司 | Data write-in method and apparatus based on copy-on-write |
| CN103902593A (en) * | 2012-12-27 | 2014-07-02 | 中国移动通信集团河南有限公司 | Data transfer method and device |
| CN103631726A (en) * | 2013-11-28 | 2014-03-12 | 北京锐安科技有限公司 | File processing method and device of series-connection streaming computational nodes |
| CN104407933A (en) * | 2014-10-31 | 2015-03-11 | 华为技术有限公司 | Data backup method and device |
| CN104331344A (en) * | 2014-11-11 | 2015-02-04 | 浪潮(北京)电子信息产业有限公司 | Data backup method and device |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106598786A (en) * | 2016-12-30 | 2017-04-26 | 郑州云海信息技术有限公司 | Snapshot-storing copy-on-write processing system and method |
| CN106598786B (en) * | 2016-12-30 | 2020-02-07 | 郑州云海信息技术有限公司 | Storage snapshot copy-on-write processing system and method |
| CN110147296A (en) * | 2018-02-11 | 2019-08-20 | 华为技术有限公司 | Data processing method, device, equipment and readable storage medium storing program for executing |
| CN110147296B (en) * | 2018-02-11 | 2021-07-09 | 华为技术有限公司 | Data processing method, device, equipment and readable storage medium |
| CN110941511A (en) * | 2019-11-21 | 2020-03-31 | 深信服科技股份有限公司 | Snapshot merging method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102609360B (en) | Data processing method, data processing device and data processing system | |
| US9996542B2 (en) | Cache management in a computerized system | |
| CN103019888B (en) | Backup method and device | |
| CN103077121B (en) | The method of data management in a kind of flash memory device and device | |
| CN103034566B (en) | Method and device for restoring virtual machine | |
| CN102831072B (en) | Flash memory device and management method, data read-write method and read-write equipment | |
| CN104407933A (en) | Data backup method and device | |
| US10754785B2 (en) | Checkpointing for DRAM-less SSD | |
| CN103677653A (en) | Data processing method and electronic device based on solid state disk (SSD) | |
| CN107423425B (en) | Method for quickly storing and inquiring data in K/V format | |
| CN103229150B (en) | data control method and system | |
| CN105260264A (en) | Snapshot implementation method and snapshot system | |
| CN103514140B (en) | For realizing the reconfigurable controller of configuration information multi-emitting in reconfigurable system | |
| CN110019063A (en) | Method, terminal device and the storage medium of calculate node data disaster tolerance playback | |
| CN107193693A (en) | A kind of online data storage optimization method based on storage system | |
| CN104102552A (en) | Message processing method and device | |
| CN104408126B (en) | A kind of persistence wiring method of database, device and system | |
| CN103927215A (en) | kvm virtual machine scheduling optimization method and system based on memory disk and SSD disk | |
| CN103823634A (en) | Data processing method and system supporting non-random write mode | |
| CN102520879B (en) | Priority-based file information storage method, device and system | |
| CN105589912B (en) | A kind of method and storage organization using MRAM processing frequency written document | |
| CN109710547B (en) | Buffer memory management design and implementation method in industrial Internet of things | |
| CN103064762B (en) | Heavily delete restoration methods and the device of Backup Data | |
| CN106202262A (en) | A kind of information processing method and electronic equipment | |
| CN104332170A (en) | A storage device and a data storage method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160120 |