CN108170377A - It is a kind of that tape library is supported to drive the backup method concurrently write more - Google Patents
It is a kind of that tape library is supported to drive the backup method concurrently write more Download PDFInfo
- Publication number
- CN108170377A CN108170377A CN201711450059.0A CN201711450059A CN108170377A CN 108170377 A CN108170377 A CN 108170377A CN 201711450059 A CN201711450059 A CN 201711450059A CN 108170377 A CN108170377 A CN 108170377A
- Authority
- CN
- China
- Prior art keywords
- data
- write
- executor
- tape
- tape library
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
- G06F3/0613—Improving I/O performance in relation to throughput
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
- G06F3/0631—Configuration or reconfiguration of storage systems by allocating resources to storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
Abstract
Tape library is supported to drive the backup method concurrently write the present invention relates to a kind of more, included the following steps：(1) initialization tape library operation；(2) the identical quantity of tape library driver number generation selected according to step (1) writes data executor, each writes data executor and corresponds to a tape library driver；(3) data are handled, data are divided into data group and are written；(4) step (3) is continued to execute until the data that data source passes over all receive and process completion；(5) terminate backup, discharge resource.Compared with prior art, the present invention can substantially reduce data protection window time, promote Data Migration to the performance of tape.
Description
Technical field
The present invention relates to field of data storage, tape library are supported to drive the backup side concurrently write more particularly, to a kind of more
Method.
Background technology
With the continuous development of computer, data protection is also gradually being strengthened.The accumulation of a large amount of data has aggravated data
The pressure of storage.But it is constrained to close rule and some other factors, even if some data will not be made in a very long time
With these data are also required to be protected.It is a relatively good mode by these Data Migrations to tape.
The storage performance of tape library single driver is limited to hardware condition, and performance is extremely limited.A large amount of Data Migration
It will be limited by the drive performance bottleneck of tape library to tape, the backup window time caused to become very long, affects backup efficiency,
But also user can not faster, more timely carry out data protection.If there is a kind of method can be by data distribution to multiple tape libraries
Data writing operation is carried out at the same time on driver, then theoretically backup performance is institute in the case of there is no other performance bottlenecks
There is the summation of tape library drive performance.This method will greatly promote performance of the Data Migration to tape.
Invention content
It is an object of the present invention to overcome the above-mentioned drawbacks of the prior art and provide a kind of support tape library is more
Drive the backup method concurrently write, substantially reduce data protection window time, promote Data Migration to the performance of tape, so as to
Family more preferably faster can more timely carry out data protection.
The purpose of the present invention can be achieved through the following technical solutions：
It is a kind of that tape library is supported to drive the backup method concurrently write more, include the following steps：
(1) initialization tape library operation；
(2) the identical quantity of tape library driver number generation selected according to step (1) writes data executor, each writes
Data executor corresponds to a tape library driver；
(3) data are handled, data are divided into data group and are written；
(4) step (3) is continued to execute until the data that data source passes over all receive and process completion；
(5) terminate backup, discharge resource.
Preferably, the step (1) specifically includes following steps：
(1.1) selection participates in the tape library driver of backup；
(1.2) the tape library driver selected in step (1.1) is loaded into tape；
(1.3) tape loaded in step (1.2) is positioned to can writing position.
Preferably, the positioning action of the step (1.3) is asynchronous execution, the step (1.3) perform after after
The position that platform specifies asynchronous continuous positioning to step (1.3).
Preferably, the step (3) includes the following steps：
(3.1) data that data source passes over are received, by data according to the ratio of setting data volume and according to incoming
Sequence receive a part of data, which is defined as a data group；
(3.2) data group in step (3.1) is numbered successively, to ensure the sequence of data；
(3.3) writing of generating from the step (2) selects one writeable to write data executor in data executor；
(3.4) data group for the writing data executor storage information selected in processing step (3.3)；
(3.5) data component obtained in step (3.1) is dealt into selected in step (3.3) write data executor；
(3.6) it writes data executor and data group is organized into binary data according to the data format of setting；
(3.7) binary data obtained in step (3.6) is write data executor to correspond in tape library driver
The tape of loading.
Preferably, in the step (3.3) whether write data executor writeable, depending on tape whether positioned to
Can writing position, whether just in write data groups；
It has been positioned if the tape to writing position and can not just defining the shape for writing data executor if write data groups
State is writeable, and the state for writing data executor is not writeable during write data groups, after the completion of write data groups
The state for writing data executor is writeable.Write data executor can write state ensure that one to write data executor same
When be only possible to there are a data group, the state that data executor is write during write data groups is not writeable, and write data groups are complete
The state that data executor is write after is writeable.
Preferably, the data distribution operation of the step (3.5) is asynchronous execution, and the step (3.5) is by number
It is dealt into according to component and writes data executor and return.
Preferably, data group is organized into binary data by step (3.6) and passed through by the data executor of writing
Backstage, which is write, writes data into tape in thread, thread is write on the backstage can be lasting by incoming data write-in magnetic on backstage
Band, and the corresponding storage information of the data group is generated after completing to be written, the storage information includes tape label, starting material
Manage block position, data group size and data group attribute information.
Preferably, the step (3.4) includes the following steps：
The data executor of writing selected in (3.4.1) judgment step (3.3) whether there is the data group for having completed write operation,
If performing step (3.5) there is no if, otherwise continue to execute；
Data executor is corresponding to have completed depositing for write operation data group for writing of selecting in (3.4.2) obtaining step (3.3)
Store up information；
(3.4.3) stores the data group storage information obtained in step (3.4.2) according to the storage format of setting.
Preferably, the step (5) includes the following steps：
(5.1) select what is generated in a step (2) to write data executor successively；
(5.2) data executor of writing selected in judgment step (5.1) whether there is the data group for having completed write operation, if
There is no step (5.5) is then performed, otherwise continue to execute；
(5.3) the corresponding storage information for having completed write operation data group of data executor is write in obtaining step (5.2)；
(5.4) the data group storage information obtained in step (5.3) is stored according to the storage format of setting；
(5.5) step (5.1) is continued to execute until the data executor of writing generated in step (2) all selects；
(5.6) that closes the middle generation of step (2) writes data executor；
(5.7) the tape library driver selected in release steps (1.1).
Preferably, described data executor of writing is a kind of for data cached group and the form by data group according to setting
It is organized into binary data and the logic body of tape generation data group storage information is written, each described writes data executor
Write-in of the thread for data is write including a backstage.
The number of data group is unique in the present invention, and the purpose of number is to maintain the write sequence of data.In step 3.5
The number of middle data group can be write as data group is distributed together in data executor, at the same also can in step in 3.4.2 with
The storage information association of data group.
Compared with prior art, the present invention can will write in data distribution to multiple tape library drivers that data source is passed to
Enter, to realize the write performance that data are substantially improved, break through the write performance bottleneck of single tape library driver.This method energy product
Very effective help user faster, more timely complete data protection, so as to save more material resources people sheets and manpower people's sheet.
Description of the drawings
Fig. 1 is flow chart of the method for the present invention；
Fig. 2 is the flow chart that tape library operation is initialized in the step (1) of the present invention；
Fig. 3 is the flow chart that data are handled in the step (3) of the present invention；
Fig. 4 is the flow chart for terminating backup release resource in the step (5) of the present invention.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present invention, the technical solution in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is the part of the embodiment rather than whole embodiments of the present invention.Based on this hair
Embodiment in bright, the every other reality that those of ordinary skill in the art are obtained under the premise of creative work is not made
Example is applied, should all belong to the scope of protection of the invention.
The operating system that the example uses for 64 RedHat Enterprise 5, data use 10 file sizes for
The file of 1GB.Tape library use ULT3580-TD5, comprising 4 tape library drivers, 4 tapes, tape can writing position it is equal
It is 0.Data group is dimensioned to maximum 64MB, allows to be less than 64MB when remaining data source is less than 64MB.
As shown in Figs 1-4, which comprises the following steps：
(1) initialization tape library operation
(1.1) 4 tape library drivers are selected as the tape library driver for participating in backup, tape library actuator device road
Diameter be respectively/dev/nst0 ,/dev/nst1 ,/dev/nst2 ,/dev/nst3；
(1.2) 4 tape library drivers that step (1.1) selects are loaded into tape respectively, tape label is respectively
E01001L5、E01002L5、E01003L5、E01004L5；
(1.3) by the tape loaded in step (1.2) position to can writing position, each tape can writing position be 0.It should
It operates as asynchronous operation；
(2) 4 are generated and writes data executor, each write data executor and write thread comprising a backstage for data to be write
Enter tape；
(3) data are handled, data are divided into data group and are written；
(3.1) data of the file of 10 1GB are successively read and are passed to the data of reading as data source, data are pressed
Maximum 64MB data are received according to incoming sequence, which is defined as a data group；
(3.2) data group in step (3.1) is numbered successively, to ensure the sequence of data, number since 0 and
Uniquely；
(3.3) writing of generating from the step (2) selects one writeable to write data executor in data executor；
(3.4) data group for the writing data executor storage information selected in processing step (3.3)；
The data executor of writing selected in (3.4.1) judgment step (3.3) whether there is the data group for having completed write operation.
If performing step (3.5) there is no if, otherwise continue to execute；
Data executor is corresponding to have completed depositing for write operation data group for writing of selecting in (3.4.2) obtaining step (3.3)
Information is stored up, storage information includes tape label, data set number, starting physical storage locations, data group size, data group attribute
Etc. information；
(3.4.3) stores the data group storage information obtained in step (3.4.2) according to certain storage format；
(3.5) data executor is write by what the data component obtained in step (3.1) was dealt into step (3.3) selection, the behaviour
As asynchronous operation；
(3.6) it writes data executor and data group is organized into binary data according to certain data format；
(3.7) binary data obtained in step (3.6) is write into data executor by writing thread and corresponds to tape
The tape loaded in the driver of library；
(4) step (3) is continued to execute until the data that data source passes over all receive and process completion；
(5) terminate backup, discharge resource；
(5.1) select what is generated in a step (2) to write data executor successively；
(5.2) data executor of writing selected in judgment step (5.1) whether there is the data group for having completed write operation.If
There is no step (5.5) is then performed, otherwise continue to execute；
(5.3) the corresponding storage information for having completed write operation data group of data executor is write in obtaining step (5.2)；
(5.4) the data group storage information obtained in step (5.3) is stored according to certain storage format；
(5.5) step (5.1) is continued to execute until the data executor of writing generated in step (2) all selects；
(5.6) that closes the middle generation of step (2) writes data executor；
(5.7) the tape library driver selected in release steps (1.1)；
The above description is merely a specific embodiment, but protection scope of the present invention is not limited thereto, any
Those familiar with the art in the technical scope disclosed by the present invention, can readily occur in various equivalent modifications or replace
It changes, these modifications or substitutions should be covered by the protection scope of the present invention.Therefore, protection scope of the present invention should be with right
It is required that protection domain subject to.
Claims (10)
1. a kind of support tape library to drive the backup method concurrently write more, which is characterized in that includes the following steps：
(1) initialization tape library operation；
(2) the identical quantity of tape library driver number generation selected according to step (1) writes data executor, each writes data
Actuator corresponds to a tape library driver；
(3) data are handled, data are divided into data group and are written；
(4) step (3) is continued to execute until the data that data source passes over all receive and process completion；
(5) terminate backup, discharge resource.
A kind of tape library is supported to drive the backup method concurrently write 2. according to claim 1, which is characterized in that described more
The step of (1) specifically include following steps：
(1.1) selection participates in the tape library driver of backup；
(1.2) the tape library driver selected in step (1.1) is loaded into tape；
(1.3) tape loaded in step (1.2) is positioned to can writing position.
A kind of tape library is supported to drive the backup method concurrently write 3. according to claim 2, which is characterized in that described more
The step of (1.3) positioning action be asynchronous execution, the step (1.3) perform after backstage by asynchronous continuous positioning to walk
Suddenly the position that (1.3) are specified.
A kind of tape library is supported to drive the backup method concurrently write 4. according to claim 1, which is characterized in that described more
The step of (3) include the following steps：
(3.1) data that pass over of data source are received, by data according to the ratio of setting data volume and according to incoming suitable
Sequence receives a part of data, which is defined as a data group；
(3.2) data group in step (3.1) is numbered successively, to ensure the sequence of data；
(3.3) writing of generating from the step (2) selects one writeable to write data executor in data executor；
(3.4) data group for the writing data executor storage information selected in processing step (3.3)；
(3.5) data component obtained in step (3.1) is dealt into selected in step (3.3) write data executor；
(3.6) it writes data executor and data group is organized into binary data according to the data format of setting；
(3.7) it the binary data obtained in step (3.6) is write into data executor corresponds in tape library driver and load
Tape.
A kind of tape library is supported to drive the backup method concurrently write 5. according to claim 4, which is characterized in that described more
The step of (3.3) in whether write data executor writeable, depending on tape whether positioned to can writing position, whether writing
Data group；
It has been positioned if the tape to writing position and can not just defining the state for writing data executor if write data groups
To be writeable, the state for writing data executor is not writeable during write data groups, described after the completion of write data groups
The state for writing data executor to be writeable.
A kind of tape library is supported to drive the backup method concurrently write 6. according to claim 4, which is characterized in that described more
The step of (3.5) data distribution operation be asynchronous execution, the step (3.5) data component is dealt into writes data execution
Device returns.
A kind of tape library is supported to drive the backup method concurrently write 7. according to claim 4, which is characterized in that described more
Data executor of writing data group is organized into binary data and passes through backstage by step (3.6) writes in thread and write data
Enter tape, thread is write on the backstage can be lasting by incoming data write-in tape on backstage, and is generated after completing to be written
The corresponding storage information of the data group, the storage information include tape label, starting physical block locations, data group size and
Data group attribute information.
A kind of tape library is supported to drive the backup method concurrently write 8. according to claim 4, which is characterized in that described more
The step of (3.4) include the following steps：
The data executor of writing selected in (3.4.1) judgment step (3.3) whether there is the data group for having completed write operation, if not
In the presence of step (3.5) is then performed, otherwise continue to execute；
What is selected in (3.4.2) obtaining step (3.3) writes the corresponding storage letter for having completed write operation data group of data executor
Breath；
(3.4.3) stores the data group storage information obtained in step (3.4.2) according to the storage format of setting.
A kind of tape library is supported to drive the backup method concurrently write 9. according to claim 1, which is characterized in that described more
The step of (5) include the following steps：
(5.1) select what is generated in a step (2) to write data executor successively；
(5.2) data executor of writing selected in judgment step (5.1) whether there is the data group for having completed write operation, if not depositing
Step (5.5) is then being performed, is otherwise being continued to execute；
(5.3) the corresponding storage information for having completed write operation data group of data executor is write in obtaining step (5.2)；
(5.4) the data group storage information obtained in step (5.3) is stored according to the storage format of setting；
(5.5) step (5.1) is continued to execute until the data executor of writing generated in step (2) all selects；
(5.6) that closes the middle generation of step (2) writes data executor；
(5.7) the tape library driver selected in release steps (1.1).
A kind of tape library is supported to drive the backup method concurrently write 10. according to claim 1, which is characterized in that institute more
State write data executor be it is a kind of for data cached group and by data group according to the format organization of setting into binary data
And the logic body of tape generation data group storage information is written, each described writes data executor and writes line including a backstage
Journey is used for the write-in of data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711450059.0A CN108170377B (en) | 2017-12-27 | 2017-12-27 | Backup method for supporting multi-drive concurrent writing of tape library |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711450059.0A CN108170377B (en) | 2017-12-27 | 2017-12-27 | Backup method for supporting multi-drive concurrent writing of tape library |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108170377A true CN108170377A (en) | 2018-06-15 |
| CN108170377B CN108170377B (en) | 2022-04-01 |
Family
ID=62518813
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711450059.0A Active CN108170377B (en) | 2017-12-27 | 2017-12-27 | Backup method for supporting multi-drive concurrent writing of tape library |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108170377B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP4220418A1 (en) * | 2022-01-26 | 2023-08-02 | FUJIFILM Corporation | Information processing apparatus, information processing method, and information processing program |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101727291A (en) * | 2008-10-14 | 2010-06-09 | 北京众志和达信息技术有限公司 | System and method for embedded integrated virtual tape library |
| CN102541957A (en) * | 2010-12-30 | 2012-07-04 | 北大方正集团有限公司 | Method and device for operating data files on basis of data flow magnetic tapes |
| CN103164172A (en) * | 2013-03-11 | 2013-06-19 | 华为技术有限公司 | Data flow storage method and device |
| CN103713860A (en) * | 2014-01-03 | 2014-04-09 | 浪潮(北京)电子信息产业有限公司 | Method and system for building virtual disk base on basis of backup architecture |
| US20160162198A1 (en) * | 2012-05-31 | 2016-06-09 | Commvault Systems, Inc | Shared library in a data storage system |
| US20170161156A1 (en) * | 2014-01-18 | 2017-06-08 | International Business Machines Corporation | Storage Unit Replacement |
-
2017
- 2017-12-27 CN CN201711450059.0A patent/CN108170377B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101727291A (en) * | 2008-10-14 | 2010-06-09 | 北京众志和达信息技术有限公司 | System and method for embedded integrated virtual tape library |
| CN102541957A (en) * | 2010-12-30 | 2012-07-04 | 北大方正集团有限公司 | Method and device for operating data files on basis of data flow magnetic tapes |
| US20160162198A1 (en) * | 2012-05-31 | 2016-06-09 | Commvault Systems, Inc | Shared library in a data storage system |
| CN103164172A (en) * | 2013-03-11 | 2013-06-19 | 华为技术有限公司 | Data flow storage method and device |
| CN103713860A (en) * | 2014-01-03 | 2014-04-09 | 浪潮(北京)电子信息产业有限公司 | Method and system for building virtual disk base on basis of backup architecture |
| US20170161156A1 (en) * | 2014-01-18 | 2017-06-08 | International Business Machines Corporation | Storage Unit Replacement |
Non-Patent Citations (1)
| Title |
|---|
| 牛奎光: "THStoreMan海量层次存储系统的设计与物理存储的实现", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP4220418A1 (en) * | 2022-01-26 | 2023-08-02 | FUJIFILM Corporation | Information processing apparatus, information processing method, and information processing program |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108170377B (en) | 2022-04-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11669277B2 (en) | Latency-based scheduling of command processing in data storage devices | |
| CN104166606B (en) | File backup method and main storage device | |
| CN104050045B (en) | Virtual resource allocation method and device based on disk I/O | |
| CN104091617B (en) | Flash memory equipment detection method and apparatus thereof | |
| CN104965757B (en) | Method, virtual machine (vm) migration managing device and the system of live migration of virtual machine | |
| US6154852A (en) | Method and apparatus for data backup and recovery | |
| CN104866428B (en) | Data access method and data access device | |
| CN102096616B (en) | Logical object data duplication method and related device | |
| CN104899049B (en) | File deletion method and device | |
| CN106325758B (en) | A kind of queue storage space management method and device | |
| JP6060277B2 (en) | Disk array flash method and disk array flash apparatus | |
| CN102187317A (en) | Flashcopy handling | |
| CN104899218A (en) | Data reading and writing method and data reading and writing apparatus | |
| US8433871B2 (en) | Data copy management for faster reads | |
| CN106227621A (en) | The data back up method of logic-based volume management simplification volume and system | |
| CN108733321A (en) | Garbage collection-automaticdata is placed | |
| CN107544869A (en) | A kind of data reconstruction method and device | |
| CN107015888B (en) | A kind of data back up method and system based on submodule model | |
| CN109558213A (en) | The method and apparatus for managing the virtual machine snapshot of OpenStack platform | |
| CN110377529A (en) | A kind of method, apparatus and equipment of full flash memory storage system data management | |
| CN107220184B (en) | A kind of management method and device of LUN storage unit | |
| CN102122284B (en) | Compound document storage and read-write method and compound document storage and read-write device | |
| CN108170377A (en) | It is a kind of that tape library is supported to drive the backup method concurrently write more | |
| CN106254270A (en) | A kind of queue management method and device | |
| CN103164172B (en) | Data flow storage method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |