WO2012120421A1 - Deleting relations between sources and space-efficient targets in multi-target architectures - Google Patents

Deleting relations between sources and space-efficient targets in multi-target architectures Download PDF

Info

Publication number
WO2012120421A1
WO2012120421A1 PCT/IB2012/050996 IB2012050996W WO2012120421A1 WO 2012120421 A1 WO2012120421 A1 WO 2012120421A1 IB 2012050996 W IB2012050996 W IB 2012050996W WO 2012120421 A1 WO2012120421 A1 WO 2012120421A1
Authority
WO
WIPO (PCT)
Prior art keywords
target
relation
data
sibling
volume
Prior art date
Application number
PCT/IB2012/050996
Other languages
French (fr)
Inventor
Rivka Mayraz Matosevich
Carol Santich Mellgren
Theresa Mary Brown
Lokesh Gupta
Michael Thomas Benhase
Original Assignee
International Business Machines Corporation
Ibm United Kingdom Limited
IBM Japan Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US13/043,409 external-priority patent/US20120233121A1/en
Priority claimed from US13/043,394 external-priority patent/US20120233416A1/en
Priority claimed from US13/043,398 external-priority patent/US8667237B2/en
Application filed by International Business Machines Corporation, Ibm United Kingdom Limited, IBM Japan Limited filed Critical International Business Machines Corporation
Priority to DE112012000604.6T priority Critical patent/DE112012000604T5/en
Priority to CN201280011948.6A priority patent/CN103415843B/en
Priority to JP2013557198A priority patent/JP6048976B2/en
Priority to GB1316907.3A priority patent/GB2502929B/en
Publication of WO2012120421A1 publication Critical patent/WO2012120421A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00Accessing, addressing or allocating within memory systems or architectures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061Improving I/O performance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629Configuration or reconfiguration of storage systems
    • G06F3/0631Configuration or reconfiguration of storage systems by allocating resources to storage systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629Configuration or reconfiguration of storage systems
    • G06F3/0635Configuration or reconfiguration of storage systems by changing the path, e.g. traffic rerouting, path reconfiguration
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Definitions

  • This invention relates to data replication, and more particularly to apparatus and methods for creating point-in-time copies of data while minimizing data duplication.
  • IBM FlashCopy may be used to generate nearly instantaneous point-in-time copies of logical volumes or datasets. Among other uses, these point-in-time copies may be used for disaster recovery and business continuity purposes.
  • IBM FlashCopy in particular creates a point-in-time copy by establishing a relation (or "mapping") between a source volume and a target volume. Once this relation is established, data may be read from either the source volume or target volume.
  • a target bit map associated with a target volume keeps track of which data tracks have actually been copied from the source volume to the target volume.
  • volumes may be arranged in a cascaded configuration such that certain volumes function as both targets and sources.
  • volumes may be arranged in a flat (or "multi- target”) configuration such that a source volume has relations with multiple target volumes.
  • I/O performance can be impacted significantly as the number of volumes increases in either a cascaded or multi-target configuration.
  • a write to a source volume may need to wait for data to be copied between various volumes in the cascade before the write can be performed.
  • the larger number of volumes in the cascade the larger number of copies that need to occur before data can be written to the source volume.
  • a write to a source volume may need to wait for data to be copied to each connected target before the write can be performed.
  • the larger number of volumes in the multi-target configuration the larger number of copies that need to occur before data can be written to the source volume. This can make a write to a source volume very slow.
  • current FlashCopy implementations typically only allow a limited number of targets in a multi-target configuration to keep the performance impact within an acceptable range.
  • the invention has been developed in response to the present state of the art and, in particular, in response to the problems and needs in the art that have not yet been fully solved by currently available methods. Accordingly, the invention has been developed to provide methods, apparatus, computer program product and computer program for deleting relations between sources and space-efficient targets in multi-target architectures. The features and advantages of the invention will become more fully apparent from the following description and appended claims, or may be learned by practice of the invention as set forth hereinafter.
  • a method for deleting a relation between a source and a target in a multi-target architecture includes a source and multiple space-efficient (SE) targets mapped thereto.
  • SE space-efficient
  • such a method includes initially identifying a relation for deletion from the multi-target
  • a space-efficient (SE) target associated with the relation is then identified.
  • a mapping structure maps data in logical tracks of the SE target to physical tracks of a repository.
  • the method identifies a sibling SE target that inherits data from the SE target. Once the SE target and the sibling SE target are identified, the method modifies the mapping structure such that the data in the physical tracks of the repository is mapped to the logical tracks of the sibling SE target.
  • the relation is then deleted between the source and the SE target.
  • the present invention provides a method for deleting a relation between a source and a space-efficient (SE) target in a multi-target architecture, the multi- target architecture comprising a source and a plurality of SE targets mapped thereto, the method comprising: identifying a first relation for deletion from a multi-target architecture; identifying a space-efficient (SE) target associated with the first relation, wherein a mapping structure maps data in logical tracks of the SE target to physical tracks of a repository;
  • the present invention provides a computer program product for deleting a relation between a source and a space-efficient (SE) target in a multi-target architecture, the multi-target architecture comprising a source and a plurality of SE targets mapped thereto, the computer program product comprising: a computer readable storage medium readable by a processing circuit and storing instructions for execution by the processing circuit for performing a method for performing the steps of the invention.
  • the present invention provides a computer program stored on a computer readable medium and loadable into the internal memory of a digital computer, comprising software code portions, when said program is run on a computer, for performing the steps of the invention.
  • the present invention provides an apparatus for deleting a relation between a source and a space-efficient (SE) target in a multi-target architecture, the multi-target architecture comprising a source and a plurality of SE targets mapped thereto, the apparatus comprising: an identify component for identifying a first relation for deletion from a multi-target architecture; the identify component further operable for identifying a space-efficient (SE) target associated with the first relation, wherein a mapping structure maps data in logical tracks of the SE target to physical tracks of a repository; the identify component further operable for identifying a sibling SE target that inherits data from the SE target; a modify component for modifying the mapping structure to map the data in the physical tracks of the repository to the logical tracks of the sibling SE target; and a delete component for deleting the first relation.
  • SE space-efficient
  • the present invention provides a method for performing a write to a target volume (target x) in a multi-target architecture, the multi-target architecture comprising a source volume and a plurality of target volumes mapped thereto, the method comprising: determining whether the target x has a closest older sibling (COS), wherein the COS is a target volume established just before the target x; determining whether a target bit map (TBM) for each of the target x and the COS are set; if the TBMs for both the COS and the target x are set, copying data from a higher source (HS) volume to the COS; if the TBM for the COS is set and the TBM for the target x is not set, copying the data from the target x to the COS; and performing the write to the target x.
  • COS closest older sibling
  • the present invention provides a method for performing a read on a target volume (target x) in a multi-target architecture, the multi-target architecture comprising a source volume and a plurality of target volumes mapped thereto, the method comprising: reading a target bit map (TBM) associated with the target x; determining whether the TBM is set; if the TBM is set, reading data from a higher source (HS) volume, wherein reading data from the HS volume comprises: finding the source volume associated with the target x; finding, by inspecting generation numbers (GNs) on the source volume, the next younger sibling relative to the target x; and reading the data from the next younger sibling if a TBM associated with the next younger sibling is not set.
  • TBM target bit map
  • HS higher source
  • the present invention provides a method for performing a write to a source volume in a multi-target architecture, the multi-target architecture comprising a source volume and a plurality of target volumes mapped thereto, the method comprising: copying data in a track of the source volume to a target volume (target x) mapped to the source volume; enabling at least one sibling target volume (sibling) mapped to the source volume to inherit the data from the target x; and performing a write to the track of the source volume.
  • the present invention provides a method for deleting a relation between a source and a target in a multi-target architecture, the multi-target architecture comprising a source and a plurality of targets mapped thereto, the method comprising:
  • identifying a first relation for deletion from a multi-target architecture identifying a target associated with the first relation; identifying a sibling target that inherits data from the target; copying the data from the target to the sibling target; and deleting the first relation.
  • Figure 1 is a high-level block diagram showing one example of a network architecture comprising various types of storage systems, in accordance with the prior art, and in which a preferred embodiment of the present invention may be implemented;
  • Figure 2 is a high-level block diagram showing one example of a storage system where a methodology, in accordance with the prior art, and in which a preferred embodiment of the present invention may be implemented;
  • Figure 3 is a high-level block diagram showing one example of a multi-target architecture comprising a source volume mapped to multiple target volumes, according to a preferred embodiment of the present invention
  • Figure 4 is a high-level block diagram showing one embodiment of a method for reading a track from a target volume, according to a preferred embodiment of the present invention
  • Figure 5 is a flow diagram showing one embodiment of a method for copying a data track in response to a write to a source volume, according to a preferred embodiment of the present invention
  • Figure 6 is a flow diagram showing one embodiment of a method for copying a data track in response to a write to a target volume, according to a preferred embodiment of the present invention
  • Figure 7 is a flow diagram showing one embodiment of a method for finding a higher source (HS) volume in response to a read to a volume, according to a preferred embodiment of the present invention
  • Figure 8 is a flow diagram showing one embodiment of a method for finding a higher source (HS) volume in response to a write to a volume, according to a preferred embodiment of the present invention
  • Figure 9 is a high-level diagram showing one example of a multi-target architecture showing the use of generation numbers, according to a preferred embodiment of the present invention.
  • Figures 10 and 11 are tables showing data and TBM values for the volumes illustrated in Figure 9 after various writes are made thereto, according to a preferred embodiment of the present invention
  • Figure 12A is a high-level block diagram showing the deletion of a relation between a source volume and a target volume, according to a preferred embodiment of the present invention
  • Figure 12B is a high-level block diagram showing the deletion of a relation between a source volume and a space-efficient (SE) target volume, according to a preferred embodiment of the present invention
  • Figure 13 is a high-level block diagram showing in-memory source and target relationship entries, according to a preferred embodiment of the present invention.
  • Figure 14 is a flow diagram showing one embodiment of a method for deleting a relation between a source and a SE target in a multi-target architecture, according to a preferred embodiment of the present invention
  • Figure 15 is a flow diagram showing one embodiment of a method for processing a deleted relation, according to a preferred embodiment of the present invention.
  • Figure 16 is a flow diagram showing another embodiment of a method for processing a deleted relation, according to a preferred embodiment of the present invention.
  • the present invention may be embodied as an apparatus, system, method, or computer program product.
  • the present invention may take the form of a hardware embodiment, a software embodiment (including firmware, resident software, micro-code, etc.) configured to operate hardware, or an embodiment combining software and hardware aspects that may all generally be referred to herein as a "module” or "system.”
  • the present invention may take the form of a computer-usable storage medium embodied in any tangible medium of expression having computer-usable program code stored therein.
  • the computer-usable or computer-readable storage medium may be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable storage medium may include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CDROM), an optical storage device, or a magnetic storage device.
  • a computer-usable or computer-readable storage medium may be any medium that can contain, store, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
  • Computer program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object-oriented programming language such as Java®, Smalltalk, C++, or the like, and conventional procedural programming languages, such as the "C" programming language or similar programming languages.
  • Computer program code for implementing the invention may also be written in a low-level programming language such as assembly language. The program code may execute entirely on the user's computer, partly on the user's computer, as a standalone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server.
  • the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
  • LAN local area network
  • WAN wide area network
  • Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates.
  • the computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means which implement the function/act specified in the flowchart and/or block diagram block or blocks.
  • the computer program instructions may also be loaded onto a computer or other
  • the network architecture 100 is presented to show one example of an environment where a point-in-time- copy methodology in accordance with the invention may be implemented.
  • the network architecture 100 is presented only by way of example and not limitation. Indeed, the methodology disclosed herein may be applicable to a wide variety of different computers, servers, storage devices, and network architectures, in addition to the network architecture 100 shown.
  • the network architecture 100 includes one or more computers 102, 106 interconnected by a network 104.
  • the network 104 may include, for example, a local-area- network (LAN) 104, a wide-area-network (WAN) 104, the Internet 104, an intranet 104, or the like.
  • the computers 102, 106 may include both client computers 102 and server computers 106 (also referred to herein as "host systems" 106). In general, the client computers 102 initiate communication sessions, whereas the server computers 106 wait for requests from the client computers 102.
  • the computers 102 and/or servers 106 may connect to one or more internal or external direct-attached storage systems 112 (e.g., arrays of hard-disk drives, solid-state drives, tape drives, etc.). These computers 102, 106 and direct-attached storage systems 112 may communicate using protocols such as ATA, SATA, SCSI, SAS, Fibre Channel, or the like. One or more of the storage systems 112 may utilize the point-in-time- copy methodology disclosed herein.
  • direct-attached storage systems 112 e.g., arrays of hard-disk drives, solid-state drives, tape drives, etc.
  • These computers 102, 106 and direct-attached storage systems 112 may communicate using protocols such as ATA, SATA, SCSI, SAS, Fibre Channel, or the like.
  • One or more of the storage systems 112 may utilize the point-in-time- copy methodology disclosed herein.
  • the network architecture 100 may, in certain embodiments, include a storage network 108 behind the servers 106, such as a storage-area-network (SAN) 108 or a LAN 108 (e.g., when using network-attached storage).
  • This network 108 may connect the servers 106 to one or more storage systems 110, such as arrays 110a of hard-disk drives or solid-state drives, tape libraries 110b, individual hard-disk drives 110c or solid-state drives 110c, tape drives 1 lOd, CD-ROM libraries, or the like.
  • a host system 106 may communicate over physical connections from one or more ports on the host 106 to one or more ports on the storage system 110.
  • a connection may be through a switch, fabric, direct connection, or the like.
  • the servers 106 and storage systems 110 may communicate using a networking standard such as Fibre Channel (FC).
  • FC Fibre Channel
  • One or more of the storage systems 110 may utilize the point- in-time-copy methodology disclosed herein.
  • the storage system 110b includes a storage controller 200, one or more switches 202, and one or more storage devices 204, such as hard disk drives 204 or solid-state drives 204 (such as flash-memory-based drives 204).
  • the storage controller 200 may enable one or more hosts 106 (e.g., open system and/or mainframe servers 106) to access data in the one or more storage devices 204.
  • the storage controller 200 includes one or more servers 206.
  • the storage controller 200 may also include host adapters 208 and device adapters 210 to connect the storage controller 200 to host devices 106 and storage devices 204, respectively.
  • Multiple servers 206a, 206b may provide redundancy to ensure that data is always available to connected hosts 106. Thus, when one server 206a fails, the other server 206b may pick up the I/O load of the failed server 206a to ensure that I/O is able to continue between the hosts 106 and the storage devices 204. This process may be referred to as a "failover.”
  • IBM DS8000® enterprise storage system One example of a storage system 110b having an architecture similar to that illustrated in Figure 2 is the IBM DS8000® enterprise storage system.
  • the IBM DS8000 is a high- performance, high-capacity storage controller providing disk storage that is designed to support continuous operations. Nevertheless, the methods disclosed herein are not limited to the IBM DS8000 enterprise storage system 110b, but may be implemented in any comparable or analogous storage system 110, regardless of the manufacturer, product name, or components or component names associated with the system 110. Furthermore, any storage system that could benefit from one or more preferred embodiments of the present invention is deemed to fall within the scope of the invention.
  • the IBM DS8000 is presented only by way of example and is not intended to be limiting. IBM, FlashCopy, DS8000 are trademarks of International Business Machines Corporation, registered in many jurisdictions worldwide.
  • each server 206 may include one or more processors 212 and memory 214.
  • the memory 214 may include volatile memory (e.g., RAM) as well as nonvolatile memory (e.g., ROM, EPROM, EEPROM, hard disks, flash memory, etc.).
  • volatile and non- volatile memory may, in certain embodiments, store software modules that run on the processor(s) 212 and are used to access data in the storage devices 204.
  • the servers 206 may host at least one instance of these software modules. These software modules may manage all read and write requests to logical volumes in the storage devices 204.
  • the memory 214 includes a cache 218.
  • a host 106 e.g., an open system or mainframe server 106
  • the server 206 that performs the read may fetch data from the storages devices 204 and save it in its cache 218 in the event it is needed again. If the data is requested again by a host 106, the server 206 may fetch the data from the cache 218 instead of fetching it from the storage devices 204, saving both time and resources.
  • the server 106 may store the write in its cache 218. The server 106 may then destage the write to the storage devices 204 as time and resources allow.
  • a multi-target architecture 300 for creating point-in- time copies is illustrated.
  • Such an architecture 300 may be implemented within a storage system 110, such as the storage system 110b illustrated in Figure 2.
  • the multi- target architecture 300 includes a source volume 302 and one or more target volumes 304a- d.
  • Each of the target volumes 304a-d contains a point-in-time copy of data in the source volume 302.
  • a point-in- time copy is created by establishing a relation (or "mapping") between a source volume 302 and a target volume 304.
  • a target bit map (TBM) 306 associated with a target volume 304 keeps track of which data tracks have actually been copied from the source volume 302 to the target volume 304. For example, a "0" in the TBM 306 may indicate that a data track has been copied (i.e., the target volume 304 has its own data), whereas a "1" may indicate that a data track has not yet been copied. In cases where the TBM 306 contains a "1," a read to a track on the target volume 306 may be directed to the corresponding track on the source volume 302.
  • a bit in a TBM 304 is said to be “set” if it contains a "1” and “reset” if it contains a "0,” although this could be reversed in other embodiments.
  • the source 302 and targets 304 are labeled as "volumes" in the illustrated embodiment, it should be recognized that the source 302 and targets 304 could also be datasets or other collections of data.
  • a write to a source volume 302 may need to wait for data in the source volume 302 to be copied (i.e., destaged) to each connected target volume 304a-d not containing its own data before the write can be completed to the source volume 302. That is, before a write is performed on a data track of the source volume 302, the existing data track needs to be copied to target volumes 304a-d that do not already contain the data track before the data track on the source volume 302 is overwritten.
  • an improved methodology in accordance with preferred embodiments of the present invention may be used reduce the performance impact of having multiple target volumes 304a-d mapped to a source volume 302. Instead of copying data to multiple targets 304a-d when a write is performed on the source volume 302, the improved methodology copies the data to a single target 304 or a subset of the targets 304.
  • An inheritance scheme then enables other targets 304 to inherit the data from the single target 304 or subset of targets 304 that contain the data. In this way, a write to a source volume 302 may only need to copy data to a single target 304 or a subset of the targets 304 before the write can be completed on the source volume 302.
  • the flow diagrams illustrated in Figures 4 through 8 show various specific examples of methods to implement such a methodology.
  • a method 400 for reading a track from a target volume 304 is illustrated.
  • the method 400 determines 402 whether the TBM of the target volume 304 is set. If the TBM is not set (indicating that the target volume 304 contains the requested data), the method 400 simply reads 406 the requested data track from the target volume 304. On the other hand, if the TBM is set (indicating that the target volume 304 does not contain the requested data), the method 400 finds 404 a higher source (HS) volume from which to read the data, and reads 404 from the HS volume.
  • HS higher source
  • One method 700 for finding the HS volume is described in association with Figure 7. For the purposes of this disclosure, the HS volume is the volume that contains the requested data and from which the target volume 304 inherits.
  • a method 500 for destaging a data track in response to a write to a source volume 302 is illustrated.
  • the method 500 initially finds 502 the youngest child (YC) of the source volume 302.
  • the YC is the target volume 304 that was last mapped to the source volume 302.
  • generation numbers may be used to determine the order in which target volumes 304 were added to the source volume 302 in order to generate point- in-time copies. The manner in which GNs are used to determine the order the targets 304 were mapped to the source volume 302 will be discussed in association with Figure 9.
  • the method 500 determines 504 whether the TBM of the YC is set. If the TBM is not set (indicating that the YC 304 contains its own copy of the data), the method 500 does nothing 508 since the YC 304 already has a copy of the data. On the other hand, if the TBM is set (indicating that the YC 304 does not contain its own copy of the data), the method 500 copies 506 the data from the source volume 302 to the YC 304. In this way, when a write occurs to the source volume 302, a single copy is made between the source volume 302 and the YC 304 as opposed to copying the data to all target volumes 304 not containing the data. The other target volumes 304 (not the YC 304) may then inherit this data from the YC 304, such as when a read is made to the other volumes 304 or when data is copied from the other volumes 304.
  • a method 600 for destaging a data track in response to a write to a target volume 304 is illustrated.
  • the method 600 initially determines 602 whether the TBMs for the target x 304 and the closest older sibling (COS) 304 are set for the track that is being written to.
  • the COS is the target volume 304 that was mapped just before the target x 304. If both of the TBMs are set (indicating that neither volume contains the data in the track being written to), the method 600 copies 604 the data track from the higher source (HS) volume to the COS 304.
  • HS higher source
  • the method 600 copies 608 the data track from the target x to the COS 304— i.e., the data track is destaged from the target x 304 to the COS 304.
  • the TBM of the COS is not set (indicating that the COS contains the data), or there is no COS, the method 600 does nothing 610 since no copy is needed. Once the end of the method 600 is reached, the write may be performed on the target x.
  • the methods 500, 600 described above could be modified in various ways without departing from the invention.
  • the youngest child (YC) could be replaced by the oldest child
  • the closest older sibling (COS) could be replaced by the closest younger sibling.
  • embodiments that utilize the YC and the COS are also deemed to encompass embodiments that utilize the oldest child and closest younger sibling.
  • Other variations are also possible and within the scope of the invention.
  • a method 700 for finding the HS volume for a read is illustrated. Such a method 700 may be used in association with step 404 of Figure 4. As shown, the method 700 initially determines 702 whether the volume being read is a target volume 304. If not, the method 700 reads 704 from the volume since it is a source volume 302. If the volume is a target volume 304, the method determines 706 whether the TBM of the volume is set. If the TBM is not set, the method 700 reads 704 from the volume 304. If the TBM of the volume is set, the method 700 finds 708 the source volume 302 associated with the target volume 304. The method 700 then finds 710 the next relation with a generation number (GN) just higher than that of the subject target volume 304.
  • GN generation number
  • the decision step 710 finds the relation on the source volume 302 that is just younger than the relation associated with the subject target volume 304 (as identified at step
  • the method 700 finds 714 the target 304 of this relation. If the TBM of this target 304 is set 716, the method 700 reads from the target 304. If the TBM of this target 304 is not set 716, the method 700 repeats steps 710, 714 to find the next younger target 304 and determine 716 whether its TBM is set. In this way, the method 700 traverses through the younger siblings of the target volume 304 identified at step 702 until the target volume
  • the method 700 reads 718 from the target 304. If no younger sibling target 304 containing the desired data is found, the method 700 simply reads 712 from the source volume 302. In this way, a target volume 304 is able to inherit data from a sibling 304 when a read is performed thereto.
  • a method 800 for finding the HS volume from which to copy data is illustrated.
  • Such a method 800 may be used in association with step 604 of Figure 6.
  • the method 800 initially determines 802 whether the volume being written to is a target volume 304. If not, no copy is required as reflected at step 804. If the volume is a target volume 304, the method determines 806 whether the TBM of the volume is set. If the TBM is not set, no copy is required. If the volume is a target volume 304 and the TBM of the volume is set, the method finds 808 the source volume 302 associated with the target volume 304. The method 800 then finds the next relation with a higher generation number (GN) in the manner previously discussed.
  • GN generation number
  • the method 800 finds 814 the target 304 of this relation, which is a sibling of the target 304 identified at step 802. If the TBM of this sibling target 304 is not set 816 (indicating that it contains the desired data), the method 800 copies 818 the data from the sibling target 304 to the COS 304. If the TBM of this sibling target 304 is set 816 (indicating that it does not contain the desired data), the method 800 repeats steps 810, 814 to find the next younger sibling target 304 and determine 816 whether its TBM is set. In this way, the method 800 traverses through the younger siblings of the target volume 304 identified at step 802 until the sibling target volume 304 containing the desired data is found.
  • the method 800 copies 818 the data from the sibling target 304 to the COS. If no sibling target 304 containing the desired data is found, the method 800 copies 812 the data from the source volume 302 to the COS. Once the data is copied, the write may be performed on the target 304 identified at step 802.
  • FIG. 9 one example of a multi-target architecture 300 showing the use of generation numbers (GNs) is illustrated.
  • SV source volume
  • TVl first target volume
  • TV3 target volume
  • the first relation is associated with a generation number of "1,”
  • the second relation is associated with a generation number of "2”
  • the third relation is associated with a generation number of "3.”
  • the data in track 2 is copied from the source volume 302 to the second target volume 304b (the youngest child, or YC) and the TBM of the second target volume 304b is reset (indicating that it now contains the data).
  • the write is then performed to track 2 of the source volume 302.
  • the data residing in the first target volume (TV1) 304a and the second target volume (TV2) 304b after the two writes described above is shown in Figure 10.
  • the values in the TBMs are also shown. Assume that the third relation is now established between the source volume 302 and the third target volume 304c.
  • the data in track 3 is copied from the source volume 302 to the third target volume 304c (the youngest child, or YC) and the TBM of the third target volume 304c is reset.
  • the write is then performed to track 3 of the source volume 302.
  • the data in track 4 is copied from the source volume 302 (the higher source) to the first target volume 304a (the closest older sibling, or COS) and the TBM of the first target volume 304a is reset.
  • the write is then performed to track 4 of the second target volume 304b and the TBM of the second target volume 304b is reset.
  • a relation between a source volume 302 and a target volume 304, or several relations between a source volume 302 and several target volumes 304 may be deleted from a multi-target architecture 300.
  • a relation is deleted from a multi-target architecture 300, the point-in-time-copy relationship between the source volume 302 and the target volume 304 associated with the relation is terminated. In certain embodiments, this may terminate the ability of other sibling target volumes 304 to inherit data from the target volume 304 for which the relation was deleted.
  • data on the target volume 304 associated with the relation may be copied to one or more sibling target volumes 304 so that the data is still accessible to the sibling target volumes 304. For example, assume that the relation between the source volume 302 and the target volume
  • data that is stored on the target volume 304c and inherited by other sibling target volumes 304 may be copied from the target volume 304c to one or more sibling target volumes 304 so that the data is still accessible to the sibling target volumes 304.
  • the data will be copied to the closest older sibling (COS).
  • COS closest older sibling
  • the data may be copied to other sibling target volumes 304 other than the COS. Nevertheless, for the purposes of this disclosure, it will be assumed that the data is copied to the COS.
  • the relation between the source volume 302 and the target volume 304c may be deleted, thereby terminating the point-in-time copy relationship between the source volume 302 and the target volume 304c.
  • a relation may be deleted between a source volume 302 and a space-efficient (SE) target volume 304.
  • An SE target volume 304 differs from a standard target volume 304 (such as those illustrated in Figure 12 A) in that data is not physically stored in the volume. Rather, the SE target volume 304 is a virtual volume (as indicated by the dotted lines) whose data is physically stored in a common repository 1200.
  • a mapping structure 1202 keeps track of where a SE target volume's data is physically located in the repository 1200. Stated otherwise, the mapping structure 1202 maps logical tracks of the SE target volume 304 to physical tracks of the repository 1200. From the perspective of a host device 106, reading from or writing to a SE target volume 304 may be the same as reading from or writing to a standard target volume.
  • mapping structure 1202 may be modified so that other sibling SE target volumes, and more specifically a COS volume or volumes, point to the SE target volume's data in the repository 1200. Stated otherwise, instead of physically copying data from one SE target volume to another, as may occur with standard target volumes, the mapping structure 1202 is modified so that data that is logically stored in one SE target volume is now logically stored in another SE target volume. For the purposes of this disclosure, it will be assumed that all target volumes referred to hereafter are space- efficient (SE) target volumes.
  • SE space- efficient
  • a relationship table 1300 is stored in memory 214 to keep track of each of the relations in the multi-target architecture 300.
  • each relation has associated therewith a source relationship entry 1302a, corresponding to the source of the relation, and a target relationship entry 1302b, corresponding to the target of the relation.
  • the source relationship entry 1302a and the target relationship entry 1302b associated with the relation may be marked as "deleted" to indicate that the relation is in the process of being deleted (i.e., the mapping structure is in the process of being modified to map data to the COS, in preparation to delete the relation).
  • Marking the relationship entries 1302a, 1302b in this manner may also ensure that data is not written to the SE target volume 304 whose relation is in the process of being deleted.
  • the relation may be deleted. Deleting the relation may include deleting the source relationship entry 1302a and target relationship entry 1302b associated with the relation from the relationship table 1300.
  • the method 1400 initially determines 1402 whether a request to withdraw (i.e., a request to delete a relation) has been received. If a request to withdraw has been received, the method 1400 marks 1404 the relationship entries associated with the relation as "deleted.” This may include marking 1404 both the source relationship entry 1302a and the target relationship entry 1302b associated with the relation as "deleted.” The method 1400 then determines 1406 whether a relation is already in process, meaning that the mapping structure 1202 is in the process of being modified to map data to a COS, in preparation to delete a relation.
  • the method 1400 queues 1408 the relation. Upon queuing the relation, the method 1400 sorts 1408 the relations in the queue from oldest to youngest in order to process older relations prior to younger relations. This will ideally minimize the number of times that the mapping structure 1202 is modified. For example, if the mapping structure 1202 is modified to map data to a COS whose relation is in line to be deleted, the mapping structure 1202 may need to be modified again, wasting both time and resources. Processing the relations from oldest to youngest will help to ensure that the mapping structure 1202 is modified a minimal number of times.
  • the age of the relations is determined using generation numbers, as illustrated in Figure 9. For example, by inspecting the generation numbers on the source volume 302, the age of the relations may be readily determined. In the illustrated example of Figure 9, the generation number is incremented each time a new relation is generated. Thus, the relation associated with the generation number "1" is the oldest and the relation associated with the generation number "3" is the youngest. This convention could be reversed in other embodiments.
  • the method 1400 simply processes 1410 the relation. If one or more relations are in the queue, the method 1400 processes 1410 the next relation in the queue. Various methods for processing 1410 a relation will be described in association with Figures 15 and 16. Once a relation is processed, meaning that the mapping structure 1202 has been modified for a SE target 304 to map data to a COS 304, the method 1400 removes 1412 the relationship entries 1302a, 1302b associated with the relation from the relationship table 1300. This will terminate the relation. The method then checks 1414 whether any other relations are in the queue. If the queue is empty, the method 1400 waits 1402 for the next request to withdraw. If the queue is not empty, the method 1400 processes 1410 the next relation in the queue. This continues until all relations in the queue are processed.
  • the method 1400 is configured such that several relations can be in process at any particular time.
  • the number of relations in process at any particular time may be limited so as not to overdrive storage devices 204 (e.g., disk drives, solid state drives, etc.) or device adapters 210 associated with the storage devices 204.
  • device adapters 210 and storage devices 204 may be limited to processing some number (e.g., four) of relations at any particular time to not overdrive the devices.
  • older relations may be given priority over newer relations to minimize the number of times that a mapping structure 1202 is modified.
  • a method 1410 for processing a relation is illustrated. Such a method 1410 may be executed whenever a relation is processed 1410, as described in Figure 14. As shown, to process a relation, the method 1410 initially identifies 1500 the SE target associated with the relation. The method 1410 then identifies 1502 the closest older sibling (COS) of the SE target. The method 1410 then examines 1504 the first track of the SE target and the COS.
  • COS closest older sibling
  • the method 1410 determines 1506 that the TBM of the SE target for the track is not set (indicating that the SE target includes a copy of the data) and determines 1508 that the TBM of the COS for the track is set (indicating that the COS does not include a copy of the data), then the method 1410 modifies 1510 the mapping structure 1202 to map the data in the repository 1200 to the COS. The TBM of the COS is then reset 1510 for the track to indicate that it includes a copy of the data.
  • the mapping structure 1202 is not modified and the method 1410 proceeds to the decision step 1512.
  • the method 1410 determines 1512 whether the last track of the SE target 304 has been reached. If the last track has not been reached, the method 1410 examines 1514 the next track of the SE target and the corresponding track of the COS and repeats steps 1506, 1508, 1510, 1512. When all tracks in the SE target 304 have been examined and the mapping structure 1202 has been modified for those tracks where it is required, the method 1410 ends.
  • FIG. 16 another embodiment of a method 1410 for processing a relation is illustrated. Such a method 1410 may be executed in place of the method of Figure 15 whenever a relation is processed 1410.
  • the method 1410 illustrated in Figure 16 may be used to address implementations where different ranges of tracks in a SE target have different closest older siblings (COSs), such as in dataset-level point-in-time-copy implementations .
  • COSs closest older siblings
  • the method 1410 initially identifies 1600 the SE target associated with the relation and identifies 1602 a first track range (e.g., the first fifty tracks) of the SE target. The method 1410 then identifies 1604 the closest older sibling (COS) associated with the track range. The method 1410 then examines 1606 the first track of the track range and the corresponding track of the COS.
  • a first track range e.g., the first fifty tracks
  • COS closest older sibling
  • the method 1410 determines 1608 that the TBM for the track in the track range is not set (indicating that the track includes a copy of the data) and determines 1610 that the TBM for the corresponding track of the COS is set (indicating that the track in the COS does not include a copy of the data), then the method 1410 modifies 1620 the mapping structure 1202 to map the data in the repository 1200 to the COS. The TBM for the track in the COS is then reset 1620 to indicate that it now includes a copy of the data.
  • the mapping structure 1202 is not modified and the method 1410 proceeds to the decision step 1618.
  • the method 1410 determines 1618 whether another track in the track range exists. If another track in the track range does exist, the method 1410 examines 1616 the next track of the track range along with the corresponding track in the COS by repeating steps 1608, 1610, 1620, 1618. When all tracks in the track range have been examined and the mapping structure 1202 has been modified for those tracks where it is required, the method 1410 determines 1614 whether there is another track range in the SE target.
  • the method 1410 identifies 1604 the COS for the track range and repeats steps 1606, 1608, 1610, 1620, 1618, 1616 for the track range and the identified COS. This continues until all tracks within all track ranges of the SE target have been examined and the mapping structure 1202 has been modified for those tracks where it is required. Once all tracks in all track ranges of the SE target have been examined and the mapping structure 1202 has been modified accordingly, the method 1410 ends.
  • each block in the flowcharts or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s).
  • the functions noted in the block may occur out of the order noted in the Figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.

Abstract

A method for deleting a relation between a source and a target in a multi-target architecture is described. The multi-target architecture includes a source and multiple space-efficient (SE) targets mapped thereto. In one embodiment, such a method includes initially identifying a relation for deletion from the multi-target architecture. A space-efficient (SE) target associated with the relation is then identified. A mapping structure maps data in logical tracks of the SE target to physical tracks of a repository. The method then identifies a sibling SE target that inherits data from the SE target. Once the SE target and the sibling SE target are identified, the method modifies the mapping structure to map the data in the physical tracks of the repository to the logical tracks of the sibling SE target. The relation is then deleted between the source and the SE target. A corresponding computer program product is also described herein.

Description

DELETING RELATIONS BETWEEN SOURCES AND SPACE-EFFICIENT TARGETS IN MULTI-TARGET ARCHITECTURES
Technical Field
This invention relates to data replication, and more particularly to apparatus and methods for creating point-in-time copies of data while minimizing data duplication.
Background Art
Data replication functions such as IBM® FlashCopy®, Hitachi Shadowlmage, or the like, may be used to generate nearly instantaneous point-in-time copies of logical volumes or datasets. Among other uses, these point-in-time copies may be used for disaster recovery and business continuity purposes. IBM FlashCopy in particular creates a point-in-time copy by establishing a relation (or "mapping") between a source volume and a target volume. Once this relation is established, data may be read from either the source volume or target volume. A target bit map associated with a target volume keeps track of which data tracks have actually been copied from the source volume to the target volume. In certain cases, volumes may be arranged in a cascaded configuration such that certain volumes function as both targets and sources. In other cases, volumes may be arranged in a flat (or "multi- target") configuration such that a source volume has relations with multiple target volumes.
Nevertheless, I/O performance can be impacted significantly as the number of volumes increases in either a cascaded or multi-target configuration. For example, in a cascaded configuration, a write to a source volume may need to wait for data to be copied between various volumes in the cascade before the write can be performed. Thus, the larger number of volumes in the cascade, the larger number of copies that need to occur before data can be written to the source volume. Similarly, in a multi-target configuration, a write to a source volume may need to wait for data to be copied to each connected target before the write can be performed. The larger number of volumes in the multi-target configuration, the larger number of copies that need to occur before data can be written to the source volume. This can make a write to a source volume very slow. For this reason, current FlashCopy implementations typically only allow a limited number of targets in a multi-target configuration to keep the performance impact within an acceptable range.
In view of the foregoing, what are needed are methods to reduce the performance impact of having large numbers of volumes in cascaded or multi-target configurations. For example, methods are needed to reduce data duplication in cascaded or multi-target configurations when performing reads and writes thereto. Further needed are methods to efficiently delete relations in cascaded or multi-target configurations.
Therefore, there is a need in the art to address the aforementioned problem.
SUMMARY
The invention has been developed in response to the present state of the art and, in particular, in response to the problems and needs in the art that have not yet been fully solved by currently available methods. Accordingly, the invention has been developed to provide methods, apparatus, computer program product and computer program for deleting relations between sources and space-efficient targets in multi-target architectures. The features and advantages of the invention will become more fully apparent from the following description and appended claims, or may be learned by practice of the invention as set forth hereinafter.
Consistent with the foregoing, a method for deleting a relation between a source and a target in a multi-target architecture is disclosed. The multi-target architecture includes a source and multiple space-efficient (SE) targets mapped thereto. In one embodiment, such a method includes initially identifying a relation for deletion from the multi-target
architecture. A space-efficient (SE) target associated with the relation is then identified. A mapping structure maps data in logical tracks of the SE target to physical tracks of a repository. The method then identifies a sibling SE target that inherits data from the SE target. Once the SE target and the sibling SE target are identified, the method modifies the mapping structure such that the data in the physical tracks of the repository is mapped to the logical tracks of the sibling SE target. The relation is then deleted between the source and the SE target.
Viewed from a first aspect, the present invention provides a method for deleting a relation between a source and a space-efficient (SE) target in a multi-target architecture, the multi- target architecture comprising a source and a plurality of SE targets mapped thereto, the method comprising: identifying a first relation for deletion from a multi-target architecture; identifying a space-efficient (SE) target associated with the first relation, wherein a mapping structure maps data in logical tracks of the SE target to physical tracks of a repository;
identifying a sibling SE target that inherits data from the SE target; modifying the mapping structure to map the data in the physical tracks of the repository to the logical tracks of the sibling SE target; and deleting the first relation.
Viewed from a further aspect, the present invention provides a computer program product for deleting a relation between a source and a space-efficient (SE) target in a multi-target architecture, the multi-target architecture comprising a source and a plurality of SE targets mapped thereto, the computer program product comprising: a computer readable storage medium readable by a processing circuit and storing instructions for execution by the processing circuit for performing a method for performing the steps of the invention. Viewed from a further aspect, the present invention provides a computer program stored on a computer readable medium and loadable into the internal memory of a digital computer, comprising software code portions, when said program is run on a computer, for performing the steps of the invention. Viewed from a further aspect the present invention provides an apparatus for deleting a relation between a source and a space-efficient (SE) target in a multi-target architecture, the multi-target architecture comprising a source and a plurality of SE targets mapped thereto, the apparatus comprising: an identify component for identifying a first relation for deletion from a multi-target architecture; the identify component further operable for identifying a space-efficient (SE) target associated with the first relation, wherein a mapping structure maps data in logical tracks of the SE target to physical tracks of a repository; the identify component further operable for identifying a sibling SE target that inherits data from the SE target; a modify component for modifying the mapping structure to map the data in the physical tracks of the repository to the logical tracks of the sibling SE target; and a delete component for deleting the first relation.
Viewed from a further aspect the present invention provides a method for performing a write to a target volume (target x) in a multi-target architecture, the multi-target architecture comprising a source volume and a plurality of target volumes mapped thereto, the method comprising: determining whether the target x has a closest older sibling (COS), wherein the COS is a target volume established just before the target x; determining whether a target bit map (TBM) for each of the target x and the COS are set; if the TBMs for both the COS and the target x are set, copying data from a higher source (HS) volume to the COS; if the TBM for the COS is set and the TBM for the target x is not set, copying the data from the target x to the COS; and performing the write to the target x.
Viewed from a further aspect the present invention provides a method for performing a read on a target volume (target x) in a multi-target architecture, the multi-target architecture comprising a source volume and a plurality of target volumes mapped thereto, the method comprising: reading a target bit map (TBM) associated with the target x; determining whether the TBM is set; if the TBM is set, reading data from a higher source (HS) volume, wherein reading data from the HS volume comprises: finding the source volume associated with the target x; finding, by inspecting generation numbers (GNs) on the source volume, the next younger sibling relative to the target x; and reading the data from the next younger sibling if a TBM associated with the next younger sibling is not set.
Viewed from a further aspect the present invention provides a method for performing a write to a source volume in a multi-target architecture, the multi-target architecture comprising a source volume and a plurality of target volumes mapped thereto, the method comprising: copying data in a track of the source volume to a target volume (target x) mapped to the source volume; enabling at least one sibling target volume (sibling) mapped to the source volume to inherit the data from the target x; and performing a write to the track of the source volume. Viewed from a further aspect the present invention provides a method for deleting a relation between a source and a target in a multi-target architecture, the multi-target architecture comprising a source and a plurality of targets mapped thereto, the method comprising:
identifying a first relation for deletion from a multi-target architecture; identifying a target associated with the first relation; identifying a sibling target that inherits data from the target; copying the data from the target to the sibling target; and deleting the first relation.
Brief Description of the Drawings
The present invention will now be described, by way of example only, with reference to preferred embodiments, as illustrated in the following figures:
Figure 1 is a high-level block diagram showing one example of a network architecture comprising various types of storage systems, in accordance with the prior art, and in which a preferred embodiment of the present invention may be implemented;
Figure 2 is a high-level block diagram showing one example of a storage system where a methodology, in accordance with the prior art, and in which a preferred embodiment of the present invention may be implemented;
Figure 3 is a high-level block diagram showing one example of a multi-target architecture comprising a source volume mapped to multiple target volumes, according to a preferred embodiment of the present invention;
Figure 4 is a high-level block diagram showing one embodiment of a method for reading a track from a target volume, according to a preferred embodiment of the present invention;
Figure 5 is a flow diagram showing one embodiment of a method for copying a data track in response to a write to a source volume, according to a preferred embodiment of the present invention;
Figure 6 is a flow diagram showing one embodiment of a method for copying a data track in response to a write to a target volume, according to a preferred embodiment of the present invention;
Figure 7 is a flow diagram showing one embodiment of a method for finding a higher source (HS) volume in response to a read to a volume, according to a preferred embodiment of the present invention;
Figure 8 is a flow diagram showing one embodiment of a method for finding a higher source (HS) volume in response to a write to a volume, according to a preferred embodiment of the present invention;
Figure 9 is a high-level diagram showing one example of a multi-target architecture showing the use of generation numbers, according to a preferred embodiment of the present invention;
Figures 10 and 11 are tables showing data and TBM values for the volumes illustrated in Figure 9 after various writes are made thereto, according to a preferred embodiment of the present invention;
Figure 12A is a high-level block diagram showing the deletion of a relation between a source volume and a target volume, according to a preferred embodiment of the present invention;
Figure 12B is a high-level block diagram showing the deletion of a relation between a source volume and a space-efficient (SE) target volume, according to a preferred embodiment of the present invention;
Figure 13 is a high-level block diagram showing in-memory source and target relationship entries, according to a preferred embodiment of the present invention;
Figure 14 is a flow diagram showing one embodiment of a method for deleting a relation between a source and a SE target in a multi-target architecture, according to a preferred embodiment of the present invention; Figure 15 is a flow diagram showing one embodiment of a method for processing a deleted relation, according to a preferred embodiment of the present invention; and
Figure 16 is a flow diagram showing another embodiment of a method for processing a deleted relation, according to a preferred embodiment of the present invention.
DETAILED DESCRIPTION
It will be readily understood that the components of the present invention, as generally described and illustrated in the Figures herein, could be arranged and designed in a wide variety of different configurations. Thus, the following more detailed description of the preferred embodiments of the present invention, as represented in the Figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of certain examples of presently contemplated preferred embodiments in accordance with the invention. The presently described embodiments will be best understood by reference to the drawings, wherein like parts are designated by like numerals throughout.
As will be appreciated by one skilled in the art, the present invention may be embodied as an apparatus, system, method, or computer program product. Furthermore, the present invention may take the form of a hardware embodiment, a software embodiment (including firmware, resident software, micro-code, etc.) configured to operate hardware, or an embodiment combining software and hardware aspects that may all generally be referred to herein as a "module" or "system." Furthermore, the present invention may take the form of a computer-usable storage medium embodied in any tangible medium of expression having computer-usable program code stored therein.
Any combination of one or more computer-usable or computer-readable storage medium(s) may be utilized to store the computer program product. The computer-usable or computer- readable storage medium may be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable storage medium may include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CDROM), an optical storage device, or a magnetic storage device. In the context of this document, a computer-usable or computer-readable storage medium may be any medium that can contain, store, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
Computer program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object-oriented programming language such as Java®, Smalltalk, C++, or the like, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. Computer program code for implementing the invention may also be written in a low-level programming language such as assembly language. The program code may execute entirely on the user's computer, partly on the user's computer, as a standalone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider). Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates.
The present invention may be described below with reference to flowchart illustrations and/or block diagrams of methods, apparatus, systems, and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions or code. These computer program instructions may be provided to a processor of a general- purpose computer, special-purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
The computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means which implement the function/act specified in the flowchart and/or block diagram block or blocks. The computer program instructions may also be loaded onto a computer or other
programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
Referring to Figure 1, one example of a network architecture 100 is illustrated. The network architecture 100 is presented to show one example of an environment where a point-in-time- copy methodology in accordance with the invention may be implemented. The network architecture 100 is presented only by way of example and not limitation. Indeed, the methodology disclosed herein may be applicable to a wide variety of different computers, servers, storage devices, and network architectures, in addition to the network architecture 100 shown.
As shown, the network architecture 100 includes one or more computers 102, 106 interconnected by a network 104. The network 104 may include, for example, a local-area- network (LAN) 104, a wide-area-network (WAN) 104, the Internet 104, an intranet 104, or the like. In certain embodiments, the computers 102, 106 may include both client computers 102 and server computers 106 (also referred to herein as "host systems" 106). In general, the client computers 102 initiate communication sessions, whereas the server computers 106 wait for requests from the client computers 102. In certain embodiments, the computers 102 and/or servers 106 may connect to one or more internal or external direct-attached storage systems 112 (e.g., arrays of hard-disk drives, solid-state drives, tape drives, etc.). These computers 102, 106 and direct-attached storage systems 112 may communicate using protocols such as ATA, SATA, SCSI, SAS, Fibre Channel, or the like. One or more of the storage systems 112 may utilize the point-in-time- copy methodology disclosed herein.
The network architecture 100 may, in certain embodiments, include a storage network 108 behind the servers 106, such as a storage-area-network (SAN) 108 or a LAN 108 (e.g., when using network-attached storage). This network 108 may connect the servers 106 to one or more storage systems 110, such as arrays 110a of hard-disk drives or solid-state drives, tape libraries 110b, individual hard-disk drives 110c or solid-state drives 110c, tape drives 1 lOd, CD-ROM libraries, or the like. To access a storage system 110, a host system 106 may communicate over physical connections from one or more ports on the host 106 to one or more ports on the storage system 110. A connection may be through a switch, fabric, direct connection, or the like. In certain embodiments, the servers 106 and storage systems 110 may communicate using a networking standard such as Fibre Channel (FC). One or more of the storage systems 110 may utilize the point- in-time-copy methodology disclosed herein.
Referring to Figure 2, one embodiment of a storage system 110b containing an array of hard- disk drives 204 and/or solid-state drives 204 is illustrated. The internal components of the storage system 110b are shown since the point-in-time-copy methodology disclosed herein may, in certain embodiments, be implemented within such a storage system 110b, although the methodology may also be applicable to other storage systems 110. As shown, the storage system 110b includes a storage controller 200, one or more switches 202, and one or more storage devices 204, such as hard disk drives 204 or solid-state drives 204 (such as flash-memory-based drives 204). The storage controller 200 may enable one or more hosts 106 (e.g., open system and/or mainframe servers 106) to access data in the one or more storage devices 204.
In selected embodiments, the storage controller 200 includes one or more servers 206. The storage controller 200 may also include host adapters 208 and device adapters 210 to connect the storage controller 200 to host devices 106 and storage devices 204, respectively. Multiple servers 206a, 206b may provide redundancy to ensure that data is always available to connected hosts 106. Thus, when one server 206a fails, the other server 206b may pick up the I/O load of the failed server 206a to ensure that I/O is able to continue between the hosts 106 and the storage devices 204. This process may be referred to as a "failover."
One example of a storage system 110b having an architecture similar to that illustrated in Figure 2 is the IBM DS8000® enterprise storage system. The IBM DS8000 is a high- performance, high-capacity storage controller providing disk storage that is designed to support continuous operations. Nevertheless, the methods disclosed herein are not limited to the IBM DS8000 enterprise storage system 110b, but may be implemented in any comparable or analogous storage system 110, regardless of the manufacturer, product name, or components or component names associated with the system 110. Furthermore, any storage system that could benefit from one or more preferred embodiments of the present invention is deemed to fall within the scope of the invention. Thus, the IBM DS8000 is presented only by way of example and is not intended to be limiting. IBM, FlashCopy, DS8000 are trademarks of International Business Machines Corporation, registered in many jurisdictions worldwide.
In selected embodiments, each server 206 may include one or more processors 212 and memory 214. The memory 214 may include volatile memory (e.g., RAM) as well as nonvolatile memory (e.g., ROM, EPROM, EEPROM, hard disks, flash memory, etc.). The volatile and non- volatile memory may, in certain embodiments, store software modules that run on the processor(s) 212 and are used to access data in the storage devices 204. The servers 206 may host at least one instance of these software modules. These software modules may manage all read and write requests to logical volumes in the storage devices 204.
In selected embodiments, the memory 214 includes a cache 218. Whenever a host 106 (e.g., an open system or mainframe server 106) performs a read operation, the server 206 that performs the read may fetch data from the storages devices 204 and save it in its cache 218 in the event it is needed again. If the data is requested again by a host 106, the server 206 may fetch the data from the cache 218 instead of fetching it from the storage devices 204, saving both time and resources. Similarly, when a host 106 performs a write, the server 106 that receives the write request may store the write in its cache 218. The server 106 may then destage the write to the storage devices 204 as time and resources allow.
Referring to Figure 3, one example of a multi-target architecture 300 for creating point-in- time copies is illustrated. Such an architecture 300 may be implemented within a storage system 110, such as the storage system 110b illustrated in Figure 2. As shown, the multi- target architecture 300 includes a source volume 302 and one or more target volumes 304a- d. Each of the target volumes 304a-d contains a point-in-time copy of data in the source volume 302. In selected embodiments, such as in FlashCopy implementations, a point-in- time copy is created by establishing a relation (or "mapping") between a source volume 302 and a target volume 304. Once this relation is established, data may be read from either the source volume 302 or target volume 304 even though data may still not be copied from the source volume 302 to the target volume 304. A target bit map (TBM) 306 associated with a target volume 304 keeps track of which data tracks have actually been copied from the source volume 302 to the target volume 304. For example, a "0" in the TBM 306 may indicate that a data track has been copied (i.e., the target volume 304 has its own data), whereas a "1" may indicate that a data track has not yet been copied. In cases where the TBM 306 contains a "1," a read to a track on the target volume 306 may be directed to the corresponding track on the source volume 302. For the purposes of this disclosure, a bit in a TBM 304 is said to be "set" if it contains a "1" and "reset" if it contains a "0," although this could be reversed in other embodiments. Although the source 302 and targets 304 are labeled as "volumes" in the illustrated embodiment, it should be recognized that the source 302 and targets 304 could also be datasets or other collections of data.
As previously mentioned, in conventional multi-target architectures 300, a write to a source volume 302 may need to wait for data in the source volume 302 to be copied (i.e., destaged) to each connected target volume 304a-d not containing its own data before the write can be completed to the source volume 302. That is, before a write is performed on a data track of the source volume 302, the existing data track needs to be copied to target volumes 304a-d that do not already contain the data track before the data track on the source volume 302 is overwritten. The larger the number of target volumes 304a-d in the multi-target architecture
300, the larger number of copies that need to occur before data can be successfully written to the source volume 302. This can make a write to the source volume 302 very slow. For this reason, conventional point-in-time-copy technologies may only support a limited number (e.g., twelve) of targets 304 in multi-target architectures 300 to keep the performance impact within an acceptable range. As will be explained in more detail hereafter, an improved methodology in accordance with preferred embodiments of the present invention may be used reduce the performance impact of having multiple target volumes 304a-d mapped to a source volume 302. Instead of copying data to multiple targets 304a-d when a write is performed on the source volume 302, the improved methodology copies the data to a single target 304 or a subset of the targets 304. An inheritance scheme then enables other targets 304 to inherit the data from the single target 304 or subset of targets 304 that contain the data. In this way, a write to a source volume 302 may only need to copy data to a single target 304 or a subset of the targets 304 before the write can be completed on the source volume 302. The flow diagrams illustrated in Figures 4 through 8 show various specific examples of methods to implement such a methodology.
Referring to Figure 4, one example of a method 400 for reading a track from a target volume 304 is illustrated. Upon receiving a request to read a data track from a target volume 304, the method 400 determines 402 whether the TBM of the target volume 304 is set. If the TBM is not set (indicating that the target volume 304 contains the requested data), the method 400 simply reads 406 the requested data track from the target volume 304. On the other hand, if the TBM is set (indicating that the target volume 304 does not contain the requested data), the method 400 finds 404 a higher source (HS) volume from which to read the data, and reads 404 from the HS volume. One method 700 for finding the HS volume is described in association with Figure 7. For the purposes of this disclosure, the HS volume is the volume that contains the requested data and from which the target volume 304 inherits.
Referring to Figure 5, one embodiment of a method 500 for destaging a data track in response to a write to a source volume 302 is illustrated. As shown, the method 500 initially finds 502 the youngest child (YC) of the source volume 302. For the purposes of this disclosure, the YC is the target volume 304 that was last mapped to the source volume 302. In selected embodiments, generation numbers (GNs) may be used to determine the order in which target volumes 304 were added to the source volume 302 in order to generate point- in-time copies. The manner in which GNs are used to determine the order the targets 304 were mapped to the source volume 302 will be discussed in association with Figure 9.
Once the method 500 finds the YC, the method 500 determines 504 whether the TBM of the YC is set. If the TBM is not set (indicating that the YC 304 contains its own copy of the data), the method 500 does nothing 508 since the YC 304 already has a copy of the data. On the other hand, if the TBM is set (indicating that the YC 304 does not contain its own copy of the data), the method 500 copies 506 the data from the source volume 302 to the YC 304. In this way, when a write occurs to the source volume 302, a single copy is made between the source volume 302 and the YC 304 as opposed to copying the data to all target volumes 304 not containing the data. The other target volumes 304 (not the YC 304) may then inherit this data from the YC 304, such as when a read is made to the other volumes 304 or when data is copied from the other volumes 304.
Referring to Figure 6, one embodiment of a method 600 for destaging a data track in response to a write to a target volume 304 (target x) is illustrated. As shown, the method 600 initially determines 602 whether the TBMs for the target x 304 and the closest older sibling (COS) 304 are set for the track that is being written to. For the purposes of this disclosure, the COS is the target volume 304 that was mapped just before the target x 304. If both of the TBMs are set (indicating that neither volume contains the data in the track being written to), the method 600 copies 604 the data track from the higher source (HS) volume to the COS 304. A method for finding the HS volume will be discussed in association with Figure 8. On the other hand, if the TBM for the target x is not set and the TBM for the COS is set (indicating that the target x 304 contains data in the data track being overwritten), as determined at step 606, the method 600 copies 608 the data track from the target x to the COS 304— i.e., the data track is destaged from the target x 304 to the COS 304. On the other hand, if the TBM of the COS is not set (indicating that the COS contains the data), or there is no COS, the method 600 does nothing 610 since no copy is needed. Once the end of the method 600 is reached, the write may be performed on the target x.
It should be recognized that the methods 500, 600 described above could be modified in various ways without departing from the invention. For example, the youngest child (YC) could be replaced by the oldest child, and the closest older sibling (COS) could be replaced by the closest younger sibling. Thus, for the purposes of this disclosure, embodiments that utilize the YC and the COS are also deemed to encompass embodiments that utilize the oldest child and closest younger sibling. Other variations are also possible and within the scope of the invention.
Referring to Figure 7, one embodiment of a method 700 for finding the HS volume for a read is illustrated. Such a method 700 may be used in association with step 404 of Figure 4. As shown, the method 700 initially determines 702 whether the volume being read is a target volume 304. If not, the method 700 reads 704 from the volume since it is a source volume 302. If the volume is a target volume 304, the method determines 706 whether the TBM of the volume is set. If the TBM is not set, the method 700 reads 704 from the volume 304. If the TBM of the volume is set, the method 700 finds 708 the source volume 302 associated with the target volume 304. The method 700 then finds 710 the next relation with a generation number (GN) just higher than that of the subject target volume 304. The manner in which the GNs are used will be explained in more detail in the example of Figure 9.
In general, the decision step 710 finds the relation on the source volume 302 that is just younger than the relation associated with the subject target volume 304 (as identified at step
702). The method 700 then finds 714 the target 304 of this relation. If the TBM of this target 304 is set 716, the method 700 reads from the target 304. If the TBM of this target 304 is not set 716, the method 700 repeats steps 710, 714 to find the next younger target 304 and determine 716 whether its TBM is set. In this way, the method 700 traverses through the younger siblings of the target volume 304 identified at step 702 until the target volume
304 containing the desired data is found. Once this data is found, the method 700 reads 718 from the target 304. If no younger sibling target 304 containing the desired data is found, the method 700 simply reads 712 from the source volume 302. In this way, a target volume 304 is able to inherit data from a sibling 304 when a read is performed thereto.
Referring to Figure 8, one embodiment of a method 800 for finding the HS volume from which to copy data is illustrated. Such a method 800 may be used in association with step 604 of Figure 6. As shown, the method 800 initially determines 802 whether the volume being written to is a target volume 304. If not, no copy is required as reflected at step 804. If the volume is a target volume 304, the method determines 806 whether the TBM of the volume is set. If the TBM is not set, no copy is required. If the volume is a target volume 304 and the TBM of the volume is set, the method finds 808 the source volume 302 associated with the target volume 304. The method 800 then finds the next relation with a higher generation number (GN) in the manner previously discussed.
Upon finding the next higher GN, the method 800 finds 814 the target 304 of this relation, which is a sibling of the target 304 identified at step 802. If the TBM of this sibling target 304 is not set 816 (indicating that it contains the desired data), the method 800 copies 818 the data from the sibling target 304 to the COS 304. If the TBM of this sibling target 304 is set 816 (indicating that it does not contain the desired data), the method 800 repeats steps 810, 814 to find the next younger sibling target 304 and determine 816 whether its TBM is set. In this way, the method 800 traverses through the younger siblings of the target volume 304 identified at step 802 until the sibling target volume 304 containing the desired data is found. Once this data is found, the method 800 copies 818 the data from the sibling target 304 to the COS. If no sibling target 304 containing the desired data is found, the method 800 copies 812 the data from the source volume 302 to the COS. Once the data is copied, the write may be performed on the target 304 identified at step 802.
Referring to Figure 9, one example of a multi-target architecture 300 showing the use of generation numbers (GNs) is illustrated. In this example, assume that the relation between the source volume (SV) 302 and a first target volume (TVl) 304a was created first, followed by the relation between the source volume 302 and a second target volume (TV2) 304b, followed by the relation between the source volume 302 and a third target volume (TV3) 304c. Each time a new relation is added to the source volume 302, the generation number is incremented. Thus, as shown on the source volume 302, the first relation is associated with a generation number of "1," the second relation is associated with a generation number of "2," and the third relation is associated with a generation number of "3."
Assume that relations are initially established between the source volume 302 and the first and second target volumes 304a, 304b, but the relation between the source volume 302 and the third target volume 304c is not yet established. In this scenario, to perform a write to track 1 of the second target volume 304b, the data in track 1 is copied from the source volume 302 (the higher source) to the first target volume 304a (the closest older sibling, or COS) and the TBM of the first target volume 304a is reset. The write is then performed to track 1 of the second target volume 304b and the TBM of the second target volume 304b is reset. Similarly, to perform a write to track 2 of the source volume 302, the data in track 2 is copied from the source volume 302 to the second target volume 304b (the youngest child, or YC) and the TBM of the second target volume 304b is reset (indicating that it now contains the data). The write is then performed to track 2 of the source volume 302. The data residing in the first target volume (TV1) 304a and the second target volume (TV2) 304b after the two writes described above is shown in Figure 10. The values in the TBMs are also shown. Assume that the third relation is now established between the source volume 302 and the third target volume 304c. To perform a write to track 3 of the source volume 302, the data in track 3 is copied from the source volume 302 to the third target volume 304c (the youngest child, or YC) and the TBM of the third target volume 304c is reset. The write is then performed to track 3 of the source volume 302. To perform a write to track 4 of the second target volume 304b, the data in track 4 is copied from the source volume 302 (the higher source) to the first target volume 304a (the closest older sibling, or COS) and the TBM of the first target volume 304a is reset. The write is then performed to track 4 of the second target volume 304b and the TBM of the second target volume 304b is reset. To perform a write to track 5 of the first target volume 304a, no copy is made since there is no closest older sibling, or COS. The write is then performed to track 5 of the first target volume 304a and the TBM of the first target volume 304a is reset. To perform a write to track 6 of the third target volume 304c, the data in track 6 is copied from the source volume 302 (the higher source) to the second target volume 304b (the closest older sibling, or COS) and the TBM of the second target volume 304b is reset. The write is then performed to track
6 of the third target volume 304c and the TBM of the third target volume 304c is reset. The data residing in the first target volume (TV1) 304a, the second target volume (TV2) 304b, and the third target volume (TV3) 304c after all six writes described above is shown in Figure 11. The values in the TBMs are also shown.
Referring to Figure 12A, in certain circumstances, a relation between a source volume 302 and a target volume 304, or several relations between a source volume 302 and several target volumes 304, may be deleted from a multi-target architecture 300. When a relation is deleted from a multi-target architecture 300, the point-in-time-copy relationship between the source volume 302 and the target volume 304 associated with the relation is terminated. In certain embodiments, this may terminate the ability of other sibling target volumes 304 to inherit data from the target volume 304 for which the relation was deleted. Thus, in certain embodiments, prior to deleting a relation, data on the target volume 304 associated with the relation may be copied to one or more sibling target volumes 304 so that the data is still accessible to the sibling target volumes 304. For example, assume that the relation between the source volume 302 and the target volume
304c is identified for deletion (as indicated by the dotted arrow). Prior to deleting the relation, data that is stored on the target volume 304c and inherited by other sibling target volumes 304 may be copied from the target volume 304c to one or more sibling target volumes 304 so that the data is still accessible to the sibling target volumes 304. For example, in certain embodiments, such as when using the point-in-time-copy methodology described in Figures 4 through 8, the data will be copied to the closest older sibling (COS). Using other point-in-time-copy methodologies, the data may be copied to other sibling target volumes 304 other than the COS. Nevertheless, for the purposes of this disclosure, it will be assumed that the data is copied to the COS. Once all the data that is stored in the target volume 304c and inherited by other sibling target volumes 304 is copied to the COS, the relation between the source volume 302 and the target volume 304c may be deleted, thereby terminating the point-in-time copy relationship between the source volume 302 and the target volume 304c.
Referring to Figure 12B, in certain cases, a relation may be deleted between a source volume 302 and a space-efficient (SE) target volume 304. An SE target volume 304 differs from a standard target volume 304 (such as those illustrated in Figure 12 A) in that data is not physically stored in the volume. Rather, the SE target volume 304 is a virtual volume (as indicated by the dotted lines) whose data is physically stored in a common repository 1200. A mapping structure 1202 keeps track of where a SE target volume's data is physically located in the repository 1200. Stated otherwise, the mapping structure 1202 maps logical tracks of the SE target volume 304 to physical tracks of the repository 1200. From the perspective of a host device 106, reading from or writing to a SE target volume 304 may be the same as reading from or writing to a standard target volume.
Because a SE target volume 304 does not physically store any data, it is unnecessary to physically copy data from a SE target volume 304 to other sibling SE target volumes 304 when a relation is deleted. Rather, the mapping structure 1202 may be modified so that other sibling SE target volumes, and more specifically a COS volume or volumes, point to the SE target volume's data in the repository 1200. Stated otherwise, instead of physically copying data from one SE target volume to another, as may occur with standard target volumes, the mapping structure 1202 is modified so that data that is logically stored in one SE target volume is now logically stored in another SE target volume. For the purposes of this disclosure, it will be assumed that all target volumes referred to hereafter are space- efficient (SE) target volumes.
Referring to Figure 13, in certain embodiments, a relationship table 1300 is stored in memory 214 to keep track of each of the relations in the multi-target architecture 300. In certain embodiments, each relation has associated therewith a source relationship entry 1302a, corresponding to the source of the relation, and a target relationship entry 1302b, corresponding to the target of the relation. As will be explained in more detail hereafter, when deleting a relation, the source relationship entry 1302a and the target relationship entry 1302b associated with the relation may be marked as "deleted" to indicate that the relation is in the process of being deleted (i.e., the mapping structure is in the process of being modified to map data to the COS, in preparation to delete the relation). Marking the relationship entries 1302a, 1302b in this manner may also ensure that data is not written to the SE target volume 304 whose relation is in the process of being deleted. Once the mapping structure is modified so that data that was logically stored in the SE target volume is logically stored in the COS, the relation may be deleted. Deleting the relation may include deleting the source relationship entry 1302a and target relationship entry 1302b associated with the relation from the relationship table 1300.
Referring to Figure 14, one embodiment of a method 1400 for deleting a relation between a source 302 and a SE target 304 in a multi-target architecture 300 is illustrated. As shown, the method 1400 initially determines 1402 whether a request to withdraw (i.e., a request to delete a relation) has been received. If a request to withdraw has been received, the method 1400 marks 1404 the relationship entries associated with the relation as "deleted." This may include marking 1404 both the source relationship entry 1302a and the target relationship entry 1302b associated with the relation as "deleted." The method 1400 then determines 1406 whether a relation is already in process, meaning that the mapping structure 1202 is in the process of being modified to map data to a COS, in preparation to delete a relation.
If a relation is already in process, the method 1400 queues 1408 the relation. Upon queuing the relation, the method 1400 sorts 1408 the relations in the queue from oldest to youngest in order to process older relations prior to younger relations. This will ideally minimize the number of times that the mapping structure 1202 is modified. For example, if the mapping structure 1202 is modified to map data to a COS whose relation is in line to be deleted, the mapping structure 1202 may need to be modified again, wasting both time and resources. Processing the relations from oldest to youngest will help to ensure that the mapping structure 1202 is modified a minimal number of times.
Various different methods or techniques may be used to determine the age of the relations. In certain embodiments, the age of the relations is determined using generation numbers, as illustrated in Figure 9. For example, by inspecting the generation numbers on the source volume 302, the age of the relations may be readily determined. In the illustrated example of Figure 9, the generation number is incremented each time a new relation is generated. Thus, the relation associated with the generation number "1" is the oldest and the relation associated with the generation number "3" is the youngest. This convention could be reversed in other embodiments.
If no relations are in the queue, the method 1400 simply processes 1410 the relation. If one or more relations are in the queue, the method 1400 processes 1410 the next relation in the queue. Various methods for processing 1410 a relation will be described in association with Figures 15 and 16. Once a relation is processed, meaning that the mapping structure 1202 has been modified for a SE target 304 to map data to a COS 304, the method 1400 removes 1412 the relationship entries 1302a, 1302b associated with the relation from the relationship table 1300. This will terminate the relation. The method then checks 1414 whether any other relations are in the queue. If the queue is empty, the method 1400 waits 1402 for the next request to withdraw. If the queue is not empty, the method 1400 processes 1410 the next relation in the queue. This continues until all relations in the queue are processed.
In certain embodiments, the method 1400 is configured such that several relations can be in process at any particular time. In certain embodiments, the number of relations in process at any particular time may be limited so as not to overdrive storage devices 204 (e.g., disk drives, solid state drives, etc.) or device adapters 210 associated with the storage devices 204. For example, in certain embodiments, device adapters 210 and storage devices 204 may be limited to processing some number (e.g., four) of relations at any particular time to not overdrive the devices. When processing several relations simultaneously, older relations may be given priority over newer relations to minimize the number of times that a mapping structure 1202 is modified.
Referring to Figure 15, one embodiment of a method 1410 for processing a relation is illustrated. Such a method 1410 may be executed whenever a relation is processed 1410, as described in Figure 14. As shown, to process a relation, the method 1410 initially identifies 1500 the SE target associated with the relation. The method 1410 then identifies 1502 the closest older sibling (COS) of the SE target. The method 1410 then examines 1504 the first track of the SE target and the COS. If the method 1410 determines 1506 that the TBM of the SE target for the track is not set (indicating that the SE target includes a copy of the data) and determines 1508 that the TBM of the COS for the track is set (indicating that the COS does not include a copy of the data), then the method 1410 modifies 1510 the mapping structure 1202 to map the data in the repository 1200 to the COS. The TBM of the COS is then reset 1510 for the track to indicate that it includes a copy of the data. If, however, the TBM of the SE target for the track is set (indicating that the SE target does not include a copy of the data) or the TBM of the COS for the track is not set (indicating that the COS already includes a copy of the data), then the mapping structure 1202 is not modified and the method 1410 proceeds to the decision step 1512.
Once the method 1410 examines a track and either modifies the mapping structure 1202 or determines that no modification is necessary, the method 1410 determines 1512 whether the last track of the SE target 304 has been reached. If the last track has not been reached, the method 1410 examines 1514 the next track of the SE target and the corresponding track of the COS and repeats steps 1506, 1508, 1510, 1512. When all tracks in the SE target 304 have been examined and the mapping structure 1202 has been modified for those tracks where it is required, the method 1410 ends.
Referring to Figure 16, another embodiment of a method 1410 for processing a relation is illustrated. Such a method 1410 may be executed in place of the method of Figure 15 whenever a relation is processed 1410. The method 1410 illustrated in Figure 16 may be used to address implementations where different ranges of tracks in a SE target have different closest older siblings (COSs), such as in dataset-level point-in-time-copy implementations .
As shown, to process a relation, the method 1410 initially identifies 1600 the SE target associated with the relation and identifies 1602 a first track range (e.g., the first fifty tracks) of the SE target. The method 1410 then identifies 1604 the closest older sibling (COS) associated with the track range. The method 1410 then examines 1606 the first track of the track range and the corresponding track of the COS. If the method 1410 determines 1608 that the TBM for the track in the track range is not set (indicating that the track includes a copy of the data) and determines 1610 that the TBM for the corresponding track of the COS is set (indicating that the track in the COS does not include a copy of the data), then the method 1410 modifies 1620 the mapping structure 1202 to map the data in the repository 1200 to the COS. The TBM for the track in the COS is then reset 1620 to indicate that it now includes a copy of the data. If, however, the TBM for the track on the SE target is set (indicating that the SE target does not include a copy of the data) or the TBM of the COS for the corresponding track is not set (indicating that the COS already includes a copy of the data), then the mapping structure 1202 is not modified and the method 1410 proceeds to the decision step 1618.
Once the method 1410 examines a track in the track range and either modifies the mapping structure 1202 or determines that no modification is necessary, the method 1410 determines 1618 whether another track in the track range exists. If another track in the track range does exist, the method 1410 examines 1616 the next track of the track range along with the corresponding track in the COS by repeating steps 1608, 1610, 1620, 1618. When all tracks in the track range have been examined and the mapping structure 1202 has been modified for those tracks where it is required, the method 1410 determines 1614 whether there is another track range in the SE target. If there is another track range, the method 1410 identifies 1604 the COS for the track range and repeats steps 1606, 1608, 1610, 1620, 1618, 1616 for the track range and the identified COS. This continues until all tracks within all track ranges of the SE target have been examined and the mapping structure 1202 has been modified for those tracks where it is required. Once all tracks in all track ranges of the SE target have been examined and the mapping structure 1202 has been modified accordingly, the method 1410 ends.
The flowcharts and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer-usable media according to various preferred embodiments of the present invention. In this regard, each block in the flowcharts or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the Figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, may be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

Claims

1. A method for deleting a relation between a source and a space-efficient (SE) target in a multi-target architecture, the multi-target architecture comprising a source and a plurality of SE targets mapped thereto, the method comprising:
identifying a first relation for deletion from a multi-target architecture;
identifying a space-efficient (SE) target associated with the first relation, wherein a mapping structure maps data in logical tracks of the SE target to physical tracks of a repository;
identifying a sibling SE target that inherits data from the SE target;
modifying the mapping structure to map the data in the physical tracks of the repository to the logical tracks of the sibling SE target; and
deleting the first relation.
2. The method of claim 1, wherein the sibling SE target is a closest older sibling (COS).
3. The method of either of claims 1 or 2, wherein modifying the mapping structure further comprises:
(1) identifying data logically stored in the SE target that is not logically stored in the sibling SE target; and
(2) modifying the mapping structure such that the data that is logically stored in the SE target but not logically stored in the sibling SE target is logically stored in the sibling SE target.
4. The method of claim 3, further comprising identifying a second relation for deletion from the multi-target architecture.
5. The method of claim 4, further comprising determining whether the second relation is older than the first relation.
6. The method of either of claims 4 or 5, further comprising deleting the second relation before the first relation if the second relation is older than the first relation.
7. The method of any of claims 4 to 6, further comprising deleting the first relation before the second relation if the first relation is older than the second relation.
8. The method of any of claims 5 to 7, wherein determining whether the second relation is older than the first relation comprises finding the source associated with the first and second relations, and comparing generation numbers associated with the first and second relations to determine which relation is older.
9. The method of any of the preceding claims, wherein identifying a first relation for deletion further comprises marking a relationship entry associated with the first relation as deleted.
10. The method of claim 9, wherein deleting the first relation further comprises deleting the relationship entry associated with the first relation.
11. A computer program product for deleting a relation between a source and a space- efficient (SE) target in a multi-target architecture, the multi-target architecture comprising a source and a plurality of SE targets mapped thereto, the computer program product comprising:
a computer readable storage medium readable by a processing circuit and storing instructions for execution by the processing circuit for performing a method according to any of claims 1 to 10.
12. A computer program stored on a computer readable medium and loadable into the internal memory of a digital computer, comprising software code portions, when said program is run on a computer, for performing the method of any of claims 1 to 10.
13. An apparatus for deleting a relation between a source and a space-efficient (SE) target in a multi-target architecture, the multi-target architecture comprising a source and a plurality of SE targets mapped thereto, the apparatus comprising:
an identify component for identifying a first relation for deletion from a multi-target architecture; the identify component further operable for identifying a space-efficient (SE) target associated with the first relation, wherein a mapping structure maps data in logical tracks of the SE target to physical tracks of a repository;
the identify component further operable for identifying a sibling SE target that inherits data from the SE target;
a modify component for modifying the mapping structure to map the data in the physical tracks of the repository to the logical tracks of the sibling SE target; and
a delete component for deleting the first relation.
14. The apparatus of claim 13, wherein the sibling SE target is a closest older sibling (COS).
15. The apparatus of either of claims 13 or 14, further comprising:
(1) the identify component further operable for identifying data logically stored in the SE target that is not logically stored in the sibling SE target; and
(2) the modify component further operable for modifying the mapping structure such that the data that is logically stored in the SE target but not logically stored in the sibling SE target is logically stored in the sibling SE target.
16. The apparatus of claim 15, wherein the identify component is further operable for identifying a second relation for deletion from the multi-target architecture.
17. The apparatus of claim 16, further comprising a determine component for determining whether the second relation is older than the first relation.
18. The apparatus of either of claims 16 or 17, wherein the delete component is further operable for deleting the second relation before the first relation if the second relation is older than the first relation.
19. The apparatus of any of claims 15 to 18, wherein the delete component is further operable for deleting the first relation before the second relation if the first relation is older than the second relation.
20. The apparatus of any of claims 17 to 19, wherein the determine component is further operable for finding the source associated with the first and second relations, and for comparing generation numbers associated with the first and second relations to determine which relation is older.
21. The apparatus of any of claims 13 to 20, wherein the identify component is further operable for identifying a first relation for deletion further comprises marking a relationship entry associated with the first relation as deleted.
22. The apparatus of claim 21, wherein the delete component is further operable for deleting the first relation further comprises deleting the relationship entry associated with the first relation.
23. A method for performing a write to a target volume (target x) in a multi-target architecture, the multi-target architecture comprising a source volume and a plurality of target volumes mapped thereto, the method comprising:
determining whether the target x has a closest older sibling (COS), wherein the COS is a target volume established just before the target x;
determining whether a target bit map (TBM) for each of the target x and the COS are set;
if the TBMs for both the COS and the target x are set, copying data from a higher source (HS) volume to the COS;
if the TBM for the COS is set and the TBM for the target x is not set, copying the data from the target x to the COS; and
performing the write to the target x.
24. The method of claim 23, wherein finding the HS volume further comprises initially finding the source volume associated with the target x.
25. The method of either of claims 23 or 24, further comprising, by inspecting generation numbers (GN) on the source volume, finding the next younger sibling relative to the target x to determine if the next younger sibling is the HS volume.
26. The method of any of claims 23 to 25, further comprising, if a TBM of the next younger sibling is not set, copying the data from the next younger sibling to the COS.
27. The method of either of claims 25 to 26, further comprising, if no younger sibling exists, copying the data from the source volume to the COS.
28. A method for performing a read on a target volume (target x) in a multi-target architecture, the multi-target architecture comprising a source volume and a plurality of target volumes mapped thereto, the method comprising:
reading a target bit map (TBM) associated with the target x;
determining whether the TBM is set;
if the TBM is set, reading data from a higher source (HS) volume, wherein reading data from the HS volume comprises:
finding the source volume associated with the target x;
finding, by inspecting generation numbers (GNs) on the source volume, the next younger sibling relative to the target x; and
reading the data from the next younger sibling if a TBM associated with the next younger sibling is not set.
29. The method of claim 28, further comprising, if no younger sibling exists, reading the data from the source volume.
30. The method of either of claims 28 or 29, further comprising, if the TBM associated with the target x is not set, reading the data from the target x.
31. A method for performing a write to a source volume in a multi-target architecture, the multi-target architecture comprising a source volume and a plurality of target volumes mapped thereto, the method comprising:
copying data in a track of the source volume to a target volume (target x) mapped to the source volume;
enabling at least one sibling target volume (sibling) mapped to the source volume to inherit the data from the target x; and performing a write to the track of the source volume.
32. The method of claim 31 , wherein the target x is at least one of the youngest child and the oldest child mapped to the source volume.
33. The method of either of claim 32 or 33, wherein inheriting the data from the target x comprises directing reads to the sibling to the target x.
34. The method of either of claims 32 or 33, wherein inheriting the data from the target x comprises directing copies from the sibling to the target x.
35. A method for deleting a relation between a source and a target in a multi-target architecture, the multi-target architecture comprising a source and a plurality of targets mapped thereto, the method comprising:
identifying a first relation for deletion from a multi-target architecture;
identifying a target associated with the first relation;
identifying a sibling target that inherits data from the target;
copying the data from the target to the sibling target; and
deleting the first relation.
36. The method of claim 1, wherein the sibling target is the closest older sibling (COS).
37. The method of either of claim 35 or 36, wherein copying the data from the target to the sibling target comprises (1) identifying data stored in the target that is not stored in the sibling target, (2) copying the data that is stored in the target but not stored in the sibling target from the target to the sibling target.
38. The method of any of claims 35 to 37, further comprising identifying a second relation for deletion from the multi-target architecture.
39. The method of claim 38, further comprising determining whether the second relation is older than the first relation.
40. The method of claim 38, further comprising deleting the second relation before the first relation if the second relation is older than the first relation.
41. The method claim 38, further comprising deleting the first relation before the second relation if the first relation is older than the second relation.
42. The method of claim 39, wherein determining whether the second relation is older than the first relation comprises finding the source associated with the first and second relations, and comparing generation numbers associated with the first and second relations to determine which relation is older.
43. The method of any of claims 35 to 42, wherein identifying a first relation for deletion further comprises marking a relationship entry associated with the first relation as deleted.
44. The method of claim 43, wherein deleting the first relation further comprises deleting the relationship entry associated with the first relation.
PCT/IB2012/050996 2011-03-08 2012-03-02 Deleting relations between sources and space-efficient targets in multi-target architectures WO2012120421A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
DE112012000604.6T DE112012000604T5 (en) 2011-03-08 2012-03-02 Delete relationships between sources and space-efficient targets in multi-target architectures
CN201280011948.6A CN103415843B (en) 2011-03-08 2012-03-02 Delete the relation between source and the space-efficient target in multi-objective system structure
JP2013557198A JP6048976B2 (en) 2011-03-08 2012-03-02 Method, computer program, and apparatus for deleting a relationship between a source and a space efficient target in a multi-target architecture
GB1316907.3A GB2502929B (en) 2011-03-08 2012-03-02 Deleting relations between sources and space-efficient targets in multi-target architectures

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US13/043,409 US20120233121A1 (en) 2011-03-08 2011-03-08 Deleting relations between sources and space-efficient targets in multi-target architectures
US13/043,394 US20120233416A1 (en) 2011-03-08 2011-03-08 Multi-target, point-in-time-copy architecture with data deduplication
US13/043,409 2011-03-08
US13/043,394 2011-03-08
US13/043,398 2011-03-08
US13/043,398 US8667237B2 (en) 2011-03-08 2011-03-08 Deleting relations in multi-target, point-in-time-copy architectures with data deduplication

Publications (1)

Publication Number Publication Date
WO2012120421A1 true WO2012120421A1 (en) 2012-09-13

Family

ID=46797545

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2012/050996 WO2012120421A1 (en) 2011-03-08 2012-03-02 Deleting relations between sources and space-efficient targets in multi-target architectures

Country Status (5)

Country Link
JP (1) JP6048976B2 (en)
CN (1) CN103415843B (en)
DE (1) DE112012000604T5 (en)
GB (1) GB2502929B (en)
WO (1) WO2012120421A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060200640A1 (en) * 2005-03-02 2006-09-07 International Business Machines Corporation Storage system with cascaded copy targeting and enhanced integrity
US20090319735A1 (en) * 2008-06-23 2009-12-24 International Business Machines Corporation Space Efficient De-Allocation for Cascade/Multiple Target Flash Copy Cleaning
WO2010040768A2 (en) * 2008-10-08 2010-04-15 International Business Machines Corporation Method for optimizing cleaning of maps in flashcopy cascades containing incremental maps
US20100174880A1 (en) * 2009-01-06 2010-07-08 International Business Machines Corporation Method for fast format of a fully allocated volume when copied from a space efficient volume

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4644446B2 (en) * 2004-06-11 2011-03-02 インターナショナル・ビジネス・マシーンズ・コーポレーション Method, system, and program for managing information about a relationship between a target volume and a source volume when performing additional operations on the relationship
GB0428108D0 (en) * 2004-12-23 2005-01-26 Ibm Storage system with multiple copy targeting
JP4662548B2 (en) * 2005-09-27 2011-03-30 株式会社日立製作所 Snapshot management apparatus and method, and storage system
US7587564B2 (en) * 2006-09-26 2009-09-08 International Business Machines Corporation System, method and computer program product for managing data versions
US7593973B2 (en) * 2006-11-15 2009-09-22 Dot Hill Systems Corp. Method and apparatus for transferring snapshot data
US7716183B2 (en) * 2007-04-11 2010-05-11 Dot Hill Systems Corporation Snapshot preserved data cloning
JP5228466B2 (en) * 2007-12-14 2013-07-03 富士通株式会社 Backup device, backup method and backup program
US8327095B2 (en) * 2008-06-06 2012-12-04 International Business Machines Corporation Maintaining information of a relationship of target volumes comprising logical copies of a source volume
US8449679B2 (en) * 2008-08-15 2013-05-28 Lam Research Corporation Temperature controlled hot edge ring assembly
JP5581776B2 (en) * 2010-03-31 2014-09-03 富士通株式会社 Backup device, backup method and backup program

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060200640A1 (en) * 2005-03-02 2006-09-07 International Business Machines Corporation Storage system with cascaded copy targeting and enhanced integrity
US20090319735A1 (en) * 2008-06-23 2009-12-24 International Business Machines Corporation Space Efficient De-Allocation for Cascade/Multiple Target Flash Copy Cleaning
WO2010040768A2 (en) * 2008-10-08 2010-04-15 International Business Machines Corporation Method for optimizing cleaning of maps in flashcopy cascades containing incremental maps
US20100174880A1 (en) * 2009-01-06 2010-07-08 International Business Machines Corporation Method for fast format of a fully allocated volume when copied from a space efficient volume

Also Published As

Publication number Publication date
GB2502929B (en) 2020-06-03
DE112012000604T5 (en) 2014-01-16
JP6048976B2 (en) 2016-12-27
GB201316907D0 (en) 2013-11-06
CN103415843A (en) 2013-11-27
JP2014511539A (en) 2014-05-15
GB2502929A (en) 2013-12-11
CN103415843B (en) 2016-12-21

Similar Documents

Publication Publication Date Title
US8843719B2 (en) Multi-target, point-in-time-copy architecture with data duplication
US7783850B2 (en) Method and apparatus for master volume access during volume copy
US8972681B2 (en) Enhanced copy-on-write operation for solid state drives
US7975115B2 (en) Method and apparatus for separating snapshot preserved and write data
US7593973B2 (en) Method and apparatus for transferring snapshot data
US8606767B2 (en) Efficient metadata invalidation for target CKD volumes
US20110078682A1 (en) Providing Object-Level Input/Output Requests Between Virtual Machines To Access A Storage Subsystem
US20110173404A1 (en) Using the change-recording feature for point-in-time-copy technology to perform more effective backups
US11789611B2 (en) Methods for handling input-output operations in zoned storage systems and devices thereof
US9086811B2 (en) Managing data sets of a storage system
US10664189B2 (en) Performance in synchronous data replication environments
US9594511B2 (en) Cascaded, point-in-time-copy architecture with data deduplication
US8850147B2 (en) Deleting relations in multi-target, point-in-time-copy architectures with data deduplication
US8458134B2 (en) Near continuous space-efficient data protection
US11048667B1 (en) Data re-MRU to improve asynchronous data replication performance
US10366014B1 (en) Fast snap copy
US20120233136A1 (en) Deleting relations between sources and space-efficient targets in multi-target architectures
WO2012120421A1 (en) Deleting relations between sources and space-efficient targets in multi-target architectures
US8892834B2 (en) Cyclic point-in-time-copy architecture with data deduplication
US11379427B2 (en) Auxilary LRU list to improve asynchronous data replication performance
US11314691B2 (en) Reserved area to improve asynchronous data replication performance

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12754475

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2013557198

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 112012000604

Country of ref document: DE

Ref document number: 1120120006046

Country of ref document: DE

ENP Entry into the national phase

Ref document number: 1316907

Country of ref document: GB

Kind code of ref document: A

Free format text: PCT FILING DATE = 20120302

WWE Wipo information: entry into national phase

Ref document number: 1316907.3

Country of ref document: GB

122 Ep: pct application non-entry in european phase

Ref document number: 12754475

Country of ref document: EP

Kind code of ref document: A1