US20080034005A1 - Control device for storage system capable of acting as a constituent element of virtualization storage system - Google Patents
Control device for storage system capable of acting as a constituent element of virtualization storage system Download PDFInfo
- Publication number
- US20080034005A1 US20080034005A1 US11/529,053 US52905306A US2008034005A1 US 20080034005 A1 US20080034005 A1 US 20080034005A1 US 52905306 A US52905306 A US 52905306A US 2008034005 A1 US2008034005 A1 US 2008034005A1
- Authority
- US
- United States
- Prior art keywords
- management
- storage system
- identifier
- storage
- identifiers
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
- G06F3/0635—Configuration or reconfiguration of storage systems by changing the path, e.g. traffic rerouting, path reconfiguration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
- G06F3/0607—Improving or facilitating administration, e.g. storage management by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
- G06F3/0617—Improving the reliability of storage systems in relation to availability
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0647—Migration mechanisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0662—Virtualisation aspects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0683—Plurality of storage devices
- G06F3/0689—Disk arrays, e.g. RAID, JBOD
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/46—Interconnection of networks
- H04L12/4641—Virtual LANs, VLANs, e.g. virtual private networks [VPN]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- H04L67/125—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
Definitions
- the present invention relates to a virtual storage system that virtualizes a plurality of storage systems logically as one storage resource.
- a plurality of computing resources distributed over a network are operated as if these computing resources were one computing resource and there has been a focus on ‘storage grids (wide bandwidth common file system)’ which increase the processing performance and fault tolerance and so forth.
- storage grids wide bandwidth common file system
- construction that involves assembling a plurality of storage systems that operate as a single storage system, for example, may be considered.
- a case where two storage systems a and b are a storage grid may be considered as a specific example.
- the numbers of the logical storage devices also called logical volumes and abbreviated to ‘LDEV’ hereinbelow
- LDEV logical volumes and abbreviated to ‘LDEV’ hereinbelow
- the same problem can also occur with copy system control information such as pair numbers and group numbers and so forth, for example (the numbers of groups consisting of a plurality of pairs).
- copy system control information such as pair numbers and group numbers and so forth, for example (the numbers of groups consisting of a plurality of pairs).
- the storage systems a and b sometimes each comprise at least one management server (‘SVP’ (service processor) hereinbelow).
- SVP management server
- An SVP receives an instruction to input information to a management-target storage system, outputs the information, and holds management information for the storage system, for example.
- SVP management server
- a virtual storage system is constructed with storage systems a and b forming the storage grid and information managed by the SVP of storage system a is obtained by storage system b, then storage system b must issue an inquiry to the SVP of storage system a.
- the storage system b issues an inquiry to the SVP, the processing grows complex and the load increases.
- an object of the present invention is to make it possible to smoothly establish storage systems that operate individually as the constituent elements of a virtual storage system.
- a further object of the present invention is to provide a new management method that is completed without the respective storage systems of the virtual storage system seeking management information from the management servers of the other storage systems.
- a control device is a control device for managing a management target constituting the target of processing executed by a first storage system in accordance with a request transmitted from a higher-level device and for controlling the operation of the first storage system.
- the control device comprises an identifier correspondence storage section for storing identifier correspondence information that records first and second management identifiers for each of a plurality of management targets; a reception section for receiving a request designating the first management identifier from the higher-level device; a correspondence specification section for specifying the second management identifier that corresponds with the first management identifier designated by the received request from the identifier correspondence information; and an output section for outputting the specified second management identifier to the processing section of the first storage system.
- the second management identifier is a management identifier of a type that is used for the processing by the first storage system.
- the processing section of the first storage system is able to identify the processing target from the second management identifier thus output.
- the first management identifier is a management identifier of a type that is recognized by the higher-level device and which is changed to a value that does not overlap the first management identifier of the management target of another storage system of a virtual storage system obtained by logically virtualizing a plurality of storage systems as one storage resource when the first storage system is a constituent element of the virtual storage system.
- the control device may be installed in the first storage system or may be a separate device from the first storage system.
- the first and second management identifiers are an identifier for identifying each of a plurality of logical storage devices that exist in the first storage system and/or an identifier for identifying each of a plurality of specified resources.
- a specified resource can be a pair for copying from a logical storage device to another logical storage device, for example.
- the pair may be a single pair or a pair which is a constituent element of a pair group constituted by a plurality of pairs.
- control device further comprises a change section for changing the first management identifier in accordance with a change in the number of storage systems constituting the virtual storage system.
- control device is the control device according to the second embodiment, wherein the change in the number of storage systems involves adding the first storage system to an existing virtual storage system.
- the change section changes each of a plurality of first management identifiers that correspond with each of a plurality of management targets of the first storage system to values that do not overlap a plurality of first management identifiers of respective other storage systems of the existing virtual storage system.
- the control device is the control device according to the second embodiment, wherein the change in the number of storage systems involves constructing a third virtual storage system by merging a second virtual storage system with the existing first virtual storage system containing the first storage system according to the second embodiment.
- the change section changes each of a plurality of first management identifiers that correspond with each of a plurality of management targets of the first storage system to values that do not overlap a plurality of first management identifiers of respective other storage systems of the third virtual storage system.
- control device is the control device according to the second embodiment, further comprising a change report section that reports the changed plurality of first management identifiers to the higher-level device.
- control device is the control device according to the second embodiment, wherein the change section changes the plurality of first management identifiers to the same values as the plurality of second management identifiers respectively when the first storage system is independent as a result of the first storage system being removed from the virtual storage system.
- the control device is the control device according to the second embodiment, wherein each of the plurality of management targets is a logical storage device.
- the first and second storage systems constituting the virtual storage system are connected to an external storage system that does not constitute the virtual storage system and an intangible first virtual logical storage device of the first storage system and an intangible second virtual logical storage device of the second storage system are connected to a tangible external logical storage device of the external storage system.
- the change section affords the first management identifier of the first virtual logical storage device the same value as the first management identifier of the second virtual logical storage device.
- the management method according to a second aspect of the present invention is a management method of a virtual storage system obtained by logically virtualizing a plurality of storage systems as one storage resource.
- This management method connects a plurality of management computers held by the plurality of storage systems by means of a network and collectively manages a plurality of management information items that are each managed by the plurality of management computers by means of one master management computer.
- a management computer other than the plurality of management computers is connected to the network.
- the other management computer is rendered the master management computer and the plurality of management computers are rendered the slave management computers.
- the master management computer stores the respective identifiers of the plurality of slave management computers.
- Each of the plurality of slave management computers stores the identifiers of the master management computers.
- Each of the plurality of slave management computers transmits management information to the master management computer.
- the master management computer receives each of a plurality of management information items from the plurality of slave management computers and stores the plurality of management information items thus received in the storage resource of the master management computer.
- one of the plurality of management computers is rendered the master management computer and the other management computers are rendered slave management computers.
- the master management computer stores the identifiers of the slave management computers.
- the slave management computers store the identifiers of the master management computer.
- the slave management computers transmit management information to the master management computer.
- the master management computer receives management information from the slave management computers and stores the management information thus received in the storage resource of the master management computer.
- the master management computer also stores management information for managing the storage system to which the master management computer is itself connected in the storage resource of the master management computer in addition to the management information of the slave management computers.
- the master management computers are multiplexed and one of the multiplexed master management computers is rendered Active while the others are rendered Passive.
- the Active master management computer is stopped, any of the Passive master management computers becomes Active and operates as the master management computer in place of the stopped master management computer.
- the master management computer broadcasts a master identifier which is its own identifier to management computers other than itself.
- the management computers that receive the master identifier store the received master identifier in their own storage resource and, by way of response, transmit slave identifiers which are their own identifiers to the master management computer constituting the transmission origin of the master identifier.
- the master management computer receives the slave identifiers from management computers other than itself and store the slave identifiers thus received in its own storage resource.
- a computer system comprises a control device for managing a management target constituting the target of processing executed by a first storage system in accordance with a request transmitted from a higher-level device and for controlling the operation of the first storage system; a virtual storage system obtained by logically virtualizing a plurality of storage systems including the first storage system as one storage resource; and a virtualization section for providing the virtual storage system as the one storage resource.
- the control device comprises an identifier correspondence storage section for storing identifier correspondence information that records first and second management identifiers for each of a plurality of management targets; a reception section for receiving a request designating the first management identifier from the higher-level device;
- the second management identifier is a management identifier of a type that is used for the processing by the first storage system and the processing section of the first storage system identifies the processing target from the second management identifier thus output.
- the first management identifier is a management identifier of a type that is recognized by the higher-level device and which is changed to a value that does not overlap the first management identifier of the management target of another storage system of a virtual storage system obtained by logically virtualizing a plurality of storage systems as one storage resource when the first storage system is a constituent element of the virtual storage system.
- control device further comprises a change section that changes the first management identifier in accordance with a change in the number of storage systems constituting the virtual storage system; and a change report section that reports the changed plurality of first management identifiers to the virtualization section.
- the virtualization section manages the correspondence between a plurality of third management identifiers that can be designated by a host and the plurality of first management identifiers and, when the changed plurality of first management identifiers are received, changes the plurality of first management identifiers that correspond with each of the plurality of third management identifiers to the changed plurality of first management identifiers thus received.
- the higher-level device is a switch that is interposed between the host and the virtual storage system.
- the virtualization section is installed in the switch.
- the higher-level device is the host, and the virtualization section is installed in the host.
- the storage section of the above control device or computer system can be constructed by a storage resource such as a memory, for example.
- the other parts of the control device or computer system can be constructed by hardware, a computer program or a combination thereof (a portion is implemented by a computer program while the remainder is implemented by hardware, for example).
- the computer program is read to a predetermined processor and executed.
- a storage area that exists in a hardware resource such as memory may be suitably used during information processing that is performed when a computer program is read to the processor.
- the computer program may be installed on a computer from a recording medium such as a CD-ROM or may be downloaded to the computer via a communication network.
- FIG. 1 shows a constitutional example of the whole system according to a first embodiment of the present invention
- FIG. 2 shows a constitutional example of a same-device correspondence table 62 ;
- FIG. 3 shows various programs and tables that are stored in a memory 22 of a storage system 20 ;
- FIG. 4A shows an example of a number management table 105 B in a storage system 20 B that operates independently;
- FIG. 4B shows the number management table 105 in the storage system 20 B after the global LDEV numbers have been changed
- FIG. 5 shows a constitutional example of a device information table 106 ;
- FIG. 6 shows the flow of processing that is performed when the storage system 20 receives an access request
- FIG. 7 a shows the relationship between the global LDEV numbers of respective storage systems 20 A and 20 B that do not constitute a virtual storage system and local LDEV numbers;
- FIG. 7 b shows the relationship between the global LDEV numbers of the respective storage systems 20 A and 20 B that constitute a virtual storage system and local LDEV numbers;
- FIG. 8A shows the relationship between the global LDEV numbers of separate virtual storage systems 100 A and 100 B and local LDEV numbers
- FIG. 8B shows the relationship between global LDEV numbers of a virtual storage system 100 C constituted as a result of the other virtual storage system 100 B merging with the virtual storage system 100 A and local LDEV numbers;
- FIG. 9A is an explanatory diagram of a first method of SVP integrated management
- FIG. 9B is an explanatory diagram of a second method of SVP integrated management
- FIG. 10 is a flowchart showing the procedure for performing SVP integrated management by means of the first method
- FIG. 11 is a flowchart showing the procedure for performing SVP integrated management by means of the second method
- FIG. 12A shows storage system management information for the storage system 20 A
- FIG. 12B shows storage system management information for the storage system 20 D
- FIG. 13 shows virtual storage system management information
- FIG. 14 shows virtual storage system overall information
- FIG. 15A shows fail over management information for a failed over LDEV
- FIG. 15B shows fail over management information for an LDEV that has not been failed over
- FIG. 16 shows the overall constitution of a system relating to a modified example of this embodiment
- FIG. 17 is an example of the flow of access by the virtual storage system
- FIG. 18 is an example of the access flow after a fault occurs in the path between the storage system 20 A and an external storage system 70 in the system in FIG. 17 ;
- FIG. 19 is an example of the flow of an Active/Passive switch between storage systems.
- FIG. 20 is a flowchart showing an example of the procedure for constructing a virtual storage system.
- FIG. 1 shows a constitutional example of the whole system according to a first embodiment of the present invention.
- the description is provided by using only parent numerals ( 100 , for example) and, when elements of the same type are described with differentiation, the description is provided by using parent and child numerals ( 100 a, 100 b , for example).
- the virtual storage system 100 a comprises a plurality of storage systems 20 a and 20 b and the external storage system 70 .
- the virtual storage system 100 b comprises a plurality of storage systems 20 c and 20 d and the external storage system 70 .
- the virtual storage system 100 b which has the same constitution as the virtual storage system 100 a, may also be connected to a san 41 in the same way.
- the respective hosts 51 comprise a CPU and a storage resource (memory, for example) (not illustrated).
- a computer program is stored in the storage resource and the CPU is able to execute the computer program.
- the computer program is the subject hereinbelow, in reality, processing is performed by the CPU that executes the computer program.
- the host 51 a is connected to the respective storage systems 20 a and 20 b.
- the host 51 a is connected to the respective storage systems 20 a and 20 b via the san (storage area network) 41 .
- the host 51 a recognizes the plurality of storage systems 20 a and 20 b logically as one storage resource (virtual storage system) 100 a by means of the functions of alternate path software 61 .
- Another host 51 b that does not comprise alternate path software 61 is connected to the respective storage systems 20 a and 20 b via a san 42 , a virtualization device 52 , and the san 41 .
- the host 51 b recognizes the plurality of storage systems 20 a and 20 b as one virtual storage system 100 a by means of the functions of the alternate path software 61 in the virtualization device 52 .
- the virtualization device 52 virtualizes the storage areas provided by each of the plurality of storage systems 20 a and 20 b into one logical storage area.
- the virtualization device 52 is a virtualization switch, intelligent switch, or virtualization-dedicated switch, or the like, for example. Further, a system constituting comprising a virtual storage system 100 and the virtualization device 52 is called a storage network system.
- the respective hosts 51 comprise an application program 60 .
- the application program 60 is a business program such as database management software, web application software, streaming application software, for example.
- the alternate path software 61 manages logical paths between the host 51 a and logical storage devices (LDEV) in the virtual storage system 100 a and executes alternate path control.
- alternate path control involves controlling which logical path among a plurality of logical paths is used to access an LDEV.
- the alternate path software 61 comprises an alternate path management program (not shown), an inter-storage system alternate path program (not shown), a priority control program (not shown), and the same-device correspondence table 62 of FIG. 2 . Further, the aforementioned programs and table are managed for each of the virtual storage systems 100 a and 100 b. The same is true of the following description. The virtual storage system 100 a will be described here.
- the alternate path management program performs management and control of the whole alternate path software 61 .
- the inter-storage system alternate path program recognizes the plurality of logical paths connected to the same external LDEV 701 via each of the plurality of storage systems 20 as alternate paths.
- the external LDEV is an LDEV that is provided in the external storage system 70 and is an LDEV that is mapped to the LDEV of the storage system in the virtual storage system 100 .
- the priority control program selects a logical path that is to be used as a priority from among the plurality of logical paths on the basis of the usage rate of each of the plurality of logical paths connected to the same LDEV.
- the same-device correspondence table 62 shows the correspondence relationship between the logical paths and logical devices in the environment of a network in which different logical paths are connected to the same logical device. More specifically, the path numbers, identifiers of the storage systems of the virtual storage system, LUN, and global LDEV numbers are recorded for each logical path as shown in FIG. 2 in the same-device correspondence table 62 , for example.
- the global LDEV numbers of the logical paths with path numbers 0 , 2 , and 3 are the same because the respective local LDEV numbers corresponding with the same global LDEV numbers are connected to the same external LDEV.
- each of the plurality of logical paths will be called an ‘alternate path’ hereinbelow.
- the same-device correspondence table 62 is stored in the storage system 20 and the virtual storage system is constructed by a plurality of storage systems, for example, preparations are made for each virtual storage system 100 .
- a single logical path can also be managed by the same-device correspondence table 62 . In other words, the correspondence relationships between the LUN recognized by the application 60 and the global LDEV numbers managed by the storage system 20 are registered in the same-device correspondence table 62 .
- the storage system 20 can be broadly classified into a control unit and a storage unit, for example.
- the control unit comprises, for example, a CPU (central processing unit) 21 , a memory 22 , a disk interface control unit 23 , FC (fiber channel) interface control units 25 and 26 , and LAN (local area network) interface control units 27 and 28 .
- the storage section is a disk unit 24 , for example.
- the CPU 21 executes a variety of control processes of the storage system 20 by executing a variety of programs or modules stored in the memory 22 .
- the memory 22 is called the internal storage device and includes an involatile memory for storing a variety of modules and so forth and a volatile memory for temporarily holding the results of the computation processing of the cpu 21 .
- the CPU 21 is connected to the disk unit 24 via the disk interface control unit 23 .
- the disk interface control unit 23 converts logical addresses output from the CPU 21 into IBA (logical block address) and enables access to the logical devices by the cpu 21 .
- the disk unit 24 comprises a plurality of disk drives 240 with a raid (redundant arrays of independent inexpensive disks) constitution.
- the disk drives 240 are physical devices such as FC (fibre channel) disk drives, SATA (serial advanced technology attachment disk drives, PATA (parallel advanced technology attachment) disk drives, FATA (fibre attached technology adapted disk drives, SAS (serial attached SCSI) disk drives or SCSI (small computer system interface) disk drives.
- a physical device is a real device with a real storage area. Further, a physical device is not limited to a disk drive 240 and another type of storage device (flash memory, for example) may also be adopted.
- the LDEV 242 is a virtual device without a real storage area. an actual storage area for storing data exists in the logical device 701 in the external storage system 70 . That is, the storage system 20 incorporates the external LDEV 701 of the external storage system 70 as its own internal device and provides same to the host 51 as a logical unit.
- the host 51 is a UNIX (registered trademark)-based system
- the logical unit is associated with a device file.
- the host 51 is a windows (registered trademark)-based system
- the logical unit is associated with a drive letter (drive name).
- a LUN (logical unit number) is assigned to the logical unit.
- the command device 243 is a dedicated logical unit for delivering commands and statuses between the host 51 and storage systems 20 .
- the commands transmitted from the host 51 to the storage systems 20 are written to a command device 243 .
- the storage system 20 executes processing corresponding with the commands written to the command device 243 and writes the execution results to the command device 243 as the status.
- the details of the command management using the command device 243 will be described subsequently.
- the disk interface control unit 23 is able to control a plurality of disk drives 240 by the raid level ( 0 , 1 , 5 , for example) specified by the raid system.
- a raid system a plurality of disk drives 240 are managed as one raid group.
- the raid group is constituted by grouping four disk drives 240 as one set ( 3 d + 1 p ) or by grouping eight disk drives 240 as one set ( 7 d + 1 p ), for example. That is, one raid group is constituted by assembling storage areas provided by a plurality of disk drives 240 .
- a plurality of logical devices 241 constituting access units accessed by the host 51 are defined in the raid group.
- One or more logical devices 241 are mapped with a logical unit constituting a logical storage area recognized by the host 51 .
- the host 51 is able to access the logical devices 241 by designating the LUN and IBA.
- the storage system 20 need not necessarily comprise the disk unit 24 and disk interface control unit 23 .
- the commands, control information, and data can be transferred via the host 51 .
- one virtual storage system 100 may be connected to one or more external storage systems 70 and an external storage system 70 may be connected from a plurality of virtual storage systems 100 .
- An FC interface control unit 25 controls the transfer of commands and data and so forth via a san 43 between the storage systems 20 and external storage systems 70 .
- An FC interface control unit 26 controls the transfer of commands and data and so forth via the san 41 between the storage systems 20 and hosts 51 .
- a fiber channel protocol and ISSCSI protocol and so forth can be adopted as the data communication protocol via the san 41 and 43 , for example.
- the san 43 is not essential and the FC interface control unit 25 and external storage system 70 may be directly connected by an optic fiber cable or the like.
- a LAN interface control unit 27 is connected to a management server 50 via a management network 40 .
- the management network 40 is a LAN constituted by an Ethernet (registered trademark) cable or the like.
- the data communication protocol of the management network 40 is TCP/IP, for example.
- the management server 50 is able to manage the settings of the access path (LUN masking and zoning and so forth) between the host 51 and virtual storage systems 100 through the creation of LDEV in the virtual storage systems 100 and the allocation of a LDEV to the host 51 .
- the external storage system 70 has one or more disk drives 700 with a raid constitution.
- the disk drive 700 may be a storage device such as an FC (FIBRE channel) disk drive, SATA (serial advanced technology attachment) disk drive, PATA (parallel advanced technology attachment) disk drive, FATA (FIBRE attached technology adapted) disk drive, SAS (serial attached SCSI) disk drive or SCSI (small computer system interface) disk drive.
- An external LDEV 701 is formed on a plurality of disk drives 700 . Further, there may be storage devices of another type (flash memory, for example) instead of or in addition to the disk drive 700 .
- the external storage system 70 may be of a different type from the storage system 20 or may be of the same type as the storage system 20 .
- An SVP (service processor) 81 is a computer terminal that sets information on the constitution of the storage system 20 (including the device information table 106 and mapping table 108 described subsequently) and acquires operating information and so forth.
- the svp 81 is connected to a LAN interface control unit 28 of the storage system 20 .
- the respective svp 81 connected to the respective storage systems 20 is connected to one master SVP.
- the master SVP centrally manages information (information on the constitution of the storage system 20 as well as operating information and so forth) that is collected from the respective svp 81 .
- One of a plurality of svp 81 may also function as the master SVP or the respective storage systems 20 may be directly connected to a master svp 82 .
- a management method that comprises the master SVP will be described subsequently.
- the virtual storage system 100 indicates the range in which the command transfers and volume migration between the respective storage systems 20 can be executed by sending and receiving constitution information between the storage systems 20 .
- the range of the virtual storage system 100 includes the plurality of storage systems 20 and the external storage system 70 .
- the range of the virtual storage system 100 includes the plurality of storage systems 20 and does not include the external storage system 70 .
- the respective storage systems 20 can be constituted as a disk array system that comprises a plurality of disk drives 240 with a raid constitution or can be constituted as a virtualization switch with the respective storage systems 20 themselves are the SCSI targets, for example.
- a device that manages management identifiers that are hierarchized such as LDEV numbers and controls the operation of storage systems can be called a ‘control device’.
- a control device may be in the storage system 20 or outside same.
- the management network 40 is connected to one or more hosts 51 . Further, one or more client computers 30 are connected to the management network 40 . The respective client computers 30 are able to connect to the hosts 51 via the management network 40 and issue data i/o requests to the virtual storage systems 100 via the application program 60 .
- FIG. 3 shows various programs and tables that are stored in the memory 22 of the storage system 20 .
- the number management table 105 is a correspondence table of global LDEV numbers and local LDEV numbers.
- the device information table 106 is a table that holds attributes of the logical devices.
- the mapping table 108 is a table that shows the correspondence relationship between the LDEV number of the external LDEV 701 and the local LDEV number (may be a global LDEV number instead of or in addition to same).
- FIGS. 4 a and 4 b show constitutional examples of the number management table 105 .
- the number management table 105 is a correspondence table of ‘global LDEV numbers’, which are numbers visible to devices higher than the virtual storage system 100 (the host 51 and/or virtualization device 52 ) and ‘local LDEV numbers’, which are the numbers when processing is performed within the storage system 20 .
- ‘global LDEV numbers’ which are numbers visible to devices higher than the virtual storage system 100 (the host 51 and/or virtualization device 52 )
- ‘local LDEV numbers’ which are the numbers when processing is performed within the storage system 20 .
- a request with a global LDEV number is received from the host 51 a
- the local LDEV numbers corresponding with the global LDEV numbers are acquired from the table 105 by the number management program 102 and processing (writing or reading (i/o) processing with respect to the LDEV, for example) is performed by using the acquired local LDEV number.
- Only the information on the global LDEV numbers is held as mentioned earlier in the alternate path software 61 (see FIG. 2 ). The difference between FIGS
- a table of LDEV numbers is shown here, the table is not limited to LDEV numbers.
- the same table can also be held for other types of management identifiers (copy system pair numbers and group numbers and so forth, for example) used by separate storage systems but with the risk of duplication because there is one virtual storage system.
- a management identifier that is designated by a request of some kind from a higher-level device (host, for example) can be cited as another type if management identifier, for example.
- FIG. 5 shows a constitutional example of the device information table 106 .
- the device information table 106 is a table for managing the attributes of the respective LDEVs. a ‘device number’, ‘status flag’ and ‘external device flag’ are recorded for each LDEV, for example, in the device information table 106 .
- a ‘device number’ is a local LDEV number for uniquely recognizing the LDEVs 241 and 242 in the storage system 20 .
- the ‘status flag’ indicates a state where the LDEV 241 and 242 in the storage system 20 are being used or a state where same are not being used (empty state). On in the device information table 106 is a state where the LDEV 241 and 242 are being used.
- the ‘external device flag’ indicates whether the LDEV (virtual device) 242 in the storage system 20 is being used as the external LDEV 701 .
- On in FIG. 5 indicates that the LDEV 242 is being used as an external LDEV.
- “Off” indicates that the LDEV 241 is being used as an internal LDEV.
- the default value of the external device flag is “off” and, when the LDEV 242 in the storage system 20 is mapped to the logical device 701 in the external storage system 70 , “off” is changed to “on”.
- FIG. 6 shows the flow of processing that is performed when the storage system 20 receives an access request.
- the serial process flow that is performed when the virtual storage system 100 a is accessed by the host 51 will now be described with reference to FIG. 6 and FIGS. 1 and 3 .
- the application program 60 issues an access request that designates a LUN.
- the alternate path software 61 specifies the storage system identifier and global LDEV number corresponding with the LUN designated by the access request from the same-device correspondence table 62 .
- the alternate path software 61 issues an access request that designates a global LDEV number to the storage system 20 that is recognized by the storage system identifier.
- the alternate path software 61 may issue an access request by using another alternate path when there is a special reason to do so such as mixing of the alternate paths corresponding with the designated LUN.
- the storage system 60 receives an access request that designates a global LDEV number (step s 101 ).
- the storage system specifies the local LDEV number that corresponds with the global LDEV number from the number management table 105 by means of the number management program 102 .
- the storage system 60 (i/o processing program (not shown), for example) references the device information table 106 and judges whether the specified local LDEV number corresponds with an internal LDEV (whether the external device flag is “off”) or corresponds with an external LDEV (whether the external device flag is “on”) (s 102 ). That is, it is judged whether the access request is an access request to access the external LDEV 701 or an access request to access the internal LDEV 241 .
- the storage system 20 references the mapping table 108 , performs an address conversion or the like to the external LDEV 701 and transmits an access request to access the external LDEV 701 to the external storage system 70 (s 104 ).
- the storage system 20 accesses the internal LDEV 241 in the event of an access request to access the internal LDEV 241 (no in s 102 ) (s 103 ).
- the virtual storage system is constructed by means of the procedure described hereinbelow. This procedure will be described with reference to FIG. 20 .
- the management server 50 receives a designation of the number of the virtual storage system (unique number of the virtual storage system managed within the management server 50 ) from the manager and a designation of the numbers of the storage systems contained in the virtual storage system (unique numbers of the storage systems managed within the management server 50 ). Registration of the various designated numbers is performed. Further, when the virtual storage system is newly created, the new virtual storage system number created by means of a predetermined method (alphabetic character of final digit of final virtual storage system number is changed to the next alphabetic character, for example) is allocated to the new virtual storage system.
- a predetermined method alphabetic character of final digit of final virtual storage system number is changed to the next alphabetic character, for example
- the MSVP and SVP number lists of FIGS. 12 and 13 are registered. When a virtual storage system environment is created without integrating the SVP with the plurality of SVP left as is, this processing is not executed.
- the details of the virtual storage system 100 are decided. More specifically, it is decided by which storage system 20 an alternate path is to be extended to the external Idev 701 . This is performed for each LDEV of the storage system.
- An external Idev 701 that is recognized by the storage system 20 is determined (added, for example).
- the same external LDEV 701 is mapped to the respective virtual devices of the plurality of storage systems 20
- the external LDEV 701 is recognized by the plurality of storage systems 20 .
- an external LDEV 701 is recognized by the storage systems 20 a and 20 b, for example, an alternate path through each of the different storage systems 20 a and 20 b is established. Further, in 3 , one of the plurality of storage systems 20 capable of accessing the same external LDEV 701 (storage system with control right, for example) is active and the others are passive.
- the hierarchized LDEV numbers are feature of this embodiment. That is, the LDEV numbers used in the processing in the storage system are local LDEV numbers and new conceptual LDEV numbers provided to the host 51 a, that is, global LDEV numbers, are prepared.
- global LDEV numbers are held in addition to local LDEV numbers. Even when there is no special need for global LDEV numbers, the holding of global LDEV numbers by the storage system is useful in this embodiment. That is because the storage systems can smoothly be made members of the virtual storage system.
- a LUN is an identifier whereby an open host (host of open-type system) identifies one LU (logical unit) which is decided by a combination of a port number and SCSI-ID. That is, this is not a number than can be changed arbitrarily.
- hierarchized LDEV numbers are prepared below the LUN that cannot be changed arbitrarily and, by changing the hierarchized Idev numbers, storage systems that operate independently can be incorporated in the virtual storage system and storage systems can be removed from the virtual storage system without impacting the higher level.
- the storage systems 20 a and 20 b each operate as single systems as in FIG. 7 a.
- the LDEV 241 and 242 in the storage system 20 a are allocated LDEV numbers in the storage system 20 a and perform processing based on these LDEV numbers.
- the LDEV numbers are local LDEV numbers.
- the global LDEV numbers of the LDEV have the same values as the local LDEV numbers of the LDEV, for example. This is also true of the storage system 20 b.
- the storage systems 20 a and 20 b have local LDEV numbers and global LDEV numbers from 0 to 63 .
- global LDEV numbers are supplied to the alternate path software 61 irrespective of whether the storage systems 20 are members of the virtual storage systems 100 .
- Global LDEV numbers are designated by access requests from the host 51 a. for example, when operating as a single unit, the storage system 20 b has the same values as the global LDEV numbers and local; DEV numbers registered in the number management table 105 b.
- FIG. 4 a shows an example of the number management table 105 b in the storage system 20 b that is operating as a single unit.
- the number management program 102 b changes the global LDEV numbers of the storage system 20 b from 0 to 63 to 64 to 127 (s 201 ).
- FIG. 4 b shows the number management table 105 in the storage system 20 b after global LDEV numbers have been changed.
- the fact that the global LDEV numbers of the storage systems 20 a and 20 b are 0 to 63 can be specified by a variety of methods such as through interaction between the number management programs 102 or receiving notice from the management server 50 .
- Number change information includes, for example, the numbers of the newly constructed virtual storage system 100 a, the respective numbers of the storage systems 20 a and 20 b constituting the virtual storage system 100 a, and the global LDEV numbers before and after changes by the respective storage systems 20 a and 20 b.
- the alternate path software 61 recognizes from the number change information that the storage systems 20 a and 20 b are the virtual storage system 100 a and the global LDEV numbers have been changed to 0 to 127 (s 203 ).
- the alternate path software 61 updates the same-device correspondence table 62 on the basis of the received number change information. More specifically, because the storage systems 20 a and 20 b operate separately, for example, the alternate path software 61 comprises same-device correspondence tables 62 a and 62 b that correspond with the storage systems 20 a and 20 b.
- the alternate path software 61 knows from the received number change information that one virtual storage system 100 a is constructed by the storage systems 20 a and 20 b.
- the alternate path software 61 creates one table from the tables 62 a and 62 b (for example, newly prepares one same-device correspondence table and registers the respective information items recorded in the same-device correspondence tables 62 a and 62 b in the new same-device correspondence table).
- the alternate path software 61 specifies the respective global LDEV numbers prior to the change in the storage systems 20 a and 20 b contained in the received number change information from the new same-device correspondence table.
- the alternate path software 61 updates each of the specified global LDEV numbers to the respective changed global LDEV numbers in the storage systems 20 a and 20 b which are contained in the received number change information.
- the alternate path software 61 is able to prevent a particular effect on the host 51 when the alternate path software 61 is installed in the virtualization device 52 rather than the host 51 .
- the changing of the global LDEV numbers and the reporting of number change information may be performed by the number management program 102 a instead of or in addition to the number management program 102 b.
- the storage system 20 b receives an access request with the global LDEV numbers 64 to 127 from the host 51 a.
- the storage system 20 b specifies the local LDEV numbers corresponding with the changed global LDEV numbers designated by the access request from the updated number management table 105 b. Processing corresponding with the access request (access to the LDEV corresponding with the specified local LDEV numbers) can be executed by means of the specified local LDEV numbers.
- the number management program 102 b (and/or 102 a ) ascertains from the mapping tables 108 a and 108 b whether the external LDEV associated with the local LDEV number of the storage system 20 b is also associated with the storage system 20 a and, if such an association exists, the number management program 102 b is able to assign the same global LDEV number to the plurality of local LDEV numbers associated with the same external LDEV in changing the global LDEV number.
- FIGS. 8 a and 8 b show specific examples of a case where one virtual storage system 100 c is constructed by merging the virtual storage system 100 b with the virtual storage system 100 a.
- the numbers 0 to 127 are assigned as global LDEV numbers to each of the virtual storage systems 100 a and 100 b.
- the global LDEV numbers of the virtual storage system 100 b are changed from 0 to 127 to 128 to 255 as shown in FIG. 8 b.
- the changing of the numbers can be performed by at least one of the number management programs 102 a to 102 d.
- the changing of the global LDEV numbers and the reporting of the number change information is not limited to a case where a virtual storage system is newly constructed and is also applicable to cases where a virtual storage system or storage system is merged with a virtual storage system.
- the number of global LDEV numbers naturally also changes proportionately.
- the global 1 dev numbers 64 to 127 are eliminated from the global LDEV numbers 0 to 255 of the virtual storage system 100 c.
- the global LDEV numbers may be switched at the time of removal ( 128 to 255 may be changed to 64 to 191 ) and the switching of the global LDEV numbers may be performed when the storage system 20 is merged the next time.
- the removed storage system 20 b can also be made to operate independently.
- the number management program 102 b of the removed storage system 20 b changes the global LDEV numbers 64 to 127 to the same numbers as its own local LDEV numbers (numbers 0 to 63 , for example) upon sensing that the storage system 20 b has been removed from the virtual storage system is now independent.
- an 1 d LDEV of a certain storage system can also be moved to another storage system within one virtual storage system.
- An example where the LDEV with global LDEV number 10 of the virtual storage system 100 a is moved from the storage system 20 a to the storage system 20 b will be described hereinbelow.
- the storage system 20 a moves the control right of the LDEV with global LDEV number 10 from storage system 20 a to storage system 20 b.
- the LDEV with global LDEV number 10 is unique in the virtual storage system 100 a and therefore, even when the LDEV is moved from storage system 20 a to storage system 20 b, the LDEV with global LDEV number 10 remains unchanged as number 10 .
- the association between global LDEV number 10 and the local LDEV number is changed for each of the storage systems 20 a and 20 b.
- the number management program 102 a deletes global LDEV number 10 from the number management table 105 a and the number management program 102 b specifies an unused local LDEV number from the number management table 105 b and associates global LDEV number 10 with the unused local LDEV number specified.
- global LDEV number 10 is associated with the local LDEV number 10 in the storage system 20 a but that, following the move, global LDEV number 10 is associated with local LDEV number 30 in storage system 20 b.
- the move is not seen by the host 51 and, even when an access request is sent, this has no effect because the global LDEV number has not changed.
- the fact that the volume control rights have moved is recognized by the storage systems 20 a and 20 b and the storage system 20 b associates the unused local LDEV numbers with the transfer-target global LDEV numbers.
- Volumes that can be moved between storage systems 20 in the virtual storage system 100 are called ‘virtual storage system application volumes’.
- Volumes within the virtual storage system 100 may all be virtual storage system application volumes or there may be a mixture such that a portion of the volumes in the virtual storage system 100 are virtual storage system application volumes while the remaining volumes are conventional volumes used only within the respective storage systems 20 .
- SVP integrated management provides one master SVP (MSVP hereinbelow) in a virtual storage system 100 and manages a plurality of other SVPs by means of the MSVP.
- the information acquired by the plurality of other SVPs is transmitted actively to the MSVP and managed all together by the MSVP.
- the SVPS 81 in the respective storage systems 20 are connected by means of a network (s 301 ).
- a new computer is connected on the network and this computer is the MSVP 82 (s 302 ).
- an MSVP setting program 821 for making MSVP settings is executed by the processor of the MSVP 82 .
- the MSVP setting program 821 recognizes the identifiers of all the SVP 81 in the virtual storage system 100 (s 303 ).
- the identifiers of the SVP are set for each SVP 81 .
- the method involves the MSVP setting program 821 receiving an input of the identifiers of all the svp 81 in the virtual storage system 100 from the user or sending a message and the identifier of the MSVP 82 by means of a broadcast to all the svp 81 and receiving in return the identifiers of the SVP 81 from an inter-SVP recognition program 811 for the respective svp 81 .
- the MSVP setting program 821 stores an SVP list (not shown) in the storage resource of the msvp 82 (memory, for example).
- the SVP identifiers of the respective SVP 81 are recorded in the SVP list.
- Each SVP 81 (more specifically, the control program executed by the processor of the SVP, for example) registers the MSVP identifier received from the MSVP 82 in its own storage resource (memory, for example) (s 304 ).
- the MSVP identifier may also be input by the user.
- Each of the SVP 81 sends information that is being managed on the SVP 81 to the MSVP 82 and information managed by the respective SVP (these are called slave SVP: SSVP) 81 is managed all together by the MSVP 82 (s 305 ).
- the ssvp 81 acquires the number management table 105 from the storage system to which it is itself connected and transmits the acquired number change table 105 to the msvp 82 .
- the fact that the msvp 82 and other ssvp 81 have been set is reported by the MSVP setting program 821 to all the storage systems 20 constituting the virtual storage system, for example (s 306 ).
- the MSVP identifier and respective SSVP identifiers are reported to the respective storage systems 20 and recorded in the memory 22 or the like of the storage system 20 .
- the MSVP setting program 821 Upon receiving information from the respective ssvp 81 , the MSVP setting program 821 associates the identifiers of the ssvp 81 constituting the transmission origin of the information with the received information. As a result, the MSVP 82 is able to consciously manage the SSVP information of any storage system 20 .
- the msvp 82 may be duplicated to afford alternate systems.
- the loads of the ssvp 81 can be made even. Further, is can also be easily adapted to adding or removing storage systems 20 .
- a second method of SVP integrated management includes a method of using one of the plurality of SVP 81 as the MSVP as shown in FIG. 9 b. The procedure will be described with reference to FIG. 11 .
- the SVP 81 in the respective storage systems 20 are connected by a network (s 401 ).
- the user determines the spv 81 among the plurality of spv 81 that is also to be used as the MSVP, for example (s 402 ).
- Any of the respective SVP 81 can be an MSVP.
- the SVP 81 all have the MSVP setting program 821 beforehand and an svp 81 executes the program 821 only when selected as the MSVP. Further, all the SVP 81 have the inter-SVP recognition program 811 and perform mutual communication between svp 81 .
- the user executes the MSVP setting program 821 of the SVP 81 determined as the MSVP (s 403 ).
- the SVP 82 ( 81 ) that executes the MSVP setting program 821 recognizes the fact that it is the MSVP and registers for the control information in the MSVP 82 (s 404 ). more specifically, for example, the MSVP setting program 821 registers information signifying that the SVP 82 is the MSVP in the storage resource of the SVP 82 .
- the MSVP setting program 821 advises the other SVP 81 of the MSVP identifier (own identifier) by means of a broadcast (s 405 ).
- An INTESVP recognition program 811 of each of the other SVP 81 receives an MSVP identifier and registers the MSVP identifier in the storage resource of the svp 81 that comprises the INTESVP recognition program 811 . Further, each of the other SVP 81 sends back its own identifier to the MSVP 82 in response to receiving the MSVP identifier.
- the INTESVP recognition program 811 of each of the other svp 81 also transmits information managed by the storage resource of the svp 81 that comprises the INTESVP recognition program 811 to the msvp 82 .
- the management information of all the other svp 81 is centrally managed by the msvp 82 .
- the number change table 105 in the storage system to which the other svp 81 are connected for example, exists for the information transmitted from the other svp 81 to the msvp 82 .
- the MSVP setting program 821 reports the fact that the MSVP and other SVP (‘SSVP’ hereinbelow) have been set to all the storage systems 20 that constitute the virtual storage system (s 406 ). More specifically, for example, information indicating whether the identifiers of the respective SVP are MSVP identifiers or SSVP identifiers is reported to the respective storage systems 20 .
- the respective storage systems 20 are able to recognize and register their own SVPs as MSVP or SSVP based on this information.
- An SSVP that constitutes an MSVP alternate system may be selected from the plurality of SSVP by means of the second method above. That is, the MSVP may be duplicated. In this case, when the MSVP that is operating breaks down, the other SVP that has been selected is able to operate as the MSVP. It is possible to detect from the communications of the INTERSVP recognition programs 811 , for example, whether the MSVP has broken down (fault, for example). Further, both in this second method and the abovementioned first method, the number of MSVP operating at the same time is one in the virtual storage system 100 . When this one MSVP breaks down, the MSVP of the alternate system is able to operate.
- the number management program 102 above may be executed by the MSVP or SVP.
- the MSVP functions are also suspended.
- the role of the MSVP must be transferred to the svp 81 of another storage system 20 . Therefore, when the storage system 20 is systematically stopped (that is, when same is stopped intentionally), the fact that the storage system 20 has stopped is reported to the other storage system 20 so that the other storage system 20 is able to recognize the fact that the storage system 20 has stopped.
- the reporting method at this time may also employ interstorage system communication 44 via the host.
- the storage system 20 a of the MSVP When the storage system 20 a of the MSVP is systematically stopped, the storage system 20 a transmits a message to the effect that same is the MSVP to the other storage systems 20 and sends all the management information managed by the MSVP.
- the storage system 20 that has received the message sets the svp 81 connected to the storage system 20 as the MSVP and stores management information that has been sent in the storage resource of the svp 81 .
- the other storage system 20 communicates with the storage system 20 at fixed intervals in order to be capable of sensing the fact that the storage system 20 has stopped.
- the SVP connected to the storage system 20 is established as the MSVP. If the storage system 20 obtains management information from the MSVP of the stopped storage system 20 a, the storage system 20 extracts the management information and stores the extracted management information in the storage resource of the SVP which is the MSVP. The exchange between the storage systems above may be performed between SVPs.
- the respective SSVP transmit the information which has been acquired from the storage system comprising the SSVP and stored to the MSVP together with their own SSVP identifiers.
- the MSVP setting program associates the received information with the SSVP identifier received with this information and stores the information in the storage resource of the MSVP.
- the storage system management information in which it is written whether the SVP of the storage system is an MSVP and so forth can be managed by the management server 50 .
- the storage system management information is prepared for each storage system. This will be described hereinbelow.
- FIG. 12 a shows the storage system management information for the storage system 20 a.
- FIG. 12 b shows the storage system management information for the storage system 20 d. The description will be provided hereinbelow with reference to FIG. 12 a as a representative example.
- Virtual storage system configuration information, storage system information, the virtual storage system number, the SVP number, and the MSVP number, for example, are recorded as the storage system management information 951 a.
- the ‘virtual storage system configuration information’ is bit information indicating whether the storage system 20 a constitutes the virtual storage system 100 . According to FIG. 12 a, because the value “yes” is recorded, it can be seen that the storage system 20 a constitutes the virtual storage system 100 . On the other hand, according to FIG. 12 b, because the value “no” is recorded, it can be seen that storage system 20 d does not constitute the virtual storage system 100 (that is, the storage system 20 d operates independently).
- the ‘storage system information’ is the number of the other storage system 20 constituting the virtual storage system 100 . It can be seen from the drawings that one virtual storage system is constituted by the storage systems 20 a and 20 b.
- the ‘virtual storage system number’ is the number of the virtual storage system 100 of which the storage system 20 a is one constituent element.
- the ‘SVP number’ is the identifier of the SVP of the storage system 20 a.
- the ‘MSVP number’ is the identifier of the MSVP.
- the SVP of the storage system 20 a is the MSVP
- a number that is the same as the svp number is recorded as the MSVP number.
- the storage system 20 d operates independently, the same number as the SVP number is recorded as the MSVP number (in this case, the MSVP number may instead be blank).
- FIG. 13 shows virtual storage system management information.
- One virtual storage system management information item 953 is prepared for each virtual storage system 100 . This information is also prepared in the storage resource of the management server 50 .
- the virtual storage system management information 953 is information corresponding with the virtual storage system 100 a hereinbelow.
- the virtual storage system number, storage system information, MSVP number, and an SVP number list are recorded as the virtual storage system management information 953 .
- the ‘virtual storage system number’ is the identifier (number) of the virtual storage system 100 a.
- the ‘storage system information’ is a list of identifiers (numbers) of the storage systems 20 constituting the virtual storage system 100 a.
- the ‘MSVP number’ is the identifier of the MSVP of the virtual storage system 100 a.
- the ‘SVP number list’ is a list of identifiers of the SVP in the virtual storage system 100 a.
- the same identifier (s 20 a ) as the MSVP identifier is recorded as illustrated.
- the same identifier as the MSVP identifier is not recorded as the SVP identifier (may be recorded in the same way as the second method).
- FIG. 14 shows virtual storage system overall information.
- the virtual storage system overall information 955 is stored in the storage resource of the management server 50 .
- This information 955 includes item such as the ‘virtual storage system number list’ which is the number of all the virtual storage systems constituting the management target of the management server 50 .
- the numbers contained in the ‘virtual storage system number list’ are added in s 601 of FIG. 20 , for example.
- the virtual storage system 100 is seen as one system by the host 51 .
- the fail over function is implemented by the virtual storage system 100 , for example.
- the storage system 20 b is the alternate system of the storage system 20 a.
- the storage system 20 a may be the alternate system of the storage system 20 b with respect to different LDEV.
- FIG. 15 shows fail over management information. More specifically, FIG. 15 a shows fail over management information for a LDEV for fail over. On the other hand, FIG. 15 b shows fail over management information for an LDEV that is not for fail over.
- the fail over management information 957 is stored in the memory 22 of the respective storage systems, for example.
- the global LDEV number with which the information is associated, the initial active storage system number (the number of the storage system that is initially active), the current active storage system number (the current active storage system number), the current passive storage system number (the current passive storage system number), fail over existence (whether fail over is performed), and the state (whether fail over is in the course of being performed, for example) are recorded as the fail over management information 957 .
- the fail over management information items corresponding with the global LDEV number not for fail over are all blank as shown in FIG. 15 b. further, there may be no fail over management information for the LDEV not for fail over.
- the storage system 20 a of a normal system is called ‘active’ and the storage system 20 b of an alternate system is called ‘passive’.
- the migration function of switching the control right of the external volume 701 between the new and old storage systems 20 can also be implemented by rendering the migration source initially ‘active’ (path to the external volume is connected) and the migration destination ‘passive’ and performing processing to switch between active and passive.
- FIG. 17 is a simplification of FIG. 1 obtained by extracting the parts associated with the fail over processing.
- the external LDEVX in the external storage system 70 is a real unit and the LDEV 240 that correspond with the external LDEVX are virtual devices a and b.
- Virtual device a is in the storage system 20 a
- virtual device b is in the storage system 20 b.
- the virtual devices a and b are connected to the same real unit x and, therefore, the same global LDEV number (‘global LDEV number x’ hereinbelow) is assigned thereto.
- Paths are extended from the host 51 to the virtual devices a and b and set as alternate paths by the alternate path software 61 .
- storage system 20 a is active and storage system 20 b is passive.
- An access request in which a global LDEV number x is designated is issued by the host 51 to the storage system 20 a or 20 b.
- the storage system 20 a receives the access request, because the storage system 20 a is active in the fail over management information 957 that corresponds with the global LDEV number x, the storage system 20 a is active and the access request is processed by the storage system 20 a.
- the storage system 20 b transfers the access request from the storage system 20 b to 20 a via the dedicated line 44 .
- the storage system 20 a is able to perform processing without distinguishing whether this is an access request received from the host 51 or an access request received from the storage system 20 b.
- the storage system 20 b validates the path between virtual device b and the external LDEVX (s 501 ).
- the storage system 20 a transfers an access request which has already been received by the virtual device a but for which access to the external LDEVX has not been processed to the virtual device b (s 502 ).
- the storage system 20 b accesses the external LDEVX in accordance with the access request that has been transferred (s 503 ).
- the active/passive state of the storage systems 20 a and 20 b are switched (s 504 ). That is, in the fail over management information corresponding with the global LDEV number x, the current active storage number is at least the number of the storage system 20 b and the current passive storage number is at least the number of the storage system 20 a.
- the switching of the active and passive of the storage systems 20 a and 20 b is completed as detailed above. Thereafter, when the storage system 20 b receives the access request that designates the global LDEV number x, the storage system 20 b processes the access request as shown in FIG. 18 . On the other hand, when the storage system 20 a receives the access request, the access request is transferred from the storage system 20 a to the storage system 20 b via the dedicated line 44 .
- FIG. 1 is an outband system in which the network for issuing commands from the host 51 to the respective storage systems 20 (san 41 , 42 ) and the network (management network 40 ) whereby the management server 50 sends and receives management information between the storage systems 20 are different.
- this embodiment can also be applied to an inband system.
- the system is an inband system.
- the external storage system 70 may be dispensed with.
- the management through hierarchization is not limited to LDEV numbers, for example.
- resource numbers such as the pair numbers and group numbers of the copy system and so forth are hierarchized and can be switched by means of the same method as the LDEV numbers.
- the resource numbers in the separate storage systems have been one virtual storage system and, therefore, unique numbers are required.
- the 1 dev# 0 and replication 1 dev# 100 are managed as pair # 0 in the storage system 20 a.
- the 1 dev# 0 and replication 1 dev# 100 are managed as pair # 0 in the storage system 20 b.
- LDEV numbers must be reset as mentioned earlier.
- the pair number and pair # 0 are replicated.
- global pair numbers and local pair numbers can be provided in the same way as LDEV numbers.
- the method of number switching can be similar to the method of switching the LDEV numbers.
- the processing can be performed in the same way by also providing global group numbers and local group numbers for the group numbers resulting from grouping the copy-system pair numbers.
Abstract
A management target constituting the target of processing executed by a first storage system in accordance with a request transmitted from a higher-level device is managed by first and second management identifiers. A request designating the first management identifier is received from the higher-level device, and a first management identifier designated by the request is converted into a corresponding second management identifier.
Description
- This application relates to and claims priority from Japanese Patent Application No. 2006-210464 filed on Aug. 2, 2006, the entire disclosure of which is incorporated herein by reference.
- The present invention relates to a virtual storage system that virtualizes a plurality of storage systems logically as one storage resource.
- In the storage field, for example, a plurality of computing resources distributed over a network are operated as if these computing resources were one computing resource and there has been a focus on ‘storage grids (wide bandwidth common file system)’ which increase the processing performance and fault tolerance and so forth. As a method of operating a storage grid, a method that virtualizes a plurality of storage systems logically as one storage resource is known.
- Further, as a technology for virtualizing volumes, a technology that manages logical units of a second storage system that exists outside a first storage system within the first storage system is known (Japanese patent application laid open no. 2005-107645, for example).
- As a method for constructing a storage grid, construction that involves assembling a plurality of storage systems that operate as a single storage system, for example, may be considered. A case where two storage systems a and b are a storage grid may be considered as a specific example.
- Put simply, when a single system is virtually constructed by eliminating the boundary between these storage systems a and b, the numbers of the logical storage devices (also called logical volumes and abbreviated to ‘LDEV’ hereinbelow) (may be another identifier instead of a number) are associated with the storage systems a and b respectively. Hence, there may be the problem that a plurality of LDEVs with the same LDEV number are present. This can occur not only with LDEV numbers but also with management identifiers of different types. For example, the same problem can also occur with copy system control information such as pair numbers and group numbers and so forth, for example (the numbers of groups consisting of a plurality of pairs). Hence, it is difficult to smoothly establish storage systems that are operating individually as the constituent elements of a virtual storage system.
- In addition, the storage systems a and b sometimes each comprise at least one management server (‘SVP’ (service processor) hereinbelow). An SVP receives an instruction to input information to a management-target storage system, outputs the information, and holds management information for the storage system, for example. When a virtual storage system is constructed with storage systems a and b forming the storage grid and information managed by the SVP of storage system a is obtained by storage system b, then storage system b must issue an inquiry to the SVP of storage system a. Hence, whenever the storage system b acquires management information from the SVP of the storage system a, the storage system b issues an inquiry to the SVP, the processing grows complex and the load increases.
- Therefore, an object of the present invention is to make it possible to smoothly establish storage systems that operate individually as the constituent elements of a virtual storage system.
- A further object of the present invention is to provide a new management method that is completed without the respective storage systems of the virtual storage system seeking management information from the management servers of the other storage systems.
- Further objects of the present invention will become evident from the subsequently description.
- A control device according to a first aspect of the present invention is a control device for managing a management target constituting the target of processing executed by a first storage system in accordance with a request transmitted from a higher-level device and for controlling the operation of the first storage system. The control device comprises an identifier correspondence storage section for storing identifier correspondence information that records first and second management identifiers for each of a plurality of management targets; a reception section for receiving a request designating the first management identifier from the higher-level device; a correspondence specification section for specifying the second management identifier that corresponds with the first management identifier designated by the received request from the identifier correspondence information; and an output section for outputting the specified second management identifier to the processing section of the first storage system. The second management identifier is a management identifier of a type that is used for the processing by the first storage system. The processing section of the first storage system is able to identify the processing target from the second management identifier thus output. The first management identifier is a management identifier of a type that is recognized by the higher-level device and which is changed to a value that does not overlap the first management identifier of the management target of another storage system of a virtual storage system obtained by logically virtualizing a plurality of storage systems as one storage resource when the first storage system is a constituent element of the virtual storage system.
- The control device may be installed in the first storage system or may be a separate device from the first storage system.
- In the first embodiment of the control device, the first and second management identifiers are an identifier for identifying each of a plurality of logical storage devices that exist in the first storage system and/or an identifier for identifying each of a plurality of specified resources. A specified resource can be a pair for copying from a logical storage device to another logical storage device, for example. The pair may be a single pair or a pair which is a constituent element of a pair group constituted by a plurality of pairs.
- In a second embodiment of the control device, the control device further comprises a change section for changing the first management identifier in accordance with a change in the number of storage systems constituting the virtual storage system.
- In a third embodiment of the control device, the control device is the control device according to the second embodiment, wherein the change in the number of storage systems involves adding the first storage system to an existing virtual storage system. The change section changes each of a plurality of first management identifiers that correspond with each of a plurality of management targets of the first storage system to values that do not overlap a plurality of first management identifiers of respective other storage systems of the existing virtual storage system.
- In a fourth embodiment of the control device, the control device is the control device according to the second embodiment, wherein the change in the number of storage systems involves constructing a third virtual storage system by merging a second virtual storage system with the existing first virtual storage system containing the first storage system according to the second embodiment. The change section changes each of a plurality of first management identifiers that correspond with each of a plurality of management targets of the first storage system to values that do not overlap a plurality of first management identifiers of respective other storage systems of the third virtual storage system.
- In a fifth embodiment of the control device, the control device is the control device according to the second embodiment, further comprising a change report section that reports the changed plurality of first management identifiers to the higher-level device.
- In a sixth embodiment of the control device, the control device is the control device according to the second embodiment, wherein the change section changes the plurality of first management identifiers to the same values as the plurality of second management identifiers respectively when the first storage system is independent as a result of the first storage system being removed from the virtual storage system.
- In a seventh embodiment of the control device, the control device is the control device according to the second embodiment, wherein each of the plurality of management targets is a logical storage device. The first and second storage systems constituting the virtual storage system are connected to an external storage system that does not constitute the virtual storage system and an intangible first virtual logical storage device of the first storage system and an intangible second virtual logical storage device of the second storage system are connected to a tangible external logical storage device of the external storage system. In this case, the change section affords the first management identifier of the first virtual logical storage device the same value as the first management identifier of the second virtual logical storage device.
- The management method according to a second aspect of the present invention is a management method of a virtual storage system obtained by logically virtualizing a plurality of storage systems as one storage resource. This management method connects a plurality of management computers held by the plurality of storage systems by means of a network and collectively manages a plurality of management information items that are each managed by the plurality of management computers by means of one master management computer.
- In a first embodiment of the management method, a management computer other than the plurality of management computers is connected to the network. The other management computer is rendered the master management computer and the plurality of management computers are rendered the slave management computers. The master management computer stores the respective identifiers of the plurality of slave management computers. Each of the plurality of slave management computers stores the identifiers of the master management computers. Each of the plurality of slave management computers transmits management information to the master management computer. The master management computer receives each of a plurality of management information items from the plurality of slave management computers and stores the plurality of management information items thus received in the storage resource of the master management computer.
- In a second embodiment of the management method, one of the plurality of management computers is rendered the master management computer and the other management computers are rendered slave management computers. The master management computer stores the identifiers of the slave management computers. The slave management computers store the identifiers of the master management computer. The slave management computers transmit management information to the master management computer. The master management computer receives management information from the slave management computers and stores the management information thus received in the storage resource of the master management computer. The master management computer also stores management information for managing the storage system to which the master management computer is itself connected in the storage resource of the master management computer in addition to the management information of the slave management computers.
- In a third embodiment of the management method, the master management computers are multiplexed and one of the multiplexed master management computers is rendered Active while the others are rendered Passive. When the Active master management computer is stopped, any of the Passive master management computers becomes Active and operates as the master management computer in place of the stopped master management computer.
- In a fourth embodiment of the management method, the master management computer broadcasts a master identifier which is its own identifier to management computers other than itself. The management computers that receive the master identifier store the received master identifier in their own storage resource and, by way of response, transmit slave identifiers which are their own identifiers to the master management computer constituting the transmission origin of the master identifier. The master management computer receives the slave identifiers from management computers other than itself and store the slave identifiers thus received in its own storage resource.
- A computer system according to a third aspect of the present invention comprises a control device for managing a management target constituting the target of processing executed by a first storage system in accordance with a request transmitted from a higher-level device and for controlling the operation of the first storage system; a virtual storage system obtained by logically virtualizing a plurality of storage systems including the first storage system as one storage resource; and a virtualization section for providing the virtual storage system as the one storage resource. The control device comprises an identifier correspondence storage section for storing identifier correspondence information that records first and second management identifiers for each of a plurality of management targets; a reception section for receiving a request designating the first management identifier from the higher-level device;
- a correspondence specification section for specifying the second management identifier that corresponds with the first management identifier designated by the received request from the identifier correspondence information; and an output section for outputting the specified second management identifier to the processing section of the first storage system. The second management identifier is a management identifier of a type that is used for the processing by the first storage system and the processing section of the first storage system identifies the processing target from the second management identifier thus output. The first management identifier is a management identifier of a type that is recognized by the higher-level device and which is changed to a value that does not overlap the first management identifier of the management target of another storage system of a virtual storage system obtained by logically virtualizing a plurality of storage systems as one storage resource when the first storage system is a constituent element of the virtual storage system.
- In a first embodiment of the computer system, the control device further comprises a change section that changes the first management identifier in accordance with a change in the number of storage systems constituting the virtual storage system; and a change report section that reports the changed plurality of first management identifiers to the virtualization section. The virtualization section manages the correspondence between a plurality of third management identifiers that can be designated by a host and the plurality of first management identifiers and, when the changed plurality of first management identifiers are received, changes the plurality of first management identifiers that correspond with each of the plurality of third management identifiers to the changed plurality of first management identifiers thus received.
- In a second embodiment of the computer system, the higher-level device is a switch that is interposed between the host and the virtual storage system. The virtualization section is installed in the switch.
- In a third embodiment of the computer system, the higher-level device is the host, and the virtualization section is installed in the host.
- The storage section of the above control device or computer system can be constructed by a storage resource such as a memory, for example. Further, the other parts of the control device or computer system can be constructed by hardware, a computer program or a combination thereof (a portion is implemented by a computer program while the remainder is implemented by hardware, for example). The computer program is read to a predetermined processor and executed. Further, a storage area that exists in a hardware resource such as memory may be suitably used during information processing that is performed when a computer program is read to the processor. In addition, the computer program may be installed on a computer from a recording medium such as a CD-ROM or may be downloaded to the computer via a communication network.
-
FIG. 1 shows a constitutional example of the whole system according to a first embodiment of the present invention; -
FIG. 2 shows a constitutional example of a same-device correspondence table 62; -
FIG. 3 shows various programs and tables that are stored in amemory 22 of astorage system 20; -
FIG. 4A shows an example of a number management table 105B in astorage system 20B that operates independently; -
FIG. 4B shows the number management table 105 in thestorage system 20B after the global LDEV numbers have been changed; -
FIG. 5 shows a constitutional example of a device information table 106; -
FIG. 6 shows the flow of processing that is performed when thestorage system 20 receives an access request; -
FIG. 7 a shows the relationship between the global LDEV numbers ofrespective storage systems -
FIG. 7 b shows the relationship between the global LDEV numbers of therespective storage systems -
FIG. 8A shows the relationship between the global LDEV numbers of separatevirtual storage systems -
FIG. 8B shows the relationship between global LDEV numbers of avirtual storage system 100C constituted as a result of the othervirtual storage system 100B merging with thevirtual storage system 100A and local LDEV numbers; -
FIG. 9A is an explanatory diagram of a first method of SVP integrated management; -
FIG. 9B is an explanatory diagram of a second method of SVP integrated management; -
FIG. 10 is a flowchart showing the procedure for performing SVP integrated management by means of the first method; -
FIG. 11 is a flowchart showing the procedure for performing SVP integrated management by means of the second method; -
FIG. 12A shows storage system management information for thestorage system 20A; -
FIG. 12B shows storage system management information for thestorage system 20D; -
FIG. 13 shows virtual storage system management information; -
FIG. 14 shows virtual storage system overall information; -
FIG. 15A shows fail over management information for a failed over LDEV; -
FIG. 15B shows fail over management information for an LDEV that has not been failed over; -
FIG. 16 shows the overall constitution of a system relating to a modified example of this embodiment; -
FIG. 17 is an example of the flow of access by the virtual storage system; -
FIG. 18 is an example of the access flow after a fault occurs in the path between thestorage system 20A and anexternal storage system 70 in the system inFIG. 17 ; -
FIG. 19 is an example of the flow of an Active/Passive switch between storage systems; and -
FIG. 20 is a flowchart showing an example of the procedure for constructing a virtual storage system. - An embodiment of the present invention will be described herein below.
-
FIG. 1 shows a constitutional example of the whole system according to a first embodiment of the present invention. In the following description, when elements of the same type are described without differentiation, the description is provided by using only parent numerals (100, for example) and, when elements of the same type are described with differentiation, the description is provided by using parent and child numerals (100 a, 100 b, for example). - The virtual storage system 100 a comprises a plurality of storage systems 20 a and 20 b and the
external storage system 70. similarly, the virtual storage system 100 b comprises a plurality of storage systems 20 c and 20 d and theexternal storage system 70. The virtual storage system 100 b, which has the same constitution as the virtual storage system 100 a, may also be connected to a san41 in the same way. - The respective hosts 51 comprise a CPU and a storage resource (memory, for example) (not illustrated). A computer program is stored in the storage resource and the CPU is able to execute the computer program. When the computer program is the subject hereinbelow, in reality, processing is performed by the CPU that executes the computer program.
- The host 51 a is connected to the respective storage systems 20 a and 20 b. The host 51 a is connected to the respective storage systems 20 a and 20 b via the san (storage area network) 41. The host 51 a recognizes the plurality of storage systems 20 a and 20 b logically as one storage resource (virtual storage system) 100 a by means of the functions of
alternate path software 61. - Another host 51 b that does not comprise
alternate path software 61 is connected to the respective storage systems 20 a and 20 b via a san42, avirtualization device 52, and the san41. The host 51 b recognizes the plurality of storage systems 20 a and 20 b as one virtual storage system 100 a by means of the functions of thealternate path software 61 in thevirtualization device 52. - The
virtualization device 52 virtualizes the storage areas provided by each of the plurality of storage systems 20 a and 20 b into one logical storage area. Thevirtualization device 52 is a virtualization switch, intelligent switch, or virtualization-dedicated switch, or the like, for example. Further, a system constituting comprising avirtual storage system 100 and thevirtualization device 52 is called a storage network system. - The respective hosts 51 comprise an
application program 60. theapplication program 60 is a business program such as database management software, web application software, streaming application software, for example. - The
alternate path software 61 manages logical paths between the host 51 a and logical storage devices (LDEV) in the virtual storage system 100 a and executes alternate path control. alternate path control involves controlling which logical path among a plurality of logical paths is used to access an LDEV. Thealternate path software 61 comprises an alternate path management program (not shown), an inter-storage system alternate path program (not shown), a priority control program (not shown), and the same-device correspondence table 62 ofFIG. 2 . Further, the aforementioned programs and table are managed for each of the virtual storage systems 100 a and 100 b. The same is true of the following description. The virtual storage system 100 a will be described here. - The alternate path management program performs management and control of the whole
alternate path software 61. - The inter-storage system alternate path program recognizes the plurality of logical paths connected to the same
external LDEV 701 via each of the plurality ofstorage systems 20 as alternate paths. Further, the external LDEV is an LDEV that is provided in theexternal storage system 70 and is an LDEV that is mapped to the LDEV of the storage system in thevirtual storage system 100. - The priority control program selects a logical path that is to be used as a priority from among the plurality of logical paths on the basis of the usage rate of each of the plurality of logical paths connected to the same LDEV.
- The same-device correspondence table 62 shows the correspondence relationship between the logical paths and logical devices in the environment of a network in which different logical paths are connected to the same logical device. More specifically, the path numbers, identifiers of the storage systems of the virtual storage system, LUN, and global LDEV numbers are recorded for each logical path as shown in
FIG. 2 in the same-device correspondence table 62, for example. Here, the global LDEV numbers of the logical paths withpath numbers storage system 20 and the virtual storage system is constructed by a plurality of storage systems, for example, preparations are made for eachvirtual storage system 100. Further, as well as alternate paths, a single logical path can also be managed by the same-device correspondence table 62. In other words, the correspondence relationships between the LUN recognized by theapplication 60 and the global LDEV numbers managed by thestorage system 20 are registered in the same-device correspondence table 62. - The
storage system 20 can be broadly classified into a control unit and a storage unit, for example. the control unit comprises, for example, a CPU (central processing unit) 21, amemory 22, a diskinterface control unit 23, FC (fiber channel)interface control units interface control units disk unit 24, for example. - The
CPU 21 executes a variety of control processes of thestorage system 20 by executing a variety of programs or modules stored in thememory 22. Thememory 22 is called the internal storage device and includes an involatile memory for storing a variety of modules and so forth and a volatile memory for temporarily holding the results of the computation processing of the cpu21. - The
CPU 21 is connected to thedisk unit 24 via the diskinterface control unit 23. the diskinterface control unit 23 converts logical addresses output from theCPU 21 into IBA (logical block address) and enables access to the logical devices by the cpu21. - The
disk unit 24 comprises a plurality ofdisk drives 240 with a raid (redundant arrays of independent inexpensive disks) constitution. The disk drives 240 are physical devices such as FC (fibre channel) disk drives, SATA (serial advanced technology attachment disk drives, PATA (parallel advanced technology attachment) disk drives, FATA (fibre attached technology adapted disk drives, SAS (serial attached SCSI) disk drives or SCSI (small computer system interface) disk drives. A physical device is a real device with a real storage area. Further, a physical device is not limited to adisk drive 240 and another type of storage device (flash memory, for example) may also be adopted. - The
LDEV 242 is a virtual device without a real storage area. an actual storage area for storing data exists in thelogical device 701 in theexternal storage system 70. That is, thestorage system 20 incorporates theexternal LDEV 701 of theexternal storage system 70 as its own internal device and provides same to thehost 51 as a logical unit. When thehost 51 is a UNIX (registered trademark)-based system, the logical unit is associated with a device file. when thehost 51 is a windows (registered trademark)-based system, the logical unit is associated with a drive letter (drive name). A LUN (logical unit number) is assigned to the logical unit. The details of the method of virtualization whereby theexternal LDEV 701 is an internal device of thestorage system 20 as it were will be disclosed in Japanese patent application laid open no. 2005-107645. That is, for the external connection of this embodiment, the technology disclosed in Japanese patent application laid open no. 2005-107645 (U.S. application Ser. No. 10/769805, U.S. application Ser. No. 11/471556), for example. - The
command device 243 is a dedicated logical unit for delivering commands and statuses between thehost 51 andstorage systems 20. The commands transmitted from thehost 51 to thestorage systems 20 are written to acommand device 243. Thestorage system 20 executes processing corresponding with the commands written to thecommand device 243 and writes the execution results to thecommand device 243 as the status. The details of the command management using thecommand device 243 will be described subsequently. - The disk
interface control unit 23 is able to control a plurality ofdisk drives 240 by the raid level (0, 1, 5, for example) specified by the raid system. In a raid system, a plurality ofdisk drives 240 are managed as one raid group. The raid group is constituted by grouping fourdisk drives 240 as one set (3 d+1 p) or by grouping eightdisk drives 240 as one set (7 d+1 p), for example. That is, one raid group is constituted by assembling storage areas provided by a plurality of disk drives 240. A plurality oflogical devices 241 constituting access units accessed by thehost 51 are defined in the raid group. One or morelogical devices 241 are mapped with a logical unit constituting a logical storage area recognized by thehost 51. Thehost 51 is able to access thelogical devices 241 by designating the LUN and IBA. - Further, if the
storage system 20 is able to supply the storage areas of theexternal storage system 70 to thehost 51 by connecting to theexternal storage system 70, thestorage system 20 need not necessarily comprise thedisk unit 24 and diskinterface control unit 23. - There is a
dedicated communication line 44 for transferring commands, control information, and data between the storage systems 20 a and 20 b in the virtual storage system 100 a. In the case of a constitution without thecommunication line 44, the commands, control information, and data can be transferred via thehost 51. - Further, one
virtual storage system 100 may be connected to one or moreexternal storage systems 70 and anexternal storage system 70 may be connected from a plurality ofvirtual storage systems 100. - An FC
interface control unit 25 controls the transfer of commands and data and so forth via asan 43 between thestorage systems 20 andexternal storage systems 70. An FCinterface control unit 26 controls the transfer of commands and data and so forth via thesan 41 between thestorage systems 20 and hosts 51. A fiber channel protocol and ISSCSI protocol and so forth can be adopted as the data communication protocol via thesan san 43 is not essential and the FCinterface control unit 25 andexternal storage system 70 may be directly connected by an optic fiber cable or the like. - A LAN
interface control unit 27 is connected to amanagement server 50 via amanagement network 40. Themanagement network 40 is a LAN constituted by an Ethernet (registered trademark) cable or the like. The data communication protocol of themanagement network 40 is TCP/IP, for example. Themanagement server 50 is able to manage the settings of the access path (LUN masking and zoning and so forth) between thehost 51 andvirtual storage systems 100 through the creation of LDEV in thevirtual storage systems 100 and the allocation of a LDEV to thehost 51. - The
external storage system 70 has one ormore disk drives 700 with a raid constitution. thedisk drive 700 may be a storage device such as an FC (FIBRE channel) disk drive, SATA (serial advanced technology attachment) disk drive, PATA (parallel advanced technology attachment) disk drive, FATA (FIBRE attached technology adapted) disk drive, SAS (serial attached SCSI) disk drive or SCSI (small computer system interface) disk drive. Anexternal LDEV 701 is formed on a plurality of disk drives 700. Further, there may be storage devices of another type (flash memory, for example) instead of or in addition to thedisk drive 700. - Further, the
external storage system 70 may be of a different type from thestorage system 20 or may be of the same type as thestorage system 20. - An SVP (service processor) 81 is a computer terminal that sets information on the constitution of the storage system 20 (including the device information table 106 and mapping table 108 described subsequently) and acquires operating information and so forth. The svp81 is connected to a LAN
interface control unit 28 of thestorage system 20. The respective svp81 connected to therespective storage systems 20 is connected to one master SVP. The master SVP centrally manages information (information on the constitution of thestorage system 20 as well as operating information and so forth) that is collected from the respective svp81. One of a plurality of svp81 may also function as the master SVP or therespective storage systems 20 may be directly connected to a master svp82. A management method that comprises the master SVP will be described subsequently. - The
virtual storage system 100 indicates the range in which the command transfers and volume migration between therespective storage systems 20 can be executed by sending and receiving constitution information between thestorage systems 20. When theexternal storage system 70 is connected to therespective storage systems 20, the range of thevirtual storage system 100 includes the plurality ofstorage systems 20 and theexternal storage system 70. When anexternal storage system 70 is not connected to therespective storage systems 20, the range of thevirtual storage system 100 includes the plurality ofstorage systems 20 and does not include theexternal storage system 70. - The
respective storage systems 20 can be constituted as a disk array system that comprises a plurality ofdisk drives 240 with a raid constitution or can be constituted as a virtualization switch with therespective storage systems 20 themselves are the SCSI targets, for example. A device that manages management identifiers that are hierarchized such as LDEV numbers and controls the operation of storage systems can be called a ‘control device’. A control device may be in thestorage system 20 or outside same. - The
management network 40 is connected to one or more hosts 51. further, one ormore client computers 30 are connected to themanagement network 40. Therespective client computers 30 are able to connect to thehosts 51 via themanagement network 40 and issue data i/o requests to thevirtual storage systems 100 via theapplication program 60. -
FIG. 3 shows various programs and tables that are stored in thememory 22 of thestorage system 20. - An
operating system 101, anumber management program 102, the number management table 105, device information table 106, and mapping table 108, for example, are stored in thememory 22. - The number management table 105 is a correspondence table of global LDEV numbers and local LDEV numbers. The device information table 106 is a table that holds attributes of the logical devices. The mapping table 108 is a table that shows the correspondence relationship between the LDEV number of the
external LDEV 701 and the local LDEV number (may be a global LDEV number instead of or in addition to same). -
FIGS. 4 a and 4 b show constitutional examples of the number management table 105. - The number management table 105 is a correspondence table of ‘global LDEV numbers’, which are numbers visible to devices higher than the virtual storage system 100 (the
host 51 and/or virtualization device 52) and ‘local LDEV numbers’, which are the numbers when processing is performed within thestorage system 20. For example, a request with a global LDEV number is received from the host 51 a, the local LDEV numbers corresponding with the global LDEV numbers are acquired from the table 105 by thenumber management program 102 and processing (writing or reading (i/o) processing with respect to the LDEV, for example) is performed by using the acquired local LDEV number. Only the information on the global LDEV numbers is held as mentioned earlier in the alternate path software 61 (seeFIG. 2 ). The difference betweenFIGS. 4 a and 4 b will be described subsequently. - Furthermore, although an example of a table of LDEV numbers is shown here, the table is not limited to LDEV numbers. The same table can also be held for other types of management identifiers (copy system pair numbers and group numbers and so forth, for example) used by separate storage systems but with the risk of duplication because there is one virtual storage system. In particular, a management identifier that is designated by a request of some kind from a higher-level device (host, for example) can be cited as another type if management identifier, for example.
-
FIG. 5 shows a constitutional example of the device information table 106. - The device information table 106 is a table for managing the attributes of the respective LDEVs. a ‘device number’, ‘status flag’ and ‘external device flag’ are recorded for each LDEV, for example, in the device information table 106.
- A ‘device number’ is a local LDEV number for uniquely recognizing the
LDEVs storage system 20. - The ‘status flag’ indicates a state where the
LDEV storage system 20 are being used or a state where same are not being used (empty state). On in the device information table 106 is a state where theLDEV - The ‘external device flag’ indicates whether the LDEV (virtual device) 242 in the
storage system 20 is being used as theexternal LDEV 701. On inFIG. 5 indicates that theLDEV 242 is being used as an external LDEV. “Off” indicates that theLDEV 241 is being used as an internal LDEV. The default value of the external device flag is “off” and, when theLDEV 242 in thestorage system 20 is mapped to thelogical device 701 in theexternal storage system 70, “off” is changed to “on”. -
FIG. 6 shows the flow of processing that is performed when thestorage system 20 receives an access request. the serial process flow that is performed when the virtual storage system 100 a is accessed by thehost 51 will now be described with reference toFIG. 6 andFIGS. 1 and 3 . - The
application program 60 issues an access request that designates a LUN. thealternate path software 61 specifies the storage system identifier and global LDEV number corresponding with the LUN designated by the access request from the same-device correspondence table 62. Thealternate path software 61 issues an access request that designates a global LDEV number to thestorage system 20 that is recognized by the storage system identifier. Thealternate path software 61 may issue an access request by using another alternate path when there is a special reason to do so such as mixing of the alternate paths corresponding with the designated LUN. - As shown in
FIG. 6 , thestorage system 60 receives an access request that designates a global LDEV number (step s101). In this case, the storage system specifies the local LDEV number that corresponds with the global LDEV number from the number management table 105 by means of thenumber management program 102. The storage system 60 (i/o processing program (not shown), for example) references the device information table 106 and judges whether the specified local LDEV number corresponds with an internal LDEV (whether the external device flag is “off”) or corresponds with an external LDEV (whether the external device flag is “on”) (s102). That is, it is judged whether the access request is an access request to access theexternal LDEV 701 or an access request to access theinternal LDEV 241. - In the event of an access request to the external LDEV 701 (yes in s102), the
storage system 20 references the mapping table 108, performs an address conversion or the like to theexternal LDEV 701 and transmits an access request to access theexternal LDEV 701 to the external storage system 70 (s104). on the other hand, thestorage system 20 accesses theinternal LDEV 241 in the event of an access request to access the internal LDEV 241 (no in s102) (s103). - The whole system of this embodiment was described hereinabove.
- In this embodiment, the virtual storage system is constructed by means of the procedure described hereinbelow. this procedure will be described with reference to
FIG. 20 . - 1. Determination of the Storage Systems that Construct the Virtual Storage System (s601)
- For example, the
management server 50 receives a designation of the number of the virtual storage system (unique number of the virtual storage system managed within the management server 50) from the manager and a designation of the numbers of the storage systems contained in the virtual storage system (unique numbers of the storage systems managed within the management server 50). Registration of the various designated numbers is performed. further, when the virtual storage system is newly created, the new virtual storage system number created by means of a predetermined method (alphabetic character of final digit of final virtual storage system number is changed to the next alphabetic character, for example) is allocated to the new virtual storage system. - 2. SVP Integration (s602)
- The MSVP and SVP number lists of
FIGS. 12 and 13 are registered. When a virtual storage system environment is created without integrating the SVP with the plurality of SVP left as is, this processing is not executed. - 3. Determination of Active/Passive Storage System (s603)
- The details of the
virtual storage system 100 are decided. More specifically, it is decided by whichstorage system 20 an alternate path is to be extended to the external Idev701. This is performed for each LDEV of the storage system. - 4. External LDEV Determination Processing (s604)
- An external Idev701 that is recognized by the
storage system 20 is determined (added, for example). When the sameexternal LDEV 701 is mapped to the respective virtual devices of the plurality ofstorage systems 20, theexternal LDEV 701 is recognized by the plurality ofstorage systems 20. - 5. Setting of Alternate Path Between Storage Systems (s605)
- For example, when an
external LDEV 701 is recognized by the storage systems 20 a and 20 b, for example, an alternate path through each of the different storage systems 20 a and 20 b is established. further, in 3, one of the plurality ofstorage systems 20 capable of accessing the same external LDEV 701 (storage system with control right, for example) is active and the others are passive. - This embodiment will be described further hereinbelow. this description is provided in the order of (a) hierarchized LDEV numbers, (b) integrated SVP, and(c) fail over of
virtual storage system 100. further, although thehost 51 andvirtualization device 52 and so forth may be considered as higher level devices than thestorage system 20, the high level device is the host 51 a in the following description. - (a) Hierarchized LDEV Numbers
- The hierarchized LDEV numbers are feature of this embodiment. That is, the LDEV numbers used in the processing in the storage system are local LDEV numbers and new conceptual LDEV numbers provided to the host 51 a, that is, global LDEV numbers, are prepared. When the respective storage systems are to be members of the
virtual storage system 100, global LDEV numbers are held in addition to local LDEV numbers. Even when there is no special need for global LDEV numbers, the holding of global LDEV numbers by the storage system is useful in this embodiment. That is because the storage systems can smoothly be made members of the virtual storage system. - Further, the hierarchization of LDEV numbers in this embodiment is a completely different concept from the hierarchy of LUN and LDEV numbers as disclosed in the above publication on the external connection, for example. In this embodiment, a LUN is an identifier whereby an open host (host of open-type system) identifies one LU (logical unit) which is decided by a combination of a port number and SCSI-ID. That is, this is not a number than can be changed arbitrarily. In this embodiment, hierarchized LDEV numbers are prepared below the LUN that cannot be changed arbitrarily and, by changing the hierarchized Idev numbers, storage systems that operate independently can be incorporated in the virtual storage system and storage systems can be removed from the virtual storage system without impacting the higher level.
- The specifics will be described hereinbelow. Further, when the respective elements of the storage systems 20 a and 20 b are used in the description hereinbelow, sometimes child codes that are the same as the child codes of the storage system comprising these elements are used as the parent numerals of the elements. for example, when the number management program is used in the description, the number management program of the storage system 20 a is ‘102 a’ and the number management program of the storage system 20 b is ‘102 b’.
- Suppose that the storage systems 20 a and 20 b each operate as single systems as in
FIG. 7 a. TheLDEV - In this embodiment, global LDEV numbers are supplied to the
alternate path software 61 irrespective of whether thestorage systems 20 are members of thevirtual storage systems 100. Global LDEV numbers are designated by access requests from the host 51 a. for example, when operating as a single unit, the storage system 20 b has the same values as the global LDEV numbers and local; DEV numbers registered in the number management table 105 b.FIG. 4 a shows an example of the number management table 105 b in the storage system 20 b that is operating as a single unit. - Here, suppose that the virtual storage system 100 a is newly constructed by the storage systems 20 a and 20 b. In this case, processing to repair the global LDEV numbers which are the higher-level LDEV numbers is performed in this embodiment.
- More specifically, the number management program 102 b changes the global LDEV numbers of the storage system 20 b from 0 to 63 to 64 to 127 (s201).
FIG. 4 b shows the number management table 105 in the storage system 20 b after global LDEV numbers have been changed. Further, the fact that the global LDEV numbers of the storage systems 20 a and 20 b are 0 to 63 can be specified by a variety of methods such as through interaction between thenumber management programs 102 or receiving notice from themanagement server 50. - Thereafter, the number management program 102 b reports number change information relating to changes in the global LDEV numbers to the alternate path software 61 (s202). Number change information includes, for example, the numbers of the newly constructed virtual storage system 100 a, the respective numbers of the storage systems 20 a and 20 b constituting the virtual storage system 100 a, and the global LDEV numbers before and after changes by the respective storage systems 20 a and 20 b.
- The
alternate path software 61 recognizes from the number change information that the storage systems 20 a and 20 b are the virtual storage system 100 a and the global LDEV numbers have been changed to 0 to 127 (s203). Thealternate path software 61 updates the same-device correspondence table 62 on the basis of the received number change information. More specifically, because the storage systems 20 a and 20 b operate separately, for example, thealternate path software 61 comprises same-device correspondence tables 62 a and 62 b that correspond with the storage systems 20 a and 20 b. Thealternate path software 61 knows from the received number change information that one virtual storage system 100 a is constructed by the storage systems 20 a and 20 b. In this case, thealternate path software 61 creates one table from the tables 62 a and 62 b (for example, newly prepares one same-device correspondence table and registers the respective information items recorded in the same-device correspondence tables 62 a and 62 b in the new same-device correspondence table). Thealternate path software 61 then specifies the respective global LDEV numbers prior to the change in the storage systems 20 a and 20 b contained in the received number change information from the new same-device correspondence table. Thealternate path software 61 updates each of the specified global LDEV numbers to the respective changed global LDEV numbers in the storage systems 20 a and 20 b which are contained in the received number change information. - As a result of the serial processing above, it is possible to prevent a particular effect on the
application program 60 even when the storage systems 20 a and 20 b that operate separately are one virtual storage system 100 a. Thealternate path software 61 is able to prevent a particular effect on thehost 51 when thealternate path software 61 is installed in thevirtualization device 52 rather than thehost 51. Further, the changing of the global LDEV numbers and the reporting of number change information may be performed by the number management program 102 a instead of or in addition to the number management program 102 b. - Further, as mentioned earlier, when the update of the same-device correspondence table is performed by changing the global LDEV numbers, the storage system 20 b receives an access request with the
global LDEV numbers 64 to 127 from the host 51 a. The storage system 20 b specifies the local LDEV numbers corresponding with the changed global LDEV numbers designated by the access request from the updated number management table 105 b. Processing corresponding with the access request (access to the LDEV corresponding with the specified local LDEV numbers) can be executed by means of the specified local LDEV numbers. - Further, in s201, the number management program 102 b (and/or 102 a) ascertains from the mapping tables 108 a and 108 b whether the external LDEV associated with the local LDEV number of the storage system 20 b is also associated with the storage system 20 a and, if such an association exists, the number management program 102 b is able to assign the same global LDEV number to the plurality of local LDEV numbers associated with the same external LDEV in changing the global LDEV number.
- Furthermore, the above serial processing is not limited to one virtual storage system being constructed by a plurality of storage systems. Another virtual storage system can also be merged with one virtual storage system.
FIGS. 8 a and 8 b show specific examples of a case where one virtual storage system 100 c is constructed by merging the virtual storage system 100 b with the virtual storage system 100 a. according to this example, as shown inFIG. 8 a, thenumbers 0 to 127 are assigned as global LDEV numbers to each of the virtual storage systems 100 a and 100 b. however, when one virtual storage system 100 c is constructed, the global LDEV numbers of the virtual storage system 100 b are changed from 0 to 127 to 128 to 255 as shown inFIG. 8 b. Further, the changing of the numbers can be performed by at least one of the number management programs 102 a to 102 d. - Thus, the changing of the global LDEV numbers and the reporting of the number change information is not limited to a case where a virtual storage system is newly constructed and is also applicable to cases where a virtual storage system or storage system is merged with a virtual storage system.
- When a storage system 20 (or virtual storage system) is removed from one
virtual storage system 100, the number of global LDEV numbers naturally also changes proportionately. For example, when storage system 20 b is removed fromFIG. 8 b, theglobal 1dev numbers 64 to 127 are eliminated from theglobal LDEV numbers 0 to 255 of the virtual storage system 100 c. In this case, the global LDEV numbers may be switched at the time of removal (128 to 255 may be changed to 64 to 191) and the switching of the global LDEV numbers may be performed when thestorage system 20 is merged the next time. Further, the removed storage system 20 b can also be made to operate independently. The number management program 102 b of the removed storage system 20 b changes theglobal LDEV numbers 64 to 127 to the same numbers as its own local LDEV numbers (numbers 0 to 63, for example) upon sensing that the storage system 20 b has been removed from the virtual storage system is now independent. - Furthermore, an 1d LDEV of a certain storage system can also be moved to another storage system within one virtual storage system. An example where the LDEV with global LDEV number 10 of the virtual storage system 100 a is moved from the storage system 20 a to the storage system 20 b will be described hereinbelow.
- For example, upon receiving an instruction to move the LDEV with global LDEV number 10, the storage system 20 a moves the control right of the LDEV with global LDEV number 10 from storage system 20 a to storage system 20 b. Thereupon, the LDEV with global LDEV number 10 is unique in the virtual storage system 100 a and therefore, even when the LDEV is moved from storage system 20 a to storage system 20 b, the LDEV with global LDEV number 10 remains unchanged as number 10. On the other hand, the association between global LDEV number 10 and the local LDEV number is changed for each of the storage systems 20 a and 20 b. more specifically, for example, the number management program 102 a deletes global LDEV number 10 from the number management table 105 a and the number management program 102 b specifies an unused local LDEV number from the number management table 105 b and associates global LDEV number 10 with the unused local LDEV number specified. As an example, let us assume that, prior to the move, global LDEV number 10 is associated with the local LDEV number 10 in the storage system 20 a but that, following the move, global LDEV number 10 is associated with
local LDEV number 30 in storage system 20 b. Thus, the move is not seen by thehost 51 and, even when an access request is sent, this has no effect because the global LDEV number has not changed. The fact that the volume control rights have moved is recognized by the storage systems 20 a and 20 b and the storage system 20 b associates the unused local LDEV numbers with the transfer-target global LDEV numbers. - When remote copying is generated between
virtual storage systems 100, there is no need for a match between global LDEV numbers in the copy source and copy destination. A conventional remote copy pair may essentially be generated. Furthermore, the case of a local copy generated within thevirtual storage system 100 is also similar. - Volumes that can be moved between
storage systems 20 in thevirtual storage system 100 are called ‘virtual storage system application volumes’. Volumes within thevirtual storage system 100 may all be virtual storage system application volumes or there may be a mixture such that a portion of the volumes in thevirtual storage system 100 are virtual storage system application volumes while the remaining volumes are conventional volumes used only within therespective storage systems 20. - (b) Integrated SVP
- An SVP integrated management method will be described next with reference to the drawings.
- SVP integrated management provides one master SVP (MSVP hereinbelow) in a
virtual storage system 100 and manages a plurality of other SVPs by means of the MSVP. The information acquired by the plurality of other SVPs is transmitted actively to the MSVP and managed all together by the MSVP. - As a first method of SVP integrated management, there is a method that newly sets the master SVP (MSVP hereinbelow) 82 shown in
FIG. 9a . This procedure will now be described with reference toFIG. 10 . - The
SVPS 81 in therespective storage systems 20 are connected by means of a network (s301). Suppose that a new computer is connected on the network and this computer is the MSVP 82 (s302). When a predetermined event occurs in the MSVP 82 (in the event the connection of a computer to the network is sensed, for example), anMSVP setting program 821 for making MSVP settings is executed by the processor of theMSVP 82. - The
MSVP setting program 821 recognizes the identifiers of all theSVP 81 in the virtual storage system 100 (s303). The identifiers of the SVP are set for eachSVP 81. the method involves theMSVP setting program 821 receiving an input of the identifiers of all the svp81 in thevirtual storage system 100 from the user or sending a message and the identifier of theMSVP 82 by means of a broadcast to all the svp81 and receiving in return the identifiers of theSVP 81 from aninter-SVP recognition program 811 for the respective svp81. TheMSVP setting program 821 stores an SVP list (not shown) in the storage resource of the msvp82 (memory, for example). The SVP identifiers of therespective SVP 81 are recorded in the SVP list. - Each SVP 81 (more specifically, the control program executed by the processor of the SVP, for example) registers the MSVP identifier received from the
MSVP 82 in its own storage resource (memory, for example) (s304). The MSVP identifier may also be input by the user. - Each of the
SVP 81 sends information that is being managed on theSVP 81 to theMSVP 82 and information managed by the respective SVP (these are called slave SVP: SSVP) 81 is managed all together by the MSVP 82 (s305). For example, the ssvp81 acquires the number management table 105 from the storage system to which it is itself connected and transmits the acquired number change table 105 to the msvp82. - The fact that the msvp82 and other ssvp81 have been set is reported by the
MSVP setting program 821 to all thestorage systems 20 constituting the virtual storage system, for example (s306). For example, the MSVP identifier and respective SSVP identifiers are reported to therespective storage systems 20 and recorded in thememory 22 or the like of thestorage system 20. - Upon receiving information from the respective ssvp81, the
MSVP setting program 821 associates the identifiers of the ssvp81 constituting the transmission origin of the information with the received information. As a result, theMSVP 82 is able to consciously manage the SSVP information of anystorage system 20. The msvp82 may be duplicated to afford alternate systems. - According to a first method, the loads of the ssvp81 can be made even. Further, is can also be easily adapted to adding or removing
storage systems 20. - A second method of SVP integrated management includes a method of using one of the plurality of
SVP 81 as the MSVP as shown inFIG. 9 b. The procedure will be described with reference toFIG. 11 . - The
SVP 81 in therespective storage systems 20 are connected by a network (s401). - Thereafter, the user determines the spv81 among the plurality of spv81 that is also to be used as the MSVP, for example (s402). Any of the
respective SVP 81 can be an MSVP. Hence, theSVP 81 all have theMSVP setting program 821 beforehand and an svp81 executes theprogram 821 only when selected as the MSVP. Further, all theSVP 81 have theinter-SVP recognition program 811 and perform mutual communication between svp81. - The user executes the
MSVP setting program 821 of theSVP 81 determined as the MSVP (s403). the SVP 82 (81) that executes theMSVP setting program 821 recognizes the fact that it is the MSVP and registers for the control information in the MSVP 82 (s404). more specifically, for example, theMSVP setting program 821 registers information signifying that theSVP 82 is the MSVP in the storage resource of theSVP 82. - The
MSVP setting program 821 advises theother SVP 81 of the MSVP identifier (own identifier) by means of a broadcast (s405). AnINTESVP recognition program 811 of each of theother SVP 81 receives an MSVP identifier and registers the MSVP identifier in the storage resource of the svp81 that comprises theINTESVP recognition program 811. Further, each of theother SVP 81 sends back its own identifier to theMSVP 82 in response to receiving the MSVP identifier. TheINTESVP recognition program 811 of each of the other svp81 also transmits information managed by the storage resource of the svp81 that comprises theINTESVP recognition program 811 to the msvp82. As a result, the management information of all the other svp81 is centrally managed by the msvp82. The number change table 105 in the storage system to which the other svp81 are connected, for example, exists for the information transmitted from the other svp81 to the msvp82. - The
MSVP setting program 821, for example, reports the fact that the MSVP and other SVP (‘SSVP’ hereinbelow) have been set to all thestorage systems 20 that constitute the virtual storage system (s406). More specifically, for example, information indicating whether the identifiers of the respective SVP are MSVP identifiers or SSVP identifiers is reported to therespective storage systems 20. Therespective storage systems 20 are able to recognize and register their own SVPs as MSVP or SSVP based on this information. - An SSVP that constitutes an MSVP alternate system may be selected from the plurality of SSVP by means of the second method above. That is, the MSVP may be duplicated. In this case, when the MSVP that is operating breaks down, the other SVP that has been selected is able to operate as the MSVP. It is possible to detect from the communications of the
INTERSVP recognition programs 811, for example, whether the MSVP has broken down (fault, for example). Further, both in this second method and the abovementioned first method, the number of MSVP operating at the same time is one in thevirtual storage system 100. When this one MSVP breaks down, the MSVP of the alternate system is able to operate. - Once the MSVP has been set in either the first or second method, designation by the svp81 is no longer possible and designations are henceforth made by the MSVP. The
number management program 102 above may be executed by the MSVP or SVP. - Further, in the case of the second method, if the storage system 20a for which the MSVP has been set is stopped, the MSVP functions are also suspended. Hence, the role of the MSVP must be transferred to the svp81 of another
storage system 20. therefore, when thestorage system 20 is systematically stopped (that is, when same is stopped intentionally), the fact that thestorage system 20 has stopped is reported to theother storage system 20 so that theother storage system 20 is able to recognize the fact that thestorage system 20 has stopped. The reporting method at this time may also employinterstorage system communication 44 via the host. When the storage system 20 a of the MSVP is systematically stopped, the storage system 20 a transmits a message to the effect that same is the MSVP to theother storage systems 20 and sends all the management information managed by the MSVP. Thestorage system 20 that has received the message sets the svp81 connected to thestorage system 20 as the MSVP and stores management information that has been sent in the storage resource of the svp81. Further, in a case where thestorage system 20 of the MSVP is stopped abruptly due to a fault or the like, theother storage system 20 communicates with thestorage system 20 at fixed intervals in order to be capable of sensing the fact that thestorage system 20 has stopped. Once thestorage system 20 whose stoppage has been sensed is judged to be the storage system 20 a with the MSVP, the SVP connected to thestorage system 20 is established as the MSVP. If thestorage system 20 obtains management information from the MSVP of the stopped storage system 20 a, thestorage system 20 extracts the management information and stores the extracted management information in the storage resource of the SVP which is the MSVP. The exchange between the storage systems above may be performed between SVPs. - Furthermore, the respective SSVP transmit the information which has been acquired from the storage system comprising the SSVP and stored to the MSVP together with their own SSVP identifiers. The MSVP setting program associates the received information with the SSVP identifier received with this information and stores the information in the storage resource of the MSVP.
- Further, the integration of the SVP, for example, is reported in the MSVP setting report to the respective storage systems.
- Furthermore, the storage system management information in which it is written whether the SVP of the storage system is an MSVP and so forth can be managed by the
management server 50. The storage system management information is prepared for each storage system. This will be described hereinbelow. -
FIG. 12 a shows the storage system management information for the storage system 20 a.FIG. 12 b shows the storage system management information for the storage system 20 d. The description will be provided hereinbelow with reference toFIG. 12 a as a representative example. - Virtual storage system configuration information, storage system information, the virtual storage system number, the SVP number, and the MSVP number, for example, are recorded as the storage system management information 951 a.
- The ‘virtual storage system configuration information’ is bit information indicating whether the storage system 20 a constitutes the
virtual storage system 100. According toFIG. 12 a, because the value “yes” is recorded, it can be seen that the storage system 20 a constitutes thevirtual storage system 100. On the other hand, according toFIG. 12 b, because the value “no” is recorded, it can be seen that storage system 20 d does not constitute the virtual storage system 100 (that is, the storage system 20 d operates independently). - The ‘storage system information’ is the number of the
other storage system 20 constituting thevirtual storage system 100. It can be seen from the drawings that one virtual storage system is constituted by the storage systems 20 a and 20 b. - The ‘virtual storage system number’ is the number of the
virtual storage system 100 of which the storage system 20 a is one constituent element. - The ‘SVP number’ is the identifier of the SVP of the storage system 20 a.
- The ‘MSVP number’ is the identifier of the MSVP. When the SVP of the storage system 20 a is the MSVP, a number that is the same as the svp number is recorded as the MSVP number. Further, when the storage system 20 d operates independently, the same number as the SVP number is recorded as the MSVP number (in this case, the MSVP number may instead be blank).
-
FIG. 13 shows virtual storage system management information. - One virtual storage system
management information item 953 is prepared for eachvirtual storage system 100. This information is also prepared in the storage resource of themanagement server 50. The virtual storagesystem management information 953 is information corresponding with the virtual storage system 100 a hereinbelow. - The virtual storage system number, storage system information, MSVP number, and an SVP number list are recorded as the virtual storage
system management information 953. - The ‘virtual storage system number’ is the identifier (number) of the virtual storage system 100 a.
- The ‘storage system information’ is a list of identifiers (numbers) of the
storage systems 20 constituting the virtual storage system 100 a. - The ‘MSVP number’ is the identifier of the MSVP of the virtual storage system 100 a.
- The ‘SVP number list’ is a list of identifiers of the SVP in the virtual storage system 100 a. Here, when the SVP integrated management is performed by means of the second method, for example, the same identifier (s20 a) as the MSVP identifier is recorded as illustrated. On the other hand, when SVP integrated management is performed by means of the first method, the same identifier as the MSVP identifier is not recorded as the SVP identifier (may be recorded in the same way as the second method).
-
FIG. 14 shows virtual storage system overall information. - The virtual storage system
overall information 955 is stored in the storage resource of themanagement server 50. Thisinformation 955 includes item such as the ‘virtual storage system number list’ which is the number of all the virtual storage systems constituting the management target of themanagement server 50. The numbers contained in the ‘virtual storage system number list’ are added in s601 ofFIG. 20 , for example. - (c) Fail Over By the Virtual Storage System
- The
virtual storage system 100 is seen as one system by thehost 51. The fail over function is implemented by thevirtual storage system 100, for example. Here, the storage system 20 b is the alternate system of the storage system 20 a. In reality, in order to establish an alternate system by means of LDEV units, the storage system 20 a may be the alternate system of the storage system 20 b with respect to different LDEV. -
FIG. 15 shows fail over management information. More specifically,FIG. 15 a shows fail over management information for a LDEV for fail over. On the other hand,FIG. 15 b shows fail over management information for an LDEV that is not for fail over. - The fail over
management information 957 is stored in thememory 22 of the respective storage systems, for example. The global LDEV number with which the information is associated, the initial active storage system number (the number of the storage system that is initially active), the current active storage system number (the current active storage system number), the current passive storage system number (the current passive storage system number), fail over existence (whether fail over is performed), and the state (whether fail over is in the course of being performed, for example) are recorded as the fail overmanagement information 957. The fail over management information items corresponding with the global LDEV number not for fail over are all blank as shown inFIG. 15 b. further, there may be no fail over management information for the LDEV not for fail over. - The storage system 20 a of a normal system is called ‘active’ and the storage system 20 b of an alternate system is called ‘passive’. Thus, by switching the initiative of the processing from ‘active’ to ‘passive’ in the event of a path fault between the
storage system 20 and theexternal storage system 70, and at the time of a planned stoppage of thestorage system 20 and a fault of thestorage system 20, processing can be continued without affecting theexternal volume 701. - Furthermore, when a migration of the
storage system 20 is performed, the migration function of switching the control right of theexternal volume 701 between the new andold storage systems 20 can also be implemented by rendering the migration source initially ‘active’ (path to the external volume is connected) and the migration destination ‘passive’ and performing processing to switch between active and passive. - The fail over processing between the storage system 20 a and storage system 20 b will now be described with reference to
FIG. 17 . -
FIG. 17 is a simplification ofFIG. 1 obtained by extracting the parts associated with the fail over processing. Here, suppose that the external LDEVX in theexternal storage system 70 is a real unit and theLDEV 240 that correspond with the external LDEVX are virtual devices a and b. Virtual device a is in the storage system 20 a, while virtual device b is in the storage system 20 b. The virtual devices a and b are connected to the same real unit x and, therefore, the same global LDEV number (‘global LDEV number x’ hereinbelow) is assigned thereto. Paths are extended from thehost 51 to the virtual devices a and b and set as alternate paths by thealternate path software 61. Here, storage system 20 a is active and storage system 20 b is passive. - An access request in which a global LDEV number x is designated is issued by the
host 51 to the storage system 20 a or 20 b. When the storage system 20a receives the access request, because the storage system 20 a is active in the fail overmanagement information 957 that corresponds with the global LDEV number x, the storage system 20 a is active and the access request is processed by the storage system 20 a. Hence, when the access request is received by the storage system 20 b, the storage system 20 b transfers the access request from the storage system 20 b to 20 a via thededicated line 44. The storage system 20 a is able to perform processing without distinguishing whether this is an access request received from thehost 51 or an access request received from the storage system 20 b. - Here, suppose that a fault occurs in the path between the virtual device a and the external LDEVX. In this case, because there is a fault in the path on the active side, the active and passive roles of the storage systems 20 a and 20 b which are controller parts for the external LDEVX are switched.
- First, as shown in
FIG. 19 , the storage system 20 b validates the path between virtual device b and the external LDEVX (s501). - On the other hand, the storage system 20 a transfers an access request which has already been received by the virtual device a but for which access to the external LDEVX has not been processed to the virtual device b (s502). as a result, the storage system 20 b accesses the external LDEVX in accordance with the access request that has been transferred (s503).
- Thereafter, the active/passive state of the storage systems 20 a and 20 b are switched (s504). That is, in the fail over management information corresponding with the global LDEV number x, the current active storage number is at least the number of the storage system 20 b and the current passive storage number is at least the number of the storage system 20 a.
- The switching of the active and passive of the storage systems 20 a and 20 b is completed as detailed above. Thereafter, when the storage system 20 b receives the access request that designates the global LDEV number x, the storage system 20 b processes the access request as shown in
FIG. 18 . On the other hand, when the storage system 20 a receives the access request, the access request is transferred from the storage system 20 a to the storage system 20 b via thededicated line 44. - Thus, in one
virtual storage system 100, fail over between storage systems can be implemented. - Further,
FIG. 1 is an outband system in which the network for issuing commands from thehost 51 to the respective storage systems 20 (san41, 42) and the network (management network 40) whereby themanagement server 50 sends and receives management information between thestorage systems 20 are different. However, this embodiment can also be applied to an inband system. For example, if the constitution is such that themanagement server 50 sends and receives management information between therespective storage systems 20 via the san41, the system is an inband system. - Although a preferred embodiment of the present invention was described hereinabove, this is an illustrative serving to describe the present invention, there being no intention to limit the scope of the present invention to this embodiment. The present invention can also be implemented in a variety of other forms.
- For example, as shown in
FIG. 16 , theexternal storage system 70 may be dispensed with. further, in the overall constitution of the system according to the embodiment above, there may be either a mainframe system or an open system or a mixture thereof. - Further, the management through hierarchization is not limited to LDEV numbers, for example. For example, instead of or in addition to LDEV numbers, resource numbers such as the pair numbers and group numbers of the copy system and so forth are hierarchized and can be switched by means of the same method as the LDEV numbers. Heretofore, the resource numbers in the separate storage systems have been one virtual storage system and, therefore, unique numbers are required. For example, the
1 dev# 0 andreplication 1dev# 100 are managed aspair # 0 in the storage system 20 a. Likewise, the1 dev# 0 andreplication 1dev# 100 are managed aspair # 0 in the storage system 20 b. Here, because1 dev# 0 and #100 are duplicated when the storage systems 20 a and 20 b are thevirtual storage system 100, LDEV numbers must be reset as mentioned earlier. However, the pair number andpair # 0 are replicated. Hence, global pair numbers and local pair numbers can be provided in the same way as LDEV numbers. The method of number switching can be similar to the method of switching the LDEV numbers. The processing can be performed in the same way by also providing global group numbers and local group numbers for the group numbers resulting from grouping the copy-system pair numbers.
Claims (18)
1. A control device for managing a management target constituting the target of processing executed by a first storage system in accordance with a request transmitted from a higher-level device and for controlling operation of the first storage system, comprising:
an identifier correspondence storage section for storing identifier correspondence information that records first and second management identifiers for each of a plurality of management targets;
a reception section for receiving a request designating the first management identifier from the higher-level device;
a correspondence specification section for specifying the second management identifier that corresponds with the first management identifier designated by the received request from the identifier correspondence information; and
an output section for outputting the specified second management identifier to the processing section of the first storage system,
wherein the second management identifier is a management identifier of a type that is used for processing by the first storage system, and the processing section of the first storage system identifies the processing target from the second management identifier thus output; and
the first management identifier is a management identifier of a type that is recognized by the higher-level device and which is changed to a value that does not overlap the first management identifier of the management target of another storage system of a virtual storage system obtained by logically virtualizing a plurality of storage systems as one storage resource when the first storage system is a constituent element of the virtual storage system.
2. The control device according to claim 1 , wherein the first and second management identifiers are an identifier for identifying each of a plurality of logical storage devices that exist in the first storage system and/or an identifier for identifying each of a plurality of specified resources.
3. The control device according to claim 1 , further comprising a change section for changing the first management identifier in accordance with a change in the number of storage systems constituting the virtual storage system.
4. The control device according to claim 3 , wherein the change in the number of storage systems involves adding the first storage system to an existing virtual storage system; and
the change section changes each of a plurality of first management identifiers that correspond with each of a plurality of management targets of the first storage system to values that do not overlap a plurality of first management identifiers of respective other storage systems of the existing virtual storage system.
5. The control device according to claim 3 , wherein the change in the number of storage systems involves constructing a third virtual storage system by merging a second virtual storage system with the existing first virtual storage system containing the first storage system; and
the change section changes each of a plurality of first management identifiers that correspond with each of a plurality of management targets of the first storage system to values that do not overlap a plurality of first management identifiers of respective other storage systems of the third virtual storage system.
6. The control device according to claim 3 , further comprising:
a change report section that reports the changed plurality of first management identifiers to the higher-level device.
7. The control device according to claim 3 , wherein the change section changes the plurality of first management identifiers to the same values as the plurality of second management identifiers respectively when the first storage system is independent as a result of the first storage system being removed from the virtual storage system.
8. The control device according to claim 3 , wherein each of the plurality of management targets is a logical storage device;
the first and second storage systems constituting the virtual storage system are connected to an external storage system that does not constitute the virtual storage system, and an intangible first‘virtual logical storage device of the first storage system and an intangible second virtual logical storage device of the second storage system are connected to a tangible external logical storage device of the external storage system; and
the change section affords the first management identifier of the first virtual logical storage device the same value as the first management identifier of the second virtual logical storage device.
9. An integrated management method of a virtual storage system obtained by logically virtualizing a plurality of storage systems as one storage resource, comprising the steps of:
connecting a plurality of management computers held by the plurality of storage systems by means of a network; and
collectively managing a plurality of management information items that are each managed by the plurality of management computers by means of one master management computer.
10. The integrated management method according to claim 9 , comprising:
a step of connecting a management computer other than the plurality of management computers to the network;
a step of rendering the other management computer the master management computer;
a step of rendering the plurality of management computers slave management computers;
a step in which the master management computer stores the respective identifiers of the plurality of slave management computers;
a step in which each of the plurality of slave management computers stores the identifiers of the master management computers;
a step in which each of the plurality of slave management computers transmits management information to the master management computer;
a step in which the master management computer receives each of a plurality of management information items from the plurality of slave management computers and stores the plurality of management information items thus received in the storage resource of the master management computer.
11. The integrated management method according to claim 9 , comprising:
a step of rendering one of the plurality of management computers the master management computer and rendering the other management computers slave management computers;
a step in which the master management computer stores the identifiers of the slave management computers;
a step in which the slave management computers store the identifiers of the master management computer;
a step in which the slave management computers transmit management information to the master management computer;
a step in which the master management computer receives management information from the slave management computers and stores the management information thus received in the storage resource of the master management computer; and
a step in which the master management computer also stores management information for managing the storage system to which the master management computer is itself connected in the storage resource of the master management computer in addition to the management information of the slave management computers.
12. The integrated management method according to claim 9 , wherein the master management computers are multiplexed and one of the multiplexed master management computers is rendered Active while the others are rendered Passive; and
when the Active master management computer is stopped, any of the Passive master management computers becomes Active and operates as the master management computer in place of the stopped master management computer.
13. The integrated management method according to claim 9 , wherein the master management computer broadcasts a master identifier which is its own identifier to management computers other than itself;
the management computers that receive the master identifier store the received master identifier in their own storage resource and, by way of response, transmit slave identifiers which are their own identifiers to the master management computer constituting the transmission origin of the master identifier; and
the master management computer receives the slave identifiers from management computers other than itself and store the slave identifiers thus received in its own storage resource.
14. A computer system, comprising: a control device for managing a management target constituting the target of processing executed by a first storage system in accordance with a request transmitted from a higher-level device and for controlling operation of the first storage system;
a virtual storage system obtained by logically virtualizing a plurality of storage systems including the first storage system as one storage resource; and
a virtualization section for providing the virtual storage system as the one storage resource, wherein
the control device comprises:
an identifier correspondence storage section for storing identifier correspondence information that records first and second management identifiers for each of a plurality of management targets;
a reception section for receiving a request designating the first management identifier from the higher-level device;
a correspondence specification section for specifying the second management identifier that corresponds with the first management identifier designated by the received request from the identifier correspondence information; and
an output section for outputting the specified second management identifier to the processing section of the first storage system,
and wherein the second management identifier is a management identifier of a type that is used for the processing by the first storage system, and the processing section of the first storage system identifies the processing target from the second management identifier thus output; and
the first management identifier is a management identifier of a type that is recognized by the higher-level device and which is changed to a value that does not overlap the first management identifier of the management target of another storage system of a virtual storage system obtained by logically virtualizing a plurality of storage systems as one storage resource when the first storage system is a constituent element of the virtual storage system.
15. The computer system according to claim 14 , wherein the control device further comprises:
a change section that changes the first management identifier in accordance with a change in the number of storage systems constituting the virtual storage system; and
a change report section that reports the changed plurality of first management identifiers to the virtualization section,
and wherein the virtualization section manages the correspondence between a plurality of third management identifiers that can be designated by a host and the plurality of first management identifiers and, when the changed plurality of first management identifiers are received, changes the plurality of first management identifiers that correspond with each of the plurality of third management identifiers to the changed plurality of first management identifiers thus received.
16. The computer system according to claim 14 , wherein the higher-level device is a switch that is interposed between the host and the virtual storage system, and
the virtualization section is installed in the switch.
17. The computer system according to claim 14 , wherein the higher-level device is the host, and
the virtualization section is installed in the host.
18. A storage system comprising the control device according to claim 1 .
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/858,570 US9898221B2 (en) | 2006-08-02 | 2010-08-18 | Control device for storage system capable of acting as a constituent element of virtualization storage system |
US14/931,988 US10140045B2 (en) | 2006-08-02 | 2015-11-04 | Control device for storage system capable of acting as a constituent element of virtualization storage system |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2006210464A JP4963892B2 (en) | 2006-08-02 | 2006-08-02 | Storage system control device that can be a component of a virtual storage system |
JP2006-210464 | 2006-08-02 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/858,570 Continuation US9898221B2 (en) | 2006-08-02 | 2010-08-18 | Control device for storage system capable of acting as a constituent element of virtualization storage system |
Publications (1)
Publication Number | Publication Date |
---|---|
US20080034005A1 true US20080034005A1 (en) | 2008-02-07 |
Family
ID=38610861
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/529,053 Abandoned US20080034005A1 (en) | 2006-08-02 | 2006-09-27 | Control device for storage system capable of acting as a constituent element of virtualization storage system |
US12/858,570 Active 2029-07-22 US9898221B2 (en) | 2006-08-02 | 2010-08-18 | Control device for storage system capable of acting as a constituent element of virtualization storage system |
US14/931,988 Active 2027-01-10 US10140045B2 (en) | 2006-08-02 | 2015-11-04 | Control device for storage system capable of acting as a constituent element of virtualization storage system |
Family Applications After (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/858,570 Active 2029-07-22 US9898221B2 (en) | 2006-08-02 | 2010-08-18 | Control device for storage system capable of acting as a constituent element of virtualization storage system |
US14/931,988 Active 2027-01-10 US10140045B2 (en) | 2006-08-02 | 2015-11-04 | Control device for storage system capable of acting as a constituent element of virtualization storage system |
Country Status (3)
Country | Link |
---|---|
US (3) | US20080034005A1 (en) |
EP (2) | EP1892615A3 (en) |
JP (1) | JP4963892B2 (en) |
Cited By (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080183247A1 (en) * | 2007-01-26 | 2008-07-31 | Harding William C | Radio frequency transponder based implantable medical system |
US20090094403A1 (en) * | 2007-10-05 | 2009-04-09 | Yoshihito Nakagawa | Storage system and virtualization method |
JP2009181402A (en) * | 2008-01-31 | 2009-08-13 | Hitachi Ltd | Storage system equipped with two or more controller modules |
US20090254695A1 (en) * | 2008-04-07 | 2009-10-08 | Hitachi, Ltd. | Storage system comprising plurality of storage system modules |
US20090276594A1 (en) * | 2008-05-02 | 2009-11-05 | Hitachi, Ltd. | Storage system |
US20100138832A1 (en) * | 2008-12-03 | 2010-06-03 | Kim Byung-Woan | Apparatus and method for providing services using a virtual operating system |
US20110208940A1 (en) * | 2009-02-20 | 2011-08-25 | Hitachi, Ltd. | Storage system and method for operating storage system |
WO2013042160A1 (en) | 2011-09-20 | 2013-03-28 | Hitachi, Ltd. | Volume sharing method and storage system using the same |
US20140019972A1 (en) * | 2003-10-23 | 2014-01-16 | Netapp, Inc. | Systems and methods for path-based management of virtual servers in storage network environments |
EP2704011A1 (en) | 2012-08-31 | 2014-03-05 | Hitachi Ltd. | Management method of virtual storage system and remote copy system |
WO2014061054A1 (en) | 2012-10-15 | 2014-04-24 | Hitachi, Ltd. | Storage system and method of controlling storage system |
WO2014068607A1 (en) | 2012-10-30 | 2014-05-08 | Hitachi, Ltd. | Computer system and method for updating configuration information |
WO2014106872A1 (en) | 2013-01-07 | 2014-07-10 | Hitachi, Ltd. | Data storage system and control method for data storage system |
WO2014108935A1 (en) | 2013-01-11 | 2014-07-17 | Hitachi, Ltd. | Data storage system, method of controlling a data storage system and management system for a data storage system |
US20150046611A1 (en) * | 2013-08-07 | 2015-02-12 | Micron Technology, Inc. | Devices, systems, and methods of reducing chip select |
US20160105313A1 (en) * | 2014-10-09 | 2016-04-14 | Netapp, Inc. | Configuration replication across distributed storage systems |
US9395926B2 (en) | 2013-12-24 | 2016-07-19 | Hitachi, Ltd. | Storage system and management computer |
US20160364268A1 (en) * | 2014-06-26 | 2016-12-15 | Hitachi, Ltd. | Computer system, management computer, and management method |
US9619171B2 (en) | 2007-10-05 | 2017-04-11 | Hitachi, Ltd. | Storage system and virtualization method |
US9652165B2 (en) | 2013-03-21 | 2017-05-16 | Hitachi, Ltd. | Storage device and data management method |
US9875059B2 (en) | 2014-04-21 | 2018-01-23 | Hitachi, Ltd. | Storage system |
US9961015B2 (en) | 2013-05-15 | 2018-05-01 | Hitachi, Ltd. | Computer system, and resource management method |
US10182110B2 (en) | 2013-12-13 | 2019-01-15 | Hitachi, Ltd. | Transfer format for storage system, and transfer method |
US10185636B2 (en) * | 2014-08-15 | 2019-01-22 | Hitachi, Ltd. | Method and apparatus to virtualize remote copy pair in three data center configuration |
US10452292B2 (en) | 2014-03-07 | 2019-10-22 | Hitachi, Ltd. | Computer system |
Families Citing this family (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5111204B2 (en) * | 2008-03-31 | 2013-01-09 | 株式会社日立製作所 | Storage system and storage system management method |
JP2009258825A (en) * | 2008-04-14 | 2009-11-05 | Hitachi Ltd | Storage system, virtualization device and computer system |
US8239653B2 (en) | 2009-04-23 | 2012-08-07 | Netapp, Inc. | Active-active support of virtual storage management in a storage area network (“SAN”) |
US8074038B2 (en) | 2009-05-12 | 2011-12-06 | Microsoft Corporation | Converting luns into files or files into luns in real time |
JP2012058912A (en) * | 2010-09-07 | 2012-03-22 | Nec Corp | Logical unit number management device, logical unit number management method and program therefor |
JP5749803B2 (en) | 2011-04-27 | 2015-07-15 | 株式会社日立製作所 | Information storage system and storage system management method |
WO2013157094A1 (en) * | 2012-04-18 | 2013-10-24 | 株式会社日立製作所 | Management system and management method |
WO2013175529A1 (en) | 2012-05-23 | 2013-11-28 | Hitachi, Ltd. | Storage system and storage control method for using storage area based on secondary storage as cache area |
US9298388B2 (en) | 2012-07-26 | 2016-03-29 | Hitachi, Ltd. | Computer system, data management apparatus, and data management method |
US20140122635A1 (en) | 2012-10-31 | 2014-05-01 | Hitachi, Ltd. | Computer system and data management method |
WO2014141466A1 (en) | 2013-03-15 | 2014-09-18 | 株式会社日立製作所 | Computer system |
JP6114397B2 (en) | 2013-03-18 | 2017-04-12 | 株式会社日立製作所 | Hybrid storage system and storage control method |
JP6825263B2 (en) * | 2016-08-22 | 2021-02-03 | 富士通株式会社 | Storage controller and storage system |
JP7140807B2 (en) * | 2020-09-23 | 2022-09-21 | 株式会社日立製作所 | virtual storage system |
JP7212093B2 (en) * | 2021-03-25 | 2023-01-24 | 株式会社日立製作所 | Storage system, storage system migration method |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6393432B1 (en) * | 1999-06-02 | 2002-05-21 | Visionael Corporation | Method and system for automatically updating diagrams |
US20030172140A1 (en) * | 1998-06-18 | 2003-09-11 | Koji Nishi | Communication apparatus and communication network management system |
US6640278B1 (en) * | 1999-03-25 | 2003-10-28 | Dell Products L.P. | Method for configuration and management of storage resources in a storage network |
US6883083B1 (en) * | 2002-12-20 | 2005-04-19 | Veritas Operating Corporation | System and method for maintaining and accessing information regarding virtual storage devices |
US7007152B2 (en) * | 2001-12-28 | 2006-02-28 | Storage Technology Corporation | Volume translation apparatus and method |
US20060101221A1 (en) * | 2004-11-05 | 2006-05-11 | Akitatsu Harada | Storage system and storage system construction control method |
US7360030B1 (en) * | 2004-06-01 | 2008-04-15 | Sanbolic, Inc. | Methods and apparatus facilitating volume management |
Family Cites Families (28)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH10275056A (en) * | 1997-03-31 | 1998-10-13 | Hitachi Ltd | Microprogram delivery method for magnetic disk controller |
US6073209A (en) * | 1997-03-31 | 2000-06-06 | Ark Research Corporation | Data storage controller providing multiple hosts with access to multiple storage subsystems |
US6185580B1 (en) * | 1998-06-24 | 2001-02-06 | International Business Machines Corporation | Physical information and extensions file and file system translator |
JP2000099278A (en) * | 1998-09-21 | 2000-04-07 | Hitachi Ltd | Constitution definition system for array disk drive mounted with scsi interface |
JP2000118856A (en) * | 1998-10-09 | 2000-04-25 | Minolta Co Ltd | Paper output device |
US6754696B1 (en) * | 1999-03-25 | 2004-06-22 | Micosoft Corporation | Extended file system |
JP2001350707A (en) * | 2000-06-06 | 2001-12-21 | Hitachi Ltd | Information processing system and allocating method for storage device |
US6732104B1 (en) * | 2001-06-06 | 2004-05-04 | Lsi Logic Corporatioin | Uniform routing of storage access requests through redundant array controllers |
US20020188592A1 (en) * | 2001-06-11 | 2002-12-12 | Storage Technology Corporation | Outboard data storage management system and method |
US6839706B2 (en) * | 2001-08-06 | 2005-01-04 | Lefthand Networks, Inc. | Block data storage within a computer network |
US7171434B2 (en) * | 2001-09-07 | 2007-01-30 | Network Appliance, Inc. | Detecting unavailability of primary central processing element, each backup central processing element associated with a group of virtual logic units and quiescing I/O operations of the primary central processing element in a storage virtualization system |
US7644136B2 (en) * | 2001-11-28 | 2010-01-05 | Interactive Content Engines, Llc. | Virtual file system |
US7433948B2 (en) * | 2002-01-23 | 2008-10-07 | Cisco Technology, Inc. | Methods and apparatus for implementing virtualization of storage within a storage area network |
US7340489B2 (en) * | 2002-04-10 | 2008-03-04 | Emc Corporation | Virtual storage devices |
JP2003316522A (en) * | 2002-04-26 | 2003-11-07 | Hitachi Ltd | Computer system and method for controlling the same system |
JP2004013215A (en) | 2002-06-03 | 2004-01-15 | Hitachi Ltd | Storage system, storage sub-system, and information processing system including them |
US7263593B2 (en) * | 2002-11-25 | 2007-08-28 | Hitachi, Ltd. | Virtualization controller and data transfer control method |
JP4307202B2 (en) * | 2003-09-29 | 2009-08-05 | 株式会社日立製作所 | Storage system and storage control device |
JP2005222404A (en) * | 2004-02-06 | 2005-08-18 | Hitachi Ltd | Storage control subsystem having virtual storage unit |
JP2005301561A (en) * | 2004-04-09 | 2005-10-27 | Nec Corp | Disk array system |
US7096338B2 (en) * | 2004-08-30 | 2006-08-22 | Hitachi, Ltd. | Storage system and data relocation control device |
JP2006178720A (en) * | 2004-12-22 | 2006-07-06 | Hitachi Ltd | Storage system |
JP4690765B2 (en) * | 2005-04-26 | 2011-06-01 | 株式会社日立製作所 | Storage management system, storage management server, data relocation control method, and data relocation control program |
JP5057656B2 (en) * | 2005-05-24 | 2012-10-24 | 株式会社日立製作所 | Storage system and storage system operation method |
US7620981B2 (en) * | 2005-05-26 | 2009-11-17 | Charles William Frank | Virtual devices and virtual bus tunnels, modules and methods |
JP4842593B2 (en) * | 2005-09-05 | 2011-12-21 | 株式会社日立製作所 | Device control takeover method for storage virtualization apparatus |
JP4920291B2 (en) * | 2006-04-18 | 2012-04-18 | 株式会社日立製作所 | Computer system, access control method, and management computer |
JP4892289B2 (en) * | 2006-07-07 | 2012-03-07 | 株式会社日立製作所 | Storage system including multiple storage devices |
-
2006
- 2006-08-02 JP JP2006210464A patent/JP4963892B2/en active Active
- 2006-09-27 US US11/529,053 patent/US20080034005A1/en not_active Abandoned
-
2007
- 2007-03-14 EP EP07251065A patent/EP1892615A3/en not_active Withdrawn
- 2007-03-14 EP EP14190139.7A patent/EP2854021B1/en active Active
-
2010
- 2010-08-18 US US12/858,570 patent/US9898221B2/en active Active
-
2015
- 2015-11-04 US US14/931,988 patent/US10140045B2/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030172140A1 (en) * | 1998-06-18 | 2003-09-11 | Koji Nishi | Communication apparatus and communication network management system |
US6640278B1 (en) * | 1999-03-25 | 2003-10-28 | Dell Products L.P. | Method for configuration and management of storage resources in a storage network |
US6393432B1 (en) * | 1999-06-02 | 2002-05-21 | Visionael Corporation | Method and system for automatically updating diagrams |
US7007152B2 (en) * | 2001-12-28 | 2006-02-28 | Storage Technology Corporation | Volume translation apparatus and method |
US6883083B1 (en) * | 2002-12-20 | 2005-04-19 | Veritas Operating Corporation | System and method for maintaining and accessing information regarding virtual storage devices |
US7360030B1 (en) * | 2004-06-01 | 2008-04-15 | Sanbolic, Inc. | Methods and apparatus facilitating volume management |
US20060101221A1 (en) * | 2004-11-05 | 2006-05-11 | Akitatsu Harada | Storage system and storage system construction control method |
Cited By (49)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140019972A1 (en) * | 2003-10-23 | 2014-01-16 | Netapp, Inc. | Systems and methods for path-based management of virtual servers in storage network environments |
US9501322B2 (en) * | 2003-10-23 | 2016-11-22 | Netapp, Inc. | Systems and methods for path-based management of virtual servers in storage network environments |
US20080183247A1 (en) * | 2007-01-26 | 2008-07-31 | Harding William C | Radio frequency transponder based implantable medical system |
US8301854B2 (en) | 2007-10-05 | 2012-10-30 | Hitachi, Ltd. | Storage system and virtualization method |
US20090094403A1 (en) * | 2007-10-05 | 2009-04-09 | Yoshihito Nakagawa | Storage system and virtualization method |
US8683157B2 (en) | 2007-10-05 | 2014-03-25 | Hitachi, Ltd. | Storage system and virtualization method |
US9619171B2 (en) | 2007-10-05 | 2017-04-11 | Hitachi, Ltd. | Storage system and virtualization method |
JP2009181402A (en) * | 2008-01-31 | 2009-08-13 | Hitachi Ltd | Storage system equipped with two or more controller modules |
US7984260B2 (en) | 2008-01-31 | 2011-07-19 | Hitachi, Ltd. | Storage system provided with a plurality of controller modules |
US20090254695A1 (en) * | 2008-04-07 | 2009-10-08 | Hitachi, Ltd. | Storage system comprising plurality of storage system modules |
US8645658B2 (en) | 2008-04-07 | 2014-02-04 | Hitachi, Ltd. | Storage system comprising plurality of storage system modules |
US8271759B2 (en) * | 2008-05-02 | 2012-09-18 | Hitachi, Ltd. | Storage system |
JP2009271666A (en) * | 2008-05-02 | 2009-11-19 | Hitachi Ltd | Storage system |
US20090276594A1 (en) * | 2008-05-02 | 2009-11-05 | Hitachi, Ltd. | Storage system |
US8464253B2 (en) * | 2008-12-03 | 2013-06-11 | Samsung Electronics Co., Ltd. | Apparatus and method for providing services using a virtual operating system |
US20100138832A1 (en) * | 2008-12-03 | 2010-06-03 | Kim Byung-Woan | Apparatus and method for providing services using a virtual operating system |
US9459899B2 (en) | 2008-12-03 | 2016-10-04 | Samsung Electronics Co., Ltd. | Apparatus and method for providing services using a virtual operating system |
US20110208940A1 (en) * | 2009-02-20 | 2011-08-25 | Hitachi, Ltd. | Storage system and method for operating storage system |
US8572346B2 (en) | 2009-02-20 | 2013-10-29 | Hitachi, Ltd. | Storage system and method for efficiently utilizing storage capacity within a storage system |
US9367265B2 (en) | 2009-02-20 | 2016-06-14 | Hitachi, Ltd. | Storage system and method for efficiently utilizing storage capacity within a storage system |
US8527716B2 (en) | 2011-09-20 | 2013-09-03 | Hitachi, Ltd. | Volume sharing method and storage system using the same |
WO2013042160A1 (en) | 2011-09-20 | 2013-03-28 | Hitachi, Ltd. | Volume sharing method and storage system using the same |
US8935496B2 (en) | 2012-08-31 | 2015-01-13 | Hitachi, Ltd. | Management method of virtual storage system and remote copy system |
EP2704011A1 (en) | 2012-08-31 | 2014-03-05 | Hitachi Ltd. | Management method of virtual storage system and remote copy system |
US9170743B2 (en) | 2012-08-31 | 2015-10-27 | Hitachi, Ltd. | Management method of virtual storage system and remote copy system |
US8949562B2 (en) | 2012-10-15 | 2015-02-03 | Hitachi, Ltd. | Storage system and method of controlling storage system |
WO2014061054A1 (en) | 2012-10-15 | 2014-04-24 | Hitachi, Ltd. | Storage system and method of controlling storage system |
WO2014068607A1 (en) | 2012-10-30 | 2014-05-08 | Hitachi, Ltd. | Computer system and method for updating configuration information |
US20140195573A1 (en) * | 2013-01-07 | 2014-07-10 | Hitachi, Ltd. | Storage system and control method for storage system |
WO2014106872A1 (en) | 2013-01-07 | 2014-07-10 | Hitachi, Ltd. | Data storage system and control method for data storage system |
US9262437B2 (en) * | 2013-01-07 | 2016-02-16 | Hitachi, Ltd. | Storage system and control method for storage system |
WO2014108935A1 (en) | 2013-01-11 | 2014-07-17 | Hitachi, Ltd. | Data storage system, method of controlling a data storage system and management system for a data storage system |
US9052839B2 (en) | 2013-01-11 | 2015-06-09 | Hitachi, Ltd. | Virtual storage apparatus providing a plurality of real storage apparatuses |
US9652165B2 (en) | 2013-03-21 | 2017-05-16 | Hitachi, Ltd. | Storage device and data management method |
US9961015B2 (en) | 2013-05-15 | 2018-05-01 | Hitachi, Ltd. | Computer system, and resource management method |
US9785603B2 (en) * | 2013-08-07 | 2017-10-10 | Micron Technology, Inc. | Devices, systems, and methods of reducing chip select |
US10289597B2 (en) * | 2013-08-07 | 2019-05-14 | Micron Technology, Inc. | Devices, systems, and methods of reducing chip select |
US20150046611A1 (en) * | 2013-08-07 | 2015-02-12 | Micron Technology, Inc. | Devices, systems, and methods of reducing chip select |
CN106030554A (en) * | 2013-08-07 | 2016-10-12 | 美光科技公司 | Devices, systems, and methods of reducing chip select |
US9996496B2 (en) * | 2013-08-07 | 2018-06-12 | Micron Technology, Inc. | Devices, systems, and methods of reducing chip select |
US9477616B2 (en) * | 2013-08-07 | 2016-10-25 | Micron Technology, Inc. | Devices, systems, and methods of reducing chip select |
US10182110B2 (en) | 2013-12-13 | 2019-01-15 | Hitachi, Ltd. | Transfer format for storage system, and transfer method |
US9395926B2 (en) | 2013-12-24 | 2016-07-19 | Hitachi, Ltd. | Storage system and management computer |
US10452292B2 (en) | 2014-03-07 | 2019-10-22 | Hitachi, Ltd. | Computer system |
US9875059B2 (en) | 2014-04-21 | 2018-01-23 | Hitachi, Ltd. | Storage system |
US20160364268A1 (en) * | 2014-06-26 | 2016-12-15 | Hitachi, Ltd. | Computer system, management computer, and management method |
US10185636B2 (en) * | 2014-08-15 | 2019-01-22 | Hitachi, Ltd. | Method and apparatus to virtualize remote copy pair in three data center configuration |
US10187256B2 (en) * | 2014-10-09 | 2019-01-22 | Netapp Inc. | Configuration replication across distributed storage systems |
US20160105313A1 (en) * | 2014-10-09 | 2016-04-14 | Netapp, Inc. | Configuration replication across distributed storage systems |
Also Published As
Publication number | Publication date |
---|---|
US9898221B2 (en) | 2018-02-20 |
EP1892615A3 (en) | 2010-04-07 |
US20100318579A1 (en) | 2010-12-16 |
EP1892615A2 (en) | 2008-02-27 |
JP2008040571A (en) | 2008-02-21 |
US10140045B2 (en) | 2018-11-27 |
EP2854021B1 (en) | 2018-12-26 |
EP2854021A1 (en) | 2015-04-01 |
JP4963892B2 (en) | 2012-06-27 |
US20160054950A1 (en) | 2016-02-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10140045B2 (en) | Control device for storage system capable of acting as a constituent element of virtualization storage system | |
US7558916B2 (en) | Storage system, data processing method and storage apparatus | |
US6640278B1 (en) | Method for configuration and management of storage resources in a storage network | |
US7203730B1 (en) | Method and apparatus for identifying storage devices | |
US8051262B2 (en) | Storage system storing golden image of a server or a physical/virtual machine execution environment | |
US7469289B2 (en) | Storage system having virtualized resource | |
US8301854B2 (en) | Storage system and virtualization method | |
JP4568574B2 (en) | Storage device introduction method, program, and management computer | |
JP4800059B2 (en) | Virtual storage system and control method thereof | |
US7464223B2 (en) | Storage system including storage adapters, a monitoring computer and external storage | |
US7356640B2 (en) | Storage apparatus and storage system | |
US20070239954A1 (en) | Capacity expansion volume migration transfer method | |
US20100036896A1 (en) | Computer System and Method of Managing Backup of Data | |
US20140143391A1 (en) | Computer system and virtual server migration control method for computer system | |
JP2000339098A (en) | Storage domain management system | |
JP2009271666A (en) | Storage system | |
US8904141B2 (en) | Merging a storage cluster into another storage cluster |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: HITACHI, LTD., JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SATOYAMA, AI;EGUCHI, YOSHIAKI;REEL/FRAME:018356/0521 Effective date: 20060912 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |