WO2017037800A1 - Système de mémorisation et son procédé de commande - Google Patents

Système de mémorisation et son procédé de commande Download PDF

Info

Publication number
WO2017037800A1
WO2017037800A1 PCT/JP2015/074511 JP2015074511W WO2017037800A1 WO 2017037800 A1 WO2017037800 A1 WO 2017037800A1 JP 2015074511 W JP2015074511 W JP 2015074511W WO 2017037800 A1 WO2017037800 A1 WO 2017037800A1
Authority
WO
WIPO (PCT)
Prior art keywords
migration
data
information
storage device
shaper
Prior art date
Application number
PCT/JP2015/074511
Other languages
English (en)
Japanese (ja)
Inventor
友謙 佐藤
将史 大木
Original Assignee
株式会社日立製作所
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社日立製作所 filed Critical 株式会社日立製作所
Priority to PCT/JP2015/074511 priority Critical patent/WO2017037800A1/fr
Publication of WO2017037800A1 publication Critical patent/WO2017037800A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers

Definitions

  • the present invention relates to a storage system and a control method thereof.
  • New storage devices appear year by year, and data migration (migration, copying) from a storage device in use to a new storage device is being carried out.
  • data migration migration, copying
  • the data to be distributed is transferred from the storage device in use to the added storage device.
  • Patent Document 1 discloses that “the relay unit relays communication between the information processing device and the first storage device or the second storage device.
  • the determination unit includes the information processing device and the first storage device.
  • the communication with the storage device or the second storage device is monitored, and the presence or absence of access from the information processing device to the first storage device or the second storage device is determined.
  • the first storage device to the second storage is determined.
  • a technique of “copying data to a device” is disclosed.
  • the information processing apparatus performs the second storage from the first storage apparatus without affecting the operation using the first storage apparatus or the second storage apparatus. Data can be copied to the device.
  • Patent Document 1 requires a new mechanism for judging whether or not there is access for communication and a mechanism for copying data, which increases the cost of introduction.
  • many recent storage apparatuses have a copy function and a load information acquisition function, which overlap with these functions.
  • an object of the present invention is to realize data migration with a simple structure while suppressing the influence on the operation of the storage apparatus.
  • a representative storage system is a storage system having a band shaper connected to a plurality of storage apparatuses, and the band shaper receives data from a first storage apparatus among the plurality of storage apparatuses. Receiving, transmitting the received data to a second storage device of the plurality of storage devices, obtaining load information of the first storage device, and receiving data according to the obtained load information The transmission of the information indicating that it is possible to the first storage device is suspended.
  • FIG. 1 is a diagram illustrating an example of a system to which a plurality of migration source storage apparatuses are connected.
  • FIG. 1 is a diagram showing an example of a system.
  • the migration source storage apparatus 180 is connected to the migration destination storage apparatus 190 via the band shaper 110, and the migration source volume 185 stored in the migration source storage apparatus 180 is migrated to the migration destination storage apparatus 190, and the migration destination volume 192 It becomes.
  • the migration source volume 185 and the migration destination volume 192 may be logical volumes, may be data subject to some logical management unit such as a file, or may be physical disks 184, 191. It may be data having a physical storage position in the unit as a unit.
  • Volume migration is realized by moving or copying data.
  • the migration destination storage apparatus 190 issues a READ command for the migration source volume 185, and the migration source storage apparatus 180 transmits READ data in response to this READ command.
  • the migration destination storage apparatus 190 may store the READ data in the migration destination volume 192.
  • the migration source storage apparatus 180 may issue a WRITE command and WRITE data to the migration destination storage apparatus 190, but an example of a READ command and READ data will be described below.
  • the server 160 is connected to the migration source storage apparatus 180, issues a READ command or a WRITE command to the migration source storage apparatus 180, and reads / writes data stored in the migration source storage apparatus 180.
  • the migration source storage apparatus 180 is shared by the server 160 and the migration destination storage apparatus 190, the load on the migration source storage apparatus 180 increases when there are many READ commands and READ data by the migration destination storage apparatus 190. In addition, there is a possibility of affecting the reading and writing of data by the server 160.
  • the band shaper 110 instructs the migration destination storage apparatus 190 to inhibit the transmission of the READ command for the migration or the transmission of the READ data for the migration according to the load state of the migration source storage apparatus 180. Instruct the migration source storage device to perform suppression. As a result, the load for data migration in the migration source storage apparatus 180 is reduced, and the influence on the data read / write by the server 160 is reduced.
  • the server 160 may be a general computer. As described above, the server 160 is connected to the migration source storage apparatus 180, issues a READ command or a WRITE command to the migration source storage apparatus 180, and migrates to the migration source storage apparatus 180. Read and write data stored in. This read / write target may be the disk 184 in which the migration source volume 185 is stored, or may be a disk other than the disk 184 that is not shown. There may be a plurality of servers 160 connected to the migration source storage apparatus 180.
  • the migration source storage apparatus 180 includes a storage controller 181 that receives a READ command, a WRITE command, and other control commands from the outside and transfers READ data and WRITE data, and a disk 184 in which the data is stored.
  • the storage controller 181 includes a processor 182 that processes at least a command, and a memory 183 that temporarily stores READ data and WRITE data.
  • the migration source storage apparatus 180 may include a plurality of storage controllers 181, and the storage controller 181 may include a plurality of processors 182 or a plurality of memories 183.
  • the disk 184 is a storage medium, and may be a hard disk drive, a solid state drive, or the like, or a drive in which data is stored.
  • the disk 184 may be composed of a plurality of physical storage media, or may be a part of the physical storage media.
  • the processor 182 interprets the READ command, and the data targeted for the READ command is stored in the memory 183 or stored in the disk 184. And control to transfer the READ data from the memory 183 or the disk 184 to the server 160.
  • the READ data transferred from the disk 184 may be stored in the memory 183. Therefore, the target related to the operation of the processor 182 is a READ command, and the target related to the operation of the memory 183 and the disk 184 is READ data.
  • the migration destination storage apparatus 190 since the migration destination storage apparatus 190 also issues a READ command and acquires READ data in the same manner as the server 160, the same processor 182, memory 183, If the disk 184 is used, it may affect the processing for the server 160 in each.
  • the storage controller 181 may include an interface for connecting to the server 160 and the migration destination storage apparatus 190 and an interface for connecting to the disk 184. However, the storage controller 181 has sufficient performance for the operation for the server 160 and the migration destination storage apparatus 190. Since there is no influence by the load, illustration and description are omitted here.
  • the management server 170 is a general computer, and may be connected to the migration source storage apparatus 180 and the band shaper 110 in order to manage the system.
  • the management server 170 sets information for operation to the migration source storage apparatus 180 by the management program installed in the management server 170, and the usage rates of the processor 182, the memory 183, and the disk 184 in the migration source storage apparatus 180. Or you may get Further, the management server 170 may set information in the band shaper 110 or provide the usage rate acquired from the migration source storage apparatus 180.
  • the migration destination storage apparatus 190 includes a disk 191.
  • the disk 191 is a storage medium and may have the same physical configuration as the disk 184.
  • the migration destination storage apparatus 190 may also include a storage controller or the like, illustration and description thereof are omitted because they are not necessary for the description of the embodiment.
  • the migration destination volume 192 may be a so-called circumscribing volume of the migration source storage apparatus 180, or may be further copied from the migration destination volume 192, which is a circumscribing volume, to an internal volume in the migration destination storage apparatus 190.
  • the bandwidth shaper 110 is an apparatus that is connected to the migration source storage apparatus 180 and the migration destination storage apparatus 190, relays data transfer for migration, and controls the data transfer band.
  • the data transfer relay for migration the READ command transmitted from the migration destination storage device 190 is received and transmitted to the migration source storage device 180, and the READ data transmitted from the migration source storage device 180 is received and the migration destination storage device is received. This is realized by transmitting to the device 190.
  • the storage apparatus I / F (interface) 120 is an interface for connecting to the migration source storage apparatus 180 and the migration destination storage apparatus 190, and may be, for example, a fiber channel or Ethernet (registered trademark). Note that the storage apparatus I / F 120 may include a plurality of interface ports or may include a plurality of interface adapters.
  • the X-bar (crossbar) switch 121 is a switch that selects and connects an interface port to which the source and destination of data transfer to be relayed are connected.
  • the path arbiter 122 performs arbitration so as to avoid a data transfer collision when the same data transfer destination interface port is selected for a plurality of data transfer source interface ports.
  • the buffer memory 123 is a buffer for data to be transferred, and may be stored in units of frames or packets, for example.
  • the storage apparatus I / F 120 may include a small capacity buffer.
  • the control LSI 124 controls the data transfer in the band shaper 110, analyzes the destination of data received by the storage apparatus I / F 120, for example, and selects the interface port to which the storage apparatus connected as the destination is selected. Control the bar switch 121 Further, the control LSI 124 transmits READ command suppression information and READ data suppression information from the instructed interface port based on an instruction from the processor core 130, and receives it from the migration destination storage apparatus 190 in preset time units. The number of READ commands received is counted, and the amount of READ data received from the migration source storage apparatus 180 is counted in a preset time unit.
  • the management I / F (interface) 150 is an interface for connecting to the management server 170, and may be Ethernet, for example.
  • the management I / F 150 acquires the usage rates of the processor 182, the memory 183, and the disk 184 in the migration source storage apparatus 180 from the management server 170, and acquires information on the memory 140 described later from the management server 170. To do.
  • the management I / F 150 may be directly connected to the migration source storage apparatus 180 and may directly acquire the usage rates of the processor 182, the memory 183, and the disk 184 from the migration source storage apparatus 180.
  • the processor core 130 reads the program and information stored in the memory 140 and controls the control LSI 124 based on the information acquired from the control LSI 124 and the management I / F 150.
  • Information acquired from the control LSI 124 is the number of counted READ commands and the amount of READ data.
  • the information acquired from the management I / F is the usage rate of each of the processor 182, memory 183, and disk 184 in the migration source storage apparatus 180 and information set in the memory 140.
  • the processor core 130 may be composed of a plurality of processor cores, part of which may include hardware dedicated to specific processing, or may be composed of a plurality of LSIs.
  • the memory 140 is a memory that is read and written by the processor core 130, and may be, for example, a DRAM (dynamic random access memory) or an SRAM (static random access memory).
  • the band shaper 110 may include a non-volatile memory such as a flash memory (not shown) in order to back up information and programs stored in the memory 140. A part of information and a program stored in the memory 140 may be loaded by the processor core 130 from a nonvolatile memory (not shown).
  • the control target period information 141 includes a period during which the band shaper 110 controls the band and a period during which the band is not controlled.
  • the period information 141 is information on these periods, and will be further described with reference to FIG. 4A.
  • the traffic threshold information 142 is information on a threshold related to the restriction because there is a restriction on the amount of data that can be relayed by the bandwidth shaper 110, that is, a traffic amount, and will be further described with reference to FIG.
  • the migration source load threshold information 143 is threshold information regarding the load of the migration source storage apparatus 180, and will be further described with reference to FIG. 4C.
  • the maximum delay time information 144 is information on the maximum time for suppressing the READ command and delaying the transmission of the READ command and the maximum time for suppressing the READ data and delaying the transmission of the READ data, and will be further described with reference to FIG. 4D. To do.
  • the setting information 145 and the state information 146 are other setting information and temporary control state information, and will be further described with reference to FIGS. 4E and 4F.
  • the traffic control program 147 is a program executed by the processor core 130 and will be further described with reference to FIGS.
  • FIG. 2 is a diagram illustrating an example of an operation for suppressing the READ command.
  • the band shaper 110 initializes data transfer 201 with the migration destination storage apparatus 190 and initializes data transfer 202 with the migration source storage apparatus 180.
  • the initializations 201 and 202 may include communication initialization, or there is no initialization 201 or 202 itself. May be.
  • the migration destination storage apparatus 190 transmits a READ command 203 for migration, and the band shaper 110 receives the storage apparatus I / F 120.
  • the received READ command 203 is sent to the control LSI 124 via the X-bar switch 121.
  • the control LSI 124 analyzes the read command and the destination, and controls the X-bar switch 121 to control the storage apparatus I / F 120.
  • the interface port corresponding to the destination is selected, and the READ command 204 having the same content as the READ command 203 is transmitted to the migration source storage apparatus 180.
  • the migration source storage apparatus 180 that has received the READ command 204 transmits the READ data 205 and the READ data 207 requested by the READ command 204. Since there is no difference between the READ command and the READ data in the communication relay operation, the band shaper 110 transmits the READ data 206 having the same contents as the READ data 205 when receiving the READ data 205, and the READ data when receiving the READ data 207. READ data 208 having the same content as 207 is transmitted.
  • the bandwidth shaper 110 When the bandwidth shaper 110 detects an increase in the load of the migration source storage apparatus 180 or an increase in the traffic volume of the band shaper, it transmits a busy response 209 to the migration destination storage apparatus 190 as READ command suppression.
  • the busy response may be, for example, a P_BSY message, a response for temporarily disconnecting the data transfer or communication connection, or the migration source storage depending on the communication or data transfer specification. It is a response (CHECK CONDITION) requesting a check of the state of the device 180, and busy information may be included in the checked state information. Further, it may be a signal indicating that the READ command cannot be received, and the busy response 209 may be transmitted in response to the READ command (not shown) after the READ data 208.
  • CHECK CONDITION requesting a check of the state of the device 180
  • busy information may be included in the checked state information. Further, it may be a signal indicating that the READ command cannot be received, and the busy response 209 may be transmitted in response to the READ command (not shown) after the READ data 208.
  • the migration destination storage apparatus 190 that has received the busy response 209 enters a standby 210 state, and does not transmit a READ command during the standby 210.
  • Communication for initialization when the time defined by the specification or a preset time has elapsed, or when the bandwidth shaper 110 detects a decrease in the load of the migration source storage apparatus 180 or a decrease in the traffic volume of the bandwidth shaper 110 Is started, the data transfer is initialized 211 between the band shaper 110 and the migration destination storage apparatus 190.
  • This initialization 211 may be the same as the initialization 201, may be different, or may not be present.
  • the operation of the migration destination storage apparatus 190 from the initialization 211 itself and the busy response 209 to the initialization 211 may be an operation according to the specification of communication between the band shaper 110 and the migration destination storage apparatus 190.
  • communication or data transfer is initialized 212 between the migration source storage device 180 and the bandwidth shaper 110.
  • the migration destination storage apparatus 190 transmits a READ command 213 for migration, and the band shaper 110 that has received the READ command 213 sends a READ command 214 having the same contents as the READ command 213 to the migration source storage apparatus 180. Send to.
  • the data of the migration source volume 185 is migrated to the migration destination volume 192.
  • the READ command issuance can be suppressed according to an increase in the load of the migration source storage apparatus 180, the number of READ commands received per unit time of the migration source storage apparatus 180 is reduced, and the migration source storage apparatus 180 The processing load of the READ command can be reduced.
  • FIG. 3 is a diagram illustrating an example of an operation for suppressing the READ data.
  • the band shaper 110 initializes data transfer 301 with the migration destination storage apparatus 190, and with the migration source storage apparatus 180. Data transfer is initialized 302.
  • the band shaper 110 includes a reception buffer that temporarily stores received READ data in the buffer memory 123 or the storage device I / F 120 and manages the reception buffer so that the reception buffer does not overflow.
  • the migration source storage apparatus 180 that transmits the READ data also manages the reception buffer in the band shaper 110 so as not to overflow.
  • Such management is generally called flow control, and the amount that can be received by the reception buffer or the empty amount is called credit.
  • the band shaper 110 notifies the migration destination storage apparatus 190 of the amount that can be received by the reception buffer of the band shaper 110, that is, the credit through the communication at initialization 302 or earlier.
  • the credit is “2”
  • the migration source storage apparatus 180 stores “2” as a number in a circle as the credit 303.
  • the band shaper 110 that has received the READ command 304 transmits a READ command 305 having the same contents as the READ command 304 to the migration source storage apparatus 180.
  • the migration source storage apparatus 180 that has received the READ command 305 transmits the READ data 306 requested by the READ command 305.
  • the band shaper 110 When the band shaper 110 receives the READ data 306, the band shaper 110 temporarily stores it in the reception buffer 307. Further, the migration source storage apparatus 180 transmits the READ data 306, so that “1” is subtracted from the credit count to “1” to indicate the empty state of the reception buffer 307. When the band shaper 110 transmits the READ data 306 temporarily stored in the reception buffer 307 to the migration destination storage apparatus 190 as the READ data 308, the band shaper 110 deletes the READ data 306 stored in the reception buffer 307, and transfers the migration source storage apparatus A buffer empty response 309 is transmitted to 180.
  • the migration source storage apparatus 180 Upon receiving the buffer empty response 309, the migration source storage apparatus 180 adds “1” to the credit count to “2” to indicate the empty state of the reception buffer 307.
  • the buffer empty response 309 may be, for example, ACK, R_RDY, or a response of the credit count value itself, depending on the communication or data transfer specifications. .
  • the signal which shows the state which can receive READ data may be sufficient.
  • the migration source storage apparatus 180 transmits the READ data 310 and 311 requested by the READ command 305 to the band shaper 110 because the credit count is “1” or more and the reception buffer is empty. When it becomes “0”, transmission of READ data is interrupted.
  • the band shaper 110 transmits the READ data 310 stored in the reception buffer to the migration destination storage apparatus 190 as the READ data 312, deletes the READ data 310 stored in the reception buffer, and sends a buffer empty response to the migration source storage apparatus 180. 313 is transmitted.
  • the migration source storage apparatus 180 transmits the READ data 314 to the band shaper 110 because the credit count is “1” or more, and when the credit count reaches “0”, the transmission of the READ data is interrupted again. Then, the band shaper 110 transmits the READ data 311 stored in the reception buffer to the migration destination storage apparatus 190 as the READ data 315, deletes the READ data 311 stored in the reception buffer, and can empty the reception buffer. .
  • the band shaper 110 detects an increase in the load of the migration source storage apparatus 180 or an increase in the traffic volume of the band shaper, the reception buffer is empty, but a buffer empty response is sent to the migration destination storage apparatus 190 as READ data suppression. Do not send. Since the migration source storage apparatus 180 has a credit count of “0”, it does not transmit new READ data and enters the standby 316 state.
  • the band shaper 110 detects a decrease in the load of the migration source storage apparatus 180 or a decrease in the traffic volume of the band shaper 110 and transmits a buffer empty response 317 to the migration source storage apparatus 180.
  • the credit count becomes “1”
  • the state of the standby 316 is ended, and the migration source storage apparatus 180 transmits the READ data 318 to the bandwidth shaper 110.
  • the data of the migration source volume 185 is migrated to the migration destination volume 192.
  • the transmission of the READ data can be suppressed according to the increase in the load of the migration source storage apparatus 180, the number of READ data transmitted per unit time of the migration source storage apparatus 180 is reduced, and the migration source storage apparatus 180 The processing load of READ data can be reduced.
  • FIG. 4A is a diagram illustrating an example of the control target period information 141.
  • the control target period information 141 may be stored in the memory 140 in a table configuration as shown in FIG. 4A, or may be stored in a configuration other than the table.
  • the control target period is a period in which the band shaper 110 controls the band, and is a period in which READ command suppression and READ data suppression can be issued. READ command suppression and READ data suppression are not issued in a period other than the control target period.
  • Item 401 is information for identifying one continuous period.
  • the start date and time 402 and the end date and time 403 are information indicating one continuous period.
  • the start date and time “ys1 / ms1 / ds1 hs1: ms1” of the start date and time 402 indicating year / month / day hour: minute is displayed as “
  • the period up to “ye1 / me1 / de1 he1: me1” represents a period during which the bandwidth is controlled, that is, the time within the control target.
  • a period not included between the start date and time 402 and the end date and time 403 is a non-control-target time.
  • FIG. 4B is a diagram illustrating an example of the traffic threshold information 142.
  • the traffic threshold information 142 may be stored in the memory 140 in a table configuration as shown in FIG. 4B, or may be stored in a configuration other than the table.
  • the traffic here is communication traffic passing through the band shaper 110.
  • This traffic may be communication traffic of the READ command transmitted from the migration destination storage apparatus 190 and the READ data transmitted from the migration source storage apparatus 180. It may be communication traffic including the READ command and READ data of the migration source storage apparatus, or all communication traffic of all apparatuses connected to the band shaper 110.
  • Item 404 is information for identifying the type of communication traffic, such as “the number of READ commands” and “the amount of READ data”.
  • the threshold 405 is a threshold for determining that the load set for each type of communication traffic in the item 404 should be reduced.
  • the traffic threshold information 142 is not limited to these, and information according to the type of target communication traffic may be set.
  • FIG. 4C is a diagram illustrating an example of the migration source load threshold information 143.
  • the migration source load threshold information 143 may be stored in the memory 140 with a table configuration as shown in FIG. 4C, or may be stored with a configuration other than the table.
  • the migration source load threshold is a threshold for the load of each part of the migration source storage apparatus 180.
  • Item 406 is information for identifying a target portion in the migration source storage apparatus 180.
  • examples of the item 406 are “processor usage rate”, “memory usage rate”, and “disk usage rate”.
  • the upper threshold 407 is a threshold for determining that the load set for each part of the item 406 should be reduced.
  • the lower threshold 408 is a threshold for determining that the load set for each part of the item 406 has dropped. The processing used by these threshold values will be described later.
  • FIG. 4D is a diagram showing an example of the maximum delay time information 144.
  • the maximum delay time information 144 may be stored in the memory 140 in a table configuration as shown in FIG. 4D, or may be stored in a configuration other than the table.
  • the maximum delay time is an upper limit of a waiting time due to READ command suppression or READ data suppression, and is the maximum time during which transmission of a READ command or READ data can be delayed.
  • Item 409 is information for identifying the type of delay, for example, “busy response” and “buffer empty response”.
  • the value 410 is the maximum time that can be delayed for each type of item 409 to be delayed.
  • the storage device such as the migration source storage device 180 detects a timeout when a predetermined time elapses without receiving an ACK response, and treats it as an error. Therefore, the value of the item 409 is set to be less than the time when the timeout is detected. May be.
  • FIG. 4E is a diagram showing an example of the setting information 145.
  • the setting information 145 is information set in addition to the information described above, and may be stored in the memory 140 with a table configuration as illustrated in FIG. 4E or may be stored with a configuration other than the table. .
  • Item 411 is information for identifying the type of setting, and includes “priority mode”, “migration completion time”, “migration capacity”, and “normal transfer rate”.
  • a value 412 is a value set for each type of setting of the item 411. “0” or “1” is set for “priority mode”, “0” indicates a mode that prioritizes the migration completion time, and “1” indicates a mode that prioritizes the processing of the server 160. “Migration completion time” is set as “yyyy / mm / dd hh: mm” where the scheduled time at which the migration should be completed represents year / month / day hour: minute.
  • “Migration capacity” is the capacity of the data to be migrated, and the capacity of the migration source volume 185 and the capacity of the migration destination volume 192 are the same, so either capacity is set as “C”.
  • “Normal transfer rate” is a transfer rate of data related to migration between the migration source storage device 180 and the migration destination storage device 190 via the band shaper 110 during normal time without READ command inhibition and READ data inhibition, and is measured in advance. The transfer rate is set as “Xa”.
  • FIG. 4F is a diagram showing an example of the status information 146.
  • the state information 146 is information that is updated according to a change in the state of the band shaper 110, and may be stored in the memory 140 in a table configuration as shown in FIG. 4F, or may be stored in a configuration other than the table. May be.
  • Item 413 is information for identifying the type of state, and includes “control flag”, “delay time (for command)”, “delay time (for data)”, and “transferd capacity”.
  • the value 414 is a value updated for each type of state of the item 413.
  • the “control flag” is updated to “0” or “1”, “0” is set when READ command suppression and READ data suppression are not issued and no waiting is performed, and “1” is READ command suppression and READ data suppression Is set when issuing and waiting. Even if the period to be controlled is set in the control target period information 141, it is set to “0” if no increase in the load of the migration source storage apparatus 180 or an increase in the traffic amount of the band shaper is detected.
  • Delay time (for command) is set to the time of standby 210 from busy response 209 to initialization 211 shown in FIG.
  • initialization 211 can be executed by transmission from the band shaper 110, when the time “Tci” set in “delay time (for command)” has elapsed since the busy response 209 was transmitted, Executes transmission for the system 211.
  • the “delay time (for command)” is set. If “Tci” is larger than the time until the occurrence due to some factor of initialization 211 (for example, timeout detection time of the migration destination storage apparatus 190), the busy response 209 is repeatedly transmitted, and the standby 210 continues for the time of “Tci”. You may make it do. Also, if “Tci” is smaller than the time until the occurrence of the initialization 211 due to some factor, “Tci” may not be used.
  • Delay time (for data) is set to the time of standby 316 from READ data 315 to buffer empty response 317 shown in FIG.
  • the band shaper 110 transmits a buffer empty response 317 when the time “Tcd” set in “delay time (for data)” has elapsed since the start of the standby 316.
  • the values of “Tci” and “Tcd” are written and read by the processor core 130, set in the control LSI 124, and the control LSI 124 transmits a busy response and a buffer empty response according to the set values. You may control to. Further, the values of “Tci” and “Tcd” may be read from the memory 140 by the control LSI 124.
  • “Migrated capacity” is the capacity of the READ data relayed by the band shaper 110 for migration from the migration source storage apparatus 180 to the migration destination storage apparatus 190. For example, each time the control LSI 124 relays the READ data, the capacity of the READ data may be counted, and the counted capacity may be acquired by the processor core 130 and written to the memory 140 as “Cf”. It is desirable that “C” of “migration capacity” in the setting information 145 and “Cf” of “migrated capacity” in the status information 146 are values in the same unit.
  • FIG. 5 is a diagram showing an example of a processing flow for controlling the data migration band.
  • This processing flow is included in the traffic control program 147 and is executed by the processor core 130.
  • the processor core 130 determines in step 501 whether the migration is incomplete. For this purpose, the processor core 130 reads the value “C” corresponding to the “migration capacity” of the setting information 145 stored in the memory 140 and the value “Cf” corresponding to the “migrated capacity” of the status information 146. If the value of “Cf” is subtracted from the value of “C” and does not become 0, it is determined that the transition is incomplete.
  • the processor core 130 proceeds to Step 508 and releases control of all the bands. For this purpose, the processor core 130 updates the value corresponding to the “control flag” of the state information 146 stored in the memory 140 to 0 and sets “Tci” corresponding to “delay time (for command)” to the value 0. And “Tcd” corresponding to “Delay time (for data)” is updated to “0”. Then, the bandwidth control process ends.
  • step 502 determines whether it is outside the band control target date and time. For this purpose, the processor core 130 reads the current date and time from a clock (not shown), reads the control target period information 141 stored in the memory 140, reads the current date and time, the start date and time 402, and the end date and time 403. Compare
  • step 503 the processor core 130 Proceeding to step 503, in order to cancel the band control, the same processing as step 508 is executed, and the process returns to step 501.
  • step 502 when it is determined that the current date / time is included in any of the period from the start date / time 402 to the end date / time 403, that is, when it is determined that it is not outside the target date / time for bandwidth control, the processor The core 130 proceeds to step 504 and controls the band based on the communication traffic amount relayed by the band shaper 110. This band control will be further described later with reference to FIG. In step 505, the processor core 130 controls the bandwidth based on the load of the migration source storage apparatus 180. This band control will be further described later with reference to FIG.
  • step 506 the processor core 130 determines a condition for updating the value corresponding to the “control flag” of the state information 146 to “0”. Therefore, the processor core 130 sets the value of “Tci” corresponding to “delay time (for command)” and “Tcd” corresponding to “delay time (for data)” of the state information 146 stored in the memory 140. To determine whether both of these values are zero. When these values are 0, it means that there is substantially no delay in the READ command and the READ data.
  • step 507 updates the value corresponding to the “control flag” of the state information 146 stored in the memory to 0, Return to step 501. If it is determined in step 506 that any value is not 0, the process returns to step 501.
  • the current date and time read from the clock not shown in step 502 is a date and time that can be compared with the date and time of the start date and time 403 and the end date and time 403, the current date and time is the date and time when read from the clock. On the other hand, it may be a date and time including an error.
  • FIG. 6 is a diagram showing an example of a processing flow for controlling the bandwidth based on the traffic volume.
  • This processing flow is a flow included in the traffic control program 147, is executed by the processor core 130, and corresponds to step 504 shown in FIG.
  • the processor core 130 acquires the number of READ commands received by the band shaper 110 from the migration destination storage apparatus 190 and the amount of READ data received by the band shaper 110 from the migration source storage apparatus 180.
  • the control LSI 124 may count each time the number of READ commands and the amount of READ data are received, and the processor core 130 may acquire these counted values from the control LSI 124.
  • the processor core 130 acquires the threshold value “A” corresponding to “READ command number” in the traffic threshold information 142 stored in the memory 140, and compares it with the READ command number acquired in step 601.
  • step 601 when it is determined that the number of READ commands acquired in step 601 is larger than the threshold value “A”, the processor core 130 proceeds to step 603 and READ that the migration destination storage apparatus 190 transmits by READ command suppression. Control the number of commands. As a result of the comparison in step 602, when it is determined that the value is not large, the processor core 130 skips step 603.
  • step 604 the processor core 130 acquires a threshold value “B” corresponding to “READ data amount” of the traffic threshold information 142 stored in the memory 140, and compares it with the READ data amount acquired in step 601. As a result of the comparison, when it is determined that the amount of READ data acquired in step 601 is larger than the threshold value “B”, the processor core 130 proceeds to step 605 and reads the READ transmitted from the migration source storage apparatus 180 by READ data suppression. Control the amount of data. As a result of the comparison in step 604, if it is determined that the value is not large, the processor core 130 skips step 605 and returns after step 504 shown in FIG.
  • FIG. 7 is a diagram showing an example of a processing flow for controlling the bandwidth based on the load of the migration source storage apparatus 180.
  • This processing flow is a flow included in the traffic control program 147, is executed by the processor core 130, and corresponds to step 505 shown in FIG.
  • the processor core 130 acquires load information of each part of the migration source storage apparatus 180.
  • the migration source storage apparatus 180 transmits the load information to the management server 170, the management server 170 transmits the received load information to the management I / F 150, and the processor core 130 acquires the load information from the management I / F 150. May be.
  • the load information includes, for example, the usage rate of the processor 182, the usage rate of the memory 183, and the usage rate of the disk 184.
  • step 702 the processor core 130 reads the threshold value “D” corresponding to the “processor usage rate” in the migration source load threshold information 143 of the memory 140, and compares it with the value of the processor usage rate acquired in step 701. As a result of this comparison, when it is determined that the processor usage rate acquired in step 701 is larger than the threshold value of “D”, the processor core 130 proceeds to step 703 and controls the number of READ commands and determines that it is not large , Step 703 is skipped.
  • step 704 the processor core 130 reads the threshold value “E” corresponding to “memory usage rate” in the migration source load threshold information 143 of the memory 140, reads the threshold value “F” corresponding to “disk usage rate”, and The values are compared with the values of the memory usage rate and the disk usage rate obtained in step 701. As a result of this comparison, the memory usage rate acquired in step 701 is greater than the threshold value of “E” or the disk usage rate acquired in step 701 is greater than the threshold value of “F” or both. If it is determined, the processor core 130 proceeds to step 708 to control the amount of READ data, and if it is determined that neither is large, step 708 is skipped.
  • step 706 the processor core 130 reads a value corresponding to the “control flag” of the state information 146 stored in the memory 140, and determines whether the read value is “1”. If it is determined that the read value is not 1, the processor core 130 skips Steps 707 to 710 and returns after Step 505 shown in FIG.
  • step 707 to step 710 when the value corresponding to the “control flag” is 1, the load is once increased and the bandwidth is controlled by steps 702 to 705, and when the load is reduced thereafter, the control amount of the bandwidth is set. This is a recalculation process.
  • steps 707 to 710 are not executed, and bandwidth control is not executed at the first low load.
  • step 706 If it is determined that the value read in step 706 is 1, the processor core 130 proceeds to step 707, reads the threshold value “d” corresponding to “processor utilization” in the migration source load threshold information 143 of the memory 140, The processor usage rate value obtained in step 701 is compared. As a result of this comparison, when it is determined that the processor usage rate acquired in step 701 is equal to or less than the threshold value “d”, the processor core 130 proceeds to step 708 and controls the number of READ commands and determines that it is not less than , Step 708 is skipped.
  • step 709 the processor core 130 reads the threshold value “e” corresponding to “memory usage rate” in the migration source load threshold information 143 of the memory 140, reads the threshold value “f” corresponding to “disk usage rate”, and The values are compared with the values of the memory usage rate and the disk usage rate obtained in step 701. As a result of the comparison, if it is determined that the memory usage rate acquired in step 701 is equal to or less than the threshold value “e” and the disk usage rate acquired in step 701 is equal to or less than the threshold value “f”, the processor core 130 determines in step 710. If the read data amount is controlled and it is determined that any of them is not the following, step 710 is skipped and the process returns after step 505 shown in FIG.
  • FIG. 8 is a diagram showing an example of a processing flow for controlling the number of READ commands. This processing flow is included in the traffic control program 147 and is executed by the processor core 130, and corresponds to step 603 shown in FIG. 6 and step 703 and step 708 shown in FIG. In step 801, the processor core 130 writes 1 as a value corresponding to the “control flag” of the state information 146 stored in the memory 140.
  • step 802 the processor core 130 calculates a controllable time. For this purpose, first, the time information corresponding to the “migration completion time” of the setting information 145 stored in the memory 140 is read, the current time is read from a clock not shown, and the “migration” is read from the read current time. The non-control-target time that is the total time other than the control-target period included in the period up to the time corresponding to “completion time” is calculated from the control-target period information 141.
  • the non-control-target time is the start date 402 corresponding to “plan 1” of the item 401 from the current time.
  • the start date 402 corresponds to “plan 2” of item 401 from “ye1 / me1 / de1 he1: me1” of end time 403 corresponding to “plan 1” of item 401 and the time until “ys1 / ms1 / ds1 hs1: ms1”
  • the controllable time is calculated as “Tb” by subtracting the current time from the time corresponding to the “transition completion time” and further subtracting the non-control-target time from the subtracted time.
  • the processor core 130 calculates the amount of data to be transferred in a controllable time from the current time to the time to complete the transfer. Since the non-control target time period calculated in step 802 is transferred at the speed “Xa” corresponding to the “normal transfer speed” in the setting information 145, the non-control target time is multiplied by the speed “Xa”. The amount of transition data for the non-control target time is calculated.
  • the processor core 130 calculates the remaining transfer capacity by subtracting the value “Cf” corresponding to the “transferred capacity” in the status information 146 from the value “C” corresponding to the “transfer capacity” in the setting information 145, By subtracting the amount of transition data of the non-control-target time from the transition remaining capacity, the amount of data that shifts to the time when control is possible is calculated as “Ca”.
  • step 804 the processor core 130 calculates the transfer rate of the transition of the controllable time from the current time to the time when the transition is completed.
  • the data amount of “Ca” calculated in step 803 is divided by the time “Tb” calculated in step 802, and further multiplied by a safety coefficient, thereby calculating the transfer rate as “Xb”.
  • the safety coefficient is a coefficient for completing the transition by the time corresponding to the “transition completion time” of the setting information 145, and is, for example, a preset value 1.2.
  • step 805 in order to calculate the delay rate of the READ command for “Xa”, the processor core 130 subtracts the speed of “Xb” from the speed of “Xa”, divides it by “Xa”, and sets the delay rate to “Y”.
  • step 806 the processor core 130 multiplies the value of “P” corresponding to the “busy response” of the maximum delay time information 144 by the value of “Y”, calculates the delay time as “Tci”, and calculates the calculated “Tci”. Is set to “Tci” for “delay time (for command)” in the status information 146.
  • FIG. 9 is a diagram showing an example of a processing flow for controlling the READ data amount. This processing flow is included in the traffic control program 147 and is executed by the processor core 130, and corresponds to step 605 shown in FIG. 6 and steps 705 and 710 shown in FIG. Steps 901 to 905 are the same processing as steps 801 to 805 described with reference to FIG. Note that step 801 to step 805 and step 901 to step 905 may be shared.
  • step 906 the processor core 130 multiplies the value of “Q” corresponding to the “buffer empty response” of the maximum delay time information 144 by the value of “Y”, calculates the delay time as “Tcd”, and calculates the calculated “ The value of “Tcd” is set to “Tcd” for “delay time (for data)” in the status information 146.
  • the band shaper 110 transmits a busy response and a buffer empty response based on the set “Tci” and “Tcd”.
  • step 703 the bandwidth is controlled based on the time to complete the transition as described above. If the value is “1”, step 703 is performed. In step 705, the number of READ commands is controlled so that the processor usage rate does not exceed the “D” threshold. In step 705, the memory usage rate does not exceed the “E” threshold value, and the disk usage rate exceeds the “F” threshold value. The amount of READ data may be controlled so as not to exist.
  • the transfer bandwidth for the migration can be controlled with a simple configuration. Further, communication that causes each load can be controlled in accordance with the loads on the processor 182, the memory 183, and the disk 184 of the migration source storage apparatus 180. Furthermore, it becomes possible to control the transfer band according to the completion time of the migration.
  • FIG. 10 is a diagram illustrating an example of a system in which a plurality of migration source storage apparatuses 180 are connected.
  • the two migration source storage apparatuses 180 are a migration source storage apparatus A 180a and a migration source storage apparatus B 180b, respectively. Only parts different from the processing flow described with reference to FIGS. 5 to 9 will be described.
  • the bandwidth shaper 110 has a limit on the maximum bandwidth that can be used for migration of both the migration source storage device A 180a and the migration source storage device B 180b, and the maximum bandwidth amount is Z in total.
  • the maximum bandwidth amount Z of the bandwidth shaper 110 is allocated according to the migration capacity ratio of the migration source storage device A 180a and the migration source storage device B 180b. That is, the maximum bandwidth amount P (A) allocated to the migration source storage apparatus A 180a is a value obtained by dividing C (A) by the value obtained by adding C (A) and C (B) and multiplying by Z.
  • the maximum bandwidth P (B) allocated to the original storage apparatus B 180b is a value obtained by dividing C (B) by the value obtained by adding C (A) and C (B) and multiplying by Z.
  • Xa (A) of the non-control target time higher than P (A) becomes P (A). It is limited, and Xb (A) of the control target time lower than P (A) remains as it is.
  • the migration source storage apparatus B 180b cannot migrate at a transfer rate exceeding P (B), in the example of FIG. 10, Xa (B) and non-control target time higher than P (B) Both time Xb (B) are limited to P (B).
  • transfer speed limits are also controlled as described above by calculating the delay rate “Y”.
  • three or more migration source storage apparatuses 180 may be connected, and the maximum bandwidth amount Z of the band shaper 110 may be allocated according to the migration capacity ratio of each of the migration source storage apparatuses 180.
  • a transfer bandwidth for migration can be allocated according to the data amount of migration of each migration source storage apparatus 180.
  • Band shaper 180 Migration source storage device 190: Migration destination storage device 209: Busy response 309, 313, 317: Buffer empty response

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

La présente invention a trait à un système de mémorisation comportant un conformateur de bande connecté à une pluralité de dispositifs de mémorisation, et ce conformateur de bande reçoit des données en provenance d'un premier dispositif de mémorisation de la pluralité de dispositifs de mémorisation, transmet les données reçues à un second dispositif de mémorisation de la pluralité de dispositifs de mémorisation, obtient des informations de charge concernant le premier dispositif de mémorisation, et, en réponse aux informations de charge obtenues, ne transmet au dispositif de mémorisation aucune information indiquant que des données vont être reçues.
PCT/JP2015/074511 2015-08-28 2015-08-28 Système de mémorisation et son procédé de commande WO2017037800A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2015/074511 WO2017037800A1 (fr) 2015-08-28 2015-08-28 Système de mémorisation et son procédé de commande

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2015/074511 WO2017037800A1 (fr) 2015-08-28 2015-08-28 Système de mémorisation et son procédé de commande

Publications (1)

Publication Number Publication Date
WO2017037800A1 true WO2017037800A1 (fr) 2017-03-09

Family

ID=58187060

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2015/074511 WO2017037800A1 (fr) 2015-08-28 2015-08-28 Système de mémorisation et son procédé de commande

Country Status (1)

Country Link
WO (1) WO2017037800A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09314929A (ja) * 1996-05-31 1997-12-09 Canon Inc 印刷装置、印刷方法、印刷システム、情報処理装置および記憶媒体
JP2001236250A (ja) * 2000-02-23 2001-08-31 Ntt Comware Corp データ移行装置及びデータ移行方法
JP2011091465A (ja) * 2009-10-20 2011-05-06 Hitachi Ltd アクセスログ管理方法
WO2012059971A1 (fr) * 2010-11-01 2012-05-10 株式会社日立製作所 Système de traitement d'informations et procédé de transfert de données d'un système de traitement d'informations
WO2015087442A1 (fr) * 2013-12-13 2015-06-18 株式会社日立製作所 Format de transfert pour un système de stockage, et procédé de transfert

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09314929A (ja) * 1996-05-31 1997-12-09 Canon Inc 印刷装置、印刷方法、印刷システム、情報処理装置および記憶媒体
JP2001236250A (ja) * 2000-02-23 2001-08-31 Ntt Comware Corp データ移行装置及びデータ移行方法
JP2011091465A (ja) * 2009-10-20 2011-05-06 Hitachi Ltd アクセスログ管理方法
WO2012059971A1 (fr) * 2010-11-01 2012-05-10 株式会社日立製作所 Système de traitement d'informations et procédé de transfert de données d'un système de traitement d'informations
WO2015087442A1 (fr) * 2013-12-13 2015-06-18 株式会社日立製作所 Format de transfert pour un système de stockage, et procédé de transfert

Similar Documents

Publication Publication Date Title
US7685342B2 (en) Storage control apparatus and method for controlling number of commands executed in storage control apparatus
US8775549B1 (en) Methods, systems, and computer program products for automatically adjusting a data replication rate based on a specified quality of service (QoS) level
CN102334092B (zh) 存储系统及其控制方法
JP2018173949A5 (fr)
US10061532B2 (en) Migrating data between memories
US10678437B2 (en) Method and device for managing input/output (I/O) of storage device
JP2008271017A (ja) ファブリックスイッチ、バッファ容量制御方法、およびバッファ容量制御プログラム
JP5909566B2 (ja) 計算機システム及びその制御方法
EP3462299B1 (fr) Réplication bidirectionnelle
US10552330B2 (en) Wait classified cache writes in a data storage system
US11079935B2 (en) Processing a space release command to free release space in a consistency group
US9514072B1 (en) Management of allocation for alias devices
US20120185749A1 (en) Storage apparatus and response time control method
US10956205B2 (en) Data processing
JP2006059260A (ja) 情報処理システム、管理計算機及びリモートコピー方法
WO2017037800A1 (fr) Système de mémorisation et son procédé de commande
JP2011509443A5 (fr)
JP2023015488A (ja) データ中継装置、中継制御方法およびストレージシステム
US11487633B2 (en) Communication processing apparatus, communication processing method, and non-transitory computer-readable recording medium
US11144242B2 (en) Distributed storage system
TW202303378A (zh) 多個固態硬碟（ｓｓｄ）提交佇列間的公平共享
KR102181210B1 (ko) 저장 장치의 데이터 처리 방법 및 저장 장치
US10620880B2 (en) Using a delay timer to delay code load operations to process queued write requests
US20130110780A1 (en) Relay apparatus and data copy method
US11880589B2 (en) Storage system and control method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15902923

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15902923

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP