US20010001325A1 - Disk array controller with connection path formed on connection request queue basis - Google Patents
Disk array controller with connection path formed on connection request queue basis Download PDFInfo
- Publication number
- US20010001325A1 US20010001325A1 US09/756,798 US75679801A US2001001325A1 US 20010001325 A1 US20010001325 A1 US 20010001325A1 US 75679801 A US75679801 A US 75679801A US 2001001325 A1 US2001001325 A1 US 2001001325A1
- Authority
- US
- United States
- Prior art keywords
- port
- connection request
- cache memory
- unit
- memory unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
- G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G06F12/0866—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches for peripheral storage systems, e.g. disk cache
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
- G06F3/0611—Improving I/O performance in relation to response time
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
- G06F3/0613—Improving I/O performance in relation to throughput
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
- G06F3/0656—Data buffering arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
- G06F3/0659—Command handling arrangements, e.g. command buffers, queues, command scheduling
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0683—Plurality of storage devices
- G06F3/0689—Disk arrays, e.g. RAID, JBOD
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
Definitions
- the present invention relates to a controller for controlling a disk array which divides data and stores the data in a plurality of disk drives.
- an I/O performance of a sub-system using a magnetic disk as a secondary storage has a processing ability inferior by about three to four digits. Reducing this difference, i.e., improving the I/O performance of the sub-system has been tried in various ways.
- a sub-system which is constituted of a plurality of disk drives and data is divisionally stored in the disk drives, i.e., a so-called disk array system is known.
- a disk array system is constituted of: a plurality of channel I/F units 111 for executing data transfer between a host computer 101 and a disk array controller 2 ; a plurality of disk I/F units 112 for executing data transfer between disk drives 120 and the disk array controller 2 ; cache memory units 115 for temporarily storing data of the disk drives 120 ; and shared memory units 114 for storing control information on the data in the disk drives 120 and on the disk array controller 2 , wherein the cache memory units 115 and shared memory units 114 can be accessed from all of channel I/F units 111 and disk I/F units 112 .
- the channel I/F units 111 and disk units I/F units 112 are connected to the shared memory units 114 in one-to-one correspondence, and the channel I/F units 111 and disk units I/F units 112 are also connected to the cache memory units 114 in one-to-one correspondence.
- a disk array system is constituted of: a plurality of channel I/F units 111 for executing data transfer between a host computer 101 and a disk array controller 3 ; a plurality of disk I/F units 112 for executing data transfer between disk drives 120 and the disk array controller 3 ; cache memory units 115 for temporarily storing data of the disk drives 120 ; and shared memory units 114 for storing control information on the data in the disk drives 120 and on the disk array controller 3 .
- the channel I/F units 111 and disk I/F units 112 are connected to the shared memory units 114 via a shared bus 130 , and to the cache memory units 115 via a shared bus 131 .
- a disk array controller which comprises: one or more interface units to a host computer; one or more interface units to a plurality of disk drives; and one or more physically independent shared memory units for storing control information on data in the disk drives and on the disk array controller, wherein the interface units to the host computer and the interface units to the disk drives can access the shared memory units via a selector, and access paths are connected between the selector and the interface units to the host computer and to the disk drives and between the selector and the shared memory units, and wherein the selector unit includes:
- an arbitor unit for arbitrating a plurality of connection requests and assigning an output port to a connection request from an input port.
- the arbitor unit assigns, if a top connection request among the connection requests stored in the arrival order is a connection request to a vacant output port, the output port to the connection request; checks a second connection request, if the top connection request among the connection requests stored in the arrival order is a connection request to an occupied output port, and assigns, if the second connection request is a connection request to a vacant output port, the output port to the second connection request; checks a third connection request, if the second connection request is a connection request to an occupied output port, and thereafter repeats an arbitration (assignment) of an output port to a connection request at the most by several times equal to the number of vacant output ports.
- the shared memory unit includes physically independent and duplicated first and second shared memory units, and the selector accesses both of the first and second shared memory units at the same time.
- the shared memory unit includes a cache memory unit and a shared memory unit both physically divided, the cache memory unit temporarily storing data of the disk drives, and the shared memory unit storing control information on the cache memory unit and the disk array controller;
- the selector unit includes first and second selectors both physically independent, the first selector connecting the cache memory unit, and the second selector connecting the shared memory unit;
- the disk array controller includes physically independent access paths between the interface units to the host computer and to the disk drives and the cache memory unit or the shared memory unit;
- At least the first selector includes the arbitor unit.
- the shared memory unit includes physically independent and duplicated shared memory units, the shared memory unit includes physically independent and duplicated shared memory units, and at least the selector accesses both the duplicated shared memory units at the same time and is provided with the arbitor unit.
- the selector unit disposed between the interface units to the host computer and to the disk drives and the shared memory units can efficiently distribute access requests from the interface units to the shared memory unit. It is therefore possible to improve throughput of data transfer of the disk array controller.
- FIG. 1 is a block diagram showing the structure of a disk array controller of this invention.
- FIG. 2 is a block diagram showing the structure of a conventional disk array controller.
- FIG. 3 is a block diagram showing the structure of another conventional disk array controller.
- FIG. 4 is a block diagram showing the structure of a selector unit of the disk array controller of the invention.
- FIG. 5 is a flow chart illustrating the operation to be executed by the selector unit.
- FIG. 6 is a flow chart illustrating the operation to be executed by an arbitor of the selector unit.
- FIG. 7 is a sequence diagram illustrating data write into a shared memory unit or a cache memory unit.
- FIG. 8 is a sequence diagram illustrating data read from a shared memory unit or a cache memory unit.
- FIG. 9 is a block diagram showing the structure of another disk array controller of the invention.
- FIG. 10 is a block diagram showing the structure of another disk array controller of the invention.
- FIG. 11 is a block diagram showing the structure of another disk array controller of the invention.
- FIG. 12 is a diagram showing the details of the selector unit of the disk array controller of the invention.
- FIG. 13 is a block diagram showing the structure of a channel I/F unit.
- FIG. 14 is a block diagram showing the structure of the channel I/F units shown in FIGS. 10 and 11 of the disk array controller of the invention.
- FIGS. 15A and 15B are diagrams illustrating the operation at Step 403 when a request for a vacant output port is issued.
- FIGS. 16A and 16B are diagrams illustrating the operation at Step 403 when a request for an occupied output port is issued.
- FIG. 17 is a diagram illustrating the operation at Step 405 .
- FIG. 1 shows a first embodiment of the invention.
- a disk array controller 1 is constituted of channel I/F units 111 , disk I/F units 112 , selector units 113 , shared memory units 114 , and access paths 135 and 136 .
- An access path is constituted of data lines and control lines. Control signals such as a connection request (REQ) and acknowledgement (ACK) are transferred over the control lines.
- REQ connection request
- ACK acknowledgement
- the channel I/F unit 111 is constituted of one I/F (host I/F) 51 to the host computer, one micro processor 50 , and one shared memory access controller (SM access controller) 52 including one access path I/F 54 to the shared memory units 114 .
- I/F host I/F
- SM access controller shared memory access controller
- the host I/F 51 divides data supplied from the host computer 101 into packets and sends them to the SM access controller 52 .
- the SM access controller sends a plurality of packets supplied from the host I/F 51 to the shared memory unit 114 via the selector unit 113 by using one access path.
- the SM access controller 52 For the data read, the SM access controller 52 sends a plurality of packets supplied from the shared memory unit 114 to the host I/F 51 .
- the host I/F 51 generates one set of data from a plurality of packets supplied from the SM access controller 52 and sends it to the host computer 101 .
- the micro processor 50 controls data transmission/reception at the host I/F 51 and SM access controller 52 .
- the disk I/F unit 112 is basically the same as the channel I/F unit 111 shown in FIG. 13, and is constituted of one I/F (drive I/F) to a plurality of disk drives 120 , one micro processor, and one shared memory access controller (SM access controller) including one access path I/F to the shared memory units 114 .
- the host I/F 51 shown in FIG. 13 is replaced by the drive I/F.
- a process at least similar to the process described for the channel I/F unit 111 is executed.
- the shared memory unit 114 stores data to be written in the disk drive 120 and management information such as management information of the data and system information.
- the selector unit 113 is connected to four access paths 135 to two channel I/F units 111 and two disk I/F units 112 .
- the selector unit 113 is also connected to two access paths to the two shared memory units 114 .
- One selector unit 113 and the two channel I/F units 111 and two disk I/F units 112 connected to the selector unit 113 constitute one group which is called a selector group.
- the disk array controller 1 has two selector groups 150 .
- the number above mentioned is only illustrative and is not limited thereto.
- the selector unit 113 selects only two requests corresponding to the number of access paths 136 to the shared memory units 114 , from the requests issued from the channel and disk I/F units 111 and 112 via the four access paths 135 , and processes the selected two requests.
- the number of access paths connected between one selector unit 113 and the shared memory units 114 is set smaller than the number of access paths connected between the channel and disk I/F units 111 and 112 and the selector unit 113 , and the number of selector units 113 is set smaller than the total number of channel and disk I/F units 111 and 112 , as described above. It is therefore possible to reduce the number of access paths connected to the shared memory units 114 .
- one access path is constituted of several tens signal lines so that if signal lines are directly connected between the I/F units and shared memory units, the number of signal lines becomes enormously. Therefore, such connection is impossible by using one LSI package. This is called a LSI pin connection neck.
- the invention can solve such problems.
- FIG. 4 shows the internal structure of the selector unit 113 .
- the selector unit 113 has: an I/F port unit 210 to the channel I/F units 111 and disk I/F units 112 ; an I/F port unit 211 to the shared memory units 114 ; a selector 206 for the connection between the I/F port units 210 and 211 ; error check units 201 for checking input/output data at the I/F port units 210 and 211 ; buffers 202 for buffering addresses, commands and data supplied from the channel and disk I/F units 111 and 112 ; an address/command (ADR/CMD) decoder 203 for decoding addresses and commands supplied from the channel and disk I/F units 111 and 112 ; a queue management unit 204 for managing decoded results in an arrival order, as connection requests to the I/F port unit 211 ; and an arbitor unit 205 for executing arbitration in accordance with the connection requests registered in the queue management unit 204 and determining a connection privilege to the I/F port unit 211 .
- ADR/CMD address
- the LSI pin neck and package connector neck of the shared memory unit can be solved, as described above, by setting the number of ports of the I/F port unit 210 smaller than the number of ports of the I/F port unit 211 .
- the number of ports of the I/F port unit 210 is set to “4” and the number of ports of the I/F port unit 211 is set to “2”.
- FIG. 12 shows the detailed structures of the address/command (ADR/CMD) decoder 203 , queue management unit 204 and arbitor unit 205 .
- the address/command (ADR/CMD) decoder 203 has four buffers 220 corresponding in number to the number of ports of the I/F port unit 210 to the channel and disk I/F units 111 and 112 , and stores commands (CMD) and addresses (ADR) supplied from I/F ports 210 - 1 to 210 - 4 .
- Each address has a length of four bytes, and the first one byte indicates an output port number (port No.).
- Each command has a length of four bytes, and the first one byte indicates an access type (read: RD, write: WR, duplicate read: 2 R, duplicate write: 2 W). If the shared memory unit 114 is duplicated, duplicate read and duplicate write are executed in some cases. Such duplicate access uses two ports at the same time. It is therefore necessary to acquire use privilege of two ports.
- a port number decoder 221 derives a requested port number from an address. In this embodiment, a port 0 is assigned “ 00 ” and a port 1 is assigned “ 11 ”.
- a command decoder 222 derives an access type from a command. In this embodiment, RD is assigned “ 00 ”, WR is assigned “ 01 ”, 2 R is assigned “ 10 ”, and 2 W is assigned “ 11 ”.
- a required port decision unit 223 outputs the port number itself if the access type is not a duplicate access, and outputs “ 01 ” if it is a duplicate access.
- a queue management unit 204 registers the port numbers output from the address/command (ADR/CMD) decoder 203 in the arrival order in a management table 224 , this operation being called queuing.
- the arbitor unit 205 picks up one port number from the top of the management table 224 and stores it in a buffer 227 .
- a comparison unit 228 compares an occupied port number in a buffer 226 with the required port number in the buffer 227 .
- the required port number is output to a selector 206 as selector switch signals SEL 0 and SEL 1 , and an order control unit 225 of the queue management unit 204 is instructed to advance (shifts) the queue order by “1”. If the port numbers are equal, the order control unit 225 is instructed to exchange the queue order.
- An arbitration method, an order exchange method, and a queue order shift method will be described later at the arbitration flow shown in FIG. 6 by using specific examples.
- the lengths of an address and a command, the locations of the port number and command type in an address and command, assignment of bits to the port number and command type, described above, are only illustrative and are not limited thereto. If the shared memory unit 114 is not duplicated, a duplicate access does not occur so that the command decoder 222 and required port decision unit 223 are not necessary. In this case, an output of the port number decoder 221 is directly input to the queue management unit 204 .
- FIG. 5 is a flow chart illustrating the operation to be executed by the selector unit 113 when an access is requested to one port of the I/F port unit 210 from the channel and disk I/F units 111 and 112 .
- Step 301 the process waits for an access request (REQ ON) to be issued from the SM access controller in the channel I/F unit 111 or disk I/F unit 112 .
- an address (ADR) and a command (CMD) are decoded at Step 302 .
- Step 303 it is checked whether there is any error in the address (ADR) and command (CMD). If there is an error, an error process is executed at Step 315 to thereafter return to Step 301 and enter the access request stand-by state.
- the decoded results are queued at Step 304 as a connection request to the I/F port ( 211 - 1 , 211 - 2 ) to the shared memory units 114 .
- Step 305 the process stands by until the requested port of the I/F port unit 211 to the shared memory unit 114 is acquired.
- the selector unit 206 is switched at Step 306 to connect one requested port of the I/F port unit 210 to the acquired one port of the I/F port unit 211 .
- Step 307 an access request (REQ ON) is issued to the shared memory (SM) unit 114 and an address (ADR) and a command (CMD) are transferred.
- REQ ON access request
- ADR address
- CMD command
- Step 308 the process stands by until an access acknowledgement (ACK ON) is returned from the shared memory unit 114 .
- ACK ON access acknowledgement
- the access acknowledgement (ACK ON) is received, at Step 309 the access acknowledgement (ACK ON) is returned to the SM access controller of the channel I/F unit 111 or disk I/F unit 112 .
- Step 310 in the case of data write, data supplied from the SM access controller is transmitted to the shared memory unit 114 .
- Step 315 If an error is found, an error process is executed at Step 315 to thereafter return to Step 301 and enter the access request stand-by state.
- Step 312 If there is no error, it is checked at Step 312 whether a STATUS indicating the contents of data processing is received, and data is transmitted until the STATUS is received.
- Step 313 the shared memory unit is instructed to withdraw the access acknowledgement (ACK OFF) to thereafter return to Step 301 and enter the access request stand-by state.
- ACK OFF access acknowledgement
- FIG. 6 is a flow chart illustrating an arbitration operation.
- Step 401 it is checked whether there is a vacant port, and if not, the process stands by until a vacant port appears.
- the top connection request among the connection requests stored in an arrival order in the management table 224 of the queue management unit 402 is checked at Step 402 . More specifically, as shown in FIG. 15A, the port number # 0 of “ 00 ” in the management table 224 is output to the buffer 227 .
- the comparison unit 228 compares the port number “ 00 ” with the occupied port number “ 11 ” registered in the buffer 226 .
- the output port is assigned to the request at Step 404 . Namely, as shown in the example of FIG. 15A, if the required port number “ 00 ” is not the occupied port number “ 11 ”, the switch signal SEL 0 is output to connect the IF port 210 - 3 to the IF port 211 - 1 (port number “ 00 ”). The path formation of this example in the selector unit 206 is shown in FIG. 15B.
- Step 403 If it is judged at Step 403 that the top connection request among the connection requests stored in the arrival order in the management table 224 of the queue management unit 204 is a request for an occupied output port, the top queue request is shifted to the (number of vacant ports+1)-th order at Step 406 and thereafter the flow returns to Step 401 . More specifically, as shown in an example of FIG. 16A, if the required port number “ 00 ” is the occupied port number “ 00 ”, then as shown in FIG.
- Step 403 If it is judged at Step 403 that the requested port is a vacant port and an output port is assigned at Step 404 , the queue order is advanced by “1” to thereafter return to Step 401 . Namely, as shown in FIG. 17, the port number # 0 of “ 00 ” in the management table 224 is discarded, the port number # 1 of “ 11 ” is shifted to the port number # 0 , the port number # 2 of “ 01 ” is shifted to the port number # 1 , the port number # 3 of “ 11 ” is shifted to the port number # 2 , and a new required port number “ 11 ” is registered in the port number # 3 .
- the shared memory unit 114 may be duplicated by using physically independent shared memory units 114 - 1 and 114 - 2 to form a duplicated area 160 . More specifically, the same data is written in each of the duplicate shared memory units 114 - 1 and 114 - 2 .
- the shared memory unit may be duplicated wholly or partially.
- Steps 402 and 403 shown in FIG. 6 it is checked at Steps 402 and 403 shown in FIG. 6 whether an access is a duplicate access. In the case of a duplicate access, if required two ports are vacant, these ports are assigned, whereas if not, the control advances to Step 406 .
- the structure of the disk array controller shown in FIG. 1 is changed to that shown in FIG. 10. Namely, the shared memory unit 114 shown in FIG. 1 is physically divided into cache memory units 115 for temporarily storing data to be written in the disk drives 120 and shared memory units 116 for storing control information on the cache memory units 115 and a disk array controller 5 , and a selector unit (CM selector unit) 123 connected to the cache memory units 115 and a selector unit (SM selector unit) 124 connected to the shared memory units are made physically independent.
- the structures of the selector units 123 and 124 are the same as the selector unit 113 .
- Access paths 135 and 136 between the channel I/F units 111 and disk I/F units 112 and the cache memory units 115 and shared memory units 114 are made physically independent, and at least the CM selector units 123 connected to the cache memory units 115 execute arbitration in the same manner as the process flow shown in FIG. 5.
- the reason why the SM selector units 124 do not execute arbitration is as follows.
- the control information on the cache memory units 115 and disk array controller 5 is stored in the shared memory units and has a small data amount. Therefore, it takes only a short time to use ports and these ports soon becomes vacant. As a result, even if arbitration is not executed, there is no practical problem.
- a shared memory unit 116 and a cache memory unit 115 may be duplicated by using physically independent shared memory units 116 - 1 and 116 - 2 and cache memory units 115 - 1 and 115 - 2 to form duplicated areas 160 .
- accesses a duplicate access
- it is checked at Steps 402 and 403 shown in FIG. 6 whether an access is a duplicate access. In the case of a duplicate access, if required two ports are vacant, these ports are assigned, whereas if not, the control advances to Step 406 . These operations are performed by the CM selector units 123 connected to the cache memory units.
- FIGS. 7 and 8 are flow charts illustrating the details of the process flow shown in FIG. 5, and showing the data flow when the disk array controllers having the structures shown in FIGS. 1, 9, 10 and 11 operate.
- the SM or CM access controller 52 or 53 issues an access request (REQ) to the selector unit 113 , 123 or 124 , and then at Steps 502 and 503 an address (ADR) and a command (CMD) are transferred.
- REQ access request
- ADR address
- CMD command
- the selector unit 113 , 123 or 124 is simply called a selector unit.
- the selector unit executes arbitration, and the selector 206 is switched to assign a port to the shared memory unit 114 , 116 or cache memory unit 115 .
- the selector unit issues an access request (REQ) to the shared memory unit or cache memory unit, and then at Steps 507 and 508 an address (ADR) and a command (CMD) are transferred.
- REQ access request
- ADR address
- CMD command
- a memory module to be accessed is selected in the shared memory unit 114 , 116 or cache memory unit 115 , and thereafter at Step 510 an access acknowledgement (ACK ON) is returned via the selector unit to the SM or CM access controller 52 , 53 .
- ACK ON access acknowledgement
- the SM or CM access controller 52 , 53 Upon reception of ACK ON, the SM or CM access controller 52 , 53 sends data at Step 511 .
- the shared memory unit 114 , 116 or cache memory unit 115 executes a post-process at Step 512 , and returns at Step 513 a STATUS to the SM or CM access controller 52 , 53 via the selector unit.
- the selector unit Upon reception of the status, at Step 514 the selector unit instructs the shared memory unit 114 , 116 or cache memory unit 115 to withdraw the access acknowledgement (ACK OFF).
- Step 515 the SM or CM access controller 52 , 53 instructs the selector unit to withdraw the access acknowledgement (ACK OFF).
- the data read process at Steps 601 to 610 is the same as the data write process at Steps 501 to 510 as shown in FIG. 8.
- a data read pre-process is executed by the shared memory unit 114 , 116 or cache memory unit 115 at Step 611 .
- Step 612 data is transferred to the SM or CM access controller 52 , 53 via the selector unit.
- Step 613 a STATUS is returned to the SM or CM access controller 52 , 53 via the selector unit.
- the selector unit Upon reception of the STATUS, at Step 615 the selector unit instructs the shared memory unit 114 , 116 or cache memory unit 115 to withdraw the access acknowledgement (ACK OFF).
- Step 616 the SM or CM access controller 52 , 53 instructs the selector unit to withdraw the access acknowledgement (ACK OFF).
- the channel I/F unit 111 or disk I/F unit 112 accesses the shared memory unit 114 , 116 or cache memory unit 115 , an address and a command are sequentially transferred and after an access path to the shared memory unit 114 , 116 or cache memory unit 115 is established (step 510 or 610 ), data it transferred. It is therefore unnecessary for the selector unit to buffer transfer data. Therefore, the buffer 202 is not required, the control at the selector unit can be simplified, and throughput of accesses to the memory can be improved.
- disk drives are connected, the invention is not limited only to disk drives but other drives for various types of disk media may also be used.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Memory System Of A Hierarchy Structure (AREA)
Abstract
Description
- 1. The present application relates to subject matter described in application Ser. No. ______ filed on ______ entitled “MULTI-PROCESSOR TYPE STORAGE CONTROL APPARATUS FOR PERFORMING ACCESS CONTROL THROUGH SELECTOR”, by Kenji YAMAGAMI, Kazuhisa FUJIMOTO, Yasuo KUROSU and Hisao HONMA, and assigned to the assignee of the present application.
- 2. The present invention relates to a controller for controlling a disk array which divides data and stores the data in a plurality of disk drives.
- 3. As compared to an I/O performance of a main storage of a computer, an I/O performance of a sub-system using a magnetic disk as a secondary storage has a processing ability inferior by about three to four digits. Reducing this difference, i.e., improving the I/O performance of the sub-system has been tried in various ways.
- 4. As one method of improving the I/O performance of a sub-system, a sub-system has been proposed which is constituted of a plurality of disk drives and data is divisionally stored in the disk drives, i.e., a so-called disk array system is known.
- 5. For example, according to one conventional technique (hereinafter called a first conventional technique), as shown in FIG. 2, a disk array system is constituted of: a plurality of channel I/
F units 111 for executing data transfer between ahost computer 101 and adisk array controller 2; a plurality of disk I/F units 112 for executing data transfer betweendisk drives 120 and thedisk array controller 2;cache memory units 115 for temporarily storing data of thedisk drives 120; and sharedmemory units 114 for storing control information on the data in thedisk drives 120 and on thedisk array controller 2, wherein thecache memory units 115 and sharedmemory units 114 can be accessed from all of channel I/F units 111 and disk I/F units 112. - 6. According to the first conventional technique, the channel I/
F units 111 and disk units I/F units 112 are connected to the sharedmemory units 114 in one-to-one correspondence, and the channel I/F units 111 and disk units I/F units 112 are also connected to thecache memory units 114 in one-to-one correspondence. - 7. According to another conventional technique (hereinafter called a second conventional technique), as shown in FIG. 3, a disk array system is constituted of: a plurality of channel I/
F units 111 for executing data transfer between ahost computer 101 and adisk array controller 3; a plurality of disk I/F units 112 for executing data transfer betweendisk drives 120 and thedisk array controller 3;cache memory units 115 for temporarily storing data of thedisk drives 120; and sharedmemory units 114 for storing control information on the data in thedisk drives 120 and on thedisk array controller 3. - 8. The channel I/
F units 111 and disk I/F units 112 are connected to the sharedmemory units 114 via a shared bus 130, and to thecache memory units 115 via a shared bus 131. - 9. Request for high performance of a disk array system has been dealt with by using a large scale disk array controller and high speed components, e.g., by an increase in the number of processors and in the cache capacity, use of high performance processors, expansion of an internal bus width, improvement on a bus transfer ability and the like.
- 10. With the second conventional techniques, however, it is becoming difficult for the transfer ability of an internal bus to follow a large scale system and performance improvement.
- 11. In order to achieve a high memory access performance by improving the internal bus performance, it is conceivable that one-to-one correspondence between processors and memories similar to the first conventional technique is preferable.
- 12. With this method, the internal bus performance improves proportionally to the number of access paths connected to the memories.
- 13. However, the number of access paths connected to shared memories and cache memories increases in proportion to an increase in the number of processors used in the system.
- 14. In order to maximize the internal bus performance, it is necessary to efficiently control the accesses between each processor and each memory.
- 15. It is an object of the present invention to solve the above-described problem and provide a disk array controller capable of efficiently using access paths between processors and memories and having a high memory access throughput, particularly a high cache memory access throughput.
- 16. In order to achieve the above object of the invention, a disk array controller is provided which comprises: one or more interface units to a host computer; one or more interface units to a plurality of disk drives; and one or more physically independent shared memory units for storing control information on data in the disk drives and on the disk array controller, wherein the interface units to the host computer and the interface units to the disk drives can access the shared memory units via a selector, and access paths are connected between the selector and the interface units to the host computer and to the disk drives and between the selector and the shared memory units, and wherein the selector unit includes:
- 17. a unit for connecting a plurality of input ports (access paths) from the interface units to the host computer and to the disk drives to a plurality of output ports (access paths) to the shared memory units;
- 18. a unit for storing connection requests from input ports to output ports in an arrival order of the connection requests; and
- 19. an arbitor unit for arbitrating a plurality of connection requests and assigning an output port to a connection request from an input port.
- 20. The arbitor unit assigns, if a top connection request among the connection requests stored in the arrival order is a connection request to a vacant output port, the output port to the connection request; checks a second connection request, if the top connection request among the connection requests stored in the arrival order is a connection request to an occupied output port, and assigns, if the second connection request is a connection request to a vacant output port, the output port to the second connection request; checks a third connection request, if the second connection request is a connection request to an occupied output port, and thereafter repeats an arbitration (assignment) of an output port to a connection request at the most by several times equal to the number of vacant output ports.
- 21. In this invention, the shared memory unit includes physically independent and duplicated first and second shared memory units, and the selector accesses both of the first and second shared memory units at the same time.
- 22. Also in this invention, the shared memory unit includes a cache memory unit and a shared memory unit both physically divided, the cache memory unit temporarily storing data of the disk drives, and the shared memory unit storing control information on the cache memory unit and the disk array controller;
- 23. the selector unit includes first and second selectors both physically independent, the first selector connecting the cache memory unit, and the second selector connecting the shared memory unit;
- 24. the disk array controller includes physically independent access paths between the interface units to the host computer and to the disk drives and the cache memory unit or the shared memory unit; and
- 25. at least the first selector includes the arbitor unit.
- 26. Also in this invention, the shared memory unit includes physically independent and duplicated shared memory units, the shared memory unit includes physically independent and duplicated shared memory units, and at least the selector accesses both the duplicated shared memory units at the same time and is provided with the arbitor unit.
- 27. Also in this invention, when the interface units to the host computer or to the disk drives access the shared memory unit or cache memory unit, an address and a command are sequentially transferred, and then after an access path to the shared memory unit or cache memory unit is established, data is transferred.
- 28. According to the invention, the selector unit disposed between the interface units to the host computer and to the disk drives and the shared memory units can efficiently distribute access requests from the interface units to the shared memory unit. It is therefore possible to improve throughput of data transfer of the disk array controller.
- 29.FIG. 1 is a block diagram showing the structure of a disk array controller of this invention.
- 30.FIG. 2 is a block diagram showing the structure of a conventional disk array controller.
- 31.FIG. 3 is a block diagram showing the structure of another conventional disk array controller.
- 32.FIG. 4 is a block diagram showing the structure of a selector unit of the disk array controller of the invention.
- 33.FIG. 5 is a flow chart illustrating the operation to be executed by the selector unit.
- 34.FIG. 6 is a flow chart illustrating the operation to be executed by an arbitor of the selector unit.
- 35.FIG. 7 is a sequence diagram illustrating data write into a shared memory unit or a cache memory unit.
- 36.FIG. 8 is a sequence diagram illustrating data read from a shared memory unit or a cache memory unit.
- 37.FIG. 9 is a block diagram showing the structure of another disk array controller of the invention.
- 38.FIG. 10 is a block diagram showing the structure of another disk array controller of the invention.
- 39.FIG. 11 is a block diagram showing the structure of another disk array controller of the invention.
- 40.FIG. 12 is a diagram showing the details of the selector unit of the disk array controller of the invention.
- 41.FIG. 13 is a block diagram showing the structure of a channel I/F unit.
- 42.FIG. 14 is a block diagram showing the structure of the channel I/F units shown in FIGS. 10 and 11 of the disk array controller of the invention.
- 43.FIGS. 15A and 15B are diagrams illustrating the operation at
Step 403 when a request for a vacant output port is issued. - 44.FIGS. 16A and 16B are diagrams illustrating the operation at
Step 403 when a request for an occupied output port is issued. - 45.FIG. 17 is a diagram illustrating the operation at
Step 405. - 46. Embodiments of the invention will be described in detail hereinunder.
- 47.FIG. 1 shows a first embodiment of the invention.
- 48. A
disk array controller 1 is constituted of channel I/F units 111, disk I/F units 112,selector units 113, sharedmemory units 114, andaccess paths - 49. An access path is constituted of data lines and control lines. Control signals such as a connection request (REQ) and acknowledgement (ACK) are transferred over the control lines.
- 50. As shown in FIG. 13, the channel I/
F unit 111 is constituted of one I/F (host I/F) 51 to the host computer, onemicro processor 50, and one shared memory access controller (SM access controller) 52 including one access path I/F 54 to the sharedmemory units 114. - 51. For the data write, the host I/
F 51 divides data supplied from thehost computer 101 into packets and sends them to theSM access controller 52. The SM access controller sends a plurality of packets supplied from the host I/F 51 to the sharedmemory unit 114 via theselector unit 113 by using one access path. - 52. For the data read, the
SM access controller 52 sends a plurality of packets supplied from the sharedmemory unit 114 to the host I/F 51. The host I/F 51 generates one set of data from a plurality of packets supplied from theSM access controller 52 and sends it to thehost computer 101. - 53. The
micro processor 50 controls data transmission/reception at the host I/F 51 andSM access controller 52. - 54. The disk I/
F unit 112 is basically the same as the channel I/F unit 111 shown in FIG. 13, and is constituted of one I/F (drive I/F) to a plurality ofdisk drives 120, one micro processor, and one shared memory access controller (SM access controller) including one access path I/F to the sharedmemory units 114. In this structure, the host I/F 51 shown in FIG. 13 is replaced by the drive I/F. For the data read/write, a process at least similar to the process described for the channel I/F unit 111 is executed. - 55. The numbers of devices described above are only illustrative and are not limited thereto.
- 56. The shared
memory unit 114 stores data to be written in thedisk drive 120 and management information such as management information of the data and system information. - 57. The
selector unit 113 is connected to fouraccess paths 135 to two channel I/F units 111 and two disk I/F units 112. - 58. The
selector unit 113 is also connected to two access paths to the two sharedmemory units 114. - 59. One
selector unit 113 and the two channel I/F units 111 and two disk I/F units 112 connected to theselector unit 113 constitute one group which is called a selector group. - 60. In this embodiment, the
disk array controller 1 has twoselector groups 150. The number above mentioned is only illustrative and is not limited thereto. - 61. The number of access paths between the channel and disk I/F units and the selector unit and the number of access paths between the selector unit and the shared memory units have the relation described above. Therefore, the
selector unit 113 selects only two requests corresponding to the number ofaccess paths 136 to the sharedmemory units 114, from the requests issued from the channel and disk I/F units access paths 135, and processes the selected two requests. - 62. The number of access paths connected between one
selector unit 113 and the sharedmemory units 114 is set smaller than the number of access paths connected between the channel and disk I/F units selector unit 113, and the number ofselector units 113 is set smaller than the total number of channel and disk I/F units memory units 114. - 63. With this setting, the problems of an LSI pin neck and a package connector neck of the shared memory unit can be solved.
- 64. More specifically, one access path is constituted of several tens signal lines so that if signal lines are directly connected between the I/F units and shared memory units, the number of signal lines becomes enormously. Therefore, such connection is impossible by using one LSI package. This is called a LSI pin connection neck.
- 65. Similarly, the number of pins of an input/output connector between the shared memory units and the channel and disk I/F units becomes enormously. It is therefore very difficult to increase the number of pins of the connector to such an enormous number. This is called a LSI pin neck.
- 66. The invention can solve such problems.
- 67. Next, the internal structure of the
selector unit 113 will be described. - 68.FIG. 4 shows the internal structure of the
selector unit 113. - 69. The
selector unit 113 has: an I/F port unit 210 to the channel I/F units 111 and disk I/F units 112; an I/F port unit 211 to the sharedmemory units 114; aselector 206 for the connection between the I/F port units error check units 201 for checking input/output data at the I/F port units buffers 202 for buffering addresses, commands and data supplied from the channel and disk I/F units decoder 203 for decoding addresses and commands supplied from the channel and disk I/F units queue management unit 204 for managing decoded results in an arrival order, as connection requests to the I/F port unit 211; and anarbitor unit 205 for executing arbitration in accordance with the connection requests registered in thequeue management unit 204 and determining a connection privilege to the I/F port unit 211. - 70. The LSI pin neck and package connector neck of the shared memory unit can be solved, as described above, by setting the number of ports of the I/
F port unit 210 smaller than the number of ports of the I/F port unit 211. - 71. In this embodiment, the number of ports of the I/
F port unit 210 is set to “4” and the number of ports of the I/F port unit 211 is set to “2”. - 72.FIG. 12 shows the detailed structures of the address/command (ADR/CMD)
decoder 203,queue management unit 204 andarbitor unit 205. - 73. The address/command (ADR/CMD)
decoder 203 has fourbuffers 220 corresponding in number to the number of ports of the I/F port unit 210 to the channel and disk I/F units - 74. Each address has a length of four bytes, and the first one byte indicates an output port number (port No.). Each command has a length of four bytes, and the first one byte indicates an access type (read: RD, write: WR, duplicate read: 2R, duplicate write: 2W). If the shared
memory unit 114 is duplicated, duplicate read and duplicate write are executed in some cases. Such duplicate access uses two ports at the same time. It is therefore necessary to acquire use privilege of two ports. - 75. A
port number decoder 221 derives a requested port number from an address. In this embodiment, aport 0 is assigned “00” and aport 1 is assigned “11”. Acommand decoder 222 derives an access type from a command. In this embodiment, RD is assigned “00”, WR is assigned “01”, 2R is assigned “10”, and 2W is assigned “11”. A requiredport decision unit 223 outputs the port number itself if the access type is not a duplicate access, and outputs “01” if it is a duplicate access. - 76. A
queue management unit 204 registers the port numbers output from the address/command (ADR/CMD)decoder 203 in the arrival order in a management table 224, this operation being called queuing. Thearbitor unit 205 picks up one port number from the top of the management table 224 and stores it in abuffer 227. Acomparison unit 228 compares an occupied port number in abuffer 226 with the required port number in thebuffer 227. - 77. If both the port numbers are different, the required port number is output to a
selector 206 as selector switch signals SEL0 and SEL1, and anorder control unit 225 of thequeue management unit 204 is instructed to advance (shifts) the queue order by “1”. If the port numbers are equal, theorder control unit 225 is instructed to exchange the queue order. An arbitration method, an order exchange method, and a queue order shift method will be described later at the arbitration flow shown in FIG. 6 by using specific examples. - 78. The lengths of an address and a command, the locations of the port number and command type in an address and command, assignment of bits to the port number and command type, described above, are only illustrative and are not limited thereto. If the shared
memory unit 114 is not duplicated, a duplicate access does not occur so that thecommand decoder 222 and requiredport decision unit 223 are not necessary. In this case, an output of theport number decoder 221 is directly input to thequeue management unit 204. - 79. Next, processes to be executed by the
selector unit 113 will be described. - 80.FIG. 5 is a flow chart illustrating the operation to be executed by the
selector unit 113 when an access is requested to one port of the I/F port unit 210 from the channel and disk I/F units - 81. First, at
Step 301 the process waits for an access request (REQ ON) to be issued from the SM access controller in the channel I/F unit 111 or disk I/F unit 112. - 82. When an access request is received, an address (ADR) and a command (CMD) are decoded at
Step 302. - 83. At
Step 303, it is checked whether there is any error in the address (ADR) and command (CMD). If there is an error, an error process is executed at Step 315 to thereafter return toStep 301 and enter the access request stand-by state. - 84. If there is no error, the decoded results are queued at
Step 304 as a connection request to the I/F port (211-1, 211-2) to the sharedmemory units 114. - 85. Arbitration is performed in accordance with the queue contents.
- 86. At
Step 305 the process stands by until the requested port of the I/F port unit 211 to the sharedmemory unit 114 is acquired. - 87. If acquired, the
selector unit 206 is switched atStep 306 to connect one requested port of the I/F port unit 210 to the acquired one port of the I/F port unit 211. - 88. Next, at
Step 307, an access request (REQ ON) is issued to the shared memory (SM)unit 114 and an address (ADR) and a command (CMD) are transferred. - 89. At
Step 308 the process stands by until an access acknowledgement (ACK ON) is returned from the sharedmemory unit 114. - 90. When the access acknowledgement (ACK ON) is received, at
Step 309 the access acknowledgement (ACK ON) is returned to the SM access controller of the channel I/F unit 111 or disk I/F unit 112. - 91. At
Step 310, in the case of data write, data supplied from the SM access controller is transmitted to the sharedmemory unit 114. - 92. In the case of data read, data supplied from the shared
memory unit 114 is transmitted to the SM access controller. - 93. In the data read/write, an error is checked at
Step 311. - 94. If an error is found, an error process is executed at Step 315 to thereafter return to
Step 301 and enter the access request stand-by state. - 95. If there is no error, it is checked at
Step 312 whether a STATUS indicating the contents of data processing is received, and data is transmitted until the STATUS is received. - 96. If the STATUS is received, at
Step 313 the shared memory unit is instructed to withdraw the access acknowledgement (ACK OFF) to thereafter return toStep 301 and enter the access request stand-by state. - 97. Next, an arbitration method to be performed at
Step 304 will be described. FIG. 6 is a flow chart illustrating an arbitration operation. - 98. At
Step 401 it is checked whether there is a vacant port, and if not, the process stands by until a vacant port appears. - 99. If there is a vacant port at
Step 401, the top connection request among the connection requests stored in an arrival order in the management table 224 of thequeue management unit 402 is checked atStep 402. More specifically, as shown in FIG. 15A, theport number # 0 of “00” in the management table 224 is output to thebuffer 227. Thecomparison unit 228 compares the port number “00” with the occupied port number “11” registered in thebuffer 226. - 100. If it is judged at
Step 403 that the connection request is issued to a vacant output port, then the output port is assigned to the request atStep 404. Namely, as shown in the example of FIG. 15A, if the required port number “00” is not the occupied port number “11”, the switch signal SEL0 is output to connect the IF port 210-3 to the IF port 211-1 (port number “00”). The path formation of this example in theselector unit 206 is shown in FIG. 15B. - 101. If it is judged at
Step 403 that the top connection request among the connection requests stored in the arrival order in the management table 224 of thequeue management unit 204 is a request for an occupied output port, the top queue request is shifted to the (number of vacant ports+1)-th order atStep 406 and thereafter the flow returns to Step 401. More specifically, as shown in an example of FIG. 16A, if the required port number “00” is the occupied port number “00”, then as shown in FIG. 16B theport number # 0 of “00” in the management table 224 is registered in theport number # 1 and theport number # 1 of “01” is shifted to the port number #0 (theport number # 0 of “00” is set to the (number of vacant ports (“1”)+1=2)-th order, and thereafter the flow returns to Step 401. - 102. If it is judged at
Step 403 that the requested port is a vacant port and an output port is assigned atStep 404, the queue order is advanced by “1” to thereafter return toStep 401. Namely, as shown in FIG. 17, theport number # 0 of “00” in the management table 224 is discarded, theport number # 1 of “11” is shifted to theport number # 0, theport number # 2 of “01” is shifted to theport number # 1, theport number # 3 of “11” is shifted to theport number # 2, and a new required port number “11” is registered in theport number # 3. - 103. The above-described output port assignment is repeated several times equal to the number of vacant ports. If there is no vacant port, the process stands by at
Step 401 until a vacant port appears. - 104. By effecting the above mentioned control only when the data to be recorded to the
magnetic disk device 120 to which a high throughput is required is transmitted, it becomes possible to prevent a bad influence from affecting to a transmission of control information to which a short access time is required. - 105. With the above control, it becomes possible to efficiently assign the I/F ports (211-1, 211-2) to the shared memory units and realize data transfer of high throughput.
- 106. In another embodiment, as shown in FIG. 9, the shared
memory unit 114 may be duplicated by using physically independent shared memory units 114-1 and 114-2 to form a duplicatedarea 160. More specifically, the same data is written in each of the duplicate shared memory units 114-1 and 114-2. The shared memory unit may be duplicated wholly or partially. - 107. In a
disk array controller 4 in which accesses (a duplicate access) from theselector unit 113 to the duplicate shared memory units 114-1 and 114-2 are generated at the same time, it is checked atSteps - 108. In this manner, reliability of data stored in the shared memory units 114-1 and 114-2 can be improved.
- 109. It is also possible to efficiently assign the I/F ports 211-1 and 211-2 to the shared memory units 114-1 and 114-2 when data to be written in the disk drives 120 is transferred.
- 110. The structure of the disk array controller shown in FIG. 1 is changed to that shown in FIG. 10. Namely, the shared
memory unit 114 shown in FIG. 1 is physically divided intocache memory units 115 for temporarily storing data to be written in the disk drives 120 and sharedmemory units 116 for storing control information on thecache memory units 115 and adisk array controller 5, and a selector unit (CM selector unit) 123 connected to thecache memory units 115 and a selector unit (SM selector unit) 124 connected to the shared memory units are made physically independent. The structures of theselector units selector unit 113. - 111.
Access paths F units 111 and disk I/F units 112 and thecache memory units 115 and sharedmemory units 114 are made physically independent, and at least theCM selector units 123 connected to thecache memory units 115 execute arbitration in the same manner as the process flow shown in FIG. 5. The reason why theSM selector units 124 do not execute arbitration is as follows. The control information on thecache memory units 115 anddisk array controller 5 is stored in the shared memory units and has a small data amount. Therefore, it takes only a short time to use ports and these ports soon becomes vacant. As a result, even if arbitration is not executed, there is no practical problem. - 112. In another embodiment, as shown in FIG. 11, a shared
memory unit 116 and acache memory unit 115 may be duplicated by using physically independent shared memory units 116-1 and 116-2 and cache memory units 115-1 and 115-2 to form duplicatedareas 160. In this case, in adisk array controller 5 in which accesses (a duplicate access) from at least theCM selector unit 123 connected to the cache memory units to the duplicate cache memory units 115-1 and 115-2 are generated at the same time, it is checked atSteps CM selector units 123 connected to the cache memory units. - 113. In this manner, reliability of data stored in the cash memory units 115-1 and 115-2 and shared memory units 116-1 and 116-2 can be improved. It is also possible to efficiently assign the I/F ports 211-1 and 211-2 to the cache memory units 115-1 and 115-2 when data to be written in the disk drives 120 is transferred.
- 114.FIGS. 7 and 8 are flow charts illustrating the details of the process flow shown in FIG. 5, and showing the data flow when the disk array controllers having the structures shown in FIGS. 1, 9, 10 and 11 operate.
- 115. For the data write as shown in FIG. 7, at
Step 501 the SM orCM access controller selector unit Steps selector unit - 116. At
Steps selector 206 is switched to assign a port to the sharedmemory unit cache memory unit 115. - 117. At
Step 506, the selector unit issues an access request (REQ) to the shared memory unit or cache memory unit, and then atSteps - 118. At Step 509 a memory module to be accessed is selected in the shared
memory unit cache memory unit 115, and thereafter atStep 510 an access acknowledgement (ACK ON) is returned via the selector unit to the SM orCM access controller - 119. Upon reception of ACK ON, the SM or
CM access controller Step 511. - 120. Upon reception of all of the data, the shared
memory unit cache memory unit 115 executes a post-process atStep 512, and returns at Step 513 a STATUS to the SM orCM access controller - 121. Upon reception of the status, at
Step 514 the selector unit instructs the sharedmemory unit cache memory unit 115 to withdraw the access acknowledgement (ACK OFF). - 122. Upon reception of the STATUS, at
Step 515 the SM orCM access controller - 123. The data read process at
Steps 601 to 610 is the same as the data write process atSteps 501 to 510 as shown in FIG. 8. - 124. A data read pre-process is executed by the shared
memory unit cache memory unit 115 atStep 611. - 125. At
Step 612 data is transferred to the SM orCM access controller - 126. After data is transferred, the shared
memory unit cache memory unit 115 executes a post-process atStep 613. At Step 614 a STATUS is returned to the SM orCM access controller - 127. Upon reception of the STATUS, at
Step 615 the selector unit instructs the sharedmemory unit cache memory unit 115 to withdraw the access acknowledgement (ACK OFF). - 128. Upon reception of the STATUS, at
Step 616 the SM orCM access controller - 129. As described above, when the channel I/
F unit 111 or disk I/F unit 112 accesses the sharedmemory unit cache memory unit 115, an address and a command are sequentially transferred and after an access path to the sharedmemory unit cache memory unit 115 is established (step 510 or 610), data it transferred. It is therefore unnecessary for the selector unit to buffer transfer data. Therefore, thebuffer 202 is not required, the control at the selector unit can be simplified, and throughput of accesses to the memory can be improved. - 130. In each of the embodiments described above, although disk drives are connected, the invention is not limited only to disk drives but other drives for various types of disk media may also be used.
- 131. The invention is not limited only to the disclosed embodiments, but it includes various modifications which fall in the spirit and scope of appended claims.
Claims (14)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/756,798 US6336165B2 (en) | 1998-06-19 | 2001-01-10 | Disk array controller with connection path formed on connection request queue basis |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP18995798A JP3946873B2 (en) | 1998-06-19 | 1998-06-19 | Disk array controller |
JP10-189957 | 1998-06-19 | ||
US09/334,599 US6393519B1 (en) | 1998-06-19 | 1999-06-17 | Disk array controller with connection path formed on connection request queue basis |
US09/756,798 US6336165B2 (en) | 1998-06-19 | 2001-01-10 | Disk array controller with connection path formed on connection request queue basis |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/334,599 Division US6393519B1 (en) | 1998-06-19 | 1999-06-17 | Disk array controller with connection path formed on connection request queue basis |
Publications (2)
Publication Number | Publication Date |
---|---|
US20010001325A1 true US20010001325A1 (en) | 2001-05-17 |
US6336165B2 US6336165B2 (en) | 2002-01-01 |
Family
ID=16250031
Family Applications (6)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/334,599 Expired - Lifetime US6393519B1 (en) | 1998-06-19 | 1999-06-17 | Disk array controller with connection path formed on connection request queue basis |
US09/756,798 Expired - Lifetime US6336165B2 (en) | 1998-06-19 | 2001-01-10 | Disk array controller with connection path formed on connection request queue basis |
US09/756,748 Expired - Lifetime US6341332B2 (en) | 1998-06-19 | 2001-01-10 | Disk array controller with connection path formed on connection request queue basis |
US09/985,785 Expired - Fee Related US6484236B2 (en) | 1998-06-19 | 2001-11-06 | Disk array controller with connection path formed on connection request queue basis |
US10/189,238 Expired - Fee Related US6523088B2 (en) | 1998-06-19 | 2002-07-05 | Disk array controller with connection path formed on connection request queue basis |
US10/271,797 Expired - Fee Related US7103710B2 (en) | 1998-06-19 | 2002-10-17 | Disk array controller with connection path formed on connection request queue basis |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/334,599 Expired - Lifetime US6393519B1 (en) | 1998-06-19 | 1999-06-17 | Disk array controller with connection path formed on connection request queue basis |
Family Applications After (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/756,748 Expired - Lifetime US6341332B2 (en) | 1998-06-19 | 2001-01-10 | Disk array controller with connection path formed on connection request queue basis |
US09/985,785 Expired - Fee Related US6484236B2 (en) | 1998-06-19 | 2001-11-06 | Disk array controller with connection path formed on connection request queue basis |
US10/189,238 Expired - Fee Related US6523088B2 (en) | 1998-06-19 | 2002-07-05 | Disk array controller with connection path formed on connection request queue basis |
US10/271,797 Expired - Fee Related US7103710B2 (en) | 1998-06-19 | 2002-10-17 | Disk array controller with connection path formed on connection request queue basis |
Country Status (2)
Country | Link |
---|---|
US (6) | US6393519B1 (en) |
JP (1) | JP3946873B2 (en) |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6647461B2 (en) * | 2000-03-10 | 2003-11-11 | Hitachi, Ltd. | Disk array controller, its disk array control unit, and increase method of the unit |
EP3726389A1 (en) * | 2019-03-30 | 2020-10-21 | INTEL Corporation | Apparatuses, methods, and systems for memory interface circuit allocation in a configurable spatial accelerator |
US10891240B2 (en) | 2018-06-30 | 2021-01-12 | Intel Corporation | Apparatus, methods, and systems for low latency communication in a configurable spatial accelerator |
US10942737B2 (en) | 2011-12-29 | 2021-03-09 | Intel Corporation | Method, device and system for control signalling in a data path module of a data stream processing engine |
US11037050B2 (en) | 2019-06-29 | 2021-06-15 | Intel Corporation | Apparatuses, methods, and systems for memory interface circuit arbitration in a configurable spatial accelerator |
US11086816B2 (en) | 2017-09-28 | 2021-08-10 | Intel Corporation | Processors, methods, and systems for debugging a configurable spatial accelerator |
US11200186B2 (en) | 2018-06-30 | 2021-12-14 | Intel Corporation | Apparatuses, methods, and systems for operations in a configurable spatial accelerator |
US11307873B2 (en) | 2018-04-03 | 2022-04-19 | Intel Corporation | Apparatus, methods, and systems for unstructured data flow in a configurable spatial accelerator with predicate propagation and merging |
US12086080B2 (en) | 2020-09-26 | 2024-09-10 | Intel Corporation | Apparatuses, methods, and systems for a configurable accelerator having dataflow execution circuits |
Families Citing this family (29)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3946873B2 (en) * | 1998-06-19 | 2007-07-18 | 株式会社日立製作所 | Disk array controller |
US6957346B1 (en) | 1999-06-15 | 2005-10-18 | Ssh Communications Security Ltd. | Method and arrangement for providing security through network address translations using tunneling and compensations |
JP3987241B2 (en) * | 1999-07-29 | 2007-10-03 | 株式会社東芝 | Inter-system information communication system |
US6769046B2 (en) * | 2000-02-14 | 2004-07-27 | Palmchip Corporation | System-resource router |
US6675253B1 (en) * | 2000-04-04 | 2004-01-06 | Hewlett-Packard Development Company, L.P. | Dynamic routing of data across multiple data paths from a source controller to a destination controller |
JP2002123479A (en) * | 2000-10-17 | 2002-04-26 | Hitachi Ltd | Disk control device and method for controlling its cache |
US6701390B2 (en) * | 2001-06-06 | 2004-03-02 | Koninklijke Philips Electronics N.V. | FIFO buffer that can read and/or write multiple and/or selectable number of data words per bus cycle |
US6728848B2 (en) * | 2001-06-11 | 2004-04-27 | Hitachi, Ltd. | Method and system for backing up storage system data |
US7359397B2 (en) * | 2002-04-19 | 2008-04-15 | Seagate Technology Llc | Prioritizing transfers across an interface |
JP4166516B2 (en) * | 2002-06-14 | 2008-10-15 | 株式会社日立製作所 | Disk array device |
JP2004171437A (en) | 2002-11-22 | 2004-06-17 | Fujitsu Ltd | Storage control device and control method |
JP2004348464A (en) | 2003-05-22 | 2004-12-09 | Hitachi Ltd | Storage device and communication signal shaping circuit |
JP4060235B2 (en) | 2003-05-22 | 2008-03-12 | 株式会社日立製作所 | Disk array device and disk array device control method |
JP4220887B2 (en) * | 2003-11-17 | 2009-02-04 | 株式会社日立製作所 | Disk device and control method thereof |
JP4156499B2 (en) | 2003-11-28 | 2008-09-24 | 株式会社日立製作所 | Disk array device |
JP2005190057A (en) * | 2003-12-25 | 2005-07-14 | Hitachi Ltd | Disk array device and remote copy control method for disk array device |
JP4497918B2 (en) | 2003-12-25 | 2010-07-07 | 株式会社日立製作所 | Storage system |
US7343451B2 (en) * | 2003-12-25 | 2008-03-11 | Hitachi, Ltd. | Disk array device and remote copying control method for disk array device |
JP4634049B2 (en) | 2004-02-04 | 2011-02-16 | 株式会社日立製作所 | Error notification control in disk array system |
US20050204104A1 (en) * | 2004-03-15 | 2005-09-15 | Tatsundo Aoshima | Server and method for managing volume storing digital archive |
JP4585217B2 (en) * | 2004-03-29 | 2010-11-24 | 株式会社日立製作所 | Storage system and control method thereof |
JP4688514B2 (en) * | 2005-02-14 | 2011-05-25 | 株式会社日立製作所 | Storage controller |
US7984313B2 (en) * | 2008-04-17 | 2011-07-19 | International Business Machines Corporation | Method, apparatus and system for reducing power consumption involving data storage devices |
US8291245B2 (en) * | 2008-04-17 | 2012-10-16 | International Business Machines Corporation | Method, apparatus and system for reducing power consumption based on storage device data migration |
US8171181B2 (en) * | 2008-05-05 | 2012-05-01 | Micron Technology, Inc. | Memory module with configurable input/output ports |
JP2011238038A (en) * | 2010-05-11 | 2011-11-24 | Nec Corp | Disk array device, disk array device control system, and disk array device control program |
WO2013140459A1 (en) | 2012-03-23 | 2013-09-26 | Hitachi, Ltd. | Method for accessing mirrored shared memories and storage subsystem using method for accessing mirrored shared memories |
WO2013153577A1 (en) | 2012-04-12 | 2013-10-17 | Hitachi, Ltd. | Data transfer method and storage system adopting data transfer method |
WO2014068620A1 (en) | 2012-10-31 | 2014-05-08 | Hitachi, Ltd. | Storage system and access arbitration method |
Family Cites Families (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4476526A (en) * | 1981-11-27 | 1984-10-09 | Storage Technology Corporation | Cache buffered memory subsystem |
US5051887A (en) * | 1987-08-25 | 1991-09-24 | International Business Machines Corporation | Maintaining duplex-paired storage devices during gap processing using of a dual copy function |
JP2872251B2 (en) * | 1988-10-12 | 1999-03-17 | 株式会社日立製作所 | Information processing system |
EP0428021B1 (en) * | 1989-11-03 | 1998-09-02 | Compaq Computer Corporation | Method for data distribution in a disk array |
JPH05143242A (en) * | 1991-11-25 | 1993-06-11 | Hitachi Ltd | Magnetic disk system |
US5640596A (en) | 1992-03-10 | 1997-06-17 | Hitachi, Ltd. | Input output control system for transferring control programs collectively as one transfer unit designated by plurality of input output requests to be executed |
JP3252517B2 (en) * | 1992-03-10 | 2002-02-04 | 株式会社日立製作所 | I / O control method and I / O control system |
JP3264465B2 (en) | 1993-06-30 | 2002-03-11 | 株式会社日立製作所 | Storage system |
JP3227069B2 (en) * | 1994-12-22 | 2001-11-12 | 株式会社日立製作所 | I / O processing system |
US5680580A (en) * | 1995-02-28 | 1997-10-21 | International Business Machines Corporation | Remote copy system for setting request interconnect bit in each adapter within storage controller and initiating request connect frame in response to the setting bit |
JPH08328760A (en) * | 1995-06-01 | 1996-12-13 | Hitachi Ltd | Disk array device |
JP3776496B2 (en) * | 1996-01-17 | 2006-05-17 | 株式会社日立製作所 | Data storage system |
US5835925A (en) * | 1996-03-13 | 1998-11-10 | Cray Research, Inc. | Using external registers to extend memory reference capabilities of a microprocessor |
US5864738A (en) * | 1996-03-13 | 1999-01-26 | Cray Research, Inc. | Massively parallel processing system using two data paths: one connecting router circuit to the interconnect network and the other connecting router circuit to I/O controller |
US6018778A (en) * | 1996-05-03 | 2000-01-25 | Netcell Corporation | Disk array controller for reading/writing striped data using a single address counter for synchronously transferring data between data ports and buffer memory |
US5890219A (en) * | 1996-11-27 | 1999-03-30 | Emc Corporation | Redundant writing of data to cached storage system |
US5890207A (en) * | 1996-11-27 | 1999-03-30 | Emc Corporation | High performance integrated cached storage device |
US5951656A (en) * | 1997-01-31 | 1999-09-14 | Hewlett-Packard Company | Method and system for controlling queue deletions in which pointer corresponding to item to be deleted is moved back and pointers for items after deleted item are shifted |
US6098149A (en) * | 1997-06-13 | 2000-08-01 | Emc Corporation | Method and apparatus for extending commands in a cached disk array |
JP3946873B2 (en) * | 1998-06-19 | 2007-07-18 | 株式会社日立製作所 | Disk array controller |
-
1998
- 1998-06-19 JP JP18995798A patent/JP3946873B2/en not_active Expired - Fee Related
-
1999
- 1999-06-17 US US09/334,599 patent/US6393519B1/en not_active Expired - Lifetime
-
2001
- 2001-01-10 US US09/756,798 patent/US6336165B2/en not_active Expired - Lifetime
- 2001-01-10 US US09/756,748 patent/US6341332B2/en not_active Expired - Lifetime
- 2001-11-06 US US09/985,785 patent/US6484236B2/en not_active Expired - Fee Related
-
2002
- 2002-07-05 US US10/189,238 patent/US6523088B2/en not_active Expired - Fee Related
- 2002-10-17 US US10/271,797 patent/US7103710B2/en not_active Expired - Fee Related
Cited By (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040034737A1 (en) * | 2000-03-10 | 2004-02-19 | Kazuhisa Fujimoto | Disk array controller, its disk array control unit, and increase method of the unit |
US6985989B2 (en) | 2000-03-10 | 2006-01-10 | Hitachi, Ltd. | Storage apparatus having plural controller including interconnected memories |
US6647461B2 (en) * | 2000-03-10 | 2003-11-11 | Hitachi, Ltd. | Disk array controller, its disk array control unit, and increase method of the unit |
US10942737B2 (en) | 2011-12-29 | 2021-03-09 | Intel Corporation | Method, device and system for control signalling in a data path module of a data stream processing engine |
US11086816B2 (en) | 2017-09-28 | 2021-08-10 | Intel Corporation | Processors, methods, and systems for debugging a configurable spatial accelerator |
US11307873B2 (en) | 2018-04-03 | 2022-04-19 | Intel Corporation | Apparatus, methods, and systems for unstructured data flow in a configurable spatial accelerator with predicate propagation and merging |
US11200186B2 (en) | 2018-06-30 | 2021-12-14 | Intel Corporation | Apparatuses, methods, and systems for operations in a configurable spatial accelerator |
US10891240B2 (en) | 2018-06-30 | 2021-01-12 | Intel Corporation | Apparatus, methods, and systems for low latency communication in a configurable spatial accelerator |
US11593295B2 (en) | 2018-06-30 | 2023-02-28 | Intel Corporation | Apparatuses, methods, and systems for operations in a configurable spatial accelerator |
US10915471B2 (en) | 2019-03-30 | 2021-02-09 | Intel Corporation | Apparatuses, methods, and systems for memory interface circuit allocation in a configurable spatial accelerator |
EP3726389A1 (en) * | 2019-03-30 | 2020-10-21 | INTEL Corporation | Apparatuses, methods, and systems for memory interface circuit allocation in a configurable spatial accelerator |
US11037050B2 (en) | 2019-06-29 | 2021-06-15 | Intel Corporation | Apparatuses, methods, and systems for memory interface circuit arbitration in a configurable spatial accelerator |
US12086080B2 (en) | 2020-09-26 | 2024-09-10 | Intel Corporation | Apparatuses, methods, and systems for a configurable accelerator having dataflow execution circuits |
Also Published As
Publication number | Publication date |
---|---|
US20030033478A1 (en) | 2003-02-13 |
US7103710B2 (en) | 2006-09-05 |
JP2000010901A (en) | 2000-01-14 |
US6484236B2 (en) | 2002-11-19 |
US6341332B2 (en) | 2002-01-22 |
US20010001324A1 (en) | 2001-05-17 |
US6336165B2 (en) | 2002-01-01 |
US20020029320A1 (en) | 2002-03-07 |
JP3946873B2 (en) | 2007-07-18 |
US6523088B2 (en) | 2003-02-18 |
US20020178327A1 (en) | 2002-11-28 |
US6393519B1 (en) | 2002-05-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6336165B2 (en) | Disk array controller with connection path formed on connection request queue basis | |
JP4400895B2 (en) | Disk array controller | |
US7020731B2 (en) | Disk array control device with two different internal connection systems | |
EP1646925B1 (en) | Apparatus and method for direct memory access in a hub-based memory system | |
US6850998B2 (en) | Disk array system and a method for controlling the disk array system | |
US7346754B2 (en) | Control method for storage device controller system, and storage device controller system | |
US20060206663A1 (en) | Disk array device and shared memory device thereof, and control program and control method of disk array device | |
JPH02103649A (en) | Controller and information processing system | |
US7409486B2 (en) | Storage system, and storage control method | |
JPH07191930A (en) | Interface for disk device and control method therefor | |
JP4737702B2 (en) | Disk array controller | |
JP4485503B2 (en) | Disk array control device and disk array control method | |
JP4025032B2 (en) | Disk control device and data access method thereof | |
JP3684902B2 (en) | Disk array controller | |
JP2000339101A (en) | Disk array controller | |
JP2002116883A (en) | Disk array controller | |
JP2000010900A (en) | Disk array controller and disk array | |
JP2000250712A (en) | Disk array controller | |
JP4452697B2 (en) | Disk array controller | |
JP4571963B2 (en) | Disk array controller |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Free format text: PAYER NUMBER DE-ASSIGNED (ORIGINAL EVENT CODE: RMPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
FEPP | Fee payment procedure |
Free format text: PAYER NUMBER DE-ASSIGNED (ORIGINAL EVENT CODE: RMPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 12 |