WO2015162774A1 - 計算機、計算機のi/oスイッチの制御方法 - Google Patents
計算機、計算機のi/oスイッチの制御方法 Download PDFInfo
- Publication number
- WO2015162774A1 WO2015162774A1 PCT/JP2014/061650 JP2014061650W WO2015162774A1 WO 2015162774 A1 WO2015162774 A1 WO 2015162774A1 JP 2014061650 W JP2014061650 W JP 2014061650W WO 2015162774 A1 WO2015162774 A1 WO 2015162774A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- switch
- pci express
- computer
- switches
- management controller
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F13/38—Information transfer, e.g. on bus
- G06F13/40—Bus structure
- G06F13/4004—Coupling between buses
- G06F13/4022—Coupling between buses using switching circuits, e.g. switching matrix, connection or expansion network
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F13/38—Information transfer, e.g. on bus
- G06F13/42—Bus transfer protocol, e.g. handshake; Synchronisation
- G06F13/4282—Bus transfer protocol, e.g. handshake; Synchronisation on a serial bus, e.g. I2C bus, SPI bus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2213/00—Indexing scheme relating to interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F2213/0026—PCI express
Definitions
- the present invention relates to a computer and a method for controlling a computer I / O switch.
- Patent Document 1 JP 2009-282773 A. This publication describes “a data transfer system that can provide an optimum route for use in a system including a PCI Express switch” (see summary).
- Patent Document 1 describes a computer in which each port of an I / O controller is connected to an I / O device via an I / O switch, according to the number of I / O devices connected to each port of the I / O controller. It is not assumed that the throughput of each port of the I / O controller varies and the throughput of the I / O controller decreases.
- the present invention controls a connection state between each port of an I / O controller and an I / O switch, improves a bias in throughput between each port of the I / O controller, and improves the throughput.
- a method of controlling a computer I / O switch is provided.
- a computer includes one or more I / O switches, one or more I / O devices connected to the one or more I / O switches, a management controller, and a plurality of ports.
- the management controller stores configuration management information for managing the connection state with one or more I / O switches and the number of virtual switches in association with each other.
- the management controller detects the connection state with one or more I / O switches, refers to the configuration management information, and acquires the number of virtual switches associated with the detected connection state with the I / O switch.
- the management controller sets the acquired number of virtual switches for each connected I / O switch among one or more I / O switches.
- Each port of the I / O controller is connected to one or more I / O devices via the set virtual switch.
- FIG. 3 is a diagram illustrating a configuration of a computer according to the first embodiment.
- FIG. 6 is a diagram illustrating a first modification example of the configuration of the computer according to the first embodiment.
- FIG. 10 is a diagram illustrating a second modification example of the configuration of the computer according to the first embodiment.
- 1 is a diagram illustrating a configuration of a PCI Express I / F adapter in Embodiment 1.
- FIG. It is a figure which shows the structure of the management controller in Example 1.
- FIG. 3 is a flowchart illustrating a setting process of a PCI Express Switch and a multiplexer according to the first embodiment. It is a figure which shows the structure of the input table in Example 1.
- FIG. It is a figure which shows the structure of the expectation value table in Example 1.
- FIG. 6 is a diagram illustrating a configuration of a computer according to a second embodiment.
- FIG. 10 is a diagram illustrating a first modification example of the configuration of the computer according to the second embodiment. It is a figure which shows the 2nd example of a change of the structure of the computer in Example 2.
- FIG. It is a figure which shows the structure of the management controller in Example 2.
- FIG. 10 is a flowchart illustrating a setting process of PCI Express Switch in the second embodiment. It is a figure which shows the structure of the input table in Example 2.
- FIG. It is a figure which shows the structure of the expectation value table in Example 2.
- FIG. 10 is a flowchart illustrating a setting process of PCI Express Switch in the second embodiment. It is a figure which shows the structure of the input table in Example 2.
- FIG. It is a figure which shows the structure of the expectation value table in Example 2.
- FIG. 10 is a flowchart illustrating a setting process of PCI Express Switch in the second embodiment. It is a
- FIG. 1 is a diagram showing the configuration of a computer.
- the computer is, for example, a server device or a storage device.
- the computer includes an I / O controller (Input / Output Controller) 100, a PCI Express I / F (interface) adapter 101 / 106-108, a management controller 110, and I / O devices 111-126.
- the PCI Express I / F adapter 101 is a master, and the PCI Express I / F adapters 106 to 108 are slaves. In the configuration of the computer, some or all of the PCI Express I / F adapters 106 to 108 and the I / O devices 111 to 126 may not be included.
- the I / O devices 111 to 126 are each connected to a network such as a SAN (Storage Area Network), and are connected to an external device such as a storage device or a server device via the network.
- the computer is connected to an external device via the I / O devices 111 to 126 and the network, and transmits / receives information (for example, input / output command / response to input / output command).
- the I / O controller 100 includes a CPU, a memory, and a plurality of root ports (RP) 140 to 143.
- the I / O controller 100 will be described as having four root ports: RP-A140, RP-B141, RP-C142, and RP-D143.
- the PCI Express I / F adapter 101 includes MUX B102, MUX C103, MUX D104, which is a multiplexer (MUX, multiplexer switch), a PCI Express Switch 105, and external ports 144 to 146.
- MUX B102 MUX C103
- MUX D104 which is a multiplexer (MUX, multiplexer switch)
- PCI Express Switch 105 PCI Express Switch 105
- the RP-A 140 of the I / O controller 100 is connected to the PCI Express Switch 105 through a signal line 150.
- the RP-B 141 is connected to the MUX B102 via the signal line 150.
- the MUX B102 is connected to the PCI Express Switch 105 and the external port 144 through the signal line 150, respectively.
- the RP-C 142 is connected to the MUX C103 via the signal line 150.
- the MUX C103 is connected to the PCI Express Switch 105 and the external port 145 through the signal line 150, respectively.
- the RP-D 143 is connected to the MUX D104 via the signal line 150.
- the MUX D104 is connected to the PCI Express Switch 105 and the external port 146 through signal lines 150, respectively.
- the PCI Express Switch 105 can be connected to the I / O devices 111 to 126, respectively.
- the external ports 144, 145, and 146 connected to the MUX B102, MUX C103, and MUX D104 are connected to the PCI Express I / F adapters 106, 107, and 108, respectively.
- the external port 144 to 146 of the PCI Express I / F adapter 101 and the external port of the PCI Express I / F adapter 106 to 108 are connected by a signal line 150, and the connection can be arbitrarily changed. It is.
- the computer shown in FIG. 1 has a configuration including PCI Express I / F adapters 101 and 106-108. Assuming that up to four I / O devices can be connected to each PCI Express I / F adapter 101.106 to 108, the computer shown in FIG. 1 can connect 16 I / O devices 111 to 126. .
- the management controller 110 is connected to the PCI Express I / F adapter 101 with MUX B102, MUX C103, MUX D104, and PCI Express Switch 105 via the control signal line 151.
- the management controller 110 is connected to the PCI Express I / F adapters 106, 107, and 108 via the external ports 144, 145, and 146 of the PCI Express I / F adapter 101 and the control signal lines 152, 153, and 154. And the control signal line 155.
- the signal lines 150 or the control signal lines 151 to 155 can be connected to each other, but the signal line 150 and the control signal lines 151 to 155 are not connected.
- the signal line 150 is a cable or wiring on a printed circuit board that transmits information (for example, input / output command / response to input / output command) between the I / O controller 100 and the I / O devices 111 to 126.
- the control signal lines 151 to 155 are signal lines for transmitting control information between the management controller 110 and the MUX B102, MUX C103, MUX D104, and each PCI Express Switch 105.
- FIG. 2 is a diagram illustrating a first modification of the configuration of the computer. A configuration different from that of the computer shown in FIG. 1 will be described for the computer shown in FIG.
- the PCI Express I / F adapter 106 of the computer shown in FIG. 2 is not connected to the external port 144 of the PCI Express I / F adapter 101, and the external ports 145 and 146 are connected to the signal line 150 and the control signal lines 153 and 154. Connected with. Further, the PCI Express I / F adapter 101 is not connected to the PCI Express I / F adapters 107 and 108. Assuming that up to four I / O devices can be connected to each PCI Express I / F adapter 101, 106, the computer shown in FIG. 2 can connect eight I / O devices 111-118.
- FIG. 3 is a diagram showing a second modification of the computer configuration. A different configuration of the computer shown in FIG. 3 compared to the computer shown in FIG. 1 will be described.
- the external ports 144, 145, and 146 of the PCI Express I / F adapter 101 of the computer shown in FIG. 3 are not connected to any of the PCI Express I / F adapters 106, 107, and 108. Assuming that up to four I / O devices can be connected to the PCI Express I / F adapter 101, the computer shown in FIG. 3 can connect four I / O devices 111 to 114.
- FIG. 4 is a diagram showing a configuration of the PCI Express I / F adapter 106.
- the PCI Express I / F adapter 106 has four external ports 201 to 204, and each is connected to the PCI Express Switch 105 via a signal line 150.
- the PCI Express Switch 105 can be connected to the I / O devices 115 to 118, respectively.
- the external port 204 which is one of the four external ports, and the PCI Express Switch 105 are connected by a control signal line 155.
- the management controller 110 is connected to the PCI Express Switch 105 of the PCI Express I / F adapter 106 via the control signal lines 152 and 155.
- the management controller 110 is connected to the PCI Express Switch 105 of the PCI Express I / F adapter 106 via the control signal lines 153 and 155.
- the configuration of the PCI Express I / F adapters 107 and 108 is the same as that of the PCI Express I / F adapter 106.
- the PCI Express I / F adapter 107 can be connected to the I / O devices 119 to 122, respectively.
- the PCI Express I / F adapter 108 can be connected to the I / O devices 123 to 126, respectively.
- FIG. 5 is a diagram showing the configuration of the management controller 110.
- the management controller 110 is, for example, a BMC (Baseboard Management Controller) or a service processor (Service Processor: SVP).
- the management controller 110 has a CPU 501 and a memory 502.
- the CPU 501 includes a detection unit 503, a MUX control unit 504 that controls the multiplexers 102 to 104, and a switch control unit 505 that controls the PCI Express switch 105.
- the detection unit 503, the MUX control unit 504, and the switch control unit 505 may each be hardware, or may be realized by software executed by the CPU 501.
- the memory 502 includes an input table 506 and an expected value table 507.
- FIG. 7 is a diagram showing the configuration of the input table 506.
- the input table 506 is configuration setting information indicating the configuration of the computer.
- the input table 506 manages input data (input information, input data) 701, a configuration setting value 702, a VMODE setting value 703, and a MUX setting value 704 in association with each other.
- the value of each item of the input table 506 varies depending on the configuration of the computer.
- the management controller 110 For each item of RP-A, RP-B, RP-C, and RP-D in the input data 701, the management controller 110 is connected to each PCI Express Switch 105 of the PCI Express I / F adapter 101 / 106-108. This is connection state information indicating whether or not there is. For example, “P (Present)” is recorded when connected, and “A (Absent)” is recorded when not connected.
- the management controller 110 is connected to each PCI Express Switch 105 of the PCI Express I / F adapter 101, 106, 107, and 108 via control signal lines 151 to 155.
- information indicating connection such as “P” is recorded.
- the management controller 110 is connected to each PCI Express Switch 105 of the PCI Express I / F adapter 101/106 via control signal lines 151/153/155.
- the management controller 110 is not connected to the PCI Express Switch 105 via the external ports 144 and 146.
- “P”, “A”, “P”, and “A” are recorded in the RP-A, RP-B, RP-C, and RP-D items of the input data 701, respectively.
- the management controller 110 is connected to the PCI Express Switch 105 of the PCI Express I / F adapter 101 via the control signal line 151.
- the management controller 110 is not connected to each PCI Express Switch 105 of the PCI Express I / F adapters 106 to 108.
- “P”, “A”, “A”, and “A” are recorded in the RP-A, RP-B, RP-C, and RP-D items of the input data 701, respectively.
- FIG. 8 is a diagram showing the configuration of the expected value table 507.
- the expected value table 507 is configuration management information that manages input data (input information, input data) 801, configuration setting values 802, VMODE setting values 803, and MUX setting values 804 in association with each other. Values are input in advance in each item of the expected value table 507. Unlike the input table 506, the items in the expected value table 507 are not updated even if the computer configuration changes.
- FIG. 6 is a flowchart showing a setting process of the PCI Express Switch 105 and the multiplexers 102 to 104.
- step 600 the management controller 110 starts setting processing of the PCI Express Switch 105 and the multiplexers 102 to 104.
- the start timing is, for example, when the computer is started, when the management controller 110 detects a change in the configuration of the computer, or when the management controller 110 receives a setting processing start request from a user, a management computer, or the like. .
- step 601 the detection unit 503 of the management controller 110 determines whether the PCI Express I / F adapters 101, 106, 107, and 108 are connected to the PCI Express Switch 105 via the control signal lines 151 to 155, respectively. To detect. Based on the detection result, the management controller 110 adds the PCI Express I / F adapters 101, 106, and 107 to the RP-A, RP-B, RP-C, and RP-D items of the input data 701 in the input table 506. Stores connection status information indicating whether or not each PCI Express Switch 105 is connected. As described above with reference to FIG. 7, the management controller 110 records, for example, “P (Present)” when connected, and records, for example, “A (Abent)” when not connected.
- step 602 the detection unit 503 of the management controller 110 compares the stored connection state information of the input data 701 with the input data 801 of the expected value table 507 to determine whether there is a configuration error.
- step 603 when the detection unit 503 of the management controller 110 determines that there is no configuration error, the processing of step 604 is executed. If the management controller 110 determines that there is a configuration error, the process ends in step 606.
- the case of a configuration error in the first embodiment is a case where the management controller 110 and the PCI Express Switch 105 of the PCI Express I / F adapter 101 are not connected.
- the case where there is no configuration error in the first embodiment is a case where the management controller 110 and the PCI Express Switch 105 of the PCI Express I / F adapter 101 are connected.
- step 601 the management controller 110 detects that it is not connected to the PCI Express Switch 105 of the PCI Express I / F adapter 101, and the RP-A item of the input data 701 is detected. Stores connection state information indicating that the connection is not established.
- step 602 the management controller 110 compares the connection state information of the input data 701 with the input data 801 of the expected value table 507 and detects a match. The management controller 110 detects a match with any of “# 9 to # 16” having connection state information indicating that the RP-A item of the input data 801 of the expected value table 507 is not connected. A configuration setting value 802 associated with the input data 801 is acquired. The management controller 110 acquires the configuration setting value 802 of “Error” in “# 9 to # 16”, and determines in step 603 that there is a configuration error.
- step 604 the detection unit 503 of the management controller 110 associates with the input data 801 that matches the connection status information of the input data 701 in the expected value table 507.
- 802 .VMODE setting value 803 and MUX setting value 804 are acquired and recorded in the configuration setting value 702, VMODE setting value 703 and MUX setting value 704 of the input table 506.
- step 605 the switch control unit 505 of the management controller 110 sets virtual switches in the PCI Express Switch 105 on the PCI Express I / F adapters 101 and 106 to 108 according to the value recorded in the VMODE setting value 703 of the input table 506. do.
- the VMODE setting values 703 and 803 indicate the number of virtual switches set in step 605.
- the MUX control unit 504 of the management controller 110 sets MUX B102, MUX C103, and MUX D104 on the PCI Express I / F adapter 101 according to the value recorded in the MUX setting value 704 of the input table 506.
- the management controller 110 ends the process.
- the management controller 110 causes the items of RP-A, RP-B, RP-C, and RP-D of the input data 701 to be “P” or the like. , Information indicating connection is recorded.
- step 604 the detection unit 503 sets “4to16” as the configuration setting value 802 of “# 1” associated with the input data 801 that matches the input data 701 in the expected value table 507, the VMODE setting value (the number of virtual switches) ) “1” as 803, “MUX B: EX, MUX C: EX, MUX D: EX” as MUX setting value 804, and configuration setting value 702, VMODE setting value 703, MUX setting value of input table 506 Record in 704 respectively.
- step 605 the switch control unit 505 follows the value “1” recorded in the VMODE setting value (number of virtual switches) 703 of the input table 506, in the PCI Express Switch on each of the PCI Express I / F adapters 101 and 106 to 108.
- 1 virtual switch (Virtual Switch) is set to exist.
- the switch control unit 505 transmits a request for setting the number of virtual switches to one to the PCI Express Switch 105 on each PCI Express I / F adapter 101.
- the PCI Express Switch 105 on each PCI Express I / F adapter 101 / 106-108 is set to have one virtual switch, for example, to create / delete a virtual switch.
- the MUX control unit 504 follows the values “MUX B: EX, MUX C: EX, MUX D: EX” recorded in the MUX setting value 704 of the input table 506, and the MUX B102 / MUX on the PCI Express I / F adapter 101.
- Set MUX C103 and MUX D104 Specifically, the MUX control unit 504 transmits requests to connect to the external ports 144, 145, and 146 to the MUX B102, MUX C103, and MUX D104, respectively.
- the MUX B102, MUX C103, and MUX D104 are set to connect to the external ports 144, 145, and 146, respectively, according to the received request.
- the corresponding multiplexer is connected to the external port, and if it is “IN”, the corresponding multiplexer is a PCI Express I / F adapter.
- a request from the MUX control unit 504 is transmitted so as to connect to the PCI Express Switch 105 on the terminal 101, and each multiplexer is set.
- the RP-A140, RP-B141, RP-C142, and RP-D143 of the I / O controller 100 are PCI on the PCI Express I / F adapters 101, 106, 107, and 108, respectively. It connects to the I / O devices 111 to 126 via one virtual switch of the Express Switch 105.
- the number of root ports to which the PCI Express Switch 105 on each PCI Express I / F adapter 101, 106 to 108 is connected is the same.
- the computer shown in FIG. 1 connects 16 I / O devices 111 to 126. can do. Therefore, the number of root ports and the number of connectable I / O devices are 4 and 16, respectively, and the number of connectable I / O devices with respect to the number of root ports is the configuration setting value 702 of the input table 506. The value recorded in “4to16” is obtained.
- the configuration setting values 702 and 802 indicate “number of root ports to number of connectable I / O devices”, that is, the number of connectable I / O devices with respect to the number of root ports.
- the management controller 110 causes the items of RP-A, RP-B, RP-C, and RP-D of the input data 701 to be “P”. “A”, “P”, and “A” are recorded respectively.
- step 604 the detection unit 503 sets “4to8” as the configuration setting value 802 of “# 6” associated with the input data 801 that matches the input data 701 in the expected value table 507, the VMODE setting value (the number of virtual switches) ) “2” as 803 and “MUX B: IN, MUX C: EX, MUX D: EX” as the MUX setting value 804 are acquired and the configuration setting value 702, VMODE setting value 703, and MUX setting value of the input table 506 are obtained. Record in 704 respectively.
- step 605 the switch control unit 505 follows the value “2” recorded in the VMODE setting value (number of virtual switches) 703 in the input table 506, and sets 2 in the PCI Express Switch 105 on each PCI Express I / F adapter 101/106. Configure so that there are two virtual switches.
- the MUX control unit 504 follows the values “MUX B: IN, MUX C: EX, MUX D: EX” recorded in the MUX setting value 704 of the input table 506, and the MUX B102 on the PCI Express I / F adapter 101. Set MUX C103 and MUX D104. Specifically, the MUX control unit 504 connects the MUX B102 to the PCI Express Switch 105 on the PCI Express I / F adapter 101, and requests the MUX C103 / MUX D104 to connect to the external ports 145 and 146, respectively. Send.
- the MUX B 102 connects to the PCI Express Switch 105 on the PCI Express I / F adapter 101 in accordance with the received request.
- the MUX C103 and MUX D104 connect to the external ports 145 and 146, respectively, according to the received request.
- the RP-A 140 and RP-B 141 of the I / O controller 100 are connected to the I / O device 111 via two virtual switches of the PCI Express Switch 105 of the PCI Express I / F adapter 101. Connect with ⁇ 114. Further, the RP-C 142 and RP-D 143 of the I / O controller 100 are connected to the I / O devices 115 to 118 via the two virtual switches of the PCI Express I / F adapter 106. The number of root ports to which the PCI Express Switch 105 on the PCI Express I / F adapters 101 and 106 are connected is the same.
- the computer shown in FIG. 2 connects eight I / O devices 111 to 118. be able to. Accordingly, the number of root ports and the number of connectable I / O devices are 4 and 8, respectively, and the number of connectable I / O devices with respect to the number of root ports is the configuration setting value 702 of the input table 506. The value recorded in “4 to 8” is obtained.
- the management controller 110 causes the items of RP-A, RP-B, RP-C, and RP-D of the input data 701 to be “P”. “A”, “A”, and “A” are recorded respectively.
- the detection unit 503 sets “4to4” as the configuration setting value 802 of “# 8” associated with the input data 801 that matches the input data 701 in the expected value table 507, and the VMODE setting value (number of virtual switches).
- step 605 the switch control unit 505 follows the value “4” recorded in the VMODE setting value (number of virtual switches) 703 of the input table 506, and four virtual switches in the PCI Express Switch on the PCI Express I / F adapter 101. Is set to exist.
- the MUX control unit 504 follows the values “MUX B: IN, MUX C: IN, MUX D: IN” recorded in the MUX setting value 704 of the input table 506 according to the MUX B102 / MUX B102 on the PCI Express I / F adapter 101.
- Set MUX C103 and MUX D104 Specifically, the MUX control unit 504 transmits a request to connect the MUX B102, MUX C103, and MUX D104 to the PCI Express Switch 105 on the PCI Express I / F adapter 101.
- the MUX B102 / MUX C103 / MUX D104 connects to the PCI Express Switch 105 on the PCI Express I / F adapter 101 in accordance with the received request.
- the RP-A140, RP-B141, RP-C142, and RP-D143 of the I / O controller 100 have four virtual switches of the PCI Express I / F adapter 101 and the PCI Express Switch105. Via the I / O devices 111 to 114. The number of root ports connected to the PCI Express Switch 105 on the PCI Express I / F adapter 101 is four.
- the computer shown in FIG. 3 can be connected to four I / O devices 111 to 114. it can. Therefore, the number of root ports and the number of connectable I / O devices are 4 and 4, respectively, and the number of connectable I / O devices with respect to the number of root ports is the configuration setting value 702 of the input table 506. The value recorded in “4 to 4” is obtained.
- the computer according to the second embodiment is configured such that the PCI Express I / F adapters 106 to 109 and the root ports 140 to 143 of the I / O controller 100 are connected without passing through the multiplexers 102 to 104 and the external ports 144 to 146. .
- FIG. 9 is a diagram illustrating a configuration of a computer according to the second embodiment.
- the configuration of the PCI Express I / F adapter 109 is the same as that of the PCI Express I / F adapter 106.
- the PCI Express I / F adapter 109 can be connected to the I / O devices 111 to 114, respectively.
- the PCI Express I / F adapter 109 does not need the multiplexers 102 to 104 inside.
- the root ports 140, 141, 142, and 143 are connected to the PCI Express Switch 105 of the PCI Express I / F adapter 109, 106, 107, and 108 through the signal line 150.
- the PCI Express Switch 105 can be connected to the I / O devices 111 to 126.
- the computer has an I / O controller 100, a PCI Express I / F adapter 106-109, a management controller 910, and I / O devices 111-126. In the configuration of the computer, some or all of the PCI Express I / F adapters 106 to 109 and the I / O devices 111 to 126 may not be included.
- the computer is connected to an external device via the I / O devices 111 to 126 and the network, and transmits / receives information (for example, input / output command / response to input / output command).
- PCI Express I / F adapters 106 to 109 each include a PCI Express Switch 105. Assuming that up to four I / O devices can be connected to each PCI Express I / F adapter 106-109, the computer shown in FIG. 9 can connect 16 I / O devices 111-126.
- the management controller 910 is connected to the PCI Express Switch 105 of each PCI Express I / F adapter 106 to 109 via control signal lines 151 to 155.
- the signal lines 150 or the control signal lines 151 to 155 can be connected to each other, but the signal line 150 and the control signal lines 151 to 155 are not connected.
- the signal line 150 is a cable or wiring on a printed circuit board that transmits information (for example, input / output command / response to input / output command) between the I / O controller 100 and the I / O devices 111 to 126.
- the control signal lines 151 to 155 are signal lines for transmitting control information between the management controller 910 and each PCI Express Switch 105.
- FIG. 10 is a diagram illustrating a first modification of the configuration of the computer according to the second embodiment.
- the computer shown in FIG. 10 will be described with respect to a different configuration compared to the computer shown in FIG. Neither the I / O controller 100 nor the management controller 910 of the computer shown in FIG. 10 is connected to the PCI Express I / F adapters 107 and 108.
- the RP-A 140 and the RP-B 141 are connected to the PCI Express Switch 105 of the PCI Express I / F adapter 109 through the signal line 150.
- the RP-C 142 and RP-D 143 are connected to the PCI Express Switch 105 of the PCI Express I / F adapter 106 through a signal line 150.
- the management controller 910 is connected to the PCI Express Switch 105 of the PCI Express I / F adapter 109 via the control signal lines 151 and 155.
- the management controller 910 is connected to the PCI Express Switch 105 of the PCI Express I / F adapter 106 through the control signal lines 153 and 155. Assuming that up to four I / O devices can be connected to each PCI Express I / F adapter 106/109, the computer shown in FIG. 10 can connect eight I / O devices 111-118.
- FIG. 11 is a diagram illustrating a second modification example of the configuration of the computer according to the second embodiment.
- the computer shown in FIG. 11 will be described with respect to a different configuration compared to the computer shown in FIG. Neither the I / O controller 100 nor the management controller 910 of the computer shown in FIG. 11 is connected to the PCI Express I / F adapters 106, 107, and 108.
- RP-A140, RP-B141, RP-C142, and RP-D143 are connected to the PCI Express Switch 105 of the PCI Express I / F adapter 109 via the signal line 150.
- the management controller 910 is connected to the PCI Express Switch 105 of the PCI Express I / F adapter 109 via the control signal lines 151 and 155. Assuming that up to four I / O devices can be connected to the PCI Express I / F adapter 109, the computer shown in FIG. 11 can connect four I / O devices 111 to 114.
- the I / O controller 100 and the management controller 910 are connected between the PCI Express I / F adapters 106 to 109.
- the connection between the signal line 150 and the control signal lines 151 to 154 may be changed.
- the computer is not limited to the configuration shown in FIGS.
- FIG. 12 is a diagram showing a configuration of the management controller 910.
- the management controller 910 is, for example, a BMC (Baseboard Management Controller) or a service processor (Service Processor: SVP).
- the management controller 910 has a CPU 1301 and a memory 1302.
- the CPU 1301 includes a detection unit 503 and a switch control unit 505 that controls the PCI Express switch 105.
- Each of the detection unit 503 and the switch control unit 505 may be hardware, or may be realized by software executed by the CPU 1301.
- the memory 1302 has an input table 1306 and an expected value table 1307.
- FIG. 14 is a diagram showing the configuration of the input table 1306.
- the input table 1306 is configuration setting information indicating the configuration of the computer.
- the input table 1306 manages input data 701, configuration setting values 702, and VMODE setting values 703 in association with each other. The value of each item of the input table 1306 changes depending on the configuration of the computer.
- the management controller 910 is connected to each PCI Express Switch 105 of the PCI Express I / F adapters 106 to 109 via the control signal lines 151 to 155.
- information indicating connection such as “P” is recorded.
- the management controller 910 is connected to each PCI Express Switch 105 of the PCI Express I / F adapter 109 and 106 through control signal lines 151, 153, and 155.
- the management controller 910 is not connected to each PCI Express Switch 105 of the PCI Express I / F adapter 107 or 108.
- “P”, “A”, “P”, and “A” are recorded in the RP-A, RP-B, RP-C, and RP-D items of the input data 701, respectively.
- the management controller 910 is connected to the PCI Express Switch 105 of the PCI Express I / F adapter 109.
- the management controller 910 is not connected to each PCI Express Switch 105 of the PCI Express I / F adapter 106-108.
- “P”, “A”, “A”, and “A” are recorded in the RP-A, RP-B, RP-C, and RP-D items of the input data 701, respectively.
- FIG. 15 is a diagram showing the configuration of the expected value table 1307.
- the expected value table 1307 is configuration management information for managing the input data 801, the configuration setting value 802, and the VMODE setting value 803 in association with each other. Values are input in advance in each item of the expected value table 1307. Unlike the input table 1306, the items in the expected value table 1307 are not updated even if the computer configuration changes.
- FIG. 13 is a flowchart showing a setting process of the PCI Express Switch 105.
- step 1400 the management controller 910 starts the setting process of the PCI Express Switch 105.
- This start timing is, for example, when the computer is started, when the management controller 910 detects a change in the configuration of the computer, or when the management controller 910 receives a setting processing start request from a user, a management computer, or the like. .
- Step 1401 the detection unit 503 of the management controller 910 detects whether or not each PCI Express Switch 105 of the PCI Express I / F adapter 106 to 109 is connected via the control signal lines 151 to 155. Based on the detection result, the management controller 910 adds the PCI Express I / F adapter 109, 106, 107 to each item of RP-A, RP-B, RP-C, RP-D of the input data 701 of the input table 1306. Stores connection status information indicating whether or not each PCI Express Switch 105 is connected.
- step 1402 the detection unit 503 of the management controller 910 compares the stored connection state information of the input data 701 with the input data 801 of the expected value table 1307 to determine whether there is a configuration error. If the detection unit 503 of the management controller 910 determines in step 1403 that there is no configuration error, the processing of step 1404 is executed. If the management controller 910 determines that there is a configuration error, the process ends in step 1406.
- the case of a configuration error in the second embodiment is a case where the management controller 910 is not connected to any PCI Express Switch 105.
- the case where there is no configuration error in the second embodiment is a case where the management controller 910 and at least one PCI Express Switch 105 are connected.
- step 1404 the detection unit 503 of the management controller 910 searches the expected value table 1307 for the configuration setting value 802 associated with the input data 801 that matches the connection status information of the input data 701.
- the VMODE setting value 803 is acquired and recorded in the configuration setting value 702 and the VMODE setting value 703 of the input table 1306.
- step 1405 the switch control unit 505 of the management controller 910 sets the PCI Express Switch 105 on each PCI Express I / F adapter 106 to 109 according to the value recorded in the VMODE setting value 703 of the input table 1306.
- step 1406 the management controller 910 ends the process.
- the management controller 910 causes the items of RP-A, RP-B, RP-C, and RP-D of the input data 701 to be “P”. Etc., information indicating connection is recorded.
- the detection unit 503 sets “4to16” as the configuration setting value 802 of “# 1” associated with the input data 801 that matches the input data 701 in the expected value table 1307, the VMODE setting value (the number of virtual switches) ) “1” is acquired as 803 and recorded in the configuration setting value 702 and the VMODE setting value 703 of the input table 1306.
- step 1405 the switch control unit 505 follows the value “1” recorded in the VMODE setting value (number of virtual switches) 703 in the input table 1306, and sets 1 in the PCI Express Switch 105 on each PCI Express I / F adapter 106 to 109.
- One virtual switch (Virtual Switch) is set to exist.
- the switch control unit 505 transmits a request for setting the number of virtual switches to one to the PCI Express Switch 105 on each of the PCI Express I / F adapters 106 to 109.
- the PCI Express Switch 105 on each PCI Express I / F adapter 106 to 109 is set to have one virtual switch, for example, to create or delete a virtual switch.
- RP-A140, RP-B141, RP-C142, and RP-D143 of the I / O controller 100 are PCI Express Switch 105 on the PCI Express I / F adapters 106 to 109, respectively.
- the I / O devices 111 to 126 are connected through one virtual switch.
- the number of root ports to which the PCI Express Switch 105 on each PCI Express I / F adapter 106 to 109 is connected is the same.
- the computer shown in FIG. 1 must connect 16 I / O devices 111-126. Can do. Accordingly, the number of root ports and the number of connectable I / O devices are 4 and 16, respectively, and the number of connectable I / O devices with respect to the number of root ports is the configuration setting value 702 of the input table 1306. The value recorded in “4to16” is obtained.
- the management controller 910 causes the items of RP-A, RP-B, RP-C, and RP-D of the input data 701 to be “P”. “A”, “P”, and “A” are recorded respectively.
- the detection unit 503 sets “4to8” as the configuration setting value 802 of “# 6” associated with the input data 801 that matches the input data 701 in the expected value table 1307 and “2” as the VMODE setting value 803. Are recorded in the configuration setting value 702 and the VMODE setting value 703 of the input table 506, respectively.
- step 1405 the switch control unit 505, according to the value “2” recorded in the VMODE setting value 703 of the input table 1306, there are two virtual switches in the PCI Express Switch 105 on each PCI Express I / F adapter 109/106.
- the RP-A 140 and RP-B 141 of the I / O controller 100 are connected to the I / O device 111 via two virtual switches of the PCI Express Switch 105 of the PCI Express I / F adapter 109. Connect with ⁇ 114. Further, the RP-C 142 and RP-D 143 of the I / O controller 100 are connected to the I / O devices 115 to 118 via two virtual switches of PCI Express Switch 105 of the PCI Express I / F adapter 106. The number of root ports to which the PCI Express Switch 105 on the PCI Express I / F adapter 109 or 106 is connected is the same.
- the computer shown in FIG. 10 must connect eight I / O devices 111 to 118. Can do. Therefore, the number of root ports and the number of connectable I / O devices are 4 and 8, respectively, and the number of connectable I / O devices with respect to the number of root ports is the configuration setting value 702 of the input table 1306. The value recorded in “4 to 8” is obtained.
- the management controller 910 causes the items of RP-A, RP-B, RP-C, and RP-D of the input data 701 to be “P”. “A”, “A”, and “A” are recorded respectively.
- the detection unit 503 sets “4to4” as the configuration setting value 802 of “# 8” associated with the input data 801 that matches the input data 701 in the expected value table 1307 and “4” as the VMODE setting value 803. Are recorded in the configuration setting value 702 and the VMODE setting value 703 of the input table 1306, respectively.
- step 1405 the switch control unit 505 follows the value “4” recorded in the VMODE setting value 703 of the input table 1306 so that there are four virtual switches in the PCI Express Switch 105 on the PCI Express I / F adapter 109. Set.
- RP-A140, RP-B141, RP-C142, and RP-D143 of the I / O controller 100 include four virtual switches of PCI Express I / F adapter 109 and PCI Express Switch105. Via the I / O devices 111 to 114. The number of root ports connected to the PCI Express Switch 105 on the PCI Express I / F adapter 109 is four.
- the computer shown in FIG. 11 can connect four I / O devices 111 to 114. Accordingly, the number of root ports and the number of connectable I / O devices are 4 and 4, respectively, and the number of connectable I / O devices with respect to the number of root ports is the configuration setting value 702 of the input table 1306. The value recorded in “4 to 4” is obtained.
- the root ports 140 to 143 of the I / O controller 100 are connected via the PCI Express Switch 105 according to the number of the PCI Express Switch 105 to which the I / O controller 100 is connected.
- the PCI Express Switch 105 or the multiplexers 102 to 104 can be automatically set so that the maximum number of I / O devices to be obtained is the same. Therefore, the throughput can be improved while improving the throughput bias between the root ports or between the I / O devices.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Computer Hardware Design (AREA)
- Multi Processors (AREA)
- Bus Control (AREA)
Abstract
Description
Claims (8)
- 1以上のI/Oスイッチと、
前記1以上のI/Oスイッチと接続する1以上のI/Oデバイスと、
前記1以上のI/Oスイッチとの接続状態と仮想スイッチの数とを対応づけて管理する構成管理情報を記憶し、
前記1以上のI/Oスイッチとの接続状態を検出し、前記構成管理情報を参照して、前記検出したI/Oスイッチとの接続状態と対応づけられた前記仮想スイッチの数を取得し、
前記1以上のI/Oスイッチのうち、接続するI/Oスイッチ毎に、前記取得した数の仮想スイッチを設定するマネジメントコントローラと、
前記設定された仮想スイッチを介して、前記1以上のI/Oデバイスと接続する複数のポートを有するI/Oコントローラと、
を備える計算機。 - 請求項1記載の計算機であって、
各I/Oスイッチと接続する前記ポートの数は同じであることを特徴とする計算機。 - 請求項2記載の計算機であって、
前記ポート及び前記I/Oスイッチと接続するマルチプレクサを有し、
前記マネジメントコントローラは、各I/Oスイッチと接続する前記ポートの数が同じとなるように、前記マルチプレクサと前記仮想スイッチとを設定することを特徴とする計算機。 - 請求項3記載の計算機であって、
前記構成管理情報は、前記1以上のI/Oスイッチとの接続状態と、前記仮想スイッチの数と、前記マルチプレクサの設定と、を対応づけて管理し、
前記マネジメントコントローラは、前記1以上のI/Oスイッチとの接続状態を検出し、前記構成管理情報を参照して、前記検出したI/Oスイッチとの接続状態と対応づけられた前記仮想スイッチの数及び前記マルチプレクサの設定を取得し、
前記取得した前記仮想スイッチの数及び前記マルチプレクサの設定に基づき、各I/Oスイッチと接続する前記ポートの数が同じとなるように、前記マルチプレクサと前記仮想スイッチとを設定することを特徴とする計算機。 - 1以上のI/Oスイッチと、前記1以上のI/Oスイッチと接続する1以上のI/Oデバイスと、マネジメントコントローラと、I/Oコントローラと、を備える計算機のI/Oスイッチの制御方法であって、
前記マネジメントコントローラにより、前記1以上のI/Oスイッチとの接続状態を検出するステップと、
前記マネジメントコントローラにより、前記1以上のI/Oスイッチとの接続状態と仮想スイッチの数とを対応づけて管理する構成管理情報を参照して、前記検出したI/Oスイッチとの接続状態と対応づけられた前記仮想スイッチの数を取得するステップと、
前記マネジメントコントローラにより、前記1以上のI/Oスイッチのうち、接続するI/Oスイッチ毎に、前記取得した数の仮想スイッチを設定し、
前記設定された仮想スイッチを介して、前記I/Oコントローラの各ポートが前記1以上のI/Oデバイスと接続するステップと、
を備えるI/Oスイッチの制御方法。 - 請求項5記載のI/Oスイッチの制御方法であって、
前記I/Oコントローラは複数のポートを有し、
各I/Oスイッチと接続する前記ポートの数が同じであることを特徴とするI/Oスイッチの制御方法。 - 請求項6記載のI/Oスイッチの制御方法であって、
前記ポート及び前記I/Oスイッチと接続するマルチプレクサを有し、
前記マネジメントコントローラにより、各I/Oスイッチと接続する前記ポートの数が同じとなるように、前記マルチプレクサと前記仮想スイッチとを設定するステップを、
さらに有することを特徴とするI/Oスイッチの制御方法。 - 請求項7記載のI/Oスイッチの制御方法であって、
前記構成管理情報は、前記1以上のI/Oスイッチとの接続状態と、前記仮想スイッチの数と、前記マルチプレクサの設定と、を対応づけて管理し、
前記マネジメントコントローラは、前記1以上のI/Oスイッチとの接続状態を検出し、前記構成管理情報を参照して、前記検出したI/Oスイッチとの接続状態と対応づけられた前記仮想スイッチの数及び前記マルチプレクサの設定を取得し、
前記仮想スイッチの数及び前記マルチプレクサの設定に基づき、各I/Oスイッチと接続する前記ポートの数が同じとなるように、前記マルチプレクサと前記仮想スイッチとを設定することを特徴とするI/Oスイッチの制御方法。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2014/061650 WO2015162774A1 (ja) | 2014-04-25 | 2014-04-25 | 計算機、計算機のi/oスイッチの制御方法 |
US15/122,546 US10073801B2 (en) | 2014-04-25 | 2014-04-25 | Computer and method of controlling I/O switch of computer |
JP2016514656A JP6175186B2 (ja) | 2014-04-25 | 2014-04-25 | 計算機、計算機のi/oスイッチの制御方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2014/061650 WO2015162774A1 (ja) | 2014-04-25 | 2014-04-25 | 計算機、計算機のi/oスイッチの制御方法 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2015162774A1 true WO2015162774A1 (ja) | 2015-10-29 |
Family
ID=54331961
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2014/061650 WO2015162774A1 (ja) | 2014-04-25 | 2014-04-25 | 計算機、計算機のi/oスイッチの制御方法 |
Country Status (3)
Country | Link |
---|---|
US (1) | US10073801B2 (ja) |
JP (1) | JP6175186B2 (ja) |
WO (1) | WO2015162774A1 (ja) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2020119498A (ja) * | 2019-01-28 | 2020-08-06 | 廣達電腦股▲ふん▼有限公司Quanta Computer Inc. | フレキシブルなpcieトポロジー |
CN113612704A (zh) * | 2021-07-13 | 2021-11-05 | 华东计算技术研究所(中国电子科技集团公司第三十二研究所) | 基于拟态交换机的combo接口及拟态交换机 |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108983666B (zh) * | 2018-07-27 | 2019-11-08 | 青岛海信日立空调系统有限公司 | 控制电路及控制方法 |
US11481296B2 (en) * | 2018-09-10 | 2022-10-25 | International Business Machines Corporation | Detecting configuration errors in multiport I/O cards with simultaneous multi-processing |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2009175913A (ja) * | 2008-01-23 | 2009-08-06 | Hitachi Ltd | 計算機システム、管理サーバ、および、不一致接続構成検知方法 |
WO2011151930A1 (ja) * | 2010-06-01 | 2011-12-08 | 株式会社日立製作所 | I/oデバイス管理方法、計算機システム及びi/oデバイス管理プログラム |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TW547713U (en) * | 2002-06-05 | 2003-08-11 | C One Technology Corp | Multi-functional electronic card with multi-I/O interface |
US7415551B2 (en) * | 2003-08-18 | 2008-08-19 | Dell Products L.P. | Multi-host virtual bridge input-output resource switch |
US7356636B2 (en) * | 2005-04-22 | 2008-04-08 | Sun Microsystems, Inc. | Virtualized PCI switch |
JP5111236B2 (ja) | 2008-05-22 | 2013-01-09 | 株式会社日立製作所 | データ転送システム |
JP5069732B2 (ja) * | 2009-10-05 | 2012-11-07 | 株式会社日立製作所 | 計算機装置、計算機システム、アダプタ承継方法 |
US8767529B2 (en) * | 2011-09-12 | 2014-07-01 | International Business Machines Corporation | High availability distributed fabric protocol (DFP) switching network architecture |
US8806025B2 (en) * | 2012-06-25 | 2014-08-12 | Advanced Micro Devices, Inc. | Systems and methods for input/output virtualization |
-
2014
- 2014-04-25 JP JP2016514656A patent/JP6175186B2/ja not_active Expired - Fee Related
- 2014-04-25 WO PCT/JP2014/061650 patent/WO2015162774A1/ja active Application Filing
- 2014-04-25 US US15/122,546 patent/US10073801B2/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2009175913A (ja) * | 2008-01-23 | 2009-08-06 | Hitachi Ltd | 計算機システム、管理サーバ、および、不一致接続構成検知方法 |
WO2011151930A1 (ja) * | 2010-06-01 | 2011-12-08 | 株式会社日立製作所 | I/oデバイス管理方法、計算機システム及びi/oデバイス管理プログラム |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2020119498A (ja) * | 2019-01-28 | 2020-08-06 | 廣達電腦股▲ふん▼有限公司Quanta Computer Inc. | フレキシブルなpcieトポロジー |
CN113612704A (zh) * | 2021-07-13 | 2021-11-05 | 华东计算技术研究所(中国电子科技集团公司第三十二研究所) | 基于拟态交换机的combo接口及拟态交换机 |
Also Published As
Publication number | Publication date |
---|---|
US10073801B2 (en) | 2018-09-11 |
JP6175186B2 (ja) | 2017-08-02 |
JPWO2015162774A1 (ja) | 2017-04-13 |
US20170091134A1 (en) | 2017-03-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
TWI423039B (zh) | 伺服器系統與其操作方法 | |
US9858238B2 (en) | Dual mode USB and serial console port | |
US10127170B2 (en) | High density serial over LAN management system | |
US10515040B2 (en) | Data bus host and controller switch | |
JP5844303B2 (ja) | ポートのルーティング属性を自己設定する、シリアル接続scsiエキスパンダのための方法および構造 | |
US9866548B2 (en) | Authentication-free configuration for service controllers | |
US7694029B2 (en) | Detecting miscabling in a storage area network | |
US7490176B2 (en) | Serial attached SCSI backplane and detection system thereof | |
WO2021134928A1 (zh) | 基于p2p网络的数据传输方法、设备、系统、装置及介质 | |
JP6175186B2 (ja) | 計算機、計算機のi/oスイッチの制御方法 | |
US11736741B2 (en) | Ultra high-speed low-latency network storage | |
US20120239789A1 (en) | Storage device, controller, and address management method | |
JP2013084266A (ja) | サーバー及びそのシリアルインタフェース切換回路 | |
US20150186317A1 (en) | Method and apparatus for detecting the initiator/target orientation of a smart bridge | |
US9081614B2 (en) | Managing shared resources in a multi-computer system with failover support | |
CN107818061B (zh) | 关联外围设备的数据总线和管理总线 | |
WO2022100311A1 (zh) | 一种服务器的peci信号互联方法、系统、设备以及介质 | |
US11102300B2 (en) | SAN advisory based on latency | |
US20150074303A1 (en) | Virtual Media apparatus of a Server and Access Method Thereof | |
US20130151813A1 (en) | Switch system for dual central processing units | |
CN109697180B (zh) | 硬件资源扩充系统 | |
TWI831190B (zh) | 資料中心安全控制模組及其控制方法 | |
TWI658367B (zh) | 硬體資源擴充系統 | |
TW201510929A (zh) | 圖像輸出控制系統及方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14890310 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2016514656 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 15122546 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 14890310 Country of ref document: EP Kind code of ref document: A1 |