JP6052089B2 - Hybrid computer system - Google Patents

Description

  The present invention relates to a hybrid computer system.

  The PCI (Peripheral Component Interconnect) bus is widely adopted as a standard bus for adding expansion cards such as personal computers, workstations, servers, and office computers.

  The PCI bus originally appeared as a 32-bit or 64-bit parallel interface, but has evolved into PCI-Express in response to a demand for higher speed.

  The PCI bus has a hierarchical structure in which one host controller is at the top and the layers are connected by a PCI-PCI bridge. The PCI-PCI bridge usually has two or more ports, but the host controller side port is called Upstream (upstream port), and the port opposite to the host controller is called Downstream port (downstream port). Each endpoint has an area, and each area is assigned within one PCI space.

  The host controller allocates the area of each endpoint in the PCI space at the start initialization. The PCI space allocation work at the time of initialization is referred to as PCI configuration. Access for assigning each endpoint is called configuration access. Only the host controller performs configuration access.

  In the case of normal access (memory or IO access), the PCI-PCI bridge passes in any direction from the upstream port to the downstream port and from the downstream port to the upstream port. Pass only the direction.

  As described above, since the PCI-PCI bridge has one host controller as the apex, normally two host controllers cannot share one PCI space.

  However, if a PCI-PCI non-transparent bridge (Non-Transparent Bridge: hereinafter referred to as NTBridge) is used, the PCI space can be separated into two and each PCI space can be managed by two host controllers.

  FIG. 5 shows an example of a system configuration using NTB. FIG. 6 shows allocation of each PCI space in the configuration of FIG.

  In the PCI space 1, a CPU 1, a host controller 1, and a system memory 1 are provided, and an endpoint is provided below the hierarchical structure.

  The PCI space 2 includes a CPU 2, a host controller 2, and a system memory 2, and an endpoint is provided below the hierarchical structure. The PCI space 1 and the PCI space 2 are connected by NTBridge. That is, the host controller 1 in the PCI space 1 and the NT Bridge are connected by the port 1 of the NT Bridge, and the host controller 2 in the PCI space 2 and the NT Bridge are connected by the port 2.

  With normal access (memory or IO access), each endpoint can be accessed through NTBridge. On the other hand, NTBridge does not allow configuration access. That is, the host controller 1 needs to configure the port on the PCI space 1 side, and the host controller 2 needs to configure the port on the PCI space 2 side.

JP 2009-169842 A

  In the case of a conventional system using NTBridge as shown in FIG. 5, since the power source is common, power is simultaneously supplied from the power source 1 to the two spaces of the PCI space 1 and the PCI space 2. When the PCI configuration of the PCI space 1 and the PCI space 2 proceeds, no problem occurs because power is already supplied to all the PCI devices.

  By the way, PCI Express, which is high-speed serial transfer, can be extended to the outside by a cable, and this specification is standardized by PCI-SIG “PCI Express External Cabling Specification”.

  When this PCI-Express cabling technology is used, the PCI-Express interface itself is an interface that many computers such as personal computers and servers have as a standard, so there is no need to use a special controller. Can be realized at a relatively low cost. On the other hand, since each computer has an independent PCI space, NTBridge is required in order to connect two or more personal computers or servers by PCI-Express.

  FIG. 7 shows a configuration when two computers are connected via NTBridge. The computer 1 and the computer 2 are connected by a PCI-Express cable 102 via an NTBridge 1 mounted on the computer 1. What is important in this case is the power-on sequence.

  In the system of FIG. 7, it is necessary to turn on the computer 2 after the power supply 1 of the computer 1 on which NTBridge 1 is mounted is first turned on, the power is supplied to NTBridge 1, and NTBridge itself is internally initialized. .

  If the power of the computer 2 is turned on first, when the PCI configuration of the PCI space 2 is started, the power is not yet supplied to the NTBridge 1 mounted on the computer 1 side, and the NTBridge 1-external port Since (External port) cannot be detected, the NTBridge-external port PCI configuration of the PCI space 2 cannot be performed. For this reason, PCI access via the NTBridge 1 cannot be performed between the computer 1 and the computer 2.

  When there are more than two computers connected, the problem of the order of entry becomes more difficult.

  For example, as shown in FIGS. 8A and 8B, when four computers 1, 2, 3, 4 are connected, it is necessary to turn on the power in the order of computer 1 → computer 2 → computer 3 → computer 4. is there.

  As described above, in connection with PCI Express using NTBridge, the power-on sequence is strict and difficult to understand. Therefore, when the power is turned on one by one by the user, there is a problem that an error is likely to occur.

  An object of the present invention is to facilitate normal startup by facilitating power-on operation in a computer system in which a plurality of computers are connected by PCI-Express using NTBridge.

  The invention according to claim 1 is integrated and implemented in any one of a plurality of computers and the plurality of computers, and power is supplied to all of the computers when the power is turned on. A plurality of PCI-PCI non-transparent bridges, and among the plurality of computers, other computers other than the one of the computers use the plurality of PCI-PCI non-transparent bridges. This is a composite computer system connected to such a computer by a PCI-Express cable.

  The invention according to claim 2 is the composite computer system according to claim 1, wherein the plurality of PCI-PCI non-transparent bridges are collectively mounted on an expansion device connected to any one of the computers. It is.

  According to a third aspect of the present invention, any one of the plurality of computers receives a control signal for powering on another computer that has not been powered on after the power is turned on. The composite computer system according to claim 1, wherein the composite computer system transmits to another computer.

  The invention according to claim 4 is the case where, among the plurality of computers, the other computer is turned on before the power of any one of the computers is turned on. The power supply of any one of the computers is turned off and then turned on again when the PCI-PCI non-transparent bridge of one computer is not detected. This is a hybrid computer system.

  According to the first aspect of the present invention, the system is normally activated by first turning on the power of one of the plurality of computers.

  According to the second aspect of the present invention, even if the number of mounting slots of one of the plurality of computers is limited, the plurality of PCI-PCI non-transparent bridges are aggregated without being limited thereto. obtain.

  According to the third aspect of the present invention, when one of the plurality of computers is turned on, the other computers are also automatically turned on to facilitate the power-on operation.

  According to the fourth aspect of the present invention, even if the computer to be powered on first is mistaken, it is automatically corrected or repaired, and the system is started normally.

It is a system configuration figure of an embodiment. It is a system configuration figure of other embodiments. It is a system configuration figure of other embodiments. It is a system configuration figure of other embodiments. It is a system block diagram of a prior art. It is system explanatory drawing of a prior art. It is system explanatory drawing of a prior art. It is system explanatory drawing of a prior art.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the present embodiment, a PCI-PCI non-transparent bridge used as a bus connection circuit is referred to as NTBridge.

  In general, a PCI-PCI bus bridge that connects two independent PCI buses is known as a bus bridge, and there are a transparent bus bridge and a non-transparent bus bridge. In the transparent PCI-PCI bus bridge, the addresses of the primary bus and the secondary bus exist in the same memory space.

  On the other hand, in the non-transparent PCI-PCI bus bridge, the addresses of the primary bus and the secondary bus exist in different memory spaces. In the non-transparent PCI-PCI bus bridge, a transaction from the primary bus is transmitted to the secondary bus by performing address conversion. In the present embodiment, such a non-transparent PCI-PCI bus bridge is referred to as “PCI-PCI non-transparent bridge” or “NTBridge”.

  When the two computers 1 and 2 are connected by NTBridge, the PCI space in the computer 1 and the PCI space in the computer 2 are separated into two, and each PCI is connected by a host controller provided in each computer 1 and 2. You can manage the space. As shown in FIG. 6 or FIG. 7, in the case of normal access, that is, memory access or IO access, the mutual endpoints can be accessed through NTBridge. The computer 1 is provided with a CPU 1, a host controller 1, a system memory 1, an end point graphic controller, and an end point RAID controller, and the computer 2 is provided with a CPU 2, a host controller 2, a system memory 2, an end point Ethernet (registered trademark) controller, and an end point When a USB controller, an endpoint audio controller, and an endpoint SMBus controller are provided, the host controller 1 can access the graphic controller and RAID controller in its own PCI space, as well as the PCI space of the computer 2. It is also possible to access the system memory 2, Ethernet controller, and USB controller. The host controller 2 can access the Ethernet controller, USB controller, audio controller, and SMBus controller in its own PCI space, as well as the system memory 1, graphic controller, RAID in the PCI space of the computer 1. You can also access the controller.

  However, NTBridge does not pass configuration access. The host controller 1 needs to configure the PCI space side port of the computer 1 and the host controller 2 needs to configure the PCI space side port of the computer 2. Therefore, when NTBridge is mounted on the computer 1, in order for the computer 2 to access the system memory 1, the graphic controller, and the RAID controller of the computer 1, the computer 1 is first turned on and mounted on the computer 1. It is necessary that power is supplied to the NTBridge and the NTBridge port is configured. In consideration of this point, the present embodiment has a system configuration capable of facilitating the first power-on of the computer on which NTBridge is mounted.

  FIG. 1 shows a configuration block diagram of a composite computer system 1 in the present embodiment. In this system, a plurality of computers 1, 2, 3, and 4 are connected to each other by PCI-Express. Here, PCI-Express means a serial transfer interface for personal computers established by PCI-SIG, and may be expressed as PCIe. PCI-Express is a full-duplex method in which transmission and reception are separated, and a data transfer method is performed by packet transmission / reception in a network. For this reason, the PCI-Express architecture has a layer structure. The layer structure is a three-layer structure including a transaction layer, a data link layer, and a physical layer. Taking transmission as an example, a request issued from the CPU or another device is added with a packet providing a function compatible with PCI to the upper software layer in the transaction layer and passed to the data link layer. The transaction layer supports four address spaces: a memory space, an IO space, a configuration space, and a message space. The memory space, the IO space, and the configuration space are PCI bus compatible spaces. The message space is used for interrupts, power control notifications, and the like. The data link layer is responsible for transmission / reception control between connected counterpart devices, and adds a sequence number or CRC to the packet and passes it to the physical layer. The physical layer is the part responsible for serial transfer, and sends packets as serial data.

  When the system shown in FIG. 1 is compared with the system shown in FIG. 8, in the system shown in FIG. 8, NTBridge is distributed among a plurality of computers. However, in the system shown in FIG. Provided. That is, NTBridge 10, 12, and 14 are mounted on the computer 1. The computer 2 is connected to the NTBridge 10 of the computer 1 by a PCI-Express cable 102. The computer 3 is connected to the NTBridge 12 of the computer 1 by a PCI-Express cable 103. The computer 4 is connected to the NTBridge 14 of the computer 1 by a PCI-Express cable 104.

  When connecting a computer via NTBridge, it is necessary to first turn on the power of the computer on which NTBridge is mounted as described above. In the system of FIG. 1, NTBridges 10, 12, and 14 are integrated in the computer 1. Since they are concentrated in one power source area, that is, the power source area of the computer 1, when the computer 1 is turned on, power is supplied to all the NT Bridges 10, 12, and 14 simultaneously. Then, the internal initialization of these NTBridges 10, 12, and 14 is completed, and the external port of NTBridge 10, the external port of NTBridge 12, and the external port of NTBridge 14 are detected. It will suffice if they are introduced sequentially.

  FIG. 2 shows a configuration block diagram of a composite computer system 1 according to another embodiment. In the system of FIG. 1, NTBridges 10, 12, and 14 are integrated and mounted on a single computer 1. However, even if a plurality of NTBridges are concentrated in one computer, more specifically in one power supply area, the computer It may be limited to the number of PCI-Express mounting slots of the main body.

  Therefore, when the number of slots is limited as described above, as shown in FIG. 2, the number of PCI-Express mounting slots may be expanded using the PCI-Extension Box 16, and the necessary number of NT Bridges may be mounted. .

  In FIG. 2, a PCI-Extension Box 16 is connected to the computer 1, and NTBridges 10, 12, and 14 are mounted on the PCI Extension Box 16. The PCI-Extension Box 16 is supplied with power from the computer 1, and when the computer 1 is turned on, power is also supplied to the NT Bridges 10, 12, and 14 of the PCI-Extension Box 16 at the same time. The computer 2 is connected to the NTBridge 10 with a PCI-Express cable 102. The computer 3 is connected to the NTBridge 12 with a PCI-Express cable 103. The computer 4 is connected to the NTBridge 14 with a PCI-Express cable 104.

  Also in this configuration, when the computer 1 is turned on, the power is supplied to all the NTBridges 10, 12, and 14 simultaneously. Then, the internal initialization of these NTBridges 10, 12, and 14 is completed, and the external port of NTBridge 10, the external port of NTBridge 12, and the external port of NTBridge 14 are detected. It is sufficient to input them sequentially.

  In the system shown in FIGS. 1 and 2, NTBridge is consolidated on one computer. First, the computer on which NTBridge is aggregated and mounted is turned on, and NTBridge is turned on to complete internal initialization. When the configuration access to the external port of NTBridge is accepted, the other computer connected to the computer is turned on, but the user turns on the other computer. Instead of this, a configuration may be adopted in which the power of another computer is automatically turned on.

  FIG. 3 shows a system configuration in this case. An NTBridge 10 is mounted on the computer 1, and the computer 2 is connected to the NTBridge 10 of the computer 1. Of course, as shown in FIG. 1 or FIG. 2, another computer 3, 4 may be connected to the computer 1.

  When the user turns on the power of the computer 1, the power is supplied to the NTBridge 10, and when the internal initialization of the NTBridge is completed and the configuration access to the external port is accepted, the CPU of the computer 1 A WAKE # signal is assigned to the Express cable, and a WAKE signal conforming to the PCI-Express standard is transmitted to the computer 2. The CPU of the computer 2 turns on its own power by receiving the WAKE signal. Thus, the user need only turn on the computer 1 without turning on the computer 2.

  On the other hand, some computers 2 may not support WAKE. In this case, a configuration in which the power switch is shared between the computer 1 and the computer 2 is preferable. Alternatively, the computer 1 and the computer 2 may be connected by a PCI-Express cable and also connected by the Ethernet 28, and the power of the computer 2 may be automatically turned on using a WAKEonLAN MagicPacket on the Ethernet 28.

  In the configuration of FIGS. 1 to 3, a case has been described in which the computer 1 is first turned on and then the other computers connected to the computer 1 are turned on manually or automatically. There may be a case where a computer other than the computer 1 is erroneously turned on. In preparation for this case, it is also preferable to provide some means.

  FIG. 4 shows a system configuration in another embodiment. As in FIG. 1, NTBridges 10, 12, and 14 are integrated in the computer 1, the computer 2 is connected to the NTBridge 10 through the PCI-Express cable 102, and the computer 3 is connected to the NTBridge 12 through the PCI-Express cable 103, and the computer 4 is connected to the NTBridge 14 by a PCI-Express cable 104.

  On the other hand, the LAN port 20 of the computer 1, the LAN port 22 of the computer 2, the LAN port 24 of the computer 3, and the LAN port 26 of the computer 4 are connected to the Ethernet 28, respectively.

  The correct procedure is to first turn on the computer 1 and then the computers 2, 3 and 4 (the order of turning on the computers 2, 3 and 4 is arbitrary), but the user accidentally turns on the computer 2 first, Assume that the computer 1 is powered on and then the computers 3 and 4 are powered on.

  In this case, there is no problem because the computer 1, the computer 3 and the computer 4 are powered on in the correct order, but the computer 1 and the computer 2 are in the wrong power-on sequence, and the PCI configuration of the computer 2 is started. Sometimes, power is not yet supplied to the NTBridge 10 mounted on the computer 1 and an external port cannot be detected, so that PCI configuration cannot be performed. In short, the computer 2 cannot see the NTBridge 10 of the computer 1.

  Therefore, using all the computers 1, 2, 3, and 4 connected by the Ethernet 28, the CPU of the computer 2 can use the NTBridge (NTB) of the computer 1 even though the computer 1 is activated. If the port is not detected, turn it off and then on again. As a result, the computer 2 is also turned on after the computer 1 is turned on, and the PCI configuration is performed with the NTBridge 10 visible.

  The same applies to the case where the computer 3 or the computer 4 is turned on before the computer 1. After all the computers are turned on, the computers 3 and 4 may be turned on automatically.

  As described above, in this embodiment, the NTBridge is concentrated in one power supply area, thereby facilitating the power-on procedure in a computer system in which a plurality of computers are connected by PCI-Express.

  Further, by automating the power-on of other computers connected to the computer on which NTBridge is consolidated, the power-on procedure is further facilitated. It should be noted that unless the computer connected to the NTBridge consolidated computer is first turned on, such automatic power-on is not executed, so the user automatically turned on the other computer. Thus, it is possible to recognize that the power of a specific computer has been turned on in the correct procedure.

  Further, when the power-on procedure is incorrect, the computer is automatically turned on again, thereby further facilitating and ensuring the power-on procedure and improving user convenience.

  As mentioned above, although embodiment of this invention was described, this invention is not limited to this, A various deformation | transformation is possible.

  For example, in the configuration of FIG. 4, if the user accidentally turns on the computer 2 before the computer 1, the computer 2 automatically turns on the power again. It is preferable to turn on the power again after displaying a message that the power-on sequence is wrong and that the power is turned on again.

  Moreover, you may combine the structure of FIG. 3 and the structure of FIG. That is, in the configuration of FIG. 4, when the power of the computer 1 is first turned on, the CPU of the computer 1 assigns the WAKE # signal to the PCI-Express cable and uses the WAKE to power the computers 2, 3, and 4. Is automatically entered. On the other hand, when a computer other than the computer 1, for example, the computer 2 is first turned on and then the computer 1 is turned on, the computer 1 automatically turns on the computers 3 and 4 using WAKE. The computer 2 is turned on again after being turned off. As a result, the computers 2, 3, and 4 are all automatically turned on in the end, and are turned on in the correct order.

  DESCRIPTION OF SYMBOLS 1 Compound computer system 10, 12, 14 PCI-PCI non-transparent bridge (NTBridge), 16 PCI Extension BOX, 20, 22, 24, 26 LAN port, 28 Ethernet, 102, 103, 104 PCI-Express cable.

Claims (4)

Multiple computers,
A plurality of PCI-PCI non-transparent bridges, which are integrated and mounted on any one of the plurality of computers, and all of the computers are supplied with power when the power is turned on;
Among the plurality of computers, computers other than the one computer are connected to the one computer by a PCI-Express cable using the plurality of PCI-PCI non-transparent bridges. A compound computer system.   The composite computer system according to claim 1, wherein the plurality of PCI-PCI non-transparent bridges are collectively mounted on an expansion device connected to any one of the computers.   The one of the plurality of computers, after the power is turned on, transmits a control signal for powering on another computer that has not been powered on yet to another computer. 3. A composite computer system according to any one of the above.   Among the plurality of computers, the other computer has its own power turned on before any one of the computers is turned on, and the PCI-PCI non-transparent of any one of the computers. 3. The composite computer system according to claim 1, wherein when a type bridge is not detected, the power source of any one of the computers is turned on and then turned off and turned on again.

Images