CN100586105C

CN100586105C - Message forwarding method, system and device

Info

Publication number: CN100586105C
Application number: CN200710098165A
Authority: CN
Inventors: 赵汉表; 郑炜
Original assignee: Hangzhou H3C Technologies Co Ltd
Current assignee: New H3C Technologies Co Ltd
Priority date: 2007-04-20
Filing date: 2007-04-20
Publication date: 2010-01-27
Anticipated expiration: 2027-04-20
Also published as: CN101035087A

Abstract

The invention provides a message transmitting method, comprising: building IPoIB subinterfaces under IPoIB master interface of IB-Eth gateway, where an IPoIB subinterface is bound with an Ethernet interface IP address and Ethernet address handle corresponding to the IP address; IB side sends IP message, which is to be sent to the Ethernet interface or other equipment through the Ethernet interface, to the IPoIB subinterface bound with the Ethernet interface IP address; the IPoIB subinterface receives the IP message and then transmits the IP message to the corresponding Ethernet interface to an Ethernet interface IP address that it is bound with. In addition, the invention provides a message transmitting system and device. And the invention can save the processing time for message transmission on IB-Eth gateway, speeding up message transmission and thus raising the message transmitting efficiency of the IB-Eth gateway.

Description

Message forwarding method, system and equipment

Technical field

The present invention relates to field of data transmission, relate in particular to a kind of message forwarding method, system and equipment.

Background technology

IB (Infiniband) is a kind of based on I/O system passage, that adopt switching fabric, is mainly used in the communication of server field, comprises communicating by letter between server and server, server and memory device and server and the network.Transmission IP message protocol (IPoIB on IB, IP over Infiniband) is the agreement of formulating for the compatibility that realizes Infiniband network and transmission control protocol (TCP)/Internet protocol (IP) network, described by the Infiniband transmit IP message, making the main frame of (HCA) card that has host channel adapter is that the IB main frame visits internet (Internet) by the IPoIB agreement.IPoIB encapsulates the TCP/IP packet by corrupt data bag (UD) the transport layer protocol bearing IP packet of Infiniband system on the load data section of UD frame.Figure 1 shows that the concrete form of IPoIB frame, mainly comprise IB frame head, postamble and load three parts, wherein, top guide and IP/ ARP(Address Resolution Protocol) message two parts before IB load is divided into again comprise type (Type) field and reservation (Reserved) field in the preceding top guide.

In IPoIB, IB-Ethernet (IB-Ethernet) gateway, hereinafter to be referred as the IB-Eth gateway, be mainly used in and realize 2 layers of function of exchange, be responsible for IPoIB frame and the mutual conversion between the IP message that transmits on the Ethernet (IP over Ethernet) frame and also transmit, thereby make and to utilize the IP message to carry out mutual communication between IB main frame and the Ethernet main frame.The typical networking of IB-Eth gateway as shown in Figure 2.The IP message mainly may further comprise the steps at the concrete exchange process on the IB-Eth gateway: when the IB-Eth gateway receives the IPoIB message that the IB side sends over, at first handle by hardware and software, make this message only keep the IP data segment, next analyzes the purpose IP address in this IP data segment, the purpose Ethernet address handle that address search is bound with it according to purpose IP, this Ethernet address handle comprises information such as the Ethernet outgoing interface of this message and Ethernet purpose medium access control (MAC) address, and then this IP data segment is added 2 layers of frame head of Ethernet with this information, be packaged into the Ethernet frame format, and be forwarded to the Ethernet outgoing interface of appointment, thereby this IP message is received by final purpose Ethernet main frame; On the contrary, when the IB-Eth gateway receives the IP over Ethernet that the Ethernet side sends over, at first handle by hardware and software, make this message only keep the IP data segment, next analyzes the purpose IP address in this IP data segment, the purpose IB address handle that address search is bound with it according to purpose IP, this IB address handle comprises local sign (LID), formation is to (QP), formation keyword (Qkey), partition key information such as (Pkey), and then this IP data segment is added 2 layers of frame head of IB side with this information, be packaged into the IPoIB frame format, and be transmitted to purpose IB main frame.

The above-mentioned IP message repeating process of netting from the IB net to Ethernet only is fit to the situation that Ethernet main frame purpose IP address and IB main frame source IP address are positioned at the same network segment/broadcast domain.When purpose IP address and IB main frame source IP address are not in the same network segment, generally can adopt the method for default route, i.e. the default forwarding gateway address of an Ethernet side of configuration on the IB-Eth gateway.Such as, referring to shown in Figure 2, the Eth0 interface IP address that the default forwarding gateway address of configuration ethernet side is router Route1 on the IB-Eth gateway.After the IB-Eth gateway is received the IPoIB message of IB side, analysis purpose IP address, when purpose IP address is positioned at the different network segments with source IP address, the IB-Eth gateway is just specified the purpose forwarding address of default forwarding gateway address as this message, and the message of receiving is forwarded to this purpose interface after the frame format conversion.But this pass-through mode can consume certain IB-Eth gateway CPU processing time, when a large amount of these type of IPoIB messages need be transmitted, can cause IB-Eth gateway forwards performance decrease.

Especially when the interconnection of a plurality of IP network sections and Ethernet being arranged in the IB network and is in the same broadcast domain, be difficult to transmit by the mode that disposes default forwarding gateway address again this type of IP message of the net from the IB net to Ethernet this moment, and may on the IB-Eth gateway, bind a plurality of Ethernet gateway address, promptly be respectively the corresponding Ethernet gateway address of each subnet binding.Such as, referring to the typical networking that comprises two Ethernet gateways of two network segments shown in Figure 3, comprise two network segments of 192.168.0.0/24 and 192.168.1.0/24 among the figure, the gateway address of their correspondences is respectively the Eth0 interface IP address of Route1 and the Eth0 interface IP address of Route2, need bind these two interface IP addresses respectively here on the IB-Eth gateway.When purpose IP address of IB main frame Server1 transmission is the IPoIB message of 8.0.0.3, the IB-Eth gateway is after receiving this IPoIB message, at first extract the purpose IP address in the message, whether analysis purpose IP address and source IP address belong to the same network segment, if this message need be forwarded to outer net, then from source IP address, obtain the subnet address, search Ethernet gateway address---the Eth0 interface IP address of Route1 with this subnet address binding, and search ethernet address handle with this purpose Ethernet interface address binding, utilize the ethernet address handle that obtains that the IPoIB message received is forwarded after through the frame format conversion then.That is to say, when transmitting the IPoIB message, the IB-Eth gateway need carry out the search procedure of purpose IP address to purpose ethernet address handle, and treatment step therebetween is comparatively complicated, need to consume a large amount of IB-Eth gateway CPU processing times, cause the reduction of IB-Eth gateway forwards efficient easily.Especially when a large amount of these type of IPoIB messages need be transmitted, can cause the rapid decline of IB-Eth gateway forwards performance.

Summary of the invention

In view of this, main purpose of the present invention is to provide a kind of message forwarding method, system and equipment, improves the forward efficiency of IB-Eth gateway.

For achieving the above object, message forwarding method provided by the invention is as follows:

Under the IPoIB main interface of IB-Ethernet Eth gateway, create the IPoIB sub-interface, and an IPoIB sub-interface Ethernet interface IP address of binding and the ethernet address handle corresponding with this IP address;

The IB side will mail to described Ethernet interface or need to mail to through described Ethernet interface the IP message of miscellaneous equipment, send on the IPoIB sub-interface of described Ethernet interface IP address binding;

After the IPoIB sub-interface is received IP message from the IB side, the IP message of receiving is transmitted to the Ethernet interface of the Ethernet interface IP address correspondence of self binding.

Wherein, the process of described establishment IPoIB sub-interface comprises:

By command line mode static IPoIB sub-interface of creating under the IPoIB main interface, specify the Ethernet interface IP address of this IPoIB sub-interface binding and the ethernet address handle corresponding simultaneously with this IP address.

The process of described establishment IPoIB sub-interface comprises:

By command line mode static IPoIB sub-interface of creating under the IPoIB main interface, specify the Ethernet interface IP address of this IPoIB sub-interface binding simultaneously, the ethernet address handle of this IP address correspondence is bound by dynamic obtain manner, and the detailed process of dynamically obtaining comprises:

The IB-Eth gateway receives from behind the ARP message identical with the IP address of IPoIB sub-interface binding of the transmitting terminal IP address of Ethernet side, extract the transmitting terminal MAC Address in this message and the incoming interface information of this message, be saved in the ethernet address handle, bind with the IPoIB sub-interface of creating.

Described Ethernet interface IP address is Ethernet Hosts IP address, perhaps is ethernet gateway IP address.

Described Ethernet interface IP address is ethernet gateway IP address, and the process of described establishment IPoIB sub-interface comprises:

The ethernet gateway of IB main frame network segment correspondence under self sends the ARP message, and carries IPoIB sub-interface request to create in this message;

After the IB-Eth gateway is received the ARP message that carries IPoIB sub-interface request to create, create with this message in the IPoIB sub-interface of purpose gateway ip address binding, and the ethernet address handle of purpose gateway ip address correspondence and the IPoIB sub-interface of establishment bound.

Described ARP message is the ARP request message,

The detailed process that described IB-Eth gateway is bound the IPoIB sub-interface of the ethernet address handle of purpose gateway ip address correspondence and establishment comprises:

The IB-Eth gateway is transmitted to the purpose ethernet gateway with the ARP request message of receiving, returns the arp reply message after the purpose ethernet gateway is received;

After the IB-Eth gateway is received the arp reply message of Ethernet side, extract the transmitting terminal MAC Address in this message and the incoming interface information of this message, be saved in the ethernet address handle, bind with the IPoIB sub-interface of creating.

Described ARP message is the arp reply message,

Described IB main frame comprises before sending the arp reply message: described ethernet gateway sends the ARP request message to the IB main frame;

The IB-Eth gateway is searched the ethernet address handle of purpose gateway ip address correspondence, and the ethernet address handle that finds and the IPoIB sub-interface of establishment are bound.

Described IPoIB sub-interface request to create is carried in the Reserved field of the preceding top guide of ARP message.

Further comprise after the described establishment IPoIB sub-interface:

The IB-Eth gateway is the IPoIB sub-interface structure gratuitous ARP packet for creating regularly, in this message, insert the inquiry of IPoIB sub-interface, and carry out broadcast transmission, after the IB main frame was received the ARP message that carries the inquiry of IPoIB sub-interface, the ARP request message that broadcast transmission is carried the report of IPoIB sub-interface responded;

After the IB-Eth gateway sends described gratuitous ARP packet,, then delete the IPoIB sub-interface of the ethernet gateway binding of this network segment correspondence if do not receive the ARP request message of arbitrary IB response of host in a certain network segment at the appointed time.

Described IB-Eth gateway regularly comprises for the IPoIB sub-interface structure gratuitous ARP packet of creating:

The IB-Eth gateway is regularly constructed a gratuitous ARP packet respectively for the IPoIB sub-interface of each establishment;

Perhaps, the IB-Eth gateway is selected an IPoIB sub-interface structure gratuitous ARP packet from all IPoIB sub-interfaces that are subordinated to an IPoIB main interface.

Described IPoIB sub-interface inquiry and the report of IPoIB sub-interface are carried in the Reserved field of the preceding top guide of ARP message.

Described IPoIB sub-interface comprises before the IP message of receiving is transmitted to Ethernet interface:

The IPoIB sub-interface utilizes the ethernet address handle information of self binding to convert the IP message of receiving to ethernet frame format.

This method further comprises:

The IB-Eth gateway that the IPoIB sub-interface is arranged when the Ethernet side by establishment is when the IB side sends the IP message, and the IPoIB main interface of IB-Eth gateway is transmitted all IP messages from the Ethernet side;

Perhaps, IPoIB main interface and IPoIB sub-interface adopt the common IP message of transmitting from the Ethernet side of mode of load balancing.

Simultaneously, the present invention also provides a kind of message forwarding equipment, comprises IPoIB main interface and Eth mouth, and this equipment further comprises:

IPoIB sub-interface administration module is used for creating the IPoIB sub-interface under the IPoIB main interface, and an IPoIB sub-interface Ethernet interface IP address of binding and the ethernet address handle corresponding with this IP address;

Described IPoIB sub-interface is used to receive the IP message from the IB side, and the IP message of receiving is transmitted to the Ethernet interface of the Ethernet interface IP address correspondence of self binding by the Eth mouth.

Wherein, described IPoIB sub-interface is further used for transmitting the IP message from the Ethernet side.

Described IPoIB sub-interface administration module is further used for, and when not having arbitrary IB main frame in the network segment of the Ethernet interface correspondence of IPoIB sub-interface binding, deletes this IPoIB sub-interface.

In addition, the present invention also provides a kind of message forwarding system, comprising: IB main frame and comprise the IPoIB main interface and the IB-Eth gateway of Eth mouth, and wherein, the IB-Eth gateway further comprises:

Described IPoIB sub-interface is used to receive the IP message from the IB side, and the IP message of receiving is transmitted to the Ethernet interface of the Ethernet interface IP address correspondence of self binding by the Eth mouth;

Described IB main frame is used for sending on the IPoIB sub-interface of described Ethernet interface IP address binding mailing to described Ethernet interface or needing to mail to through described Ethernet interface the IP message of miscellaneous equipment.

Described IPoIB sub-interface is further used for transmitting the IP message from the Ethernet side.

This shows, the present invention has created the IPoIB sub-interface with Ethernet interface IP address binding, for the IP message that mails to the described Ethernet interface of having bound the IPoIB sub-interface or need mail to through the described Ethernet interface of having bound the IPoIB sub-interface IP message of miscellaneous equipment, the IB side can directly send to these IP messages on the IPoIB sub-interface of described Ethernet interface IP address binding; In view of an IPoIB sub-interface has only been bound an Ethernet interface IP address, therefore, after the IPoIB sub-interface is received IP message from the IB side, can directly the IP message of receiving be sent to the Ethernet interface of self binding, and need not to carry out purpose IP address searching to purpose ethernet address handle.Thereby saved the processing time that message is transmitted, accelerated message transferring speed, improved forward efficiency.Especially when a large amount of IPoIB messages need be transmitted, can obviously improve the forwarding performance of IB-Eth gateway like this.

And, in preferred embodiment of the present invention, for the situation of dynamic creation and managing I PoIB sub-interface, IPoIB sub-interface management information wherein can be carried by the Reserved field of top guide before the ARP message, and need not to redefine new IPoIB sub-interface type of message.Can realize the seamless compatibility with standard I PoIB drive software like this, the IB main frame with the dynamic creation of IPoIB sub-interface and administrative mechanism can and not have between this machine-processed IB main frame and carries out any IPoIB message interaction.

Description of drawings

Fig. 1 is an IPoIB frame format schematic diagram of the prior art.

Fig. 2 is the classical group web frame of IB-Eth gateway in the prior art.

Fig. 3 is the classical group web frame of two Ethernet gateways of two network segments in the prior art.

Fig. 4 is the MAC Address structure of IPoIB in the prior art.

When Fig. 5 does not create for IPoIB sub-interface in the embodiment of the invention, initiate the handling process schematic diagram of ARP request and establishment IPoIE sub-interface by the IB main frame.

When Fig. 6 does not create for IPoIB sub-interface in the embodiment of the invention, initiate the handling process schematic diagram of ARP request and establishment IPoIB sub-interface by the Ethernet gateway.

When Fig. 7 has created for IPoIB sub-interface in the embodiment of the invention, the ARP message handling process schematic diagram of initiating the ARP request by the IB main frame.

When Fig. 8 has created for IPoIB sub-interface in the embodiment of the invention, the ARP message handling process schematic diagram of initiating the ARP request by the Ethernet gateway.

Fig. 9 is the IP message repeating process of IB net on the Ethernet direction in the embodiment of the invention.

Figure 10 is the IP message repeating process of Ethernet on the IB net direction in the embodiment of the invention.

Figure 11 is the message forwarding system structural representation in the embodiment of the invention.

Embodiment

For making purpose of the present invention, technical scheme and advantage clearer, the embodiment that develops simultaneously with reference to the accompanying drawings is described in further detail the present invention.

When IB-Eth gateway initialization IPoIB driver module, the IPoIB driver module is each VLAN ID (VLAN ID) will for each broadcast domain and all creates an IPoIB interface.For ease of subsequent descriptions, this class interface that this paper will create is called the IPoIB main interface.Each IPoIB main interface all can be bound the formation check mark (QPN) of an IB definition, also can bind information such as Qkey, Pkey, LID simultaneously, and form the unicast mac address of a link layer with overall identification (GID), the structure of this MAC Address as shown in Figure 4, length is 20 bytes, comprises the QPN of 24 bits and the GID of 128 bits.Each IPoIB main interface all adds in the corresponding separately broadcast domain and uses same GID.All all are responsible for forwarding by the IPoIB main interface of IB-Eth gateway from the IP message of IB net.

Describe as can be known by background technology, when laying respectively at different subnet/broadcast domain with IB main frame source IP address when Ethernet main frame purpose IP address, IP message forwarding process is comparatively complicated, needs to consume a large amount of CPU processing times, causes IB-Eth gateway forwards performance decrease.

For overcoming the problems referred to above, the invention provides a kind of message forwarding method, its basic thought is: under the IPoIB of IB-Eth gateway main interface, create the IPoIB sub-interface, and an IPoIB sub-interface Ethernet interface IP address of binding and the Ethernet address handle corresponding with this IP address; The IB side will mail to the described IP message of having bound the Ethernet interface of IPoIB sub-interface or having needed to mail to through the described Ethernet interface of having bound the IPoIB sub-interface miscellaneous equipment, directly send on the IPoIB sub-interface of described Ethernet interface IP address binding; After the IPoIB sub-interface is received IP message from the IB side, utilize the Ethernet address handle information of self binding to convert the IP message of receiving to the Ethernet frame format, and will send to the Ethernet interface of the Ethernet interface IP address correspondence of self binding through the IP message after the frame format conversion.

Wherein, the Ethernet interface IP address of IPoIB sub-interface binding both can be Ethernet gateway interface IP address (as the Eth0 interface IP address of Route1 among Fig. 3), also can be Ethernet host IP address (as the IP address of Server2 among Fig. 3).For the IP message that mails to the Ethernet main frame of having bound the IPoIB sub-interface or need to send through the Ethernet gateway of having bound the IPoIB sub-interface IP message of outer net, the IB main frame can directly send to these IP messages on the IPoIB sub-interface of IPoIB sub-interface that described Ethernet host IP address bound or described Ethernet gateway interface IP address being bound.Because an IPoIB sub-interface has only been bound an Ethernet interface, the IP message that sends on the IPoIB sub-interface must be to send to the Ethernet interface of binding with it, therefore, after the IPoIB sub-interface is received IP message from the IB side, can directly the IP message of receiving be sent on the Ethernet interface of self binding, and need not to carry out purpose IP address searching to purpose ethernet address handle.Thereby saved the forwarding processing time, accelerated message transferring speed, improved the message forward efficiency, especially when a large amount of IPoIB messages need be transmitted, can obviously improve the forwarding performance of IB-Eth gateway like this.

In the present invention, each IPoIB main interface can be created one or more IPoIB sub-interfaces.The IPoIB sub-interface of creating can with information such as the shared identical Qkey of IPoIB main interface, Pkey, GID, LID, but each IPoIB sub-interface all need be created QPN separately, promptly each IPoIB sub-interface all has the link layer unicast mac address of oneself.Except having different unicast mac address, each IPoIB sub-interface of being created is all only bound an Ethernet interface IP address and the Ethernet address handle corresponding with this IP address; Each IPoIB sub-interface only is subordinated to the IPoIB main interface of creating this sub-interface, when needs deletion IPoIB main interface, needs to delete earlier the IPoIB sub-interface of subordinate under this main interface; Each IPoIB sub-interface can join the IPoIB main interface of appointment, also can withdraw from from the IPoIB main interface of appointment; The IPoIB sub-interface receives only and handles the IPoIB message that points to himself unicast mac address, do not receive and handle any broadcasting packet and multicast message, do not add in IPoIB the main interface affiliated broadcast domain and multicast group, but can send broadcast or multicast message (generally do not send such message, and send) by IPoIB main interface agency.When needs add the IPoIB sub-interface in broadcast domain or multicast group, then can filter the IPoIB frame that does not mail to this sub-interface by software approach.

The establishment of IPoIB sub-interface both can have been taked the static mode of creating, and also can take the mode of dynamic creation.Establishment and management to the IPoIB sub-interface is elaborated at both of these case respectively below.

One, the static IPoIB sub-interface of creating.

By modes such as order line static IPoIB sub-interface, Ethernet interface IP address of specifying this IPoIB sub-interface to bind simultaneously of creating under the IPoIB of appointment main interface.The binding procedure of the Ethernet address handle of this Ethernet interface IP address correspondence can staticly specify or dynamically obtain.The described concrete grammar that dynamically obtains is as follows: after the IB-Eth gateway receives the ARP message that the Ethernet side sends over, check whether the transmitting terminal IP address in the ARP message is identical with the IP address of IPoIB sub-interface binding, if it is identical, the transmitting terminal hardware address that then extracts in this message is ethernet mac address, the information such as incoming interface that write down this message, and be saved in the Ethernet address handle of described IP address correspondence, finish binding procedure.Need to prove that in addition the static IPoIB sub-interface of creating needs to delete by the method for static state deletion.

The static IPoIB sub-interface of creating not only can be bound the Ethernet gateway interface IP address of appointment, also can bind the Ethernet host IP address of appointment.

When an Ethernet host IP address and an IPoIB sub-interface binding, can accelerate the IP message transferring speed of all IB main frames, be particularly useful for having between IB main frame and this Ethernet main frame occasion of a large amount of IP message interactions to this Ethernet main frame direction.

Two, dynamic creation IPoIB sub-interface.

By ARP message interaction dynamic creation IPoIB sub-interface.Such as, in the Reserved field of IPoIB frame preamble head, add IPoIB sub-interface management information, the IPoIB sub-interface management information of utilizing the ARP message to carry realizes the establishment and the management of IPoIB sub-interface.

Can join about the particular content of IPoIB sub-interface management information and to be shown in Table 1.

2bit	IPoIB sub-interface management information
2bit	IPoIB sub-interface management information	00b	No management information
01b	IPoIB sub-interface request to create	00b	No management information
01b	IPoIB sub-interface request to create	10b	The inquiry of IPoIB sub-interface is sent by the IB-Eth gateway
11b	IPoIB sub-interface report is sent by the IPoIB interface of IB main frame	10b

Table 1

The IPoIB sub-interface of dynamic creation is usually used in dynamic binding Ethernet gateway interface IP address.

In conjunction with Fig. 5 and Fig. 6 the process of the IPoIB sub-interface of dynamic creation and Ethernet gateway interface IP address binding is described in detail respectively below.

Wherein, when Fig. 5 does not create for the IPoIB sub-interface, initiate the handling process schematic diagram that ARP asked and created the IPoIB sub-interface by the IB main frame, it specifically may further comprise the steps:

Step 501:IB main frame is resolved the link layer MAC Address of the Ethernet gateway of this network segment correspondence by sending the ARP request message, the purpose IP address of carrying in this ARP request message is the IP address of described Ethernet gateway, and, insert the IPoIB sub-interface in the Reserved field of IB main frame top guide before the ARP request message that sends and create incident.

After the IPoIB main interface of step 502:IB-Eth gateway receives this ARP request message, extract the IPoIB sub-interface that carries in this ARP request message and create incident, and search the IPoIB sub-interface that whether has this IP address correspondence according to the purpose gateway ip address in the message;

The IPoIB sub-interface that under situation shown in Figure 5, does not have described IP address correspondence, so directly create the IPoIB sub-interface of this IP address correspondence, and convert the ARP request message of receiving under the Ethernet ARP message format, send to purpose Ethernet gateway.

After step 503:Ethernet gateway is received the ARP request message, return the arp reply message to the IB main frame by the IB-Eth gateway.

After step 504:IB-Eth gateway is received the arp reply message of Ethernet side, extract the source IP address in the message, and search whether there be the IPoIB sub-interface corresponding with this IP address, if exist, then show the IB-Eth gateway to this IP address binding the IPoIB sub-interface of appointment, so the transmitting terminal hardware address that extracts in this message is the information such as incoming interface of ethernet mac address and this message, be saved in the Ethernet address handle of this sub-interface binding, finish the binding procedure of IPoIB sub-interface Ethernet address handle.Then, the IB-Eth gateway is revised as the transmitting terminal hardware address field of this arp reply message the link layer MAC Address of the IPoIB sub-interface of source IP address correspondence again, and amended arp reply message is transmitted to the IB main frame.

So far, entire I PoIB sub-interface is created and is finished.

When Fig. 6 did not create for the IPoIB sub-interface, the Ethernet gateway was initiated the ARP request and is created the handling process schematic diagram of IPoIB sub-interface, and it specifically may further comprise the steps:

Step 601:Ethernet gateway is resolved the link layer MAC Address of the IB host ip oIB interface of purpose IP address correspondence by sending the ARP request message.

After step 602:IB-Eth gateway is received the ARP request message of Ethernet side, extract the source IP address in the message, and search whether there be the IPoIB sub-interface corresponding with this IP address;

The IPoIB sub-interface that under situation shown in Figure 6, does not have described IP address correspondence, the IB-Eth gateway then is revised as the transmitting terminal hardware address field of this ARP request message the link layer MAC Address of IPoIB main interface, and amended ARP request message is transmitted to the IB main frame;

Simultaneously, the transmitting terminal hardware address that the IB-Eth gateway also can extract in this message is the information such as incoming interface of ethernet mac address and this message, is saved in the Ethernet address handle of this message source IP address binding.

After step 603:IB main frame is received the ARP request message, structure arp reply message responds the ARP request message of receiving, the link layer destination address of this arp reply message is the IPoIB main interface MAC Address of IB-Eth gateway, and, when the purpose IP address of arp reply message was the Ethernet gateway ip address of this network segment correspondence, the IB main frame will be before the arp reply message that sends inserts the IPoIB sub-interface in the Reserved field of top guide and creates incident.

Step 604: since this fashion do not create with the IB main frame under the IPoIB sub-interface of the corresponding Ethernet gateway ip address of network segment binding, therefore, the IPoIB main interface of IB-Eth gateway will receive this arp reply message.After receiving, the IB-Eth gateway extracts the IPoIB sub-interface that carries in this arp reply message and creates incident, and search according to the purpose gateway ip address in the message and to have the IPoIB sub-interface corresponding whether with this gateway ip address, if there is no, then create the IPoIB sub-interface corresponding with this gateway ip address, simultaneously, search the Ethernet address handle of this gateway ip address correspondence, and be tied in the IPoIB sub-interface of new establishment.Then, new ARP request message of IB-Eth gateway structure, the transmitting terminal IP address field of this message extends this as the purpose IP address of the arp reply message that receives before this, the transmitting terminal hardware address field extends this as the link layer MAC Address of the IPoIB sub-interface of establishment, the purpose IP address field extends this as the transmitting terminal IP address of the arp reply message that receives before this, and sends new ARP request message by the IPoIB sub-interface to the IB main frame.

After step 605:IB main frame is received the ARP request message, structure arp reply message responds the ARP request message of receiving, the link layer destination address of this arp reply message is the MAC Address of the IPoIB sub-interface of IB-Eth gateway establishment before, and, when the purpose IP address of arp reply message was the Ethernet gateway ip address of this network segment correspondence, the IB main frame need be before the arp reply message that sends inserts the IPoIB sub-interface in the Reserved field of top guide and creates incident.

Step 606: if the IPoIB sub-interface of IB-Eth gateway receives the arp reply message that the IB main frame returns, two layers of link layer address that then show gateway in the IB host ip oIB interface have been bound the MAC Address of IPoIB sub-interface corresponding in the IB-Eth gateway, at this moment, the IB-Eth gateway only needs to convert the arp reply message of receiving under the Ethernet ARP message format and is transmitted to the Ethernet gateway and gets final product.

When the IPoIB sub-interface has been created, by IB main frame or Ethernet gateway initiate the ARP request and the handling process of the ARP message that produces respectively as Fig. 7, shown in Figure 8.

Wherein, the ARP message handling process when Fig. 7 initiates the ARP request for the IB main frame mainly may further comprise the steps:

Step 701:IB main frame sends the ARP request message to the Ethernet of this network segment correspondence gateway, and inserts the IPoIB sub-interface in the Reserved field of top guide and create incident before this message.

After the IPoIB main interface of step 702:IB-Eth gateway receives this ARP request message, extract the IPoIB sub-interface that carries in this ARP request message and create incident, and search the IPoIB sub-interface that whether has this IP address correspondence according to the purpose gateway ip address in the message, if exist, then directly the ARP request message of receiving is converted to the ARP message format under the Ethernet, and send to purpose Ethernet gateway.

After step 703:Ethernet gateway is received the ARP request message, return the arp reply message to the IB main frame by the IB-Eth gateway.

After step 704:IB-Eth gateway is received the arp reply message of Ethernet side, extract the source IP address in the message, and search whether there be the IPoIB sub-interface corresponding with this IP address, if exist, the transmitting terminal hardware address that then extracts in this message is the information such as incoming interface of ethernet mac address and this message, be saved in the Ethernet address handle of this IPoIB sub-interface binding, finish the binding procedure of IPoIB sub-interface Ethernet address handle.Then, the IB-Eth gateway is revised as the transmitting terminal hardware address field of this arp reply message the link layer MAC Address of the IPoIB sub-interface of source IP address correspondence again, and amended arp reply message is transmitted to the IB main frame.

ARP message handling process when Fig. 8 initiates the ARP request for the Ethernet gateway mainly may further comprise the steps:

Step 801:Ethernet gateway sends the ARP request message by the IB-Eth gateway to the IB main frame.

After step 802:IB-Eth gateway is received the ARP request message of Ethernet side, extract the source IP address in the message, and search whether there be the IPoIB sub-interface corresponding with this IP address, if exist, then the transmitting terminal hardware address field of this ARP request message is revised as the link layer MAC Address of corresponding IPoIB sub-interface, and amended ARP request message is transmitted to the IB main frame.

After step 803:IB main frame is received the ARP request message, return the arp reply message to the Ethernet gateway, the link layer destination address of this arp reply message is the IPoIB sub-interface MAC Address of Ethernet gateway correspondence, and, insert the IPoIB sub-interface in the Reserved field of IB main frame top guide before the arp reply message that sends and create incident.

After the IPoIB sub-interface of step 804:IB-Eth gateway receives the arp reply message that the IB main frame returns, directly the arp reply message of receiving is converted to the ARP message format under the Ethernet, and be transmitted to the Ethernet gateway.

If no longer need original IPoIB sub-interface, then need under the situations such as network segment variation no longer carrying out transfer of data between IB main frame and Ethernet gateway or take place its deletion.

For the IPoIB sub-interface that static state is created, can delete by the method for static state deletion.And, can manage in the following manner for the IPoIB sub-interface of dynamic creation:

The IB-Eth gateway is regularly constructed free (gratuitous) ARP message respectively for the IPoIB sub-interface of each dynamic creation, before the ARP message of structure, insert the inquiry of IPoIB sub-interface in the Reserved field of top guide, and transmitting terminal and purpose IP address field are all filled in the Ethernet gateway ip address of IPoIB sub-interface binding, transmitting terminal and purpose hardware address field are filled in the link layer MAC Address of IPoIB sub-interface, and send this message with broadcast mode;

The IB main frame responds an IPoIB sub-interface inquiry by sending an ARP request message that carries the report of IPoIB sub-interface, insert the report of IPoIB sub-interface before the ARP request message in the Reserved field of top guide, fill in the IP address of affiliated gateway in the purpose IP address field, and send this message with broadcast mode;

After the IB-Eth gateway receives the ARP request message of IB main frame transmission, can respond this ARP request message, also can only extract the report of carrying in this ARP request message and not respond this ARP request, the IB-Eth gateway can learn according to the purpose IP address in the ARP request message of receiving the report of wherein carrying is specifically about which IPoIB sub-interface;

After the IB-Eth gateway sends an IPoIB sub-interface query message, if in the regulation timing, do not receive the report of any relevant this sub-interface, then represent not had any IB main frame in the network segment of this sub-interface binding, behind after a while aging, the IB-Eth gateway will be deleted this IPoIB sub-interface.

IB host ip oIB interface can not make an immediate response, but just sends response through after the certain time interval after receiving an IPoIB sub-interface inquiry of sending from the IB-Eth gateway.Because all the IB host ip oIB interfaces in the same network segment are after receiving the inquiry of IPoIB sub-interface, all can send an IPoIB sub-interface report with the forms of broadcasting, all IB main frames that therefore are positioned at the same network segment all will be received all reports that other IB main frame of same network segment sends.In view of these characteristics, for improving protocol efficiency, the transmission that the IB main frame can be sent the report of IPoIB sub-interface is set to random delay, that is to say, if an IB host ip oIB interface is in the process that waits IPoIB sub-interface report to be sent, received the same report from other main frames, then this IB host ip oIB interface just can send report again.Because the IB-Eth gateway only is concerned about in the network segment of IPoIB sub-interface binding whether at least also have an IB main frame, and and be indifferent to and have how many IB main frames to exist in this network segment.As long as also have an IB main frame to exist in the network segment of IPoIB sub-interface binding at least, just can not delete this IPoIB sub-interface; When only in the network segment of IPoIB sub-interface binding, not had any one IB main frame, just with this IPoIB sub-interface deletion.

Need to prove in addition, when the gratuitous ARP packet of IPoIB sub-interface inquiry is inserted in the timed sending of IB-Eth gateway, it can only select one of them IPoIB sub-interface address information to construct gratuitous ARP packet from all IPoIB sub-interfaces that are subordinated to an IPoIB main interface, and need not all construct a gratuitous ARP packet for each IPoIB sub-interface.Because the IB main frame only is concerned about this IPoIB sub-interface query event, and the content of message itself is not paid close attention to.After the IB-Eth gateway sends the gratuitous ARP packet that carries the inquiry of IPoIB sub-interface, if in official hour, do not receive the ARP request message of any one IB response of host in a certain network segment, then delete the IPoIB sub-interface of the ethernet gateway binding of this network segment correspondence.

In the dynamic creation and management process of above-mentioned IP oIB sub-interface, IPoIB sub-interface management information by the ARP message before the Reserved field of top guide carry, need not to redefine new IPoIB sub-interface type of message.Can realize the seamless compatibility with standard I PoIB drive software like this, the IB main frame with the dynamic creation of IPoIB sub-interface and administrative mechanism can and not have between this machine-processed IB main frame and carries out any IPoIB message interaction.

Need to prove, in the dynamic creation and management process of above-mentioned IP oIB sub-interface, IPoIB sub-interface management information is that 2 bits by Reserved field in the IPoIB frame preamble head define, but in actual applications, also can utilize still less or the more multidigit on the IPoIB frame preamble head Reserved field to define IPoIB sub-interface management information.The concrete definition of IPoIB sub-interface management information also is not limited to shown in the table 1.

Need to prove also that in addition the IPoIB sub-interface of static IPoIB sub-interface of creating and dynamic creation can exist simultaneously, that is to say that different IPoIB sub-interfaces can be taked different establishment modes in the IB-Eth gateway.

The IPoIB sub-interface just can utilize the IPoIB sub-interface of establishment to carry out the IP message forwarding after creating and finishing.After introducing the IPoIB sub-interface, IP message forwarding rule is as follows: an IPoIB sub-interface is only bound an Ethernet interface IP address, the IPoIB sub-interface is only transmitted the clean culture IP message that the IB main frame mails to the Ethernet interface of this sub-interface binding, and other IP messages on from the IB net to the Ethernet direction all pass through the forwarding of IPoIB main interface; The IPoIB sub-interface can not transmitted any IP message of receiving from the Ethernet side joint, and all is forwarded to IB net side by the IPoIB main interface; Perhaps, also can adopt the mode of load balancing to transmit the IP message of receiving from the Ethernet side joint between IPoIB sub-interface and the IPoIB main interface.That is to say that the IP message forwarding mode of receiving from the Ethernet side needs to realize deciding according to specific design.

For ease of understanding better, IP message forwarding process after introducing the IPoIB sub-interface is elaborated below by two concrete examples.Wherein, Fig. 9 represents the IP message repeating process of IB net on the Ethernet direction; Figure 10 represents the IP message repeating process of Ethernet on the IB net direction.

In Fig. 9, the IP address 192.168.0.3 binding of IPoIB sub-interface 1 and Ethernet main frame Server2, the Eth0 interface IP address 192.168.0.1 binding of IPoIB sub-interface M and Ethernet gateway Route1, the IP address 192.168.0.4 of Ethernet main frame Server3 does not have binding IP oIB sub-interface.Wherein, IP message 1 needs to give outer net by the Ethernet gateway forwards; The destination address of IP message 2 is 192.168.0.3; The destination address of IP message 3 is 192.168.0.4.

The repeating process of IP message 1 is as follows: IB main frame Server1 is when sending IP message 1, search the IPoIB sub-interface M address handle of Ethernet gateway ip address correspondence, make the link layer destination address of IP message related, IP message 1 is directly sent on the IPoIB sub-interface M then with the MAC Address of this IPoIB sub-interface; After the IPoIB sub-interface M of IB-Eth gateway receives IP message 1, directly obtain the purpose Ethernet address handle that this sub-interface M is bound, obtain information such as Ethernet outgoing interface and Ethernet target MAC (Media Access Control) address, utilize these information 2 layers of frame head of IP data segment interpolation Ethernet then to IP message 1, convert the Ethernet frame format to, and will send to purpose Ethernet gateway interface through the IP message 1 after the frame format conversion by the Ethernet outgoing interface of binding.In this repeating process, the IB-Eth gateway does not need to carry out purpose IP address searching to purpose ethernet address handle, the IP message that directly will send to the IPoIB sub-interface is transmitted to the Ethernet interface of binding with it and gets final product, thereby saved the forwarding time of IB-Eth gateway, improved forward efficiency.

The repeating process of IP message 2 is as follows: because the IP address that IPoIB sub-interface 1 has been bound Server2, therefore, IB main frame Server1 directly is that the IP message 2 of Server2 sends on the IPoIB sub-interface 1 with the destination, after IPoIB sub-interface 1 is received IP message 1, IP message 1 is carried out the frame format conversion, and will send to the IP address pairing Ethernet main frame Server2 that self binds through the IP message 1 after the frame format conversion.

The repeating process of IP message 3 is as follows: because Server3 does not have binding IP oIB sub-interface, therefore, the IPoIB main interface of IB-Eth gateway will be received the IP message 3 that IB main frame Server1 sends over, the IPoIB main interface receives that the concrete repeating process behind the IP message 3 is consistent with prior art, the i.e. purpose Ethernet address handle that address search is bound with it according to purpose IP, utilize the information that finds that IP message 3 is packaged into the Ethernet frame format then, and be forwarded to the Ethernet outgoing interface of appointment.

For IP message from the Ethernet side, can all pass through the IPoIB main interface of IB-Eth gateway and transmit, also can transmit jointly according to the mode of load balancing by IPoIB main interface and IPoIB sub-interface.In Figure 10, all are responsible for forwarding by the PoIB main interface from any IP message that mails to Server1 of Ethernet side, and its concrete repeating process is consistent with prior art, gives unnecessary details no longer one by one here.

Need to prove at last, after more than being primarily aimed at introducing IPoIB sub-interface, the modification that the IB-Eth gateway is made the IP/ARP message elaborates, and about the mutual conversion between the message format of the message format of Ethernet definition and IPoIB standard definition, all consistent with prior art, do not do here to launch to describe.

Correspondingly, the present invention also provides a kind of message forwarding system, and its concrete structure mainly comprises referring to shown in Figure 11: IB main frame and IB-Eth gateway.Wherein, the IB-Eth gateway also comprises except comprising basic IPoIB main interface and Eth mouth:

Wherein, the IPoIB sub-interface also can be further used for transmitting the IP message from the Ethernet side.

IPoIB sub-interface administration module also can be further used for, and when not having arbitrary IB main frame in the network segment of the Ethernet interface correspondence of IPoIB sub-interface binding, deletes this IPoIB sub-interface.

In addition, the present invention also provides a kind of message forwarding equipment, and its structure is consistent with the IB-Eth gateway among Figure 11, gives unnecessary details no longer one by one here.

The above has carried out further detailed description to purpose of the present invention, technical scheme and beneficial effect; institute is understood that; the above is not in order to restriction the present invention; within the spirit and principles in the present invention all; any modification of being made, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.

Claims

1, a kind of message forwarding method is characterized in that, comprising:

2, method according to claim 1 is characterized in that, the process of described establishment IPoIB sub-interface comprises:

3, method according to claim 1 is characterized in that, the process of described establishment IPoIB sub-interface comprises:

According to each described method of claim 1 to 3, it is characterized in that 4, described Ethernet interface IP address is Ethernet Hosts IP address, perhaps is ethernet gateway IP address.

5, method according to claim 1 is characterized in that, described Ethernet interface IP address is ethernet gateway IP address, and the process of described establishment IPoIB sub-interface comprises:

6, method according to claim 5 is characterized in that, described ARP message is the ARP request message,

7, method according to claim 5 is characterized in that, described ARP message is the arp reply message,

According to each described method of claim 5 to 7, it is characterized in that 8, described IPoIB sub-interface request to create is carried in the Reserved field of the preceding top guide of ARP message.

9, according to each described method of claim 5 to 7, it is characterized in that, further comprise after the described establishment IPoIB sub-interface:

10, method according to claim 9 is characterized in that, described IB-Eth gateway regularly comprises for the IPoIB sub-interface structure gratuitous ARP packet of creating:

11, method according to claim 9 is characterized in that, described IPoIB sub-interface inquiry and the report of IPoIB sub-interface are carried in the Reserved field of the preceding top guide of ARP message.

12, method according to claim 1 is characterized in that, described IPoIB sub-interface comprises before the IP message of receiving is transmitted to Ethernet interface:

13, method according to claim 1 is characterized in that, this method further comprises:

The IB-Eth gateway that the IPoIB sub-interface is arranged when the Ethernet side by establishment when the IB side sends the IP message,

The IPoIB main interface of IB-Eth gateway is transmitted all IP messages from the Ethernet side;

14, a kind of message forwarding equipment comprises IPoIB main interface and Eth mouth, it is characterized in that this equipment further comprises:

15, equipment according to claim 14 is characterized in that, described IPoIB sub-interface is further used for transmitting the IP message from the Ethernet side.

16, equipment according to claim 14 is characterized in that, described IPoIB sub-interface administration module is further used for, and when not having arbitrary IB main frame in the network segment of the Ethernet interface correspondence of IPoIB sub-interface binding, deletes this IPoIB sub-interface.

17, a kind of message forwarding system is characterized in that, comprising: IB main frame and comprise the IPoIB main interface and the IB-Eth gateway of Eth mouth, and wherein, the IB-Eth gateway further comprises:

18, system according to claim 17 is characterized in that, described IPoIB sub-interface is further used for transmitting the IP message from the Ethernet side.

19, system according to claim 17 is characterized in that, described IPoIB sub-interface administration module is further used for, and when not having arbitrary IB main frame in the network segment of the Ethernet interface correspondence of IPoIB sub-interface binding, deletes this IPoIB sub-interface.