CN112491672B

CN112491672B - PCIE communication system, communication configuration parameter backup method and PCIE switch

Info

Publication number: CN112491672B
Application number: CN201910860674.1A
Authority: CN
Inventors: 王海棠; 瞿勇
Original assignee: Hangzhou Hikvision Digital Technology Co Ltd
Current assignee: Hangzhou Hikvision Digital Technology Co Ltd
Priority date: 2019-09-11
Filing date: 2019-09-11
Publication date: 2022-05-06
Anticipated expiration: 2039-09-11
Also published as: CN112491672A

Abstract

The embodiment of the invention provides a PCIE communication system, a communication configuration parameter backup method and a PCIE switchboard, wherein a plurality of PCIE switchboards are added in the PCIE communication system, the PCIE switchboards are used for providing data exchange paths for each PCIE subsystem, the PCIE switchboards can acquire communication configuration parameters of the PCIE communication system, and can carry out communication configuration based on the acquired communication configuration parameters.

Description

PCIE communication system, communication configuration parameter backup method and PCIE switch

Technical Field

The present invention relates to the field of computer technologies, and in particular, to a PCIE communication system, a communication configuration parameter backup method, and a PCIE switch.

Background

With the further development of computer and communication technologies, a new generation of I/O (Input/Output) interface technologies are emerging in large numbers, such as GE (Gigabit Ethernet), 10GE (10Gigabit Ethernet, Gigabit Ethernet) Ethernet, 4G/8G FC (Fiber Channel) technology, etc., the I/O interface speed is greatly increased, the bandwidth of the conventional PCI (Peripheral Component Interconnect) bus is unable to meet the requirement of parallel reading and writing of a large amount of high bandwidth in a computer system, and the PCI bus also becomes a bottleneck for improving system performance, so a PCIE (Peripheral Component Interconnect Express) bus appears. A PCIE bus can provide very high bandwidth through multiple lanes to meet system requirements.

A conventional PCIE architecture is shown in fig. 1, and mainly includes a master card, a switch card, and a service card. The exchange card is connected with the main control card and the service card respectively and is used for providing data exchange between the main control card and the service card; the main control card is used for issuing control data, including configuration information of the business card; the service card is used for carrying out actual service processing, and the service card can directly send the generated service data to the external network.

However, as computer systems become more complex and more data to be processed becomes more and more voluminous, a single PCIE architecture cannot meet practical requirements, and thus a composite PCIE communication system is proposed. The conventional PCIE architecture is regarded as one PCIE subsystem, and a plurality of PCIE subsystems constitute a PCIE communication system. However, since the service processing of the service card in each subsystem is controlled by the main control card in the subsystem, if the main control card of the subsystem is abnormal, the service card of the subsystem cannot perform normal service processing, thereby affecting the reliability of the entire PCIE communication system.

Disclosure of Invention

Embodiments of the present invention provide a PCIE communication system, a communication configuration parameter backup method, and a PCIE switch, so as to improve reliability of the PCIE communication system. The specific technical scheme is as follows:

in a first aspect, an embodiment of the present invention provides a PCIE communication system, where the PCIE communication system includes: a plurality of PCIE subsystems and a plurality of PCIE switches; the PCIE switchboard is used for providing a data exchange path for each PCIE subsystem;

the PCIE subsystem comprises a main control card, a switch card and a service card, wherein the main control card and the service card are respectively connected to the switch card, and the switch card is used for providing a data exchange path between the main control card and the service card;

the plurality of PCIE switches comprise an active PCIE switch and at least one standby PCIE switch, wherein the active PCIE switch is used for obtaining and carrying out communication configuration according to communication configuration parameters of the PCIE communication system, and backing up the communication configuration parameters to the standby PCIE switch so as to enable the standby PCIE switch to carry out communication configuration according to the communication configuration parameters.

Optionally, the number of the master control cards in the PCIE subsystem is multiple, where the multiple master control cards include one active master control card and at least one standby master control card.

Optionally, the PCIE communication system further includes a switch board;

the switching board is connected with each PCIE subsystem and each PCIE switchboard respectively, and the switching board is used for providing a data switching path between each PCIE subsystem and each PCIE switchboard.

Optionally, the switch board includes an uplink port, a plurality of downlink ports, and a plurality of non-transparent bridge NT ports, where the uplink port is connected to one PCIE subsystem, one downlink port is connected to one NT port, and one NT port is connected to one PCIE switch.

Optionally, the PCIE switch includes a field programmable gate array FPGA and a PCIE bridge chip, where the PCIE bridge chip includes at least two NT ports, and the FPGA includes a universal serial data bus UART port;

the standby PCIE switch is respectively connected to the corresponding NT ports on the active PCIE switch through the NT ports of the standby PCIE switch; and the UART port on the standby PCIE switch is connected to the URAT port on the active PCIE switch.

In a second aspect, an embodiment of the present invention provides a communication configuration parameter backup method, which is applied to an active PCIE switch in a PCIE communication system, where the PCIE communication system includes a plurality of PCIE subsystems and a plurality of PCIE switches, the PCIE subsystems include a master control card, a switch card, and a service card, the master control card and the service card are respectively connected to the switch card, the plurality of PCIE switches include an active PCIE switch and at least one standby PCIE switch, and the PCIE switch is configured to provide a data exchange path for each PCIE subsystem, and the method includes:

acquiring communication configuration parameters of the PCIE communication system, and carrying out communication configuration according to the communication configuration parameters;

and backing up the communication configuration parameters to the standby PCIE switchboard so as to enable the standby PCIE switchboard to carry out communication configuration according to the communication configuration parameters.

Optionally, the obtaining the communication configuration parameter of the PCIE communication system includes:

inquiring address information of the master control card in each PCIE subsystem;

and acquiring communication configuration parameters of the PCIE communication system from the master control card in each PCIE subsystem based on the address information of the master control card in each PCIE subsystem.

Optionally, the communication configuration parameters include: multicast function configuration parameters; the PCIE communication system also comprises a switch board, wherein the switch board is respectively connected with each PCIE subsystem and each PCIE switchboard, and the switch board is used for providing a data exchange path between each PCIE subsystem and each PCIE switchboard;

the obtaining of the communication configuration parameters of the PCIE communication system and performing communication configuration according to the communication configuration parameters includes:

acquiring multicast function configuration parameters, wherein the multicast function configuration parameters comprise identification information of a plurality of service cards configured to the same multicast group;

determining multicast function configuration aiming at the switch board according to the identification information of the service cards;

the backing up the communication configuration parameters to the standby PCIE switch includes:

sending the multicast function configuration parameters to the standby PCIE switch so that the standby PCIE switch backs up the multicast function configuration parameters and returns a back-up success message to the active PCIE switch;

the method further comprises the following steps:

and when the backup success message returned by the standby PCIE switchboard is received, exchanging data with the plurality of service cards through the switchboard based on the multicast function configuration aiming at the switchboard.

Optionally, the communication configuration parameters include: unicast function configuration parameters; the PCIE communication system further includes a switch board, where the switch board is connected to each PCIE subsystem and each PCIE switch, and the switch board includes an uplink port, a plurality of downlink ports, and a plurality of NT ports, where the uplink port is connected to one PCIE subsystem, one downlink port is connected to one NT port, and one NT port is connected to one PCIE switch;

acquiring unicast function configuration parameters;

configuring parameters of a downlink port and a first port of an NT port in the switch board connected with the active PCIE switch according to the unicast function configuration parameters;

when the active PCIE switch is determined to be switched to the standby PCIE switch, the first port parameter is sent to the standby PCIE switch, so that the standby PCIE switch configures a downlink port and an NT port in the switch board connected with the standby PCIE switch based on the first port parameter, and sends a second port parameter of the downlink port and the NT port in the switch board connected with the standby PCIE switch to the active PCIE switch;

the method further comprises the following steps:

receiving the second port parameter sent by the standby PCIE switch;

and configuring a downlink port and an NT port in the switch board connected with the active PCIE switch based on the second port parameter.

Optionally, the communication configuration parameters include: a routing configuration parameter; each NT port on the standby PCIE switch is respectively connected to a corresponding NT port on the active PCIE switch;

acquiring a route configuration parameter;

configuring a routing table according to the routing configuration parameters;

backing up the routing configuration parameters to the standby PCIE switch through a first NT port so that the standby PCIE switch sends a backup interrupt message to a main control card in each PCIE subsystem, and returns a confirmation message to the main PCIE switch after receiving a backup completion interrupt message replied by the main control card in each PCIE subsystem, wherein the first NT port is any NT port on the main PCIE switch;

if the confirmation message returned by the standby PCIE switch is not received through the first NT port within the preset time, backing up the routing configuration parameters to the standby PCIE switch through a second NT port so that the standby PCIE switch sends a backup interruption message to the main control card in each PCIE subsystem, and returns the confirmation message to the main PCIE switch after receiving the backup completion interruption message returned by the main control card in each PCIE subsystem, wherein the second NT port is another NT port on the main PCIE switch except the first NT port;

and if a confirmation message returned by the standby PCIE switch is received through the second NT port within the preset time, determining that the standby PCIE switch backs up the route configuration parameters.

Optionally, the backing up the communication configuration parameters to the standby PCIE switch includes:

backing up the communication configuration parameters to the standby PCIE switch through a first NT port, wherein the first NT port is any NT port on the active PCIE switch;

sending a backup interrupt message to the standby PCIE switch through the first NT port so as to drive the standby PCIE switch to return a confirmation message to the active PCIE switch;

if the acknowledgement message returned by the standby PCIE switch is not received through the first NT port within the preset time, backing up the communication configuration parameters to the standby PCIE switch through a second NT port, wherein the second NT port is another NT port on the active PCIE switch except the first NT port;

sending a backup interrupt message to the standby PCIE switch through the second NT port so as to drive the standby PCIE switch to return a confirmation message to the active PCIE switch;

and if a confirmation message returned by the standby PCIE switch is received through the second NT port within the preset time, determining that the standby PCIE switch backs up the communication configuration parameters.

Optionally, the method further includes:

sending a power-down message to the standby PCIE switch to start the standby PCIE switch, and sending a starting message to the active PCIE switch after the standby PCIE switch is started; when the starting message sent by the standby PCIE switchboard is received, carrying out power-down processing;

alternatively, the first and second electrodes may be,

and receiving a power failure message sent by the standby PCIE switch, switching the main working mode of the standby PCIE switch into a standby working mode, and performing power failure processing.

In a third aspect, an embodiment of the present invention provides a communication configuration parameter backup method, which is applied to a standby PCIE switch in a PCIE communication system, where the PCIE communication system includes multiple PCIE subsystems and multiple PCIE switches, the PCIE subsystems include a master control card, a switch card, and a service card, the master control card and the service card are respectively connected to the switch card, the multiple PCIE switches include an active PCIE switch and at least one standby PCIE switch, and the PCIE switch is configured to provide a data exchange path for each PCIE subsystem, and the method includes:

receiving communication configuration parameters sent by the active PCIE switchboard;

and carrying out communication configuration according to the communication configuration parameters.

the receiving of the communication configuration parameter sent by the active PCIE switch includes:

receiving a multicast function configuration parameter sent by the active PCIE switch;

and backing up the multicast function configuration parameters and returning a backup success message to the active PCIE switchboard.

when the active PCIE switch is determined to be switched to the standby PCIE switch, setting NT ports in the switch boards connected with the standby PCIE switch as management ports, and recording second port parameters of downlink ports and NT ports in the switch boards connected with the standby PCIE switch, wherein the second port parameters are port parameters corresponding to the standby PCIE switch, which are configured in advance according to the unicast function configuration parameters;

receiving a first port parameter sent by the active PCIE switch, where the first port parameter is a first port parameter of a downlink port and an NT port in the switch board connected to the active PCIE switch, and the first port parameter is a port parameter corresponding to the active PCIE switch, which is configured in advance according to the unicast function configuration parameter;

the performing communication configuration according to the communication configuration parameter includes:

configuring a downlink port and an NT port in the switch board connected with the standby PCIE switch based on the first port parameter;

the method further comprises the following steps:

and sending the second port parameter to the active PCIE switch so that the active PCIE switch configures a downlink port and an NT port in the switch board connected with the active PCIE switch based on the second port parameter.

receiving the routing configuration parameter sent by the active PCIE switch through a first NT port, where the first NT port is any NT port on the standby PCIE switch;

the method further comprises the following steps:

and sending a backup interrupt message to the master control card in each PCIE subsystem, and returning a confirmation message to the main PCIE switch after receiving the backup completion interrupt message replied by the master control card in each PCIE subsystem.

Optionally, the receiving the communication configuration parameter sent by the active PCIE switch includes:

receiving the communication configuration parameters sent by the active PCIE switch through a first NT port, wherein the first NT port is any NT port on the active PCIE switch;

receiving, through the first NT port, a backup interrupt message sent by the active PCIE switch, and returning a confirmation message to the active PCIE switch, so that after receiving the confirmation message, the active PCIE switch determines that the standby PCIE switch has backed up the communication configuration parameters.

Optionally, the method further includes:

if a power-down message sent by the active PCIE switch is received, the standby PCIE switch is started, and a starting message is sent to the active PCIE switch after the standby PCIE switch is started, so that the active PCIE switch carries out power-down processing when receiving the starting message;

alternatively, the first and second electrodes may be,

sending a power failure message to the active PCIE switch so that the active PCIE switch switches a main working mode of the active PCIE switch into a standby working mode and performs power failure processing; and switching the self standby working mode into the main working mode.

In a fourth aspect, an embodiment of the present invention provides a communication configuration parameter backup device, which is applied to an active PCIE switch in a PCIE communication system, where the PCIE communication system includes multiple PCIE subsystems and multiple PCIE switches, each PCIE subsystem includes a master control card, a switch card, and a service card, the master control card and the service card are respectively connected to the switch cards, the multiple PCIE switches include an active PCIE switch and at least one standby PCIE switch, and the PCIE switch is configured to provide a data exchange path for each PCIE subsystem, and the device includes:

the acquisition module is used for acquiring communication configuration parameters of the PCIE communication system and carrying out communication configuration according to the communication configuration parameters;

and the backup module is used for backing up the communication configuration parameters to the standby PCIE switchboard so as to enable the standby PCIE switchboard to carry out communication configuration according to the communication configuration parameters.

In a fifth aspect, an embodiment of the present invention provides a communication configuration parameter backup device, which is applied to a standby PCIE switch in a PCIE communication system, where the PCIE communication system includes a plurality of PCIE subsystems and a plurality of PCIE switches, each PCIE subsystem includes a master control card, a switch card, and a service card, the master control card and the service card are respectively connected to the switch cards, the plurality of PCIE switches include an active PCIE switch and at least one standby PCIE switch, and the PCIE switch is configured to provide a data exchange path for each PCIE subsystem, and the device includes:

a receiving module, configured to receive the communication configuration parameter sent by the active PCIE switch;

and the configuration module is used for carrying out communication configuration according to the communication configuration parameters.

In a sixth aspect, an embodiment of the present invention provides a PCIE switch, including a processor and a memory, where the memory stores machine executable instructions that can be executed by the processor, and the machine executable instructions are loaded and executed by the processor, so as to implement the method provided in the second aspect or the third aspect of the embodiment of the present invention.

In a seventh aspect, an embodiment of the present invention provides a machine-readable storage medium, where the machine-readable storage medium stores therein machine-executable instructions, and when the machine-executable instructions are loaded and executed by a processor, the machine-executable instructions implement the method provided in the second aspect or the third aspect of the embodiment of the present invention.

The embodiment of the invention provides a PCIE communication system, a communication configuration parameter backup method and a PCIE switchboard, wherein the PCIE communication system comprises: the system comprises a plurality of PCIE subsystems and a plurality of PCIE switches, wherein the PCIE switches are used for providing data exchange paths with an external network for each PCIE subsystem, each PCIE subsystem comprises a main control card, an exchange card and a service card, the main control card and the service card are respectively connected to the exchange card, and the exchange card is used for providing the data exchange paths between the main control card and the service card. The plurality of PCIE switches comprise an active PCIE switch and at least one standby PCIE switch, wherein the active PCIE switch is used for obtaining and carrying out communication configuration according to communication configuration parameters of a PCIE communication system, and backing up the communication configuration parameters to the standby PCIE switch so that the standby PCIE switch carries out communication configuration according to the communication configuration parameters. The plurality of PCIE switches are additionally arranged in the PCIE communication system and used for providing data exchange paths for the PCIE subsystems, the PCIE switches can acquire communication configuration parameters of the PCIE communication system and can perform communication configuration based on the acquired communication configuration parameters, and the configuration function of the main control card can be realized by the PCIE switches even if the main control card of the subsystem is abnormal because the PCIE switches already acquire the communication configuration parameters of the PCIE communication system, so that the normal operation of the PCIE communication system under the condition that the main control card is abnormal is effectively ensured, and the reliability of the PCIE communication system is improved.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is a schematic diagram of a conventional PCIE architecture;

fig. 2 is a schematic structural diagram of a PCIE communication system according to an embodiment of the present invention;

fig. 3 is a schematic diagram illustrating a connection between a switch board and a PCIE switch according to an embodiment of the present invention;

fig. 4 is a schematic connection diagram of a PCIE switch according to an embodiment of the present invention;

fig. 5 is a schematic structural diagram of a PCIE communication system according to another embodiment of the present invention;

fig. 6 is a schematic flow chart of a communication configuration parameter backup method applied to an active PCIE switch according to an embodiment of the present invention;

FIG. 7 is a schematic diagram of a master card address obtaining process according to an embodiment of the present invention;

fig. 8 is a system diagram under the multicast function according to the embodiment of the present invention;

fig. 9 is a schematic view of a backup process of configuration parameters of a multicast function according to an embodiment of the present invention;

fig. 10 is a schematic diagram of an ALUT configuration backup process according to an embodiment of the present invention;

fig. 11 is a schematic diagram of a communication flow between PCIE switches according to an embodiment of the present invention;

fig. 12 is a schematic flowchart of a communication configuration parameter backup method applied to a standby PCIE switch according to an embodiment of the present invention;

fig. 13 is a schematic diagram illustrating a configuration switching flow of a unicast function according to an embodiment of the present invention;

fig. 14 is a schematic structural diagram of a communication configuration parameter backup device applied to an active PCIE switch according to an embodiment of the present invention;

fig. 15 is a schematic structural diagram of a communication configuration parameter backup device applied to a standby PCIE switch according to an embodiment of the present invention;

fig. 16 is a schematic structural diagram of a PCIE switch according to an embodiment of the present invention;

fig. 17 is a schematic structural diagram of a PCIE switch according to another embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without making any creative effort based on the embodiments in the present invention, belong to the protection scope of the present invention.

In order to improve the reliability of a PCIE communication system, embodiments of the present invention provide a PCIE communication system, a communication configuration parameter backup method and apparatus, a PCIE switch, and a machine-readable storage medium. Next, a PCIE communication system provided in the embodiment of the present invention is first described.

As shown in fig. 2, the PCIE communication system provided by the present invention includes a plurality of PCIE subsystems and a plurality of PCIE switches, where the PCIE switches are configured to provide data exchange paths for the PCIE subsystems.

The PCIE subsystem includes a main control card 211, a switch card 212, and a service card 213, where the main control card 211 and the service card 213 are respectively connected to the switch card 212, and the switch card 212 is configured to provide a data exchange path between the main control card 211 and the service card 213.

The plurality of PCIE switches include an active PCIE switch 221 and at least one standby PCIE switch 222, where the active PCIE switch 221 is configured to acquire and perform communication configuration according to communication configuration parameters of the PCIE communication system, and backup the communication configuration parameters to the standby PCIE switch 222, so that the standby PCIE switch 222 performs communication configuration according to the communication configuration parameters.

The PCIE subsystem and the conventional PCIE architecture have the same networking structure, where in one PCIE subsystem, a plurality of service cards may be set according to the type of service processing required, and each service card executes different service processing tasks.

The communication configuration parameters of the PCIE communication system mainly refer to service card configuration information under each PCIE subsystem in the PCIE communication system, and are configured to be a unicast function or a multicast function of a service card, and route configuration, and the like.

Optionally, the number of the master control cards in the PCIE subsystem may be multiple, where the multiple master control cards include one active master control card and at least one standby master control card.

One PCIE subsystem may include a plurality of main control cards, where the roles of the main control cards are divided into two types, one type is a main control card, and usually only one main control card is used, and only the main control card is normally operated, and the other type is a standby main control card, and there may be at least one standby main control card, when the main control card is abnormal, all control data and service data on the main control card are sent to one standby main control card, and the standby main control card is switched to the main role to operate instead of the main control card, thereby ensuring normal interaction of service data in the PCIE subsystem.

Optionally, the PCIE communication system may further include a switch board; the switching board is connected with each PCIE subsystem and each PCIE switchboard respectively, and the switching board is used for providing a data switching path between each PCIE subsystem and each PCIE switchboard.

The PCIE communication system may be provided with a switch board for providing a data exchange path between the PCIE subsystem and the PCIE switch, where the switch board is used to integrate data, so as to ensure consistency of data transmission.

Optionally, the switch board may include an uplink port, a plurality of downlink ports, and a plurality of NT (Non Transparent bridge) ports, where the uplink port is connected to one PCIE subsystem, one downlink port is connected to one NT port correspondingly, and one NT port is connected to one PCIE switch correspondingly.

As shown in fig. 3, it is assumed that the number of switches is two, the switch 1 is connected to the NT port 0 of the switch board, the NT port 0 is connected to the downlink port 1 through a virtual PCIE bus inside the switch board, the switch 2 is connected to the NT port 1 of the switch board, the NT port 1 is connected to the downlink port 2 through a virtual PCIE bus inside the switch board, the downlink port 1 and the downlink port 2 are connected to the uplink port through a virtual PCIE bus inside the switch board, and the uplink port is connected to one PCIE subsystem. The upstream port and the downstream port may be P2P (Peer-to-Peer) ports, and optical fiber connections may be used between the switch 1 and the NT port 0 and between the switch 2 and the NT port 1.

Optionally, the PCIE switch includes an FPGA (Field-Programmable Gate Array) and a PCIE bridge chip, where the PCIE bridge chip includes at least two NT ports, and the FPGA includes a UART (Universal Asynchronous Receiver/Transmitter, Universal serial data bus) port; the standby PCIE switch is respectively connected to the corresponding NT ports on the active PCIE switch through the NT ports of the standby PCIE switch; the UART port on the standby PCIE switch is connected to the URAT port on the active PCIE switch.

As shown in fig. 4, a PCIE switch usually includes an FPGA and a PCIE bridge chip, and in general, the PCIE switch further includes a CPU (Central Processing Unit), the PCIE bridge chip includes at least two NT ports, the FPGA includes a UART port, the PCIE bridge chip between the two PCIE switches is connected through the NT ports, and the NT port connection generally has a corresponding relationship, for example, NT port 0 of the active PCIE switch is connected to NT port 0 of the standby PCIE switch, NT port 1 of the active PCIE switch is connected to NT port 1 of the standby PCIE switch, and the FPGA between the two PCIE switches is connected through the UART port. In general, NT ports may be connected by optical fibers, and UART ports may be connected by 485 buses.

Based on the above embodiments, an embodiment of the present invention provides a PCIE communication system, as shown in fig. 5, including two PCIE subsystems, two switch boards, and two PCIE switches, where the PCIE subsystem includes two master control cards, one switch card, and two service cards, wherein, the main control card 1 is a main control card, the main control card 2 is a standby control card, the two switch boards are respectively used for collecting the configuration information of the two PCIE subsystems, the two NT ports of the two switch boards are respectively connected to the PCIE switchboard 1 and the PCIE switchboard 2, the PCIE switchboard 1 is a main PCIE switchboard, the PCIE switchboard 2 is a standby PCIE switchboard, under normal conditions, the PCIE switch 1 is physically connected to the two switch boards and can perform data exchange, the PCIE switch 2 is physically connected to the two switch boards but does not perform data exchange, and the PCIE switch 1 and the PCIE switch 2 are connected through the NT port, so that exchange of configuration information can be realized.

By applying the embodiment of the invention, the PCIE communication system provided comprises: the system comprises a plurality of PCIE subsystems and a plurality of PCIE switches, wherein the PCIE switches are used for providing data exchange paths with an external network for each PCIE subsystem, each PCIE subsystem comprises a main control card, an exchange card and a service card, the main control card and the service card are respectively connected to the exchange card, and the exchange card is used for providing the data exchange paths between the main control card and the service card. The plurality of PCIE switches comprise an active PCIE switch and at least one standby PCIE switch, wherein the active PCIE switch is used for obtaining and carrying out communication configuration according to communication configuration parameters of the PCIE communication system, and backing up the communication configuration parameters to the standby PCIE switch so that the standby PCIE switch carries out communication configuration according to the communication configuration parameters. The plurality of PCIE switches are additionally arranged in the PCIE communication system and used for providing data exchange paths for the PCIE subsystems, the PCIE switches can acquire communication configuration parameters of the PCIE communication system and can perform communication configuration based on the acquired communication configuration parameters, and the configuration function of the main control card can be realized by the PCIE switches even if the main control card of the subsystem is abnormal because the PCIE switches acquire the communication configuration parameters of the PCIE communication system, so that the normal operation of the PCIE communication system under the condition that the main control card is abnormal is effectively ensured, and the reliability of the PCIE communication system is improved.

And because the PCIE switch is provided with two roles of an active PCIE switch and a standby PICE switch, the active PCIE switch acquires communication configuration parameters and backups the communication configuration parameters to the standby PCIE switch, if the active PCIE switch is abnormal, the standby PCIE switch can also perform communication configuration because the communication configuration parameters are backed up in the standby PCIE switch, thereby ensuring that a PCIE communication system is not influenced by the abnormality of a single switch, ensuring the long-time stable operation provided by PCIE communication, and further improving the reliability of the system.

Based on the PCIE communication system, an embodiment of the present invention provides a communication configuration parameter backup method, which applies an active PCIE switch in the PCIE communication system, as shown in fig. 6, and the method may include the following steps.

S601, obtaining communication configuration parameters of the PCIE communication system, and carrying out communication configuration according to the communication configuration parameters.

The communication configuration parameter refers to configuration information of each PCIE subsystem in the PCIE communication system related to service processing, for example, a multicast function configuration parameter, a unicast function configuration parameter, a routing configuration parameter, and the like. The communication configuration parameters define which service cards in the PCIE communication system are subject to service processing, and the active PCIE switch may perform communication configuration based on the communication configuration parameters.

Optionally, S601 may specifically include: inquiring address information of a master control card in each PCIE subsystem; and acquiring communication configuration parameters of the PCIE communication system from the master control card in each PCIE subsystem based on the address information of the master control card in each PCIE subsystem.

The configuration parameters of each PCIE subsystem are configured on the main control card of the PCIE subsystem, and therefore, the PCIE switch needs to acquire the communication configuration parameters from the main control card, specifically, as shown in fig. 7, the PCIE switch accesses the device address of the main control card, needs to perform multiple address routing and conversion, mainly accesses the PCIE address register space through the PCIE memory address control unit, and finally accesses the device address information of the main control card through the access of the address register spaces of one layer and one layer, so that the communication configuration parameters of the PCIE communication system are acquired from the main control card in each PCIE subsystem based on the address information of the main control card.

S602, backup the communication configuration parameters to the standby PCIE switch, so that the standby PCIE switch performs communication configuration according to the communication configuration parameters.

After the active PCIE switch acquires the communication configuration parameters, the communication configuration parameters may be sent to the standby PCIE switch for backup, and the standby PCIE switch may perform communication configuration based on the backup communication configuration parameters. If the active PCIE switch is abnormal, the standby PCIE switch can also carry out communication configuration because the standby PCIE switch is backed up with communication configuration parameters, thereby ensuring that the PCIE communication system is not influenced by the abnormality of the single switch and ensuring the long-time stable operation provided by the PCIE communication.

Optionally, for the PCIE communication system, the communication configuration parameters mainly include a multicast function configuration parameter, a unicast function configuration parameter, and a routing configuration parameter, which are respectively described below.

Optionally, for the case that the communication configuration parameter includes a multicast function configuration parameter. The PCIE communication system may further include a switch board, where the switch board is connected to each PCIE subsystem and each PCIE switch, and the switch board is configured to provide a data exchange path between each PCIE subsystem and each PCIE switch.

Correspondingly, S601 may specifically be: acquiring multicast function configuration parameters, wherein the multicast function configuration parameters comprise identification information of a plurality of service cards configured to the same multicast group; and determining the multicast function configuration aiming at the switch board according to the identification information of the plurality of service cards.

S602 may specifically be: and sending the multicast function configuration parameters to the standby PCIE switch so that the standby PCIE switch backs up the multicast function configuration parameters and returns a backup success message to the active PCIE switch.

The method provided by the embodiment of the invention can also execute the following steps: and when receiving a backup success message returned by the standby PCIE switch, exchanging data with the plurality of service cards through the switch board based on the multicast function configuration aiming at the switch board.

The local PCIE multicast function of the PCIE is mainly realized by PCIE address fragmentation, and the multicast function across PCIE subsystems is mainly realized by 3 sub-modules: the PCIE request packet routing control module, the address routing conversion module and the multicast group address management module. The PCIE request packet routing control module is used for controlling a request routing ID mechanism and has 32 groups of routing table management in total; the address route conversion module mainly controls the address mapping relation on the PCIE path, and opens up a space in the PCIE address space, which is specially used for the mapping of the multicast group address.

As shown in fig. 8, in the multicast service function, the service cards 1, 3, and 5 need to join the same multicast group, the switch 1 and the switch 2 need information interaction, and assuming that the switch 1 is an active PCIE switch and the switch 2 is a standby PCIE switch, after the switch 1 performs multicast function configuration, the switch 2 backs up multicast function configuration parameters (mainly including multicast-managed addresses) through the PCIE request packet routing control module, the address routing conversion module, and the multicast group address management module. The switch 1 and the switch 2 can both perform multicast function configuration at this time, the configuration here is mainly to configure the switch board, configure the switch board to perform data exchange with those service cards, and under the condition that the active PCIE switch is normal, only the active PCIE switch starts the multicast function, and only when the active PCIE switch is abnormal and switched to the standby PCIE switch, the multicast function of the standby PCIE switch is started. In general, after the active PCIE switch confirms that the backup of the standby PCIE switch is completed, normal multicast data exchange may be performed.

As shown in fig. 9, the backup process of the multicast function configuration parameters mainly includes: the switch 1 (active PCIE switch) acquires multicast group information including the service cards 1, 3, and 5, first determines whether the service cards 1, 3, and 5 have joined the same multicast group, if not, adding the service cards 1, 3 and 5 into the same multicast group, if yes, all paths of the PCIE bridge are enabled to start the multicast function, that is, all multicast groups are actually added to the PCIE bridge of the switch board, therefore, no matter what multicast group data passes through, the switch board does not perform routing processing on the multicast group data, then the multicast group information is synchronized to the switch 2 (standby PCIE switch), the switch 2 configures the multicast function of the corresponding connection switch, sends the multicast group synchronization success message to the switch 1, and the switch 1 starts the multicast function of the switch board after receiving the synchronization success message. Because the switch 2 synchronously backs up the configuration parameters of the multicast function, the switch of the multicast function is enabled only when the switch switches from the master to the slave, so that the time required by the multicast function in master-slave switching can be greatly saved.

Optionally, for the case that the communication configuration parameters include unicast function configuration parameters. The PCIE communication system may further include a switch board, where the switch board is connected to each PCIE subsystem and each PCIE switch, and the switch board includes an uplink port, a plurality of downlink ports, and a plurality of NT ports, where the uplink port is connected to one PCIE subsystem, one downlink port is connected to one NT port, and one NT port is connected to one PCIE switch.

Correspondingly, S601 may specifically be: acquiring unicast function configuration parameters; and configuring parameters of a downlink port and a first port of an NT port in a switch board connected with the active PCIE switch according to the unicast function configuration parameters.

S602 may specifically be: when the active PCIE switch is determined to be switched to the standby PCIE switch, the first port parameter is sent to the standby PCIE switch, so that the standby PCIE switch configures the downlink port and the NT port in the switch board connected with the standby PCIE switch based on the first port parameter, and sends the second port parameter of the downlink port and the NT port in the switch board connected with the standby PCIE switch to the active PCIE switch.

The method provided by the embodiment of the invention can also execute the following steps: receiving a second port parameter sent by the standby PCIE switch; and configuring a downlink port and an NT port in a switch board connected with the active PCIE switch based on the second port parameter.

The unicast function configuration is mainly configuration of the NT port function and configuration of the PCIE address space, and since the unicast function is effective in real time, backup of the unicast function configuration parameters mainly occurs when the PCIE switch switches. As shown in fig. 3, NT port 0 and NT port 1 of the switch board are connected to switch 1 and switch 2, respectively, and it is assumed that switch 1 is an active PCIE switch and switch 2 is a standby PCIE switch, the backup of the NT port is to exchange configuration information of NT port 0 and NT port 1, and the configuration backup of the PCIE address space is to exchange configuration information of downlink port 1 and downlink port 2, and the configuration of the uplink port is maintained in the process of switching the backup.

Optionally, the communication configuration parameter includes a routing configuration parameter. Each NT port on the standby PCIE switch is connected to the corresponding NT port on the active PCIE switch.

Correspondingly, S601 may specifically be: acquiring a route configuration parameter; and configuring a routing table according to the routing configuration parameters.

S602 may specifically be: backing up the routing configuration parameters to the standby PCIE switch through the first NT port so that the standby PCIE switch sends a backup interrupt message to the main control card in each PCIE subsystem, and returns a confirmation message to the main PCIE switch after receiving the backup completion interrupt message replied by the main control card in each PCIE subsystem, wherein the first NT port is any NT port on the main PCIE switch; if the confirmation message returned by the standby PCIE switch is not received through the first NT port within the preset time, backing up the routing configuration parameters to the standby PCIE switch through the second NT port so that the standby PCIE switch sends a backup interrupt message to the main control card in each PCIE subsystem, and returns the confirmation message to the main PCIE switch after receiving the backup completion interrupt message returned by the main control card in each PCIE subsystem, wherein the second NT port is another NT port on the main PCIE switch except the first NT port; and if the confirmation message returned by the standby PCIE switch is received through the second NT port within the preset time, determining that the standby PCIE switch backs up the routing configuration parameters.

The routing configuration mechanism of PCIE mainly consists of two parts: ALUT (Address Lookup Table) configuration and ID routing configuration. The ALUT configuration is the address routing configuration of PCIE, and the ALUT is a segment of continuous address space of the NT port of the local end mapped into a plurality of distributed spaces of the opposite end, so as to implement a function of accessing different address spaces of the opposite end at the same time; the ALUT has 512 table entries which are respectively allocated to the virtual end and the connection end of the NT port 1 and the NT port 0, the ALUT configuration is respectively placed to the NT port 0 and the NT port 1 for use, and meanwhile, the ALUT configuration is required to be carried out at the virtual end in order to prevent the ALUTs of the NT port 0 and the NT port 1 from accessing each other and set to be a function which cannot be accessed, so that the problem of access authority of the ALUT is solved. In the ID route configuration, the ID route 32 group is shared, and the configuration mainly occurs when the ID route needs to be added or deleted again.

The switch 1 acquires the routing configuration parameters, performs configuration in response, mainly configures a routing table, then synchronizes the routing configuration parameters to the switch 2 for backup, in order to ensure that the switch 2 can normally backup the routing configuration parameters, the switch firstly sends the routing configuration parameters to the switch 2 through the NT port 0, the switch 2 sends an interrupt message to the main control card, the switch 2 returns a confirmation message to the switch 1 after receiving the interrupt message of backup completion replied by the main control card, if the switch 1 receives the confirmation message through the NT port 0 within a preset time, the switch 2 is considered to be successfully backed up, the switch 1 can perform data exchange based on the routing configuration, if the switch 1 does not receive the confirmation message through the NT port 0 within the preset time, the switch 2 is considered to be unsuccessfully backed up, the switch 1 resends the routing configuration parameters to the switch 2 through the NT port 1, and re-executing the steps until the switch 2 is determined to be successfully backed up.

As shown in fig. 10, taking the ALUT configuration backup as an example, switch 1 (active PCIE switch) first sends an ALUT configuration synchronization message to switch 2 (standby PCIE switch) through NT port 0, switch 2 sends an ALUT synchronization interrupt message to the master control card, the master control card returns an ALUT synchronization completed interrupt message to switch 2, switch 1 waits for an acknowledgement message returned by switch 2 in the timeout process, and if no acknowledgement message is returned in the timeout wait, then, it uses NT port 1 to perform ALUT configuration synchronization.

Optionally, S602 may specifically be: backing up the communication configuration parameters to a standby PCIE switchboard through a first NT port, wherein the first NT port is any NT port on the active PCIE switchboard; sending a backup interrupt message to the standby PCIE switch through the first NT port so as to drive the standby PCIE switch to return a confirmation message to the active PCIE switch; if the confirmation message returned by the standby PCIE switch is not received through the first NT port within the preset time, backing up the communication configuration parameters to the standby PCIE switch through the second NT port, wherein the second NT port is another NT port on the active PCIE switch except the first NT port; sending a backup interrupt message to the standby PCIE switch through the second NT port so as to drive the standby PCIE switch to return a confirmation message to the active PCIE switch; and if a confirmation message returned by the standby PCIE switch is received through the second NT port within the preset time, determining that the standby PCIE switch backs up the communication configuration parameters.

The information interaction between the PCIE switches mainly comprises heartbeat interaction of the PCIE switches, configuration information interaction between the PCIE switches and power-down switching processing of the PCIE switches.

The heartbeat interaction and the configuration information interaction of the PCIE switch are mainly realized by connecting two NT ports on the switch, where the NT ports are connected by an optical fiber, as in the switch connection diagram shown in fig. 4, in each PCIE bridge chip, two NT ports with the same configuration are, respectively, an NT port 0 of a switch 1 (active PCIE switch) is connected to an NT port 0 of a switch 2 (standby PCIE switch), and an NT port 1 of the switch 1 is connected to an NT port 1 of the switch 2.

The communication mode between the switches can adopt the mode of memory direct mapping for communication, as shown in fig. 11, the switch 1 directly writes the configuration information to be synchronized into the memory of the switch 2 through the NT port 0, and sends an interrupt message to the switch 2 through the NT port 0 to inform that the switch 2 has information to be synchronized, after the switch 2 receives the interrupt message, the switch 2 queries the information sent by the switch 1 in the memory and stores and records the information, such as the multicast function configuration parameter, the unicast function configuration parameter, etc., after the switch 2 finishes backing up the configuration information, the switch 2 sends an acknowledgement message to the switch through the NT port 0, if the switch 1 does not receive the acknowledgement message through the NT port 0 within the preset time, the switch 1 considers that the switch 2 does not successfully back up the configuration information, the switch 1 resends the configuration information to the switch 2 through the NT port 1, and re-executing the steps until the switch 2 is determined to be successfully backed up.

Optionally, the method provided in the embodiment of the present invention may further perform: sending a power-down message to the standby PCIE switch to start the standby PCIE switch, and sending a starting message to the active PCIE switch after the standby PCIE switch is started; when the starting message sent by the standby PCIE switchboard is received, carrying out power failure processing; or, receiving a power-down message sent by the standby PCIE switch, switching the own active working mode to the standby working mode, and performing power-down processing.

The power failure switching processing of the PCIE switch is mainly realized by an FPGA (field programmable gate array), the FPGA mainly realizes information interaction through a UART (universal asynchronous receiver/transmitter), and two modes are mainly adopted: an active power down switching mode and a passive power down switching mode. The active power-down switching mode is actively initiated by the active PCIE switchboard, the CPU of the active PCIE switchboard sends active power-down information to the FPGA of the local PCIE switchboard, the FPGA sends power-down information to the FPGA of the standby PCIE switchboard, the standby PCIE switchboard starts the standby PCIE switchboard immediately after receiving the active power-down information, the standby PCIE switchboard sends a starting message to the active PCIE switchboard after starting, the active PCIE switchboard carries out power-down processing when receiving the starting message sent by the standby PCIE switchboard, and the time sequence control can guarantee normal operation of the system.

The passive power-down mode means that the heartbeat interaction between the active and standby PCIE switches cannot be performed normally, and the standby PCIE switch cannot receive the heartbeat interaction of the active PCIE switch, so that the standby PCIE switch is switched from the standby operating mode to the active operating mode, and the FPGA of the standby PCIE switch sends power-down information to the FPGA of the active PCIE switch, and after receiving the power-down information, the working mode of the active PCIE switchboard is switched from the active working mode to the standby working mode, and does nonvolatile processing information storage, the main PCIE exchanger does power-down restarting processing of the whole machine, thus, the active PCIE exchanger can read the state of the standby working mode after restarting, and the active PCIE exchanger is enabled to work in the standby working mode, and the multicast function configuration parameters, the unicast function configuration parameters, the routing configuration parameters and the like are subjected to information synchronous backup processing.

Correspondingly, an embodiment of the present invention further provides a communication configuration parameter backup method, which is applied to a standby PCIE switch in the PCIE communication system, as shown in fig. 12, and the method may include the following steps.

S1201, receive a communication configuration parameter sent by the active PCIE switch.

Correspondingly, S1201 may specifically be: receiving a multicast function configuration parameter sent by a main PCIE exchanger; and backing up the multicast function configuration parameters and returning a backup success message to the active PCIE switchboard.

The process of the multicast function configuration parameter backup is already described in the embodiment shown in fig. 6, and is not described here again.

And S1202, performing communication configuration according to the communication configuration parameters.

Optionally, for the case that the communication configuration parameters include unicast function configuration parameters. The PCIE communication system may further include a switch board, where the switch board is connected to each PCIE subsystem and each PCIE switch, and the switch board includes an uplink port, multiple downlink ports, and multiple NT ports, where the uplink port is connected to one PCIE subsystem, one downlink port is connected to one NT port, and one NT port is connected to one PCIE switch.

Correspondingly, S1201 may specifically be: when the active PCIE switch is determined to be switched to the standby PCIE switch, setting an NT port in a switch board connected with the standby PCIE switch as a management port, and recording second port parameters of a downlink port and the NT port in the switch board connected with the standby PCIE switch, wherein the second port parameters are port parameters corresponding to the standby PCIE switch which are configured in advance according to unicast function configuration parameters; receiving a first port parameter sent by an active PCIE switch, wherein the first port parameter is a first port parameter of a downlink port and an NT port in a switch board connected with the active PCIE switch, and the first port parameter is a port parameter corresponding to the active PCIE switch, which is configured in advance according to a unicast function configuration parameter.

S1202 may specifically be: and configuring a downlink port and an NT port in a switch board connected with the standby PCIE switch based on the first port parameter.

The method may further perform: and sending the second port parameter to the active PCIE switch so that the active PCIE switch configures the downlink port and the NT port in the switch board connected with the active PCIE switch based on the second port parameter.

As shown in fig. 13, when it is required to switch from switch 1 (active PCIE switch) to switch 2 (standby PCIE switch), first, the NT port corresponding to switch 2 needs to be configured as a management port, register spaces of downstream port 1 and NT port 0 can be normally accessed, address configuration of NT port 0 is read and written into address configuration of NT port 1, register groups such as PCIE type 1 configuration header register group, I/O address control register group, and address register group capable of being prefetched related to downstream port 1 are read, information of these register groups is written into type 1 configuration header register group related to downstream port 2, and finally, NT port 1 and downstream port 2 are configured and restored into NT port 0 and downstream port 1, the operation of NT port 0 and downstream port 1 is closed, which mainly is to close I/O access of upstream port and storage access of upstream port, the management port can still access the closed downstream port and NT port, unaffected.

Optionally, for the case that the communication configuration parameter includes a routing configuration parameter. Each NT port on the standby PCIE switch is connected to a corresponding NT port on the active PCIE switch.

S1201 may specifically be: and receiving the routing configuration parameters sent by the active PCIE switch through a first NT port, wherein the first NT port is any NT port on the standby PCIE switch.

The method may further perform: and sending a backup interrupt message to the master control card in each PCIE subsystem, and returning a confirmation message to the main PCIE exchanger after receiving the backup completion interrupt message replied by the master control card in each PCIE subsystem.

The process of backing up the routing configuration parameters is already described in the embodiment shown in fig. 6, and is not described herein again.

Optionally, S1201 may specifically be: receiving communication configuration parameters sent by an active PCIE switch through a first NT port, wherein the first NT port is any NT port on the active PCIE switch; and receiving, by the first NT port, a backup interrupt message sent by the active PCIE switch, and returning a confirmation message to the active PCIE switch, so that the active PCIE switch determines that the standby PCIE switch has backed up the communication configuration parameters after receiving the confirmation message.

The process of information interaction between the switches has been described in the embodiment shown in fig. 6, and is not described here again.

Optionally, the method may further perform: if a power-down message sent by the active PCIE switchboard is received, the standby PCIE switchboard is started, and a starting message is sent to the active PCIE switchboard after the standby PCIE switchboard is started, so that the active PCIE switchboard carries out power-down processing when receiving the starting message; or, sending a power-down message to the active PCIE switch, so that the active PCIE switch switches its own active working mode to a standby working mode, and performs power-down processing; and switching the self standby working mode into the main working mode.

The power down switching process of the PCIE switch has been described in detail in the embodiment shown in fig. 6, and is not described here again.

By applying the embodiment of the invention, a plurality of PCIE switches are added in the PCIE communication system and are used for providing data exchange paths for each PCIE subsystem, the PCIE switches can acquire the communication configuration parameters of the PCIE communication system and can carry out communication configuration based on the acquired communication configuration parameters, and because the PCIE switches already acquire the communication configuration parameters of the PCIE communication system, even if the main control card of the subsystem is abnormal, the configuration function of the main control card can be realized by the PCIE switches, thereby effectively ensuring the normal operation of the PCIE communication system under the condition that the main control card is abnormal, and further improving the reliability of the PCIE communication system.

Corresponding to the above method embodiment, an embodiment of the present invention provides a communication configuration parameter backup device, which is applied to an active PCIE switch in a PCIE communication system, where the PCIE communication system includes a plurality of PCIE subsystems and a plurality of PCIE switches, each PCIE subsystem includes a master control card, a switch card, and a service card, the master control card and the service card are respectively connected to the switch cards, the plurality of PCIE switches include an active PCIE switch and at least one standby PCIE switch, and the PCIE switches are configured to provide a data exchange path for each PCIE subsystem, as shown in fig. 14, the device may include:

an obtaining module 1410, configured to obtain a communication configuration parameter of the PCIE communication system, and perform communication configuration according to the communication configuration parameter;

a backup module 1420, configured to backup the communication configuration parameters to the standby PCIE switch, so that the standby PCIE switch performs communication configuration according to the communication configuration parameters.

Optionally, the obtaining module 1410 may specifically be configured to:

inquiring address information of a master control card in each PCIE subsystem; and acquiring communication configuration parameters of the PCIE communication system from the master control card in each PCIE subsystem based on the address information of the master control card in each PCIE subsystem.

Optionally, the communication configuration parameters may include: multicast function configuration parameters; the PCIE communication system may further include a switch board, where the switch board is connected to each PCIE subsystem and each PCIE switch, respectively, and the switch board is configured to provide a data exchange path between each PCIE subsystem and each PCIE switch;

the obtaining module 1410 may be specifically configured to:

acquiring multicast function configuration parameters, wherein the multicast function configuration parameters comprise identification information of a plurality of service cards configured to the same multicast group; determining multicast function configuration aiming at the switch board according to the identification information of the plurality of service cards;

the backup module 1420 may be specifically configured to:

sending the multicast function configuration parameters to the standby PCIE switch so that the standby PCIE switch backs up the multicast function configuration parameters and returns a backup success message to the active PCIE switch;

the apparatus may further comprise:

and the data exchange module is used for exchanging data with the plurality of service cards through the exchange board based on the multicast function configuration aiming at the exchange board when receiving the backup success message returned by the standby PCIE exchanger.

Optionally, the communication configuration parameters may include: unicast function configuration parameters; the PCIE communication system may further include a switch board, where the switch board is connected to each PCIE subsystem and each PCIE switch, and the switch board includes an uplink port, a plurality of downlink ports, and a plurality of NT ports, where the uplink port is connected to one PCIE subsystem, one downlink port is connected to one NT port, and one NT port is connected to one PCIE switch;

the obtaining module 1410 may be specifically configured to:

acquiring unicast function configuration parameters; configuring parameters of a downlink port and a first port of an NT port in a switch board connected with the active PCIE switch according to the unicast function configuration parameters;

the backup module 1420 may be specifically configured to:

when the active PCIE switchboard is determined to be switched to the standby PCIE switchboard, sending a first port parameter to the standby PCIE switchboard so that the standby PCIE switchboard configures a downlink port and an NT port in a switchboard connected with the standby PCIE switchboard based on the first port parameter, and sending a second port parameter of the downlink port and the NT port in the switchboard connected with the standby PCIE switchboard to the active PCIE switchboard;

the apparatus may further include:

the receiving module is used for receiving the second port parameters sent by the standby PCIE switchboard;

and the configuration module is used for configuring the downlink port and the NT port in the switch board connected with the active PCIE switch based on the second port parameter.

Optionally, the communication configuration parameters may include: a routing configuration parameter; each NT port on the standby PCIE switch is respectively connected to the corresponding NT port on the active PCIE switch;

the obtaining module 1410 may be specifically configured to:

acquiring a route configuration parameter; configuring a routing table according to the routing configuration parameters;

backup module 1420 may be specifically configured to:

backing up the routing configuration parameters to the standby PCIE switch through the first NT port so that the standby PCIE switch sends a backup interrupt message to the main control card in each PCIE subsystem, and returns a confirmation message to the main PCIE switch after receiving the backup completion interrupt message replied by the main control card in each PCIE subsystem, wherein the first NT port is any NT port on the main PCIE switch; if the confirmation message returned by the standby PCIE switch is not received through the first NT port within the preset time, the routing configuration parameters are backed up to the standby PCIE switch through the second NT port, so that the standby PCIE switch sends a backup interruption message to the main control card in each PCIE subsystem, and returns the confirmation message to the main PCIE switch after receiving the backup completion interruption message replied by the main control card in each PCIE subsystem, wherein the second NT port is another NT port on the main PCIE switch except the first NT port; and if the confirmation message returned by the standby PCIE switch is received through the second NT port within the preset time, determining that the standby PCIE switch backs up the routing configuration parameters.

Optionally, the backup module 1420 may be specifically configured to:

backing up the communication configuration parameters to a standby PCIE switchboard through a first NT port, wherein the first NT port is any NT port on the active PCIE switchboard; sending a backup interrupt message to the standby PCIE switch through the first NT port so as to drive the standby PCIE switch to return a confirmation message to the active PCIE switch; if the confirmation message returned by the standby PCIE switch is not received through the first NT port within the preset time, the communication configuration parameters are backed up to the standby PCIE switch through the second NT port, and the second NT port is another NT port on the active PCIE switch except the first NT port; sending a backup interrupt message to the standby PCIE switchboard through the second NT port so as to drive the standby PCIE switchboard to return a confirmation message to the active PCIE switchboard; and if a confirmation message returned by the standby PCIE switch is received through the second NT port within the preset time, determining that the standby PCIE switch backs up the communication configuration parameters.

Optionally, the apparatus may further include:

the system comprises a sending module, a standby PCIE switch and a power failure module, wherein the sending module is used for sending a power failure message to the standby PCIE switch so as to start the standby PCIE switch and sending a starting message to the active PCIE switch after the standby PCIE switch is started; when a starting message sent by a standby PCIE switchboard is received, carrying out power failure processing;

and the receiving module is used for receiving the power failure message sent by the standby PCIE switch, switching the main working mode of the receiving module into the standby working mode and performing power failure processing.

The embodiment of the present invention provides a communication configuration parameter backup device, which is applied to a standby PCIE switch in a PCIE communication system, where the PCIE communication system includes multiple PCIE subsystems and multiple PCIE switches, each PCIE subsystem includes a master control card, a switch card, and a service card, the master control card and the service card are respectively connected to the switch cards, the multiple PCIE switches include one active PCIE switch and at least one standby PCIE switch, and the PCIE switch is configured to provide a data exchange path for each PCIE subsystem, as shown in fig. 15, the device may include:

a receiving module 1510, configured to receive a communication configuration parameter sent by the active PCIE switch;

a configuration module 1520, configured to perform communication configuration according to the communication configuration parameters.

the receiving module 1510 may specifically be configured to:

receiving a multicast function configuration parameter sent by a main PCIE exchanger; and backing up the multicast function configuration parameters and returning a backup success message to the main PCIE switchboard.

the receiving module 1510 may specifically be configured to:

when the active PCIE switch is determined to be switched to the standby PCIE switch, setting an NT port in a switch board connected with the standby PCIE switch as a management port, and recording second port parameters of a downlink port and the NT port in the switch board connected with the standby PCIE switch, wherein the second port parameters are port parameters corresponding to the standby PCIE switch which are configured in advance according to unicast function configuration parameters; receiving a first port parameter sent by an active PCIE switch, wherein the first port parameter is a first port parameter of a downlink port and an NT port in a switch board connected with the active PCIE switch, and the first port parameter is a port parameter corresponding to the active PCIE switch and configured in advance according to a unicast function configuration parameter;

configuration module 1520 may be specifically configured to:

configuring a downlink port and an NT port in a switch board connected with a standby PCIE switch based on the first port parameter;

the apparatus may further include:

and the sending module is used for sending the second port parameter to the active PCIE switch, so that the active PCIE switch configures the downlink port and the NT port in the switch board connected to the active PCIE switch based on the second port parameter.

the receiving module 1510 may specifically be configured to:

receiving a routing configuration parameter sent by an active PCIE switch through a first NT port, wherein the first NT port is any NT port on a standby PCIE switch;

the apparatus may further include:

and the sending module is used for sending the backup interruption message to the main control card in each PCIE subsystem and returning a confirmation message to the main PCIE switch after receiving the backup completion interruption message replied by the main control card in each PCIE subsystem.

Optionally, the receiving module 1510 may be specifically configured to:

receiving communication configuration parameters sent by an active PCIE switch through a first NT port, wherein the first NT port is any NT port on the active PCIE switch; and receiving, by the first NT port, a backup interrupt message sent by the active PCIE switch, and returning a confirmation message to the active PCIE switch, so that the active PCIE switch determines that the standby PCIE switch has backed up the communication configuration parameters after receiving the confirmation message.

Optionally, the apparatus may further include:

the starting module is used for starting the standby PCIE switchboard if receiving a power failure message sent by the active PCIE switchboard, and sending a starting message to the active PCIE switchboard after starting so as to enable the active PCIE switchboard to perform power failure processing when receiving the starting message;

the system comprises a sending module, a receiving module and a processing module, wherein the sending module is used for sending a power failure message to an active PCIE switchboard so that the active PCIE switchboard switches a main working mode of the active PCIE switchboard into a standby working mode and carries out power failure processing; and switching the self standby working mode into the main working mode.

An embodiment of the present invention further provides a PCIE switch, as shown in fig. 16, including a processor 1601 and a memory 1602, where the memory 1602 stores a machine executable instruction that can be executed by the processor 1601, and the machine executable instruction is loaded and executed by the processor 1601, so as to implement the communication configuration parameter backup method applied to a main PCIE switch provided in the embodiment of the present invention.

The embodiment of the present invention further provides a PCIE switch, as shown in fig. 17, including a processor 1701 and a memory 1702, where the memory 1702 stores a machine executable instruction that can be executed by the processor 1701, and the machine executable instruction is loaded and executed by the processor 1701, so as to implement the communication configuration parameter backup method applied to a standby PCIE switch provided in the embodiment of the present invention.

The Memory may include a RAM (Random Access Memory) or an NVM (Non-volatile Memory), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.

The Processor may be a general-purpose Processor including a CPU, an NP (Network Processor), and the like; but also DSPs (Digital Signal processors), ASICs (Application Specific Integrated circuits), FPGAs or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

Data transmission between the memory 1602 and the processor 1601, and between the memory 1702 and the processor 1701 may be performed by wired connection or wireless connection, and communication between the PCIE switch and another device may be performed by a wired communication interface or a wireless communication interface. Fig. 16 and 17 are only examples of data transmission via a bus, and are not limited to specific connection methods.

In the embodiment of the present invention, the processor can realize that: the plurality of PCIE switches are additionally arranged in the PCIE communication system and used for providing data exchange paths for the PCIE subsystems, the PCIE switches can acquire communication configuration parameters of the PCIE communication system and can perform communication configuration based on the acquired communication configuration parameters, and the configuration function of the main control card can be realized by the PCIE switches even if the main control card of the subsystem is abnormal because the PCIE switches already acquire the communication configuration parameters of the PCIE communication system, so that the normal operation of the PCIE communication system under the condition that the main control card is abnormal is effectively ensured, and the reliability of the PCIE communication system is improved. And because the PCIE switch is provided with two roles of an active PCIE switch and a standby PICE switch, the active PCIE switch acquires communication configuration parameters and backups the communication configuration parameters to the standby PCIE switch, if the active PCIE switch is abnormal, the standby PCIE switch can also perform communication configuration because the communication configuration parameters are backed up in the standby PCIE switch, thereby ensuring that a PCIE communication system is not influenced by the abnormality of a single switch, ensuring the long-time stable operation provided by PCIE communication, and further improving the reliability of the system.

In addition, an embodiment of the present invention further provides a machine-readable storage medium, where a machine-executable instruction is stored in the machine-readable storage medium, and when the machine-executable instruction is loaded and executed by a processor, the method for backing up communication configuration parameters applied to an active PCIE switch provided in the embodiment of the present invention is implemented.

The embodiment of the invention also provides a machine-readable storage medium, wherein the machine-readable storage medium stores machine-executable instructions, and the machine-executable instructions are loaded and executed by the processor to realize the communication configuration parameter backup method applied to the standby PCIE switch.

In the embodiment of the present invention, the machine-readable storage medium stores machine-executable instructions for executing the method provided in the embodiment of the present invention when executed, so that the following can be implemented: the plurality of PCIE switches are additionally arranged in the PCIE communication system and used for providing data exchange paths for the PCIE subsystems, the PCIE switches can acquire communication configuration parameters of the PCIE communication system and can perform communication configuration based on the acquired communication configuration parameters, and the configuration function of the main control card can be realized by the PCIE switches even if the main control card of the subsystem is abnormal because the PCIE switches already acquire the communication configuration parameters of the PCIE communication system, so that the normal operation of the PCIE communication system under the condition that the main control card is abnormal is effectively ensured, and the reliability of the PCIE communication system is improved. And because the PCIE switch is provided with two roles of an active PCIE switch and a standby PICE switch, the active PCIE switch acquires communication configuration parameters and backups the communication configuration parameters to the standby PCIE switch, if the active PCIE switch is abnormal, the standby PCIE switch can also perform communication configuration because the communication configuration parameters are backed up in the standby PCIE switch, thereby ensuring that a PCIE communication system is not influenced by the abnormality of a single switch, ensuring the long-time stable operation provided by PCIE communication, and further improving the reliability of the system.

As for the embodiments of the PCIE switch and the machine-readable storage medium, since the contents of the related methods are basically similar to the foregoing embodiments of the methods, the description is relatively simple, and reference may be made to the partial description of the embodiments of the methods for the related points.

It should be noted that, in this document, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the device, PCIE switch, and machine-readable storage medium embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and for relevant points, reference may be made to the partial description of the method embodiments.

The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.

Claims

1. A PCIE communication system, the PCIE communication system comprising: a plurality of PCIE subsystems and a plurality of PCIE switches; the PCIE switchboard is used for providing a data exchange path for each PCIE subsystem;

the plurality of PCIE switches comprise an active PCIE switch and at least one standby PCIE switch, wherein the active PCIE switch is used for inquiring the address information of the master control card in each PCIE subsystem, and acquiring the communication configuration parameters of the PCIE communication system from the master control card in each PCIE subsystem based on the address information of the master control card in each PCIE subsystem; and performing communication configuration on the service processing function of the service card under each PCIE subsystem according to the communication configuration parameters of the PCIE communication system, and backing up the communication configuration parameters to the standby PCIE switch, so that the standby PCIE switch performs communication configuration on the service processing function of the service card under each PCIE subsystem according to the communication configuration parameters, where the communication configuration parameters are: and configuration information related to service processing of each PCIE subsystem in the PCIE communication system.

2. The PCIE communication system of claim 1, wherein the number of the master control cards in the PCIE subsystem is multiple, wherein the multiple master control cards include one active master control card and at least one standby master control card.

3. The PCIE communication system of claim 1, wherein the PCIE communication system further comprises a switch board;

4. The PCIE communication system according to claim 3, wherein the switch board comprises an uplink port, a plurality of downlink ports, and a plurality of non-transparent bridge NT ports, wherein the uplink port is connected to one PCIE subsystem, one downlink port is connected to one NT port correspondingly, and one NT port is connected to one PCIE switch correspondingly.

5. The PCIE communication system according to claim 1, wherein the PCIE switch comprises a field programmable gate array FPGA and a PCIE bridge chip, the PCIE bridge chip comprises at least two NT ports, the FPGA comprises a universal serial data bus UART port;

6. A communication configuration parameter backup method is characterized in that the method is applied to an active PCIE switch in a PCIE communication system, the PCIE communication system comprises a plurality of PCIE subsystems and a plurality of PCIE switches, the PCIE subsystems comprise a master control card, a switch card and a service card, the master control card and the service card are respectively connected to the switch card, the PCIE switches comprise an active PCIE switch and at least one standby PCIE switch, and the PCIE switches are used for providing data exchange paths for the PCIE subsystems, and the method comprises the following steps:

acquiring communication configuration parameters of the PCIE communication system, and performing communication configuration according to the communication configuration parameters, where the acquiring the communication configuration parameters of the PCIE communication system includes: inquiring address information of a master control card in each PCIE subsystem, and acquiring communication configuration parameters of the PCIE communication system from the master control card in each PCIE subsystem based on the address information of the master control card in each PCIE subsystem; the communication configuration parameters are as follows: configuration information related to service processing of each PCIE subsystem in the PCIE communication system; the performing communication configuration according to the communication configuration parameters includes: performing communication configuration on the service processing function of the service card under each PCIE subsystem according to the communication configuration parameters of the PCIE communication system;

7. The method of claim 6, wherein the communication configuration parameters comprise: multicast function configuration parameters; the PCIE communication system also comprises a switch board, wherein the switch board is respectively connected with each PCIE subsystem and each PCIE switchboard, and the switch board is used for providing a data exchange path between each PCIE subsystem and each PCIE switchboard;

the method further comprises the following steps:

8. The method of claim 6, wherein the communication configuration parameters comprise: unicast function configuration parameters; the PCIE communication system further includes a switch board, where the switch board is connected to each PCIE subsystem and each PCIE switch, and the switch board includes an uplink port, a plurality of downlink ports, and a plurality of NT ports, where the uplink port is connected to one PCIE subsystem, one downlink port is connected to one NT port, and one NT port is connected to one PCIE switch;

acquiring unicast function configuration parameters;

the method further comprises the following steps:

receiving the second port parameter sent by the standby PCIE switch;

9. The method of claim 6, wherein the communication configuration parameters comprise: a routing configuration parameter; each NT port on the standby PCIE switch is respectively connected to the corresponding NT port on the active PCIE switch;

acquiring a route configuration parameter;

configuring a routing table according to the routing configuration parameters;

10. The method according to any one of claims 6-9, wherein the backing up the communication configuration parameters to the standby PCIE switch comprises:

11. The method of claim 6, further comprising:

alternatively, the first and second electrodes may be,

12. A communication configuration parameter backup method is characterized in that the method is applied to a standby PCIE switch in a PCIE communication system, the PCIE communication system comprises a plurality of PCIE subsystems and a plurality of PCIE switches, the PCIE subsystems comprise a main control card, a switch card and a service card, the main control card and the service card are respectively connected to the switch card, the PCIE switches comprise an active PCIE switch and at least one standby PCIE switch, and the PCIE switches are used for providing data exchange paths for the PCIE subsystems, and the method comprises the following steps:

receiving communication configuration parameters sent by the active PCIE switch, wherein the communication configuration parameters are: the active PCIE switch is configured to: inquiring address information of a master control card in each PCIE subsystem, and acquiring communication configuration parameters of the PCIE communication system from the master control card in each PCIE subsystem based on the address information of the master control card in each PCIE subsystem;

performing communication configuration according to the communication configuration parameters, wherein the performing communication configuration according to the communication configuration parameters includes: and performing communication configuration on the service processing function of the service card under each PCIE subsystem according to the communication configuration parameters of the PCIE communication system.

13. The method of claim 12, wherein the communication configuration parameters comprise: multicast function configuration parameters; the PCIE communication system also comprises a switch board, wherein the switch board is respectively connected with each PCIE subsystem and each PCIE switchboard, and the switch board is used for providing a data exchange path between each PCIE subsystem and each PCIE switchboard;

14. The method of claim 12, wherein the communication configuration parameters comprise: unicast function configuration parameters; the PCIE communication system further includes a switch board, where the switch board is connected to each PCIE subsystem and each PCIE switch, and the switch board includes an uplink port, a plurality of downlink ports, and a plurality of NT ports, where the uplink port is connected to one PCIE subsystem, one downlink port is connected to one NT port, and one NT port is connected to one PCIE switch;

when the active PCIE switch is determined to be switched to the standby PCIE switch, setting an NT port in the switch board connected with the standby PCIE switch as a management port, and recording second port parameters of a downlink port and the NT port in the switch board connected with the standby PCIE switch, wherein the second port parameters are port parameters corresponding to the standby PCIE switch and configured in advance according to the unicast function configuration parameters;

the method further comprises the following steps:

15. The method of claim 12, wherein the communication configuration parameters comprise: a routing configuration parameter; each NT port on the standby PCIE switch is respectively connected to a corresponding NT port on the active PCIE switch;

the method further comprises the following steps:

16. The method according to any one of claims 12-15, wherein the receiving the communication configuration parameters sent by the active PCIE switch comprises:

17. The method of claim 12, further comprising:

alternatively, the first and second electrodes may be,

18. The utility model provides a communication configuration parameter backup device, its characterized in that is applied to the active PCIE switch in the PCIE communication system, PCIE communication system includes a plurality of PCIE subsystems and a plurality of PCIE switch, the PCIE subsystem includes master control card, switch card and business card, master control card and the business card is connected to respectively the switch card, a plurality of PCIE switches include an active PCIE switch and at least one spare PCIE switch, the PCIE switch is used for providing the data switching route for each PCIE subsystem, the device includes:

an obtaining module, configured to query address information of a master control card in each PCIE subsystem, and obtain, based on the address information of the master control card in each PCIE subsystem, a communication configuration parameter of the PCIE communication system from the master control card in each PCIE subsystem; performing communication configuration on the service processing function of the service card under each PCIE subsystem according to the communication configuration parameters of the PCIE communication system; wherein the communication configuration parameters are: configuration information related to service processing of each PCIE subsystem in the PCIE communication system;

19. The utility model provides a communication configuration parameter backup device, its characterized in that is applied to the spare PCIE switch in the PCIE communication system, PCIE communication system includes a plurality of PCIE subsystems and a plurality of PCIE switch, the PCIE subsystem includes master control card, switch card and business card, master control card and the business card is connected to respectively the switch card, a plurality of PCIE switches include an active PCIE switch and at least one spare PCIE switch, the PCIE switch is used for providing the data exchange route for each PCIE subsystem, the device includes:

a receiving module, configured to receive a communication configuration parameter sent by the active PCIE switch, where the communication configuration parameter is: configuration information of each PCIE subsystem in the PCIE communication system, which is related to service processing, wherein the active PCIE switch is used for: inquiring address information of a master control card in each PCIE subsystem, and acquiring communication configuration parameters of the PCIE communication system from the master control card in each PCIE subsystem based on the address information of the master control card in each PCIE subsystem;

and the configuration module is used for performing communication configuration on the service processing function of the service card under each PCIE subsystem according to the communication configuration parameters of the PCIE communication system.

20. A PCIE switch comprising a processor and a memory, wherein the memory stores machine executable instructions executable by the processor, the machine executable instructions being loaded and executed by the processor to implement the method of any one of claims 6-11 or 12-17.

21. A machine-readable storage medium having stored therein machine-executable instructions which, when loaded and executed by a processor, implement the method of any of claims 6-11 or 12-17.