CN114285786B - Construction method and device of network link library - Google Patents
Construction method and device of network link library Download PDFInfo
- Publication number
- CN114285786B CN114285786B CN202111601394.2A CN202111601394A CN114285786B CN 114285786 B CN114285786 B CN 114285786B CN 202111601394 A CN202111601394 A CN 202111601394A CN 114285786 B CN114285786 B CN 114285786B
- Authority
- CN
- China
- Prior art keywords
- address
- data transmission
- transmission path
- path information
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000010276 construction Methods 0.000 title claims description 7
- 230000005540 biological transmission Effects 0.000 claims abstract description 187
- 238000000034 method Methods 0.000 claims abstract description 53
- 230000004931 aggregating effect Effects 0.000 claims abstract description 26
- 230000002776 aggregation Effects 0.000 claims abstract description 23
- 238000004220 aggregation Methods 0.000 claims abstract description 23
- 238000004140 cleaning Methods 0.000 claims abstract description 7
- 230000002159 abnormal effect Effects 0.000 claims description 43
- 238000004458 analytical method Methods 0.000 claims description 17
- 230000036541 health Effects 0.000 claims description 9
- 238000006116 polymerization reaction Methods 0.000 claims description 3
- 230000008569 process Effects 0.000 description 15
- 238000010586 diagram Methods 0.000 description 10
- 230000009471 action Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 238000009960 carding Methods 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000007670 refining Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/50—Reducing energy consumption in communication networks in wire-line communication networks, e.g. low power modes or reduced link rate
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention provides a method and a device for constructing a network link library, wherein data transmission path information recorded by each load balancing device can be acquired; determining target data transmission path information which does not meet the data cleaning condition from the data transmission path information; based on the intermediate device address of each target data transmission path information, carrying out aggregation processing on each target data transmission path information to obtain an initial network link corresponding to each intermediate device address; aggregating all initial network links to obtain a network link library; the network link library comprises a plurality of application access path groups; each application access path group contains application access paths, each application access path including a target sender address, at least one intermediary device address, and a target receiver address. The connection pair information can be aggregated, so that a network link library can be quickly constructed, and fault location can be quickly performed based on the network link library.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a method and an apparatus for constructing a network link library.
Background
With the development of information technology, people increasingly rely on computer networks to make the reliability of the operation of the computer networks become critical, so that people have higher requirements on network management.
At present, in the process of managing a network, traffic path information among various devices in the network is generally collected through various load balancing devices, then connection pair information is simply classified, when the devices are in failure, failure devices and influence ranges are difficult to determine from a plurality of connection pair information, and network management requirements of technicians cannot be met.
Disclosure of Invention
The invention aims to provide a construction method of a network link library, which can quickly and accurately construct the network link library so as to realize fault location.
The invention also provides a construction device of the network link library, which is used for ensuring the realization and application of the method in practice.
A construction method of a network link library comprises the following steps:
responding to a link analysis instruction, and determining each load balancing device corresponding to the link analysis instruction;
acquiring the information of each data transmission path recorded in advance by each load balancing device; each data transmission path information comprises a transmitting end address, an intermediate device address and a receiving end address; the intermediate device address is the address of the load balancing device for recording the data transmission path information;
Determining target data transmission path information which does not meet preset data cleaning conditions from the data transmission path information;
based on the intermediate device address of each target data transmission path information, carrying out aggregation processing on each target data transmission path information to obtain an initial network link corresponding to each intermediate device address;
determining a target sender address in each sender address of each initial network link, and determining a target receiver address in each receiver address of each initial network link; the target transmitting end corresponding to the target transmitting end address belongs to a preset first application module; the target receiving end corresponding to the target receiving end address belongs to a preset second application module;
according to each target sending end address and each target receiving end address, aggregating each initial network link to obtain a network link library; the network link library comprises a plurality of application access path groups; each application access path group comprises at least one application access path, and each application access path comprises a target sender address, at least one intermediate device address and a target receiver address.
In the above method, optionally, the aggregating the target data transmission path information based on the intermediate device address of the target data transmission path information to obtain an initial network link corresponding to each intermediate device address includes:
dividing each target data transmission path information according to the intermediate equipment address of each target data transmission path information to obtain a plurality of data groups; each data group comprises target data transmission path information with consistent addresses of a plurality of intermediate devices;
aggregating the target data transmission path information of each data group to obtain an initial network link corresponding to each intermediate equipment address; the initial network link corresponding to each intermediate device address comprises a plurality of sending end addresses, the intermediate device addresses and a plurality of receiving end addresses.
In the above method, optionally, the aggregating each initial network link according to each target sender address and each target receiver address to obtain a network link library includes:
determining that the addresses except the target sender address in the sender addresses of the initial network link are intermediate device addresses, and determining that the addresses except the target receiver address in the receiver addresses of the initial network link are intermediate device addresses;
And aggregating each initial network link based on the intermediate equipment address of each initial network link to obtain a network link library.
In the above method, optionally, the determining, in each data transmission path information, target data transmission path information that does not satisfy a preset data cleansing condition includes:
determining first data transmission path information of which the transmission protocol is a preset TCP transmission control protocol from the data transmission path information;
determining second data transmission path information except for the first data transmission path information generated by health examination of the load balancing equipment in each first data transmission path information;
determining third data transmission path information generated by successful data transmission of the load balancing equipment in the second data transmission path information;
and determining the third data transmission path information as target data transmission path information meeting the data cleansing condition.
The method, optionally, after obtaining the network link library, further includes:
when an abnormal inquiry request is received, acquiring an abnormal address contained in the abnormal inquiry request;
Matching the abnormal address with the network link library to determine an application access path corresponding to the abnormal address;
and displaying the application access path corresponding to the abnormal address.
A network link library construction apparatus, comprising:
the first determining unit is used for responding to the link analysis instruction and determining each load balancing device corresponding to the link analysis instruction;
an acquisition unit, configured to acquire information of each data transmission path recorded in advance by each load balancing device; each data transmission path information comprises a transmitting end address, an intermediate device address and a receiving end address; the intermediate device address is the address of the load balancing device for recording the data transmission path information;
a second determining unit configured to determine target data transmission path information that does not satisfy a preset data cleansing condition from among the respective data transmission path information;
the first aggregation unit is used for carrying out aggregation processing on each piece of target data transmission path information based on the intermediate device address of each piece of target data transmission path information to obtain an initial network link corresponding to each intermediate device address;
A third determining unit, configured to determine a target sender address from the sender addresses of each initial network link, and determine a target receiver address from the receiver addresses of each initial network link; the target transmitting end corresponding to the target transmitting end address belongs to a preset first application module; the target receiving end corresponding to the target receiving end address belongs to a preset second application module;
the second aggregation unit is used for aggregating each initial network link according to each target sending end address and each target receiving end address to obtain a network link library; the network link library comprises a plurality of application access path groups; each application access path group comprises at least one application access path, and each application access path comprises a target sender address, at least one intermediate device address and a target receiver address.
The above apparatus, optionally, the first aggregation unit includes:
the first execution subunit is used for dividing each target data transmission path information according to the intermediate equipment address of each target data transmission path information to obtain a plurality of data groups; each data group comprises target data transmission path information with consistent addresses of a plurality of intermediate devices;
The first aggregation subunit is used for aggregating the target data transmission path information of each data group to obtain an initial network link corresponding to each intermediate equipment address; the initial network link corresponding to each intermediate device address comprises a plurality of sending end addresses, the intermediate device addresses and a plurality of receiving end addresses.
The above apparatus, optionally, the second polymerization unit includes:
a first determining subunit, configured to determine, from each of the sender addresses of the initial network link, an address other than the target sender address as an intermediate device address, and determine, from each of the receiver addresses of the initial network link, an address other than the target receiver address as an intermediate device address;
and the second aggregation subunit is used for aggregating each initial network link based on the intermediate equipment address of each initial network link to obtain a network link library.
The above apparatus, optionally, the second determining unit includes:
a second determining subunit, configured to determine, from each data transmission path information, first data transmission path information that a transmission protocol is a preset TCP transmission control protocol;
A third determining subunit, configured to determine, from the first data transmission path information, second data transmission path information other than the first data transmission path information generated by the health check performed by the load balancing device;
a fourth determining subunit, configured to determine, in each second data transmission path information, third data transmission path information generated by successful data transmission by the load balancing device;
a fifth determining subunit configured to determine the third data transmission path information as target data transmission path information that satisfies the data cleansing condition.
The above device, optionally, further comprises:
the device comprises a receiving unit, a processing unit and a processing unit, wherein the receiving unit is used for acquiring an abnormal address contained in an abnormal inquiry request when the abnormal inquiry request is received;
the matching unit is used for matching the abnormal address with the network link library so as to determine an application access path corresponding to the abnormal address;
and the display unit is used for displaying the application access path corresponding to the abnormal address.
The embodiment of the invention provides a method and a device for constructing a network link library, wherein the method comprises the following steps: responding to a link analysis instruction, and determining each load balancing device corresponding to the link analysis instruction; acquiring the information of each data transmission path recorded in advance by each load balancing device; each data transmission path information comprises a transmitting end address, an intermediate device address and a receiving end address; the intermediate device address is the address of the load balancing device for recording the data transmission path information; determining target data transmission path information which does not meet preset data cleaning conditions from the data transmission path information; based on the intermediate device address of each target data transmission path information, carrying out aggregation processing on each target data transmission path information to obtain an initial network link corresponding to each intermediate device address; determining a target sender address in each sender address of each initial network link, and determining a target receiver address in each receiver address of each initial network link; the target transmitting end corresponding to the target transmitting end address belongs to a preset first application module; the target receiving end corresponding to the target receiving end address belongs to a preset second application module; according to each target sending end address and each target receiving end address, aggregating each initial network link to obtain a network link library; the network link library comprises a plurality of application access path groups; each application access path group comprises at least one application access path, and each application access path comprises a target sender address, at least one intermediate device address and a target receiver address. The connection pair information can be aggregated, so that a network link library can be quickly constructed, and fault location can be quickly performed based on the network link library.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are required to be used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only embodiments of the present invention, and that other drawings can be obtained according to the provided drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a method for constructing a network link library according to the present invention;
FIG. 2 is a flow chart of a process for obtaining an initial network link corresponding to each intermediate device address according to the present invention;
FIG. 3 is a diagram of an exemplary architecture of a data processing system according to the present invention;
FIG. 4 is an exemplary diagram of an initial network link provided by the present invention;
FIG. 5 is an exemplary diagram of a network link provided by the present invention;
FIG. 6 is an exemplary diagram of an application access group provided by the present invention;
fig. 7 is a schematic structural diagram of a device for constructing a network link library according to the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
In the present disclosure, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The application is operational with numerous general purpose or special purpose computing device environments or configurations. For example: personal computers, server computers, hand-held or portable devices, tablet devices, multiprocessor devices, distributed computing environments that include any of the above devices or devices, and the like.
The embodiment of the application provides a method for constructing a network link library, which can be applied to various system platforms, wherein an execution subject of the method can be a processor of a computer terminal or various mobile devices, and a flow chart of the method is shown in fig. 1, and specifically comprises the following steps:
S101: and responding to the link analysis instruction, and determining each load balancing device corresponding to the link analysis instruction.
In this embodiment, the load balancing device corresponding to the link analysis instruction may be various types of load balancing devices, for example, may be an F5 load balancing device, where the load balancing device is configured to be set at a front end of a group of servers with the same or similar functions, and reasonably distribute traffic arriving at the server group.
S102: acquiring the information of each data transmission path recorded in advance by each load balancing device; each data transmission path information comprises a transmitting end address, an intermediate device address and a receiving end address; the intermediate device address is the address of the load balancing device which records the data transmission path information.
In this embodiment, the data transmission path information may be connection pair information, where the data transmission path information may represent that data flows from a device to which a sender address belongs to a load device to which an intermediate device address belongs, and then flows from a load balancing device to a device to which a receiver address belongs; the device to which the sender address belongs and the device to which the receiver address belongs may be various types of electronic devices, for example, may be servers in a server cluster.
Alternatively, the sender address may include an IP address and a port of the sender, and the receiver address may include an IP address and a port of the receiver.
S103: and determining target data transmission path information which does not meet preset data cleaning conditions from the data transmission path information.
In this embodiment, it may be determined whether each data transmission path information satisfies a preset data cleansing condition, the data transmission path information satisfying the data cleansing condition may be cleansed, and the data transmission path information not satisfying the data cleansing condition may be determined as target data transmission path information.
Optionally, the data cleansing condition may be that the data transmission protocol corresponding to the data transmission path information is not a TCP transmission control protocol, and the data transmission path information is generated by the load balancing device self health check or the data packet corresponding to the data transmission path information is not successfully distributed.
S104: and carrying out aggregation processing on each piece of target data transmission path information based on the intermediate device address of each piece of target data transmission path information to obtain an initial network link corresponding to each intermediate device address.
In this embodiment, aggregation processing is performed on each target data transmission path information, and repeated target data transmission paths in each target data transmission path information may be combined, and repeated transmitting end addresses, repeated intermediate device addresses, or repeated receiving end addresses in each target data path information having the same intermediate device address may be combined.
S105: determining a target sender address in each sender address of each initial network link, and determining a target receiver address in each receiver address of each initial network link; the target transmitting end corresponding to the target transmitting end address belongs to a preset first application module; and the target receiving end corresponding to the target receiving end address belongs to a preset second application module.
In this embodiment, the first application module may be an application module for sending data, the second application module may be an application module for receiving data, and each sending end address and each receiving end address may be matched with a preset comparison relation table to determine a target sending end address in each sending end address and a target receiving end address in each receiving end address, where the object relation table includes an association relation between each address and each application module, and for each address having an association relation with the application module, a device corresponding to the address belongs to the application module.
S106: according to each target sending end address and each target receiving end address, aggregating each initial network link to obtain a network link library; the network link library comprises a plurality of application access path groups; each application access path group comprises at least one application access path, and each application access path comprises a target sender address, at least one intermediate device address and a target receiver address.
In this implementation, each application access path group may correspond to a different first application module, and the first application modules corresponding to each target sender address in the application access path in each application access path group are consistent.
By applying the method provided by the embodiment of the invention, the connection pair information can be aggregated, so that a network link library can be quickly constructed, and further, fault location can be quickly performed based on the network link library.
In an embodiment of the present invention, based on the implementation process, optionally, the aggregating process is performed on each piece of target data transmission path information based on an intermediate device address of each piece of target data transmission path information, so as to obtain an initial network link corresponding to each intermediate device address, as shown in fig. 2, including:
s201: dividing each target data transmission path information according to the intermediate equipment address of each target data transmission path information to obtain a plurality of data groups; each data group contains target data transmission path information with consistent addresses of a plurality of intermediate devices.
In this embodiment, the respective target data transmission path information is divided according to the intermediate device addresses in the respective target data transmission path information, and a data group corresponding to each intermediate device address is obtained.
S202: aggregating the target data transmission path information of each data group to obtain an initial network link corresponding to each intermediate equipment address; the initial network link corresponding to each intermediate device address comprises a plurality of sending end addresses, the intermediate device addresses and a plurality of receiving end addresses.
Optionally, for each data group, aggregating the target data transmission path information in the data group to obtain an initial network link, where the initial network link includes a plurality of sender addresses, an intermediate device address, and a plurality of receiver addresses.
In an embodiment of the present invention, based on the foregoing implementation process, optionally, the aggregating the initial network links according to each target sender address and each target receiver address to obtain a network link library includes:
determining that the addresses except the target sender address in the sender addresses of the initial network link are intermediate device addresses, and determining that the addresses except the target receiver address in the receiver addresses of the initial network link are intermediate device addresses;
And aggregating each initial network link based on the intermediate equipment address of each initial network link to obtain a network link library.
In this embodiment, the connection relationship between the intermediate devices may be determined first, and the initial network links corresponding to the intermediate devices are aggregated according to the connection relationship between the intermediate devices, to obtain a network link library.
In an embodiment of the present invention, based on the implementation process, optionally, determining, from the data transmission path information, target data transmission path information that does not satisfy a preset data cleansing condition includes:
determining first data transmission path information of which the transmission protocol is a preset TCP transmission control protocol from the data transmission path information;
determining second data transmission path information except for the first data transmission path information generated by health examination of the load balancing equipment in each first data transmission path information;
determining third data transmission path information generated by successful data transmission of the load balancing equipment in the second data transmission path information;
And determining the third data transmission path information as target data transmission path information meeting the data cleansing condition.
In this embodiment, the data transmission path information whose transmission protocol is not the TCP transmission control protocol, the data transmission path information generated by the load balancing device performing the health check, and the data transmission path information which is not successfully transmitted may be filtered.
In an embodiment of the present invention, based on the implementation process, optionally, after obtaining the network link library, the method further includes:
when an abnormal inquiry request is received, acquiring an abnormal address contained in the abnormal inquiry request;
matching the abnormal address with the network link library to determine an application access path corresponding to the abnormal address;
and displaying the application access path corresponding to the abnormal address.
In this embodiment, the abnormal address may be an address of an abnormal device, or may be an address of a device of the abnormal application module.
Optionally, by determining the application access path corresponding to the abnormal address, the abnormal application range and the specific fault location can be rapidly determined.
The method for constructing the network link library provided by the embodiment of the invention can be applied to various fields, for example, the method can be applied to a banking system, wherein the banking system comprises a network consisting of a plurality of devices, and for example, the method can comprise a plurality of server clusters, load balancing devices, data processing devices and a configuration center.
Optionally, the load balancer of the server is set at the front end of a group of servers with the same or similar functions, reasonably distributes the traffic arriving at the server group, and can transfer the access request to software or network equipment of other servers capable of working normally when one of the servers fails, where the load balancing equipment in this embodiment may be an F5 load balancing equipment.
In the embodiment of the invention, connection pair information is collected on F5 equipment at fixed time, and each piece of connection pair information is such as '10.227.4.71:60672, 10.235.91.221:555, 10.235.91.193:60672, 10.235.214.169:555, tcp, 11, (tmm: 2)', 4 pieces of IP and port information are included, and the IP and port of a sending end, the IP and port of F5VS (F5 virtual server), the Floating IP address and port, and the IP and port information of a receiving end are sequentially shown from left to right.
In some embodiments, as shown in fig. 3, which is a structural example diagram of a data processing system provided by the embodiment of the present invention, connection pair information, that is, data transmission path information, acquired by each F5 device at regular time may be acquired by an F5 acquisition module, and the connection pair information acquired by the F5 acquisition module may be subjected to data cleaning and data merging by the F5 data processing module to obtain a network link library. The specific process is as follows:
The data cleaning is performed first, and data of a non-TCP (transmission control protocol) connection pair, connection pair data of F5 self health check and data which are not successfully distributed in the connection pair information can be cleaned, and the rest of the connection pair information is used as target data transmission path information.
And then data merging is carried out, wherein the data merging can be divided into three parts, namely source IP merging, destination IP merging and F5VS merging.
In the embodiment of the invention, a configuration library can be combined, so that each IP can obtain F5 PoolMember (load balancing pool member) associated with the IP, and the F5 PoolMember can be further associated with an application module or F5VS; the F5VS may merge the IP and port of the F5VS over the connection pair.
The first step: merging three elements, namely the source IP, the F5VS IP, the port, the destination IP and the port, which are the same, to obtain metadata of each access relation, and recording the occurrence times of the access relation as the liveness of the access pair.
And a second step of: based on the first step, merging is performed by using the F5VS IP and the port as elements, as shown in fig. 4, which is an example diagram of an initial network link provided by the embodiment of the present invention, access pairs with the same F5VS IP and port may be merged, and duplicate IPs of a source end and a destination end may be cleaned respectively, so as to obtain an initial network link.
And a third step of: on the basis of the second step, comparing source-destination IPs, finding all F5VS accessed by the source-destination IPs, and further refining to obtain a set of network links, as shown in fig. 5, which is an example diagram of a network link provided in the embodiment of the present invention, where the network link indicates that there is a set of source IPs, and accessing another set of IPs through a plurality of parallel F5 VS.
Fourth step: on the basis of the third step, combining with the configuration library, the IP group of the source end finds out a corresponding cluster according to F5 Pool (load balancing Pool) of each sub-category, further knows the sub-category of the application module according to the relation between the IP and the application module, and the IP group of the destination end carries out the same analysis, and the IP group of the destination end possibly associates F5VS, namely, the situation of F5 cascade exists, and then the analysis continues to the third step until the IP of the destination end associates the application module. Finally, the mutual access links of all the deployed applications of the data center are obtained to form a link access relation library, and each application access group in the link access relation library is shown in fig. 6, which is an example diagram of an application access group provided by the embodiment of the invention. Each source IP and the destination IP accessed by the application form a path to be accessed, and a network link corresponding to the application network path and network equipment on the network link can be obtained by combining the configuration library to form a network link library.
In an embodiment provided by the invention, after the network link library is constructed, deployment and access relations of all applications of the data center can be obtained through carding, and hidden production operation hidden hazards caused by hidden links, unknown access and the like are eliminated. Under the condition that a certain network device is known to be faulty, a network link where the network device is located is obtained according to a network link library, an affected IP pair is found, and then an affected application and a transaction link are inquired through a table. In case that a plurality of applications are known to be abnormal, the IP pairs associated with the abnormal applications can be determined according to the application link access relation library, and then the network link library is combined to find the network equipment common to the IP pairs, wherein the fault probability of the network equipment is very high.
Corresponding to the method shown in fig. 1, the embodiment of the present invention further provides a device for constructing a network link library, which is used for implementing the method in fig. 1, where the device for constructing a network link library provided in the embodiment of the present invention may be applied to a server, and the structural schematic diagram of the device is shown in fig. 7, and specifically includes:
a first determining unit 701, configured to determine, in response to a link analysis instruction, each load balancing device corresponding to the link analysis instruction;
An obtaining unit 702, configured to obtain respective data transmission path information recorded in advance by each of the load balancing devices; each data transmission path information comprises a transmitting end address, an intermediate device address and a receiving end address; the intermediate device address is the address of the load balancing device for recording the data transmission path information;
a second determining unit 703 configured to determine target data transmission path information that does not satisfy a preset data cleansing condition from among the respective data transmission path information;
a first aggregation unit 704, configured to aggregate each piece of target data transmission path information based on an intermediate device address of each piece of target data transmission path information, to obtain an initial network link corresponding to each intermediate device address;
a third determining unit 705, configured to determine a target sender address from the sender addresses of each of the initial network links, and determine a target receiver address from the receiver addresses of each of the initial network links; the target transmitting end corresponding to the target transmitting end address belongs to a preset first application module; the target receiving end corresponding to the target receiving end address belongs to a preset second application module;
A second aggregation unit 706, configured to aggregate each of the initial network links according to each of the target sender addresses and each of the target receiver addresses, to obtain a network link library; the network link library comprises a plurality of application access path groups; each application access path group comprises at least one application access path, and each application access path comprises a target sender address, at least one intermediate device address and a target receiver address.
In an embodiment of the present invention, based on the foregoing solution, optionally, the first aggregation unit 704 includes:
the first execution subunit is used for dividing each target data transmission path information according to the intermediate equipment address of each target data transmission path information to obtain a plurality of data groups; each data group comprises target data transmission path information with consistent addresses of a plurality of intermediate devices;
the first aggregation subunit is used for aggregating the target data transmission path information of each data group to obtain an initial network link corresponding to each intermediate equipment address; the initial network link corresponding to each intermediate device address comprises a plurality of sending end addresses, the intermediate device addresses and a plurality of receiving end addresses.
In an embodiment of the present invention, based on the foregoing solution, optionally, the second polymerization unit 706 includes:
a first determining subunit, configured to determine, from each of the sender addresses of the initial network link, an address other than the target sender address as an intermediate device address, and determine, from each of the receiver addresses of the initial network link, an address other than the target receiver address as an intermediate device address;
and the second aggregation subunit is used for aggregating each initial network link based on the intermediate equipment address of each initial network link to obtain a network link library.
In an embodiment of the present invention, based on the above solution, optionally, the second determining unit 703 includes:
a second determining subunit, configured to determine, from each data transmission path information, first data transmission path information that a transmission protocol is a preset TCP transmission control protocol;
a third determining subunit, configured to determine, from the first data transmission path information, second data transmission path information other than the first data transmission path information generated by the health check performed by the load balancing device;
A fourth determining subunit, configured to determine, in each second data transmission path information, third data transmission path information generated by successful data transmission by the load balancing device;
a fifth determining subunit configured to determine the third data transmission path information as target data transmission path information that satisfies the data cleansing condition.
In an embodiment of the present invention, based on the above solution, optionally, the method further includes:
the device comprises a receiving unit, a processing unit and a processing unit, wherein the receiving unit is used for acquiring an abnormal address contained in an abnormal inquiry request when the abnormal inquiry request is received;
the matching unit is used for matching the abnormal address with the network link library so as to determine an application access path corresponding to the abnormal address;
and the display unit is used for displaying the application access path corresponding to the abnormal address.
The specific principle and execution process of each unit and module in the device for constructing a network link library disclosed in the above embodiment of the present invention are the same as those of the method for constructing a network link library disclosed in the above embodiment of the present invention, and may refer to corresponding parts in the method for constructing a network link library provided in the above embodiment of the present invention, which are not described herein again.
It should be noted that, in the present specification, each embodiment is described in a progressive manner, and each embodiment is mainly described as different from other embodiments, and identical and similar parts between the embodiments are all enough to be referred to each other. For the apparatus class embodiments, the description is relatively simple as it is substantially similar to the method embodiments, and reference is made to the description of the method embodiments for relevant points.
Finally, it is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
For convenience of description, the above devices are described as being functionally divided into various units, respectively. Of course, the functions of each element may be implemented in the same piece or pieces of software and/or hardware when implementing the present invention.
From the above description of embodiments, it will be apparent to those skilled in the art that the present invention may be implemented in software plus a necessary general hardware platform. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the embodiments or some parts of the embodiments of the present invention.
The above describes in detail a method for constructing a network link library provided by the present invention, and specific examples are applied herein to describe the principles and embodiments of the present invention, where the description of the above examples is only for helping to understand the method and core ideas of the present invention; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in accordance with the ideas of the present invention, the present description should not be construed as limiting the present invention in view of the above.
Claims (10)
1. The construction method of the network link library is characterized by comprising the following steps:
responding to a link analysis instruction, and determining each load balancing device corresponding to the link analysis instruction;
acquiring the information of each data transmission path recorded in advance by each load balancing device; each data transmission path information comprises a transmitting end address, an intermediate device address and a receiving end address; the intermediate device address is the address of the load balancing device for recording the data transmission path information;
determining target data transmission path information which does not meet preset data cleaning conditions from the data transmission path information;
based on the intermediate device address of each target data transmission path information, carrying out aggregation processing on each target data transmission path information to obtain an initial network link corresponding to each intermediate device address;
determining a target sender address in each sender address of each initial network link, and determining a target receiver address in each receiver address of each initial network link; the target transmitting end corresponding to the target transmitting end address belongs to a preset first application module; the target receiving end corresponding to the target receiving end address belongs to a preset second application module;
According to each target sending end address and each target receiving end address, aggregating each initial network link to obtain a network link library; the network link library comprises a plurality of application access path groups; each application access path group comprises at least one application access path, and each application access path comprises a target sender address, at least one intermediate device address and a target receiver address.
2. The method according to claim 1, wherein the aggregating the target data transmission path information based on the intermediate device address of the target data transmission path information to obtain an initial network link corresponding to each intermediate device address, includes:
dividing each target data transmission path information according to the intermediate equipment address of each target data transmission path information to obtain a plurality of data groups; each data group comprises target data transmission path information with consistent addresses of a plurality of intermediate devices;
aggregating the target data transmission path information of each data group to obtain an initial network link corresponding to each intermediate equipment address; the initial network link corresponding to each intermediate device address comprises a plurality of sending end addresses, the intermediate device addresses and a plurality of receiving end addresses.
3. The method according to claim 1, wherein aggregating each of the initial network links according to each of the target sender addresses and each of the target receiver addresses to obtain a network link library comprises:
determining that the addresses except the target sender address in the sender addresses of the initial network link are intermediate device addresses, and determining that the addresses except the target receiver address in the receiver addresses of the initial network link are intermediate device addresses;
and aggregating each initial network link based on the intermediate equipment address of each initial network link to obtain a network link library.
4. The method according to claim 1, wherein the determining, among the respective data transmission path information, target data transmission path information that does not satisfy a preset data cleansing condition includes:
determining first data transmission path information of which the transmission protocol is a preset TCP transmission control protocol from the data transmission path information;
determining second data transmission path information except for the first data transmission path information generated by health examination of the load balancing equipment in each first data transmission path information;
Determining third data transmission path information generated by successful data transmission of the load balancing equipment in the second data transmission path information;
and determining the third data transmission path information as target data transmission path information which does not satisfy the data cleansing condition.
5. The method of claim 1, wherein after obtaining the network link library, further comprising:
when an abnormal inquiry request is received, acquiring an abnormal address contained in the abnormal inquiry request;
matching the abnormal address with the network link library to determine an application access path corresponding to the abnormal address;
and displaying the application access path corresponding to the abnormal address.
6. A device for constructing a network link library, comprising:
the first determining unit is used for responding to the link analysis instruction and determining each load balancing device corresponding to the link analysis instruction;
an acquisition unit, configured to acquire information of each data transmission path recorded in advance by each load balancing device; each data transmission path information comprises a transmitting end address, an intermediate device address and a receiving end address; the intermediate device address is the address of the load balancing device for recording the data transmission path information;
A second determining unit configured to determine target data transmission path information that does not satisfy a preset data cleansing condition from among the respective data transmission path information;
the first aggregation unit is used for carrying out aggregation processing on each piece of target data transmission path information based on the intermediate device address of each piece of target data transmission path information to obtain an initial network link corresponding to each intermediate device address;
a third determining unit, configured to determine a target sender address from the sender addresses of each initial network link, and determine a target receiver address from the receiver addresses of each initial network link; the target transmitting end corresponding to the target transmitting end address belongs to a preset first application module; the target receiving end corresponding to the target receiving end address belongs to a preset second application module;
the second aggregation unit is used for aggregating each initial network link according to each target sending end address and each target receiving end address to obtain a network link library; the network link library comprises a plurality of application access path groups; each application access path group comprises at least one application access path, and each application access path comprises a target sender address, at least one intermediate device address and a target receiver address.
7. The apparatus of claim 6, wherein the first aggregation unit comprises:
the first execution subunit is used for dividing each target data transmission path information according to the intermediate equipment address of each target data transmission path information to obtain a plurality of data groups; each data group comprises target data transmission path information with consistent addresses of a plurality of intermediate devices;
the first aggregation subunit is used for aggregating the target data transmission path information of each data group to obtain an initial network link corresponding to each intermediate equipment address; the initial network link corresponding to each intermediate device address comprises a plurality of sending end addresses, the intermediate device addresses and a plurality of receiving end addresses.
8. The apparatus of claim 7, wherein the second polymerization unit comprises:
a first determining subunit, configured to determine, from each of the sender addresses of the initial network link, an address other than the target sender address as an intermediate device address, and determine, from each of the receiver addresses of the initial network link, an address other than the target receiver address as an intermediate device address;
And the second aggregation subunit is used for aggregating each initial network link based on the intermediate equipment address of each initial network link to obtain a network link library.
9. The apparatus according to claim 7, wherein the second determining unit includes:
a second determining subunit, configured to determine, from each data transmission path information, first data transmission path information that a transmission protocol is a preset TCP transmission control protocol;
a third determining subunit, configured to determine, from the first data transmission path information, second data transmission path information other than the first data transmission path information generated by the health check performed by the load balancing device;
a fourth determining subunit, configured to determine, in each second data transmission path information, third data transmission path information generated by successful data transmission by the load balancing device;
a fifth determining subunit configured to determine the third data transmission path information as target data transmission path information that satisfies the data cleansing condition.
10. The apparatus as recited in claim 6, further comprising:
The device comprises a receiving unit, a processing unit and a processing unit, wherein the receiving unit is used for acquiring an abnormal address contained in an abnormal inquiry request when the abnormal inquiry request is received;
the matching unit is used for matching the abnormal address with the network link library so as to determine an application access path corresponding to the abnormal address;
and the display unit is used for displaying the application access path corresponding to the abnormal address.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111601394.2A CN114285786B (en) | 2021-12-24 | 2021-12-24 | Construction method and device of network link library |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111601394.2A CN114285786B (en) | 2021-12-24 | 2021-12-24 | Construction method and device of network link library |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114285786A CN114285786A (en) | 2022-04-05 |
| CN114285786B true CN114285786B (en) | 2023-12-08 |
Family
ID=80875195
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111601394.2A Active CN114285786B (en) | 2021-12-24 | 2021-12-24 | Construction method and device of network link library |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114285786B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115866071A (en) * | 2023-02-28 | 2023-03-28 | 中信云网有限公司 | Method and device for determining reporting path of initial equipment attribute information |
Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004104709A (en) * | 2002-09-12 | 2004-04-02 | Furukawa Electric Co Ltd:The | Access network system |
| JP2005136589A (en) * | 2003-10-29 | 2005-05-26 | Hitachi Cable Ltd | Relay apparatus with aggregation function |
| WO2012136078A1 (en) * | 2011-04-06 | 2012-10-11 | Hangzhou H3C Technologies Co., Ltd. | A method for traffic load balancing |
| US8661295B1 (en) * | 2011-03-31 | 2014-02-25 | Amazon Technologies, Inc. | Monitoring and detecting causes of failures of network paths |
| CN105743816A (en) * | 2014-12-10 | 2016-07-06 | 华为技术有限公司 | Link aggregation method and device |
| WO2016161836A1 (en) * | 2015-04-07 | 2016-10-13 | 胡汉强 | Data transmission method, control plane device and forwarding plane device |
| CN106982170A (en) * | 2017-04-19 | 2017-07-25 | 上海海加网络科技有限公司 | Multi-link load balance method and device based on linux system |
| CN107493178A (en) * | 2016-06-12 | 2017-12-19 | 富士通株式会社 | information aggregation method, device and system |
| CN108123824A (en) * | 2016-11-30 | 2018-06-05 | 华为技术有限公司 | A kind of network fault detecting method and device |
| CN111008075A (en) * | 2019-12-05 | 2020-04-14 | 安超云软件有限公司 | Load balancing system, method, device, equipment and medium |
| CN111049752A (en) * | 2019-12-17 | 2020-04-21 | 锐捷网络股份有限公司 | Load balancing method and device for multiple transmission lines |
| CN111654402A (en) * | 2020-06-23 | 2020-09-11 | 中国平安财产保险股份有限公司 | Network topology creating method, device, equipment and storage medium |
| CN111740860A (en) * | 2020-06-15 | 2020-10-02 | 中国工商银行股份有限公司 | Log data transmission link monitoring method and device |
| CN112291116A (en) * | 2020-11-23 | 2021-01-29 | 迈普通信技术股份有限公司 | Link fault detection method and device and network equipment |
| CN113298672A (en) * | 2021-05-21 | 2021-08-24 | 中国电信股份有限公司 | Commercial power fault monitoring method, device, system, storage medium and electronic equipment |
| CN113364678A (en) * | 2021-06-18 | 2021-09-07 | 北京奇艺世纪科技有限公司 | Data transmission system, method, device, electronic equipment and computer readable medium |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7333501B2 (en) * | 2005-01-14 | 2008-02-19 | Cisco Technology, Inc. | Techniques for determining network nodes to represent, multiple subnetworks for a routing protocol |
-
2021
- 2021-12-24 CN CN202111601394.2A patent/CN114285786B/en active Active
Patent Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004104709A (en) * | 2002-09-12 | 2004-04-02 | Furukawa Electric Co Ltd:The | Access network system |
| JP2005136589A (en) * | 2003-10-29 | 2005-05-26 | Hitachi Cable Ltd | Relay apparatus with aggregation function |
| US8661295B1 (en) * | 2011-03-31 | 2014-02-25 | Amazon Technologies, Inc. | Monitoring and detecting causes of failures of network paths |
| WO2012136078A1 (en) * | 2011-04-06 | 2012-10-11 | Hangzhou H3C Technologies Co., Ltd. | A method for traffic load balancing |
| CN105743816A (en) * | 2014-12-10 | 2016-07-06 | 华为技术有限公司 | Link aggregation method and device |
| WO2016161836A1 (en) * | 2015-04-07 | 2016-10-13 | 胡汉强 | Data transmission method, control plane device and forwarding plane device |
| CN107493178A (en) * | 2016-06-12 | 2017-12-19 | 富士通株式会社 | information aggregation method, device and system |
| CN108123824A (en) * | 2016-11-30 | 2018-06-05 | 华为技术有限公司 | A kind of network fault detecting method and device |
| CN106982170A (en) * | 2017-04-19 | 2017-07-25 | 上海海加网络科技有限公司 | Multi-link load balance method and device based on linux system |
| CN111008075A (en) * | 2019-12-05 | 2020-04-14 | 安超云软件有限公司 | Load balancing system, method, device, equipment and medium |
| CN111049752A (en) * | 2019-12-17 | 2020-04-21 | 锐捷网络股份有限公司 | Load balancing method and device for multiple transmission lines |
| CN111740860A (en) * | 2020-06-15 | 2020-10-02 | 中国工商银行股份有限公司 | Log data transmission link monitoring method and device |
| CN111654402A (en) * | 2020-06-23 | 2020-09-11 | 中国平安财产保险股份有限公司 | Network topology creating method, device, equipment and storage medium |
| CN112291116A (en) * | 2020-11-23 | 2021-01-29 | 迈普通信技术股份有限公司 | Link fault detection method and device and network equipment |
| CN113298672A (en) * | 2021-05-21 | 2021-08-24 | 中国电信股份有限公司 | Commercial power fault monitoring method, device, system, storage medium and electronic equipment |
| CN113364678A (en) * | 2021-06-18 | 2021-09-07 | 北京奇艺世纪科技有限公司 | Data transmission system, method, device, electronic equipment and computer readable medium |
Non-Patent Citations (2)
| Title |
|---|
| 基于链路响应的负载均衡网络实现;鞠洪尧;;齐齐哈尔大学学报(自然科学版)(第03期);全文 * |
| 基于链路聚合的数据专网互联网出口边缘侧保护机制;周伟;朱家琪;金豪;;通信技术(第11期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114285786A (en) | 2022-04-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9665420B2 (en) | Causal engine and correlation engine based log analyzer | |
| US10389596B2 (en) | Discovering application topologies | |
| US11269718B1 (en) | Root cause detection and corrective action diagnosis system | |
| US10389745B2 (en) | System and methods for detecting bots real-time | |
| US9882841B2 (en) | Validating workload distribution in a storage area network | |
| US9355007B1 (en) | Identifying abnormal hosts using cluster processing | |
| CN107124289B (en) | Weblog time alignment method, device and host | |
| US9043317B2 (en) | System and method for event-driven prioritization | |
| US11074652B2 (en) | System and method for model-based prediction using a distributed computational graph workflow | |
| CN109039787B (en) | Log processing method and device and big data cluster | |
| US10185614B2 (en) | Generic alarm correlation by means of normalized alarm codes | |
| CN110071978A (en) | A kind of method and device of cluster management | |
| TW201525714A (en) | Method for monitoring warehousing of service operating data, data source server, data monitoring center server, and communication system | |
| CN111800501B (en) | Method and device for processing service request, storage medium and electronic equipment | |
| CN114285786B (en) | Construction method and device of network link library | |
| CN112737800A (en) | Service node fault positioning method, call chain generation method and server | |
| CN111784516A (en) | Method and device for determining service path and electronic equipment | |
| KR20180089479A (en) | User data sharing method and device | |
| CN114143000B (en) | Method and device for inquiring trace based on careless transmission protocol and secret sharing | |
| CN109345249A (en) | A kind of payment fail processing method and device | |
| KR20200007912A (en) | Methods, devices, and systems for monitoring data traffic | |
| CN115150289B (en) | Anomaly handling method and system based on composite monitoring | |
| Sosnowski et al. | Monitoring event logs within a cluster system | |
| US11588678B2 (en) | Generating incident response action recommendations using anonymized action implementation data | |
| US9935836B2 (en) | Exclusive IP zone support systems and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |