CN117319269A - Data transmission control method and device, equipment and medium - Google Patents

Data transmission control method and device, equipment and medium Download PDF

Info

Publication number
CN117319269A
CN117319269A CN202210709730.3A CN202210709730A CN117319269A CN 117319269 A CN117319269 A CN 117319269A CN 202210709730 A CN202210709730 A CN 202210709730A CN 117319269 A CN117319269 A CN 117319269A
Authority
CN
China
Prior art keywords
data transmission
data
transmission
network performance
performance index
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210709730.3A
Other languages
Chinese (zh)
Inventor
刘国旭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN202210709730.3A priority Critical patent/CN117319269A/en
Publication of CN117319269A publication Critical patent/CN117319269A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/10Active monitoring, e.g. heartbeat, ping or trace-route
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/46Interconnection of networks
    • H04L12/4633Interconnection of networks using encapsulation techniques, e.g. tunneling
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/06Management of faults, events, alarms or notifications
    • H04L41/0631Management of faults, events, alarms or notifications using root cause analysis; using analysis of correlation between notifications, alarms or events based on decision criteria, e.g. hierarchy, tree or time analysis
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/06Management of faults, events, alarms or notifications
    • H04L41/0677Localisation of faults
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08Configuration management of networks or network elements
    • H04L41/0803Configuration setting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0805Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0823Errors, e.g. transmission errors
    • H04L43/0829Packet loss
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0852Delays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0876Network utilisation, e.g. volume of load or congestion level
    • H04L43/0888Throughput

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Environmental & Geological Engineering (AREA)
  • Health & Medical Sciences (AREA)
  • Cardiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The embodiment of the application discloses a control method, a device, equipment and a medium for data transmission. The method comprises the following steps: the method comprises the steps that a detecting party detects network performance aiming at a data transmission process of a data transmission special line to obtain a plurality of detection data packets, then a stream computing party can calculate based on the plurality of detection data packets, detect and obtain a data transmission condition of the data transmission special line in the data transmission process, send fault information to a control party when the detected data transmission condition represents that the data transmission has faults, and then the control party can determine a fault type based on the fault information and adjust the data transmission special line in a matching mode with the fault type. The technical scheme of the application realizes the detection of the special data transmission line, ensures the normal transmission of data and greatly optimizes the control scheme of data transmission.

Description

Data transmission control method and device, equipment and medium
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a data transmission control method, a data transmission control device, an electronic device, and a computer readable medium.
Background
In network function virtualization (Network Functions Virtualization, NFV) networks, an architecture employing an x86 server is adopted, which encapsulates different network functions such as routers, switches, firewalls, and load balancing into independent modular software, and by running different modular software on hardware devices, a diversified network function is realized on a single hardware device.
In the NFV network at present, as shown in fig. 1, there is no direct connection between the region a and the region B, and in order to open the connection between the region a and the region B, the connection is performed by bypassing the data transmission dedicated line between the region a to the region C and between the region C to the region B. The data enters through a data center Router (DataCenter Router, DR) of the region a, then flows into a Backbone Router (BR), then flows into the BR of the region B through a data transmission dedicated line between the region a to the region C and between the region C to the region B, and then flows out of the DR.
It is understood that customizable GateWay (GW) devices may be added to different domains in the NFV network, and may be controlled by a controller. Referring to fig. 1 again, the gw is usually mounted beside the DR, which does not affect data transmission.
Because a part of objects have higher requirements on network quality, in order to avoid network delay caused by detour of data transmission through other regions such as region C, in the related art, data designated by the objects are forwarded through other data transmission dedicated lines such as a third party dedicated line. As shown in fig. 2, since there is a direct third party dedicated line connection between the region a and the region B, data can enter through the DR of the region a, then flow into the GW of the region B through the third party dedicated line, and then flow out from the DR.
It can be understood that the data transmission between the region a and the region B is realized through the third party dedicated line, specifically, an instruction can be issued to the GW of the region a and the region B through the controller, a border gateway protocol (Border Gateway Protocol, BGP) neighbor is established, then a specific route is configured on the GW of the region B for the destination IP of the data to point to the DR, and then the GW of the region a learns the specific route through BGP and transmits the specific route to the corresponding DR.
However, since the third party dedicated line is leased by at least one operator of the two parties of the data transmission, the network quality is often uncontrollable, which may affect the normal transmission of the data. Therefore, how to detect the third party dedicated line to ensure the normal transmission of the data is a problem to be solved.
Disclosure of Invention
The embodiment of the application provides a control method, a device, equipment and a medium for data transmission, so that detection of a special data transmission line is realized at least to a certain extent, and normal data transmission is ensured.
In a first aspect, an embodiment of the present application provides a method for controlling data transmission, where the method includes: receiving a plurality of detection data packets sent by a detection party; the detection data packet is obtained by detecting network performance of the detection party aiming at the data transmission process of a data transmission special line, and the data transmission special line is leased by an operator in at least one direction of the two data transmission parties; calculating network performance index values in each transmission period contained in the data transmission process based on the plurality of detection data packets; detecting the data transmission condition of the data transmission special line based on the relation between the network performance index value in each transmission period and a preset threshold value; if the data transmission condition represents that the data transmission has faults, fault information is sent to a control party, the fault information is used for indicating the control party to determine the fault type, and the data transmission special line is adjusted to be matched with the fault type.
In a second aspect, an embodiment of the present application provides a method for controlling data transmission, where the method includes: network performance detection is carried out aiming at the data transmission process of the data transmission special line, so as to obtain a plurality of detection data packets; the data transmission special line is leased by at least one direction operator in the two data transmission parties; and sending the plurality of detection data packets to a streaming computing party, so that the streaming computing party calculates network performance index values in each transmission period contained in the data transmission process based on the plurality of detection data packets, detects the data transmission condition of the special data transmission line based on the relation between the network performance index values in each transmission period and a preset threshold value, and sends fault information to a control party when the transmission condition represents that the data transmission has faults.
In a third aspect, an embodiment of the present application provides a method for controlling data transmission, where the method includes: receiving fault information sent by a stream computing party; the failure information is sent when the streaming computing party characterizes the data transmission failure based on a plurality of detection data packets sent by the received detection party, calculates network performance index values in each transmission period contained in the data transmission process, and detects the data transmission condition of the data transmission special line based on the relation between the network performance index values in each transmission period and a preset threshold value; determining a fault type of a data transmission fault generated on the data transmission special line based on the fault information; and adjusting the data transmission special line to be matched with the fault type.
In a fourth aspect, an embodiment of the present application provides a control device for data transmission, where the device is configured on a streaming computing side, and the device includes: the receiving module is configured to receive a plurality of detection data packets sent by a detection party; the detection data packet is obtained by detecting network performance of the detection party aiming at the data transmission process of a data transmission special line, and the data transmission special line is leased by an operator in at least one direction of the two data transmission parties; a calculation module configured to calculate a network performance index value in each transmission period included in the data transmission process based on the plurality of probe data packets; the detection module is configured to detect the data transmission condition of the data transmission special line based on the relation between the network performance index value in each transmission period and a preset threshold value; and the sending module is configured to send fault information to a control party if the data transmission condition represents that the data transmission has faults, wherein the fault information is used for indicating the control party to determine the fault type and adjusting the data transmission special line to be matched with the fault type.
In one embodiment of the present application, based on the foregoing solution, the calculation module includes: a determining unit configured to determine a transmission period in which each probe packet is located, based on time stamp information of the probe packet; the analysis processing unit is configured to respectively analyze the detection data packets in each transmission period to obtain analysis data corresponding to each transmission period; and the calculating unit is configured to calculate the network performance index value in each transmission period based on the analysis data corresponding to each transmission period.
In an embodiment of the present application, based on the foregoing solution, the parsing unit is specifically configured to: performing deserialization processing on the detection data packets in each transmission period respectively to obtain detection data packets with appointed structures in each transmission period; splitting the detection data packets with the appointed structures in each transmission period respectively to obtain a plurality of detection data with the appointed structures in each transmission period; the computing unit is specifically configured to: network performance index values in each transmission period are calculated based on a plurality of probe data having a specified structure in each transmission period.
In an embodiment of the present application, based on the foregoing solution, the parsing unit is further specifically configured to: respectively calculating network performance index values corresponding to the plurality of detection data in each transmission period; and respectively calculating the network performance index values in each transmission period based on the network performance index values corresponding to the plurality of detection data in each transmission period.
In one embodiment of the present application, based on the foregoing solution, the network performance index includes at least one of a delay index and a packet loss rate index; the parsing unit is further specifically configured to: if the network performance index comprises the time delay index, respectively calculating the time delay index value in each transmission period based on the time delay index values corresponding to the plurality of detection data in each transmission period; and if the network performance index comprises the packet loss rate index, respectively calculating the packet loss rate index value in each transmission period based on the packet loss rate index values corresponding to the plurality of detection data in each transmission period.
In one embodiment of the present application, based on the foregoing solution, the detection module includes: an acquisition and determination unit configured to acquire a type of the network performance index and determine a target policy based on the type of the network performance index; an acquisition unit configured to acquire a network performance index value in a specified number of transmission cycles based on the target policy; and the detection unit is configured to obtain a transmission condition for representing that the data transmission has faults if the network performance index value in the designated number of transmission periods reaches the preset threshold value.
In an embodiment of the present application, based on the foregoing solution, the acquiring and determining unit is specifically configured to: determining a strategy corresponding to the type of the network performance index based on a preset mapping relation table of the type of the network performance index and the strategy, and taking the determined strategy as the target strategy; the mapping relation table of the type and the strategy of the preset network performance indexes is preset with a plurality of types of network performance indexes and strategies respectively corresponding to the plurality of types of network performance indexes.
In a fifth aspect, an embodiment of the present application provides a control device for data transmission, where the device is configured on a probe side, and the device includes: the detection module is configured to detect network performance aiming at the data transmission process of the data transmission special line to obtain a plurality of detection data packets; the data transmission special line is leased by at least one direction operator in the two data transmission parties; the sending module is configured to send the plurality of detection data packets to a streaming computing party, so that the streaming computing party calculates network performance index values in each transmission period contained in the data transmission process based on the plurality of detection data packets, detects the data transmission condition of the special data transmission line based on the relation between the network performance index values in each transmission period and a preset threshold value, and sends fault information to a control party when the transmission condition represents that data transmission has faults.
In an embodiment of the present application, based on the foregoing solution, the sending module is specifically configured to: transmitting the plurality of detection data packets to a message queue for buffering; the message queue is used for respectively buffering a plurality of detection data packets obtained by network performance detection of each detection party aiming at the data transmission process of the data transmission special line; and sending the buffered plurality of probe data packets to the streaming calculator through the message queue.
In one embodiment of the present application, based on the foregoing solution, the probe includes at least one of a network probe and a gateway device; if the detecting party comprises the network detector, the network detector is used for detecting network performance aiming at the data transmission process of the data transmission special line to obtain a plurality of detection data packets; wherein, the data transmission special line in one direction corresponds to a network detector; if the detecting party comprises the gateway equipment, the gateway equipment is used for detecting network performance aiming at the data transmission process of the data transmission tunnel contained in the data transmission special line to obtain a plurality of detection data packets; wherein the data transmission tunnel in one direction corresponds to one gateway device.
In a sixth aspect, an embodiment of the present application provides a control device for data transmission, where the device is configured on a control side, and the device includes: the receiving module is configured to receive fault information sent by the streaming computing party; the failure information is sent when the streaming computing party characterizes the data transmission failure based on a plurality of detection data packets sent by the received detection party, calculates network performance index values in each transmission period contained in the data transmission process, and detects the data transmission condition of the data transmission special line based on the relation between the network performance index values in each transmission period and a preset threshold value; a determining module configured to determine a failure type of the data transmission failure generated on the data transmission dedicated line based on the failure information; and the adjusting module is configured to adjust the data transmission special line to be matched with the fault type.
In one embodiment of the present application, based on the foregoing solution, the adjusting module is specifically configured to: if the fault type indicates that the whole data transmission special line has faults, adjusting the data transmitted on the data transmission special line to other data transmission lines for transmission; and if the fault type represents that the data transmission special line has a fault locally, adjusting the data transmitted on the data transmission tunnel with the fault contained in the data transmission special line to other data transmission tunnels contained in the data transmission special line for transmission.
In one embodiment of the present application, based on the foregoing solution, the determining module is specifically configured to: acquiring a transmission line identifier with a fault from the fault information; determining an identifier corresponding to the transmission line identifier based on a preset special line identifier and a tunnel identifier table; if the determined identifier is matched with the dedicated line identifier, obtaining a fault type for representing that the whole data transmission dedicated line has faults; and if the determined identifier is matched with the tunnel identifier, obtaining a fault type for representing that the data transmission special line has a fault locally.
In a seventh aspect, embodiments of the present application provide an electronic device comprising one or more processors; and a memory for storing one or more programs that, when executed by the one or more processors, cause the electronic device to implement the control method of data transmission as described above.
In an eighth aspect, embodiments of the present application provide a computer-readable medium having stored thereon a computer program which, when executed by a processor, implements a control method of data transmission as described above.
In a ninth aspect, embodiments of the present application provide a computer program product comprising computer instructions which, when executed by a processor, implement a control method of data transmission as described above.
In the technical scheme provided in the embodiment of the application:
on the one hand, network performance detection is carried out on the data transmission process of the data transmission special line through a detection policy to obtain a plurality of detection data packets, and then a stream calculator can calculate based on the plurality of detection data packets and detect the data transmission condition of the data transmission special line in the data transmission process; thus, the detection of the data transmission special line is realized. The flow computing party computes the network performance index value in each transmission period contained in the data transmission process based on a plurality of detection data packets, and detects the obtained data transmission condition based on the relation between the network performance index value in each transmission period and a preset threshold value; therefore, a plurality of periods are used as detection references, and the accuracy of detecting the special data transmission line is greatly improved.
On the one hand, when the detected data transmission condition represents that the data transmission has faults, the stream computing side sends fault information to the control side, and then the control side can determine the fault type based on the fault information and adjust the data transmission special line in a matching mode with the fault type; therefore, the control party is instructed to correspondingly adjust the data transmission special line through the sending of the fault information, the phenomenon that the normal transmission of the data is influenced due to uncontrollable network quality of the data transmission special line in the related art can be avoided, the normal transmission of the data is ensured, the success rate of the data transmission is greatly improved, and the method is suitable for application scenes with high requirements on the network quality.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
Fig. 1 is a schematic diagram of data transmission performed by a dedicated data transmission line without direct connection between regions;
fig. 2 is a schematic diagram of data transmission by a dedicated data transmission line with direct connection between regions;
FIG. 3 is a schematic diagram of an exemplary implementation environment in which the techniques of embodiments of the present application may be applied;
FIG. 4 is a schematic diagram of a probe side probe shown in an exemplary embodiment of the present application;
FIG. 5 is a schematic diagram of a probe side probe shown in an exemplary embodiment of the present application;
FIG. 6 is a schematic diagram of a probe side probe shown in an exemplary embodiment of the present application;
fig. 7 is a flowchart illustrating a control method of data transmission according to an exemplary embodiment of the present application;
FIG. 8 is a schematic diagram illustrating various transmission cycles involved in a data transmission process according to an exemplary embodiment of the present application;
fig. 9 is a flowchart illustrating a control method of data transmission according to another exemplary embodiment of the present application;
fig. 10 is a flowchart illustrating a control method of data transmission according to another exemplary embodiment of the present application;
Fig. 11 is a flowchart illustrating a control method of data transmission according to another exemplary embodiment of the present application;
fig. 12 is a flowchart illustrating a control method of data transmission according to another exemplary embodiment of the present application;
fig. 13 is a flowchart illustrating a control method of data transmission according to an exemplary embodiment of the present application;
fig. 14 is a flowchart illustrating a control method of data transmission according to another exemplary embodiment of the present application;
fig. 15 is a flowchart illustrating a control method of data transmission according to an exemplary embodiment of the present application;
fig. 16 is a flowchart illustrating a control method of data transmission according to another exemplary embodiment of the present application;
FIG. 17 is a schematic diagram of an exemplary implementation environment in which the techniques of embodiments of the present application may be applied;
FIG. 18 is a schematic diagram illustrating processing of a plurality of probe packets according to an exemplary embodiment of the present application;
fig. 19 is a flowchart illustrating a control method of data transmission according to an exemplary embodiment of the present application;
fig. 20 is a flowchart illustrating a control method of data transmission according to an exemplary embodiment of the present application;
FIG. 21 is a block diagram of a control device for data transmission according to one embodiment of the present application;
Fig. 22 is a block diagram of a control device for data transmission of an embodiment of the present application;
fig. 23 is a block diagram of a control device for data transmission of an embodiment of the present application;
fig. 24 is a schematic diagram of a computer system suitable for use in implementing embodiments of the present application.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations identical to the present application. Rather, they are merely examples of apparatus and methods that are identical to some aspects of the present application, as detailed in the appended claims.
The block diagrams depicted in the figures are merely functional entities and do not necessarily correspond to physically separate entities. That is, the functional entities may be implemented in software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.
The flow diagrams depicted in the figures are exemplary only, and do not necessarily include all of the elements and operations/steps, nor must they be performed in the order described. For example, some operations/steps may be decomposed, and some operations/steps may be combined or partially combined, so that the order of actual execution may be changed according to actual situations.
In this application, the term "plurality" means two or more. "and/or" describes an association relationship of an association object, meaning that there may be three relationships, e.g., a and/or B may represent: a exists alone, A and B exist together, and B exists alone. The character "/" generally indicates that the context-dependent object is an "or" relationship.
In an application scenario of the present application, please refer to fig. 3, which mainly includes a detecting party 301, a stream calculating party 302, a controlling party 303, and an alarming party 304. Wherein:
the probe 301 is a party performing network performance probing for the data transmission process of the data transmission dedicated line (i.e. the aforementioned third party dedicated line, the same applies hereinafter), and may obtain a plurality of probe packets through probing, and send the plurality of probe packets to the streaming calculator.
The probe 301 may include, but is not limited to, a network probe and gateway device, etc.
In one embodiment of the present application, if the probe 301 includes a network probe, the network probe may be used to perform network performance probing for a data transmission process of a data transmission dedicated line, so as to obtain a plurality of probing data packets.
Wherein, the data transmission special line in one direction corresponds to a network detector; for example, in the foregoing example, referring to fig. 4, a third party dedicated line is provided between the region a and the region B, where the region a may transmit data to the region B through the third party dedicated line, and the region B may also transmit data to the region a through the third party dedicated line, and then the direction a for transmitting data to the region B through the third party dedicated line for the region a may correspond to a network detector (also referred to as a network detector) a11, and the direction B for transmitting data to the region a through the third party dedicated line for the region B may correspond to a network detector B11.
In one embodiment of the present application, if the probe party includes a gateway device, the gateway device may be configured to perform network performance probing for a data transmission process of a data transmission tunnel included in the data transmission dedicated line, to obtain a plurality of probing data packets.
Alternatively, the data transmission tunnel included in the data transmission dedicated line may be an internet security protocol (Internet Protocol Security, IPSEC) encrypted tunnel constructed by an Equal Cost Multi-path (ECMP) manner between gateway devices.
Optionally, the gateway device may configure a network quality analysis (Network Quality Analysis, NQA) service to enable network performance probing of data transmission procedures for a data transmission tunnel comprised by the data transmission dedicated line.
Wherein, the data transmission tunnel in one direction corresponds to a gateway device; for example, in the foregoing example, referring to fig. 5, a third-party dedicated line is between the region a and the region B, and the third-party dedicated line includes a data transmission tunnel, specifically, the region a may transmit data to the region B through the data transmission tunnel, and the region B may transmit data to the region a through the data transmission tunnel, so that the direction a of transmitting data to the region B through the data transmission tunnel for the region a may correspond to one gateway device a21, and the direction B of transmitting data to the region a through the data transmission tunnel for the region B may correspond to one gateway device B21.
In one embodiment of the present application, 2 or more gateway devices may be deployed in each zone to ensure network quality. If 2 gateway devices are deployed, a dual-master working mode can be adopted, namely, the 2 gateway devices work simultaneously; if more than 2 gateway devices are deployed, a working mode of double main and other secondary can be adopted, namely 2 gateway devices work simultaneously, and other gateway devices start to work when the 2 gateway devices all fail.
Referring to fig. 6, zone a deploys 2 gateway devices a21, a22, zone B deploys 2 gateway devices B21, B22, and accordingly, there are 4 data transmission tunnels between zone a and zone B, so zone a may transmit data to zone B through data transmission tunnels such as k11, k12, k13, k14, and zone B may transmit data to zone a through data transmission tunnels such as k11, k12, k13, k 14. Optionally, the data transmission tunnels k11, k12, k13 and k14 can perform data transmission in a load balancing manner, so as to ensure the use balance of each data transmission tunnel.
The stream calculator 302 performs calculation based on a plurality of probe packets sent by the probe 301 to detect the data transmission condition of the data transmission line. Specifically, based on a plurality of detection data packets, calculating network performance index values in each transmission period included in a data transmission process, detecting and obtaining a data transmission condition of a data transmission special line based on a relation between the network performance index values in each transmission period and a preset threshold, and if the data transmission condition represents that data transmission has faults, sending fault information to a control party.
The streaming Computing party 302 includes, but is not limited to, a streaming Computing platform constructed by a server, where the server may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a Cloud server that provides Cloud services, cloud databases, cloud Computing (Cloud Computing), cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network ), and basic Cloud Computing services such as big data and intelligent platform.
The controller 303 performs adjustment to match the type of failure indicated by the failure information on the data transmission line based on the failure information transmitted from the flow calculator 302.
The controller 303 includes, but is not limited to, a control platform constructed by a server, where the server may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, and may also be a Cloud server that provides Cloud services, cloud databases, cloud Computing (Cloud Computing), cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network ), and basic Cloud Computing services such as big data and intelligent platform.
The warning party 304 is a party that performs warning processing by using a specified warning method based on the failure information transmitted from the stream calculator 302. Optionally, the alert mode includes, but is not limited to, a telephone alert, a mail alert, a short message alert, a communication application message alert, etc.
The alerting party 304 includes, but is not limited to, a smart phone, a tablet, a notebook computer, a computer, an intelligent voice interaction device, an intelligent home appliance, a vehicle-mounted terminal, an aircraft, and the like, and the object input interface includes, but is not limited to, a touch screen, a keyboard, physical keys, an audio pickup device, and the like. Meanwhile, the warning party can also be a warning platform constructed by a server, and the relevant description of the server is the same as that above, and is not repeated here.
It should be noted that, in the specific embodiments of the present application, related data of the object is required to obtain permission or consent of the object when the embodiments of the present application are applied to specific products or technologies, and the collection, use and processing of the related data are required to comply with related laws and regulations and standards of related countries and regions.
Various implementation details of the technical solutions of the embodiments of the present application are set forth in detail below:
referring to fig. 7, fig. 7 is a flowchart illustrating a method for controlling data transmission, which may be performed by the streaming calculator 302, according to an embodiment of the present application. As shown in fig. 7, the control method of data transmission at least includes S701 to S704, which are described in detail as follows:
S701, receiving a plurality of detection data packets sent by a detection party; the detection data packet is obtained by detecting network performance in the data transmission process of the data transmission special line by the detection guideline, and the data transmission special line is leased by an operator in at least one direction of the two data transmission parties.
In the embodiment of the application, a detecting party detects network performance aiming at the data transmission process of a data transmission special line to obtain a plurality of detection data packets, and sends the plurality of detection data packets to a streaming computing party; accordingly, the streaming calculator may receive a plurality of probe packets transmitted by the probe.
In the embodiment of the present application, the data transmission dedicated line is leased by at least one operator in both data transmission parties, that is, a third party dedicated line directly connected between the region a and the region B in the foregoing example; the network quality is often controllable, i.e. the dedicated line between the region a and the region C and the dedicated line between the region C and the region B in the foregoing example.
S702, calculating network performance index values in each transmission period contained in the data transmission process based on a plurality of detection data packets.
In this embodiment, the streaming computing side receives a plurality of detection data packets sent by the detecting side, and then may calculate the network performance index value in each transmission period included in the data transmission process based on the plurality of detection data packets.
It is understood that the data transmission process corresponds to a period of time, and the period of time can be subdivided into a plurality of transmission periods; for example, referring to fig. 8, the data transmission process includes 6 transmission periods, respectively T1', T2', T3', T4', T5', and T6', wherein the time periods corresponding to each transmission period may be the same or different, and the time periods corresponding to all the transmission periods are added to obtain the time period T corresponding to the data transmission process.
In the embodiment of the application, the network performance index is an index capable of reflecting the quality of the network, and includes, but is not limited to, a delay index, a packet loss rate index, a throughput index and the like. The time delay refers to a time interval from the first bit of the data packet entering the router to the last bit being output from the router, and can be divided into transmission time delay, propagation time delay, processing time delay, queuing time delay and the like; the better the network quality, the smaller the delay value, and conversely, the worse the network quality, the larger the delay value. Wherein the packet loss rate refers to the ratio of the number of lost data packets to the total number of transmitted data packets in the data transmission process; the better the network quality, the smaller the packet loss rate value is, and conversely, the worse the network quality, the larger the packet loss rate value is. Where throughput refers to the amount of successfully transmitted data (measured in bits, bytes, packets, etc.) per unit time; the better the network quality, the larger the throughput value is relatively, whereas the worse the network quality, the smaller the throughput value is relatively.
S703, detecting the data transmission condition of the data transmission special line based on the relation between the network performance index value in each transmission period and the preset threshold value.
In the embodiment of the present application, the streaming computing side calculates the network performance index value in each transmission period included in the data transmission process based on the plurality of detection data packets, and then can detect the data transmission condition of the data transmission dedicated line based on the relationship between the network performance index value in each transmission period and the preset threshold value.
In this embodiment of the present application, the relationship between the network performance index value and the preset threshold value in each transmission period refers to that each transmission period corresponds to a network performance index value, and the network performance index value corresponding to each transmission period has a relationship between the magnitude of the network performance index value and the preset threshold value.
In the embodiment of the application, the preset threshold corresponds to the network performance index; the preset threshold is a preset threshold corresponding to the time delay index if the network performance index is the time delay index, the preset threshold is a preset threshold corresponding to the packet loss rate index if the network performance index is the packet loss rate index, and the preset threshold is a preset threshold corresponding to the throughput index if the network performance index is the throughput index. In practical applications, the preset threshold is flexibly set by the relevant workers based on experiments or experience.
And S704, if the data transmission condition represents that the data transmission has a fault, fault information is sent to the control party, the fault information is used for indicating the control party to determine the fault type, and the data transmission special line is adjusted to be matched with the fault type.
In the embodiment of the application, the streaming computing party detects the data transmission condition of the data transmission special line based on the relation between the network performance index value in each transmission period and the preset threshold value, and then can determine the subsequent processing process according to the data transmission condition.
In one embodiment of the present application, if the data transmission condition indicates that there is a failure in the data transmission, the streaming calculator may send failure information to the controller, so that the controller may determine a failure type of the data transmission failure on the data transmission dedicated line based on the failure information, and perform adjustment matching the failure type on the data transmission dedicated line.
In one embodiment of the present application, if the data transmission condition indicates that there is a fault in the data transmission, the streaming computing party may send fault information to the alerting party, so that the alerting party may perform alert processing in a specified alert manner based on the fault information.
In one embodiment of the present application, if the data transmission conditions indicate that there is no failure in the data transmission, the streaming calculator may not be processing.
In the embodiment of the application, a streaming computing party performs computation based on a plurality of detection data packets sent by a detection party, and detects to obtain the data transmission condition of a data transmission special line in the data transmission process; thus, the detection of the data transmission special line is realized. The flow computing party computes the network performance index value in each transmission period contained in the data transmission process based on a plurality of detection data packets, and detects the obtained data transmission condition based on the relation between the network performance index value in each transmission period and a preset threshold value; therefore, a plurality of periods are used as detection references, and the accuracy of detecting the special data transmission line is greatly improved.
In one embodiment of the present application, another method of controlling data transmission is provided, which may be performed by the streaming calculator 302. As shown in fig. 9, the control method of data transmission may include S901 to S903, S701, S703 to S704.
S901 to S903 are described in detail as follows:
s901, determining a transmission period in which each probe packet is located based on the time stamp information of each probe packet.
It will be appreciated that each probe packet may contain time stamp information; therefore, in the embodiment of the present application, the transmission period in which each probe data packet is located may be determined based on the timestamp information of each probe data packet.
For example, there are 12 probe packets, 1-12 respectively, and the corresponding time stamp information of each probe packet is T1, T2, T3 … … T12 respectively, and it is assumed that the data packet 1-2 is in the transmission period T1 'based on the time stamp information, the data packet 3-4 is in the transmission period T2' based on the time stamp information, the data packet 5-6 is in the transmission period T3 'based on the time stamp information, the data packet 7-8 is in the transmission period T4' based on the time stamp information, the data packet 9-10 is in the transmission period T5 'based on the time stamp information, and the data packet 11-12 is in the transmission period T6' based on the time stamp information.
S902, analyzing the detection data packets in each transmission period to obtain analysis data corresponding to each transmission period.
In the embodiment of the application, the streaming calculator determines the transmission period of each detection data packet based on the timestamp information of each detection data packet, and then can analyze the detection data packet in each transmission period to obtain analysis data corresponding to each transmission period.
For example, for receiving the foregoing examples, the probe packet 1-2 in the transmission period T1 'may be subjected to an analysis process to obtain analysis data corresponding to the transmission period T1', the probe packet 3-4 in the transmission period T2 'may be subjected to an analysis process to obtain analysis data corresponding to the transmission period T2', the probe packet 5-6 in the transmission period T3 'may be subjected to an analysis process to obtain analysis data corresponding to the transmission period T3', the probe packet 7-8 in the transmission period T4 'may be subjected to an analysis process to obtain analysis data corresponding to the transmission period T4', the probe packet 9-10 in the transmission period T5 'may be subjected to an analysis process to obtain analysis data corresponding to the transmission period T5', and the probe packet 11-12 in the transmission period T6 'may be subjected to an analysis process to obtain analysis data corresponding to the transmission period T6'. It should be noted that, here, only a small amount of probe packets are included in the transmission period in the illustrated example, and in practical application, the transmission period can be flexibly adjusted according to a specific application scenario.
S903, calculating network performance index values in each transmission period based on the analysis data corresponding to each transmission period.
In the embodiment of the application, the streaming computing party respectively analyzes the detection data packets in each transmission period to obtain analysis data corresponding to each transmission period, and then can respectively calculate the network performance index value in each transmission period based on the analysis data corresponding to each transmission period.
For example, in the foregoing example, the network performance index value in the transmission period T1 'may be calculated based on the analysis data corresponding to the transmission period T1', the network performance index value in the transmission period T2 'may be calculated based on the analysis data corresponding to the transmission period T2', the network performance index value in the transmission period T3 'may be calculated based on the analysis data corresponding to the transmission period T3', the network performance index value in the transmission period T4 'may be calculated based on the analysis data corresponding to the transmission period T4', the network performance index value in the transmission period T5 'may be calculated based on the analysis data corresponding to the transmission period T5', and the network performance index value in the transmission period T5 'may be calculated based on the analysis data corresponding to the transmission period T6'.
Note that, for the detailed description of S701, S703 to S704 shown in fig. 9, please refer to S701, S703 to S704 shown in fig. 7, and the detailed description is omitted here.
In the embodiment of the application, the streaming computing party divides the transmission period of each detection data packet based on the time stamp information of each detection data packet; thus, the dividing accuracy of the transmission period of each detection data packet is improved. Then analyzing the detection data packet in each transmission period, and respectively calculating to obtain the network performance index value in each transmission period based on the analysis data corresponding to each transmission period; the calculation process is simple and convenient, improves the efficiency of calculating the network performance index values in each transmission period, and provides support for detecting the data transmission condition of the data transmission special line based on the network performance index values in each transmission period in the later period.
In one embodiment of the present application, another method of controlling data transmission is provided, which may be performed by the streaming calculator 302. As shown in fig. 10, the control method of data transmission may include S1001 to S1003, S901, S701, S703 to S704.
S1001 to S1003 are described in detail as follows:
s1001, performing deserialization processing on the detection data packets in each transmission period to obtain detection data packets with specified structures in each transmission period.
In the embodiment of the application, the serialization process refers to a process of converting structured data into a specified format according to a certain coding specification, and the anti-serialization process refers to a process of analyzing the data converted into the specified format into original structured data. For example, person is an object type representing a Person, person is an object of Person type, storing Person in a corresponding extensible markup language (XML, extensible Markup Language) document is a serialization process, and parsing XML to generate Person of Person type is an deserialization process. Wherein the structured data refers to Person type data, and the certain coding specification refers to the specification of the XML document. Generally, the common serialization methods include binary serialization, XML serialization, and JS object profile (JavaScript ObjectNotation, JSON) serialization.
For example, in connection with the foregoing example, the probe packet 1-2 in the transmission period T1 'may be subjected to the deserialization processing to obtain the probe packet 1' -2 'having the specified structure in the transmission period T1'. The same applies to the other transmission periods T2', T3', T4', T5', T6 '.
S1002, splitting the detection data packets with the appointed structure in each transmission period respectively to obtain a plurality of detection data with the appointed structure in each transmission period.
In the embodiment of the application, the stream computing party performs deserialization processing on the detection data packets in each transmission period to obtain detection data packets with appointed structures in each transmission period, and then can split the detection data packets with appointed structures in each transmission period to obtain a plurality of detection data with appointed structures in each transmission period.
In this embodiment, splitting refers to splitting bulk data included in a probe packet into a plurality of single data.
For example, in the foregoing example, the probe data packet 1' having the specified structure in the transmission period T1' may be split to obtain the plurality of probe data n11', n12', n13', n14' corresponding to the probe data packet 1', and the probe data packet 2' having the specified structure in the transmission period T1' may be split to obtain the plurality of probe data n21', n22', n23', n24', n25', n26' corresponding to the probe data packet 2', so as to obtain the plurality of probe data n11', n12', n13', n14', n21', n22', n23', n24', n25', n26' having the specified structure in the transmission period T1 '. It should be noted that, only one probe packet shown in the example includes a small amount of probe data, and in practical application, the probe packet may be flexibly adjusted according to a specific application scenario. The same applies to the other transmission periods T2', T3', T4', T5', T6 '.
S1003, calculating network performance index values in each transmission period based on the plurality of probe data having the specified structure in each transmission period.
In the embodiment of the application, the streaming computing party respectively performs splitting processing on the detection data packet with the specified structure in each transmission period to obtain a plurality of detection data with the specified structure in each transmission period, and then can respectively calculate the network performance index value in each transmission period based on the plurality of detection data with the specified structure in each transmission period.
For example, with the foregoing example taken in mind, the network performance index value within the transmission period T1 'may be calculated based on a plurality of probe data n11', n12', n13', n14', n21', n22', n23', n24', n25', n26 'having a specified structuring within the transmission period T1'. The same applies to the other transmission periods T2', T3', T4', T5', T6 '.
In one embodiment of the present application, the process in S1003 of calculating the network performance index value in each transmission period based on the plurality of probe data having the specified structure in each transmission period, respectively, may include at least the following steps:
Respectively calculating network performance index values corresponding to a plurality of detection data in each transmission period;
network performance index values in each transmission period are calculated based on network performance index values corresponding to the plurality of probe data in each transmission period.
That is, in an alternative embodiment, the flow calculator calculates the network performance index values corresponding to the plurality of probe data in each transmission period, and then calculates the network performance index values in each transmission period based on the network performance index values corresponding to the plurality of probe data in each transmission period.
Optionally, the network performance index values in each transmission period are calculated based on the network performance index values corresponding to the plurality of detection data in each transmission period, and the network performance index values corresponding to the plurality of detection data may be summed and averaged for each transmission period to obtain the network performance index value in each transmission period.
For example, in connection with the foregoing example, for the transmission period T1', the network performance index values corresponding to the plurality of probe data n11', n12', n13', n14', n21', n22', n23', n24', n25', n26 'are summed and averaged to obtain the network performance index value in the transmission period T1'. The same applies to the other transmission periods T2', T3', T4', T5', T6 '. It should be noted that, the operation is only one illustrated example, but may be other operations, and in practical application, the operation may be flexibly adjusted according to a specific application scenario.
Optionally, if the network performance index includes a delay index, the delay index values in each transmission period may be calculated based on the delay index values corresponding to the plurality of detection data in each transmission period;
alternatively, if the network performance index includes a packet loss rate index, the packet loss rate index value in each transmission period may be calculated based on the packet loss rate index values corresponding to the plurality of probe data in each transmission period, respectively.
Note that, the detailed description of S901 in fig. 10 refers to S901 in fig. 9, the detailed descriptions of S701, S703 to S704 in fig. 10 refer to S701, S703 to S704 in fig. 7, and the detailed description thereof will not be repeated here.
In the embodiment of the application, the streaming computing party performs deserialization processing on the detection data packets in each transmission period, and then performs splitting processing on the detection data packets with appointed structures in each transmission period; therefore, the detection data with the appointed structure in each transmission period can be accurately obtained, and the accuracy of the network performance index value in each transmission period, which is calculated based on the detection data with the appointed structure in each transmission period, is improved.
In one embodiment of the present application, another method of controlling data transmission is provided, which may be performed by the streaming calculator 302. As shown in fig. 11, the control method of data transmission may include S1101 to S1102, S701 to S702, S704.
S1101 to S1103 are described in detail as follows:
s1101, obtaining the type of the network performance index, and determining a target strategy based on the type of the network performance index.
In the embodiment of the application, different types of network performance indexes correspond to different strategies; the policy is used for indicating how to acquire the network performance index value in the transmission period, and the target policy is a policy corresponding to the type of the network performance index.
Referring to table 1 below, an exemplary mapping table of type and policy of preset network performance indexes is shown, wherein the mapping table of type and policy of preset network performance indexes is preset with a plurality of types of network performance indexes and policies corresponding to the plurality of types of network performance indexes respectively.
Type of network performance index Strategy
Time delay Successive 3 transmission periods
Packet loss rate Successive 3 transmission periods
Throughput of Discontinuous 2 transmission periods
…… ……
TABLE 1
In one embodiment of the present application, the process of determining the target policy based on the type of the network performance index in S1101 may include at least the following steps:
based on a preset network performance index type and a strategy mapping relation table, determining a strategy corresponding to the network performance index type, and taking the determined strategy as a target strategy.
That is, in an alternative embodiment, the streaming calculator may search the policy corresponding to the type of the network performance index from the preset mapping relationship table of the type of the network performance index and the policy, where the searched policy is the target policy.
S1102, acquiring network performance index values in a specified number of transmission periods based on the target strategy.
In the embodiment of the application, the streaming computing party acquires the type of the network performance index, determines the target strategy based on the type of the network performance index, and then acquires the network performance index value in a specified number of transmission periods based on the target strategy.
For example, in the foregoing example, the network performance index values in the transmission periods T1', T2', T3', T4', T5', T6' are calculated, and if the network performance index is a delay index, the target policy is 3 consecutive transmission periods based on the foregoing table 1. Therefore, the network performance index values in the 3 continuous transmission periods T1', T2', T3 'need to be acquired, the network performance index values in the 3 continuous transmission periods T2', T3', T4' need to be acquired, the network performance index values in the 3 continuous transmission periods T3', T4', T5 'need to be acquired, and the network performance index values in the 3 continuous transmission periods T4', T5', T6' need to be acquired.
And S1103, if the network performance index value in the designated number of transmission periods reaches a preset threshold value, obtaining a transmission condition for representing that the data transmission has faults.
In the embodiment of the application, the streaming calculator acquires the network performance index value in the designated number of transmission periods based on the target policy, and then obtains the transmission condition for representing whether the data transmission has a fault or not based on the magnitude relation between the network performance index value in the designated number of transmission periods and the preset threshold.
And if the network performance index value in the designated number of transmission periods reaches a preset threshold value, obtaining a transmission condition for representing that the data transmission has faults.
It will be appreciated that the network performance index value over a specified number of transmission cycles may be compared to a preset threshold value each time the network performance index value over the specified number of transmission cycles is obtained based on the target policy. For example, in the foregoing example, the network performance index values in 3 consecutive transmission periods of T1', T2', and T3 'are obtained and compared with the preset threshold, respectively, and if the network performance index values in 3 consecutive transmission periods of T1', T2', and T3' reach the preset threshold, the network performance index values in the specified number of transmission periods can be obtained without obtaining the network performance index values in 3 consecutive transmission periods of T2', T3', and T4', and the network performance index values in 3 consecutive transmission periods of T4', T5', and T6', respectively, which can reduce the resource consumption of the streaming computing party to a certain extent.
And if the network performance index value in any transmission period in the appointed number of transmission periods does not reach the preset threshold value, obtaining the transmission condition for representing that the data transmission has no fault.
It can be understood that the network performance index values in all the designated number of transmission periods need to be obtained based on the target policy, so that when the network performance index value in any transmission period in the designated number of transmission periods does not reach the preset threshold, a transmission condition for representing that no fault exists in data transmission can be obtained. For example, in the foregoing example, the transmission situation for characterizing that the data transmission has not failed cannot be directly obtained because the network performance index value in any one of the 3 acquired transmission periods T1', T2', T3 'does not reach the preset threshold, which is further required to be sequentially based on the network performance index values in the 3 acquired transmission periods T2', T3', T4', the network performance index values in the 3 continuous transmission periods T3', T4', T5 'and the network performance index values in the 3 continuous transmission periods T4', T5', T6' are compared to finally obtain the transmission condition for representing that the data transmission has no fault, so that the accuracy of the detected transmission condition of the data transmission special line can be improved to a certain extent.
It should be noted that, for the detailed description of S701 to S702 and S704 shown in fig. 11, please refer to S701 to S702 and S704 shown in fig. 7, and the detailed description is omitted here.
According to the method, a streaming computing party determines a target strategy based on the type of the acquired network performance index, acquires network performance index values in a specified number of transmission periods based on the target strategy, and then detects whether the acquired network performance index values in the specified number of transmission periods reach a preset threshold value or not, so that the data transmission condition of a data transmission dedicated line is detected; the data transmission conditions of the data transmission special lines detected according to the network performance indexes of different types are different, the flexibility is higher, and the method is applicable to wider application scenes.
In one embodiment of the present application, another method of controlling data transmission is provided, which may be performed by the streaming calculator 302. As shown in fig. 12, the control method of data transmission may include S1201, S702 to S704.
S1201 is described in detail as follows:
s1201, receiving a plurality of buffered detection data packets sent by a message queue; the detection data packets are obtained by detecting network performance in the data transmission process of the data transmission special line according to the detection guideline, and are sent to the message queue for buffer processing.
In the embodiment of the application, a plurality of detection data packets received by a streaming computing party are sent by a message queue; the message queue is used for respectively buffering a plurality of detection data packets obtained by detecting the network performance of each detection party aiming at the data transmission process of the data transmission special line, so that the phenomenon that the streaming calculator crashes or the detection data packets are lost due to the fact that the number of the detection data packets detected by the detection party is too large and all the detection data packets are sent to the streaming calculator can be avoided.
In one embodiment of the present application, the message queue may be a kafka message queue, in which probe packets sent by one or more probe parties may be temporarily stored, and then may be ordered based on the order of arrival (early-late order) of the probe packets, and then sequentially sent to the streaming calculator based on the order; accordingly, the streaming calculator receives the plurality of probe packets sent by the kafka message queue.
In one embodiment of the present application, if the message queue is a Kafka message queue, the streaming computing party may use the streaming computing engine Kafka Stream, so that the two may better interact, and code is introduced by using the packet by Kafka Stream, so that services of the maintenance framework do not need to be deployed additionally, and the streaming computing party is lighter and can reduce the later maintenance cost. It should be noted that, in practical applications, the streaming computing party may also use other streaming computing engines, such as Flink, spark, storm, according to specific application scenarios.
It should be noted that, for the detailed description of S702 to S704 shown in fig. 12, please refer to S702 to S704 shown in fig. 7, and the detailed description is omitted herein.
In the embodiment of the application, the streaming computing party acquires a plurality of buffered detection data packets from the message queue; therefore, the phenomenon that the streaming calculator crashes or the detected data packets are lost and the like caused by the fact that the number of the detected data packets detected by the detector is too large can be avoided, and support is provided for the streaming calculator to detect and obtain the data transmission condition of the data transmission special line based on the detected data packets.
It should be noted that, the embodiments shown in fig. 7 to fig. 12 are explained from the perspective of the streaming computing side, and the following details of implementation of the technical solutions of the embodiments of the present application are explained in detail from the perspective of the detecting side with reference to fig. 13 to fig. 14:
referring to fig. 13, fig. 13 is a flowchart illustrating a method for controlling data transmission, which may be performed by the probe 301 according to an embodiment of the present application. As shown in fig. 13, the control method for data transmission at least includes S1301 to S1302, which are described in detail as follows:
s1301, network performance detection is carried out aiming at the data transmission process of a data transmission special line, so as to obtain a plurality of detection data packets; the data transmission special line is leased by at least one direction operator in the two data transmission parties.
In one embodiment of the present application, a probe may passively trigger a network performance probe for a data transmission process of a data transmission dedicated line, so as to obtain a plurality of probe data packets. For example, the probe can trigger the data transmission process of the special data transmission line to perform network performance detection based on the received detection command, so as to obtain a plurality of detection data packets, wherein the detection command is sent by the control party according to the detection requirement.
In one embodiment of the present application, a probe may automatically trigger a network performance probe for a data transmission process of a data transmission dedicated line, so as to obtain a plurality of probe data packets. For example, the probe can trigger the data transmission process for the data transmission special line to perform network performance probing at a fixed time every day, so as to obtain a plurality of probing data packets.
The detailed description of the data transmission dedicated line in the embodiment of the present application refers to the foregoing embodiment, and is not repeated herein.
S1302, sending a plurality of detection data packets to a streaming computing party, so that the streaming computing party calculates network performance index values in each transmission period included in the data transmission process based on the plurality of detection data packets, detects the data transmission condition of a data transmission dedicated line based on the relationship between the network performance index values in each transmission period and a preset threshold value, and sends fault information to a control party when the transmission condition represents that the data transmission has faults.
In the embodiment of the application, the detecting party detects network performance aiming at the data transmission process of the special data transmission line to obtain a plurality of detection data packets, and then the detection data packets can be sent to the streaming computing party, so that the streaming computing party can calculate network performance index values in each transmission period contained in the data transmission process based on the detection data packets, detect the data transmission condition of the special data transmission line based on the relation between the network performance index values in each transmission period and a preset threshold value, and send fault information to the control party when the transmission condition represents that the data transmission has faults. Please refer to the foregoing embodiments for the processing procedure of the flow-type computing method, and the description thereof is omitted herein.
In the embodiment of the application, a detecting party detects network performance aiming at the data transmission process of a data transmission special line to obtain a plurality of detection data packets; the detection process is simple and convenient, is easy to realize, and is applicable to a wider application scene because the detection party can be a network detector and/or gateway equipment without network side participation.
In one embodiment of the present application, another control method of data transmission is provided, which may be performed by the probe 301. As shown in fig. 14, the control method of data transmission may include S1401 to S1402, S1301.
S1401 to S1402 are described in detail as follows:
s1401, transmitting a plurality of detection data packets to a message queue for buffering; the message queues are used for respectively buffering a plurality of detection data packets obtained by network performance detection of each detection party aiming at the data transmission process of the data transmission special line.
In the embodiment of the application, the probe performs network performance detection on the data transmission process of the data transmission dedicated line to obtain a plurality of detection data packets, and then the plurality of detection data packets can be sent to the message queue for buffering, wherein the message queue is used for buffering the plurality of detection data packets obtained by performing network performance detection on the data transmission process of the data transmission dedicated line by each probe.
S1402 sends the buffered plurality of probe packets to the streaming calculator via the message queue.
In the embodiment of the invention, the detecting party sends the plurality of detecting data packets to the message queue for buffering, and then the buffered plurality of detecting data packets can be sent to the streaming computing party through the message queue, so that the phenomena that the streaming computing party is crashed or the detecting data packets are lost and the like due to the fact that the number of the detecting data packets detected by the detecting party is too large and the detecting data packets are all sent to the streaming computing party can be avoided.
In one embodiment of the present application, the message queue may be a kafka message queue, in which probe packets sent by one or more probe parties may be temporarily stored, and then may be ordered based on the order of arrival (early-late order) of the probe packets, and then sequentially sent to the streaming calculator based on the order; accordingly, the streaming calculator receives the plurality of probe packets sent by the kafka message queue.
Note that, for a detailed description of S1301 in fig. 14, please refer to S1301 in fig. 13, and a detailed description thereof is omitted here.
In the embodiment of the application, the detecting party sends the detected data packet to a message queue for caching; therefore, the phenomenon that the streaming calculator crashes or the detected data packets are lost and the like caused by the fact that the number of the detected data packets detected by the detector is excessive and the detected data packets are completely sent to the streaming calculator can be avoided.
It should be noted that, the embodiments shown in fig. 13 to 14 are explained from the perspective of the detecting party, and the following details of implementation of the technical solutions of the embodiments of the present application are explained in detail from the perspective of the controlling party with reference to fig. 15 to 16:
Referring to fig. 15, fig. 15 is a flowchart illustrating a control method of data transmission, which may be performed by the controller 303 according to an embodiment of the present application. As shown in fig. 15, the control method of data transmission at least includes S1501 to S1503, which are described in detail as follows:
s1501, receiving fault information sent by a stream computing side; the fault information is sent when the stream computing party detects the data transmission condition of the data transmission special line and represents the fault of the data transmission based on a plurality of detection data packets sent by the received detection party, network performance index values in all transmission periods contained in the data transmission process and the relation between the network performance index values in all the transmission periods and a preset threshold value.
In the embodiment of the application, a streaming computing party calculates network performance index values in each transmission period contained in a data transmission process based on a plurality of received detection data packets sent by a detection party, detects the data transmission condition of a data transmission dedicated line based on the relation between the network performance index values in each transmission period and a preset threshold value, and sends fault information to a control party when the transmission condition represents that data transmission has faults; accordingly, the controller may receive the failure information sent by the streaming calculator. Please refer to the foregoing embodiments for the processing procedure of the flow-type computing method, and the description thereof is omitted herein.
S1502, determining a fault type of the data transmission fault on the data transmission special line based on the fault information.
In the embodiment of the application, the control party receives the fault information sent by the stream computing party, and then can determine the fault type of the data transmission fault generated on the data transmission dedicated line based on the fault information.
The fault types in the embodiment of the present application are divided into two types; one of the types of faults is that the data transmission dedicated line has faults as a whole, which belongs to the consideration of the large granularity level of the data transmission dedicated line, and the type of faults can be obtained by a stream calculator based on a plurality of detected data packets detected by a network detector as described in the previous embodiment; the other is a failure type in which a data transmission dedicated line is partially failed, which is a consideration from a small granularity level of the data transmission tunnel, and it may be obtained by the stream calculator detecting a plurality of detected data packets based on the gateway device as described in the foregoing embodiment.
S1503, adjusting the data transmission special line to be matched with the fault type.
In the embodiment of the application, the controller determines the fault type of the data transmission fault generated on the data transmission special line based on the fault information, and then can adjust the data transmission special line in a matching manner with the fault type.
In one embodiment of the present application, if the fault type indicates that the data transmission dedicated line has a fault in its entirety, the data transmitted on the data transmission dedicated line is adjusted to be transmitted on other data transmission lines. That is, if the data transmission dedicated line has a fault, the data transmitted on the whole data transmission dedicated line needs to be adjusted to other data transmission lines for transmission, so that the normal transmission of the data is ensured.
For example, referring to fig. 2 again, the data transmitted on the third party dedicated line shown in fig. 2 may be adjusted to be transmitted on the data transmission dedicated line between the region a to the region C and the region C to the region B.
In one embodiment of the present application, if the fault type indicates that the data transmission dedicated line has a fault locally, the data transmitted on the data transmission tunnel with the fault included in the data transmission dedicated line is adjusted to the data transmitted on other data transmission tunnels included in the data transmission dedicated line. That is, if the data transmission dedicated line has a fault in a local part (i.e., the data transmission tunnel), the data transmitted on the data transmission tunnel with the fault needs to be adjusted to other data transmission tunnels contained in the data transmission dedicated line for transmission, so that normal transmission of the data is ensured.
For example, referring to fig. 6 again, assuming that the failed data transmission tunnel is k11, the data transmitted on the data transmission tunnel k11 may be adjusted to the data transmitted on the other data transmission tunnels k12, k13, k 14. The data transmitted on the data transmission tunnel k11 can be adjusted to any one or more of the other data transmission tunnels k12, k13, k 14. Alternatively, the data transmitted over the data transmission tunnel k11 may be equally tuned to the other data transmission tunnels k12, k13, k14, i.e. each of the other data transmission tunnels k12, k13, k14 carries about 33% of the data transmitted over the data transmission tunnel k 11.
In the embodiment of the application, the control party determines the fault type based on the fault information sent by the stream computing party, and adjusts the data transmission special line in a matching manner with the fault type; therefore, the control party is instructed to correspondingly adjust the data transmission special line through the sending of the fault information, the phenomenon that the normal transmission of the data is influenced due to uncontrollable network quality of the data transmission special line in the related art can be avoided, the normal transmission of the data is ensured, the success rate of the data transmission is greatly improved, and the method is suitable for application scenes with high requirements on the network quality.
In one embodiment of the present application, another control method of data transmission is provided, which may be performed by the controller 303. As shown in fig. 16, the control method of data transmission may include S1601 to S1604, S1501, S1503.
S1601 to S1604 are described in detail as follows:
s1601, a transmission line identifier of the failure is obtained from the failure information.
In the embodiment of the application, the fault information comprises a transmission line identifier with a fault, wherein the transmission line identifier refers to a unique identifier for representing a transmission line; therefore, the controller in the embodiment of the application can obtain the failed transmission line identification from the failure information.
S1602, determining an identification corresponding to the transmission line identification based on a preset private line identification and tunnel identification table.
In this embodiment of the present application, a preset dedicated line identifier and a tunnel identifier table are preset, refer to table 2 below, which is an example of a preset dedicated line identifier and a tunnel identifier table, where the preset dedicated line identifier and the tunnel identifier table are preset with identifiers of data transmission dedicated lines, and identifiers of data transmission tunnels respectively corresponding to the identifiers of the data transmission dedicated lines.
TABLE 2
It can be understood that the preset special line identifier and the tunnel identifier table in the illustrated example are in a table form, and can be split into two table forms, so that in practical application, the preset special line identifier and the tunnel identifier table can be flexibly adjusted according to specific application scenes.
In the embodiment of the application, the controller can search the identifier corresponding to the transmission line identifier from the preset special line identifier and tunnel identifier table, and then can obtain the fault type for representing that the whole or part of the data transmission special line has faults based on the searched identifier.
S1603, if the determined identification is matched with the special line identification, obtaining a fault type for representing that the whole data transmission special line has faults.
In the embodiment of the application, if the determined identifier is matched with the dedicated line identifier, the fault type used for representing the fault of the whole data transmission dedicated line can be obtained.
S1604, if the determined identification is matched with the tunnel identification, obtaining a fault type used for representing that the data transmission special line has a fault locally.
In the embodiment of the application, if the determined identifier is matched with the tunnel identifier, the fault type used for representing that the data transmission special line has a fault locally can be obtained.
Note that, in the detailed description of S1501 and S1503 shown in fig. 16, reference is made to S1501 and S1503 shown in fig. 15, and the detailed description is omitted here.
According to the embodiment of the application, the control party can determine whether the data transmission special line has a fault wholly or locally through the fault information, and then the data transmission special line is adjusted in a corresponding mode; therefore, normal transmission of data is guaranteed, adaptive adjustment is performed based on the determined fault type, and flexibility is higher.
One specific application scenario of the embodiments of the present application is described in detail below:
referring to fig. 17, the system mainly includes a detecting party (specifically, a network detecting machine 1-2, a gateway device 1-4), a streaming computing party (specifically, a streaming computing platform), a controlling party (specifically, a control platform), an alarming party (specifically, an alarming platform), and a kafka message queue. Wherein:
the network detection machine 1-2 and the gateway equipment 1-4 are mainly used for detecting the network performance of the data transmission special line to obtain a plurality of detection data packets, wherein the network detection machine 1-2 is used for detecting the network performance of the data transmission special line to obtain a plurality of detection data packets, the gateway equipment 1-4 is used for detecting the network performance of a data transmission tunnel contained in the data transmission special line to obtain a plurality of detection data packets, and then the network detection machine 1-2 and the gateway equipment 1-4 both send the obtained plurality of detection data packets to a kafka message queue for buffer treatment;
the kafka message queue is mainly used for buffering a plurality of detection data packets obtained by detecting network performance of the network detector 1-2 aiming at a data transmission special line, and buffering a plurality of detection data packets obtained by detecting network performance of the gateway device 1-4 aiming at a data transmission tunnel contained in the data transmission special line.
The stream computing platform is mainly used for computing network performance index values in each transmission period contained in the data transmission process based on a plurality of detection data packets acquired from the kafka message queue, detecting the data transmission condition of a data transmission special line based on the relation between the network performance index values in each transmission period and a preset threshold value, and sending fault information to the control platform and the alarm platform if the data transmission condition represents that the data transmission has faults.
Alternatively, the streaming computing platform may employ a streaming computing engine Kafka Stream, referring to fig. 18, and probe packets are accessed to the streaming computing platform based on a Kafka message queue and converted into a Stream. Each probe data packet is deserialized into a probe data packet with a specified structure according to a specified data format through Map, and because each probe data packet possibly contains batch data, the batch data contained in the probe data packet needs to be split or mapped into a plurality of single data through the Flat Map. It can be understood that the Window1 is for one transmission period included in the data transmission process, the Window2 is for a plurality of transmission periods included in the data transmission process, and the streaming computing platform is based on the plurality of transmission periods included in the data transmission process when detecting the data transmission condition of the data transmission dedicated line, and the specific detection process is referred to the foregoing embodiment and will not be repeated herein.
The control platform is mainly used for determining the fault type of the data transmission fault generated on the data transmission special line based on the received fault information sent by the stream computing platform, and then adjusting the data transmission special line to be matched with the fault type.
The alarm platform is mainly used for carrying out alarm processing in a designated alarm mode based on the received fault information sent by the stream computing platform.
First, the process of probing and processing from the large granularity level of the data transmission line is described:
referring to fig. 19, fig. 19 is a flowchart illustrating a control method of data transmission according to an embodiment of the present application. As shown in fig. 19, the control method for data transmission at least includes S1901 to S1909, which are described in detail as follows:
in S1901, the network probe 1 performs network performance probing for the data transmission process of the data transmission dedicated line to obtain a plurality of probing data packets.
It will be appreciated that the network probe 1 is directed to a data transmission direction in which data is transmitted to the other party in the direction in which it is located.
S1902, the network probe 2 performs network performance probing for the data transmission process of the data transmission dedicated line, to obtain a plurality of probing data packets.
It will be appreciated that the network probe 2 is also directed to a data transmission direction in which it is transmitting data to the other party, which is two opposite data transmission directions to the network probe 1.
S1903, the network probe 1 transmits a plurality of probe packets to the streaming computing platform through the kafka message queue.
S1904, the network probe 2 transmits a plurality of probe packets to the streaming platform through the kafka message queue.
And S1905, the flow computing platform calculates network performance index values in each transmission period contained in the data transmission process based on a plurality of detection data packets sent by the network detector 1 and the network detector 2, and detects the data transmission condition of the special data transmission line based on the relation between the network performance index values in each transmission period and a preset threshold value.
And S1906, if the data transmission condition indicates that the data transmission has faults, the stream computing platform sends fault information to the alarm platform.
S1907, the alarm platform adopts a specified alarm mode to carry out alarm processing based on the fault information.
And S1908, if the data transmission condition indicates that the data transmission has faults, the stream computing platform sends fault information to the control platform.
And S1909, the control platform determines that the special data transmission line fails based on the failure information, and adjusts the data transmitted on the special data transmission line to other data transmission lines for transmission.
It should be noted that, please refer to the foregoing embodiments for the detailed description of S1901 to S1909 in fig. 19, and the detailed description is omitted here.
In the embodiment of the application, the self-healing of the network fault of the special data transmission line is realized by detecting and processing the special data transmission line at a large granularity level, and the normal transmission of the data is ensured.
Secondly, the process of probing and processing from a small granularity level of the data transmission tunnel is described:
referring to fig. 20, fig. 20 is a flowchart illustrating a control method of data transmission according to an embodiment of the present application. As shown in fig. 20, the control method of data transmission at least includes S2001 to S2009, which are described in detail as follows:
s2001, the gateway device 1-2 performs network performance detection for the data transmission process of the data transmission tunnel included in the data transmission dedicated line, to obtain a plurality of detection data packets.
It will be appreciated that the gateway device 1-2 is directed to a data transmission direction in which data is transmitted to the other party in the direction in which it is located.
S2002, the gateway device 3-4 detects network performance according to the data transmission process of the data transmission tunnel included in the data transmission dedicated line, and obtains a plurality of detection data packets.
It will be appreciated that the gateway device 3-4 is also directed to a data transmission direction in which it is transmitting data to the other party, which is two opposite data transmission directions to the gateway device 1-2.
S2003, the gateway apparatus 1-2 transmits a plurality of probe packets to the streaming computing platform through the kafka message queue.
S2004, the gateway device 3-4 transmits the plurality of probe packets to the streaming computing platform through the kafka message queue.
S2005, the stream computing platform calculates network performance index values in each transmission period contained in the data transmission process based on a plurality of detection data packets sent by the gateway device 1-2 and the gateway device 3-4, and detects the data transmission condition of the data transmission special line based on the relation between the network performance index values in each transmission period and a preset threshold value.
S2006, if the data transmission condition indicates that the data transmission has a fault, the stream computing platform sends fault information to the alarm platform.
S2007, the alarm platform adopts a specified alarm mode to carry out alarm processing based on the fault information.
And S2008, if the data transmission condition indicates that the data transmission has faults, the stream computing platform sends fault information to the control platform.
And S2009, the control platform determines that the data transmission tunnel contained in the data transmission special line fails based on the failure information, and adjusts the data transmitted on the failed data transmission tunnel to other data transmission tunnels contained in the data transmission special line for transmission.
It should be noted that, for the detailed description of S2001 to S2009 shown in fig. 20, please refer to the foregoing embodiments, and the detailed description is omitted here.
In the embodiment of the application, the self-healing of the network fault of the data transmission tunnel is realized by detecting and processing the data transmission tunnel from the small granularity level, and the normal transmission of the data is ensured.
Fig. 21 is a block diagram of a control device for data transmission shown in one embodiment of the present application. As shown in fig. 21, the control device for data transmission is configured in a streaming computing side, and the device includes:
a receiving module 2101 configured to receive a plurality of probe packets transmitted by a probe; the detection data packet is obtained by detecting network performance in the data transmission process of a data transmission special line according to a detection guideline, and the data transmission special line is leased by an operator in at least one direction of two data transmission parties;
a calculation module 2102 configured to calculate, based on the plurality of probe data packets, network performance index values within respective transmission periods included in the data transmission process;
the detection module 2103 is configured to detect the data transmission condition of the data transmission dedicated line based on the relation between the network performance index value in each transmission period and a preset threshold value;
And the sending module 2104 is configured to send fault information to the control party if the data transmission condition indicates that the data transmission has a fault, wherein the fault information is used for indicating the control party to determine the fault type and adjusting the data transmission special line to be matched with the fault type.
In one embodiment of the present application, the computing module 2102 includes:
a determining unit configured to determine a transmission period in which each probe packet is located, based on time stamp information of each probe packet;
the analysis processing unit is configured to respectively analyze the detection data packets in each transmission period to obtain analysis data corresponding to each transmission period;
and the calculating unit is configured to calculate the network performance index value in each transmission period based on the analysis data corresponding to each transmission period.
In one embodiment of the present application, the parsing unit is specifically configured to:
performing deserialization processing on the detection data packets in each transmission period respectively to obtain detection data packets with appointed structures in each transmission period;
splitting the detection data packets with the appointed structures in each transmission period respectively to obtain a plurality of detection data with the appointed structures in each transmission period;
A computing unit specifically configured to:
network performance index values in each transmission period are calculated based on a plurality of probe data having a specified structure in each transmission period.
In an embodiment of the present application, the parsing processing unit is further specifically configured to:
respectively calculating network performance index values corresponding to a plurality of detection data in each transmission period;
network performance index values in each transmission period are calculated based on network performance index values corresponding to the plurality of probe data in each transmission period.
In one embodiment of the present application, the network performance index includes at least one of a delay index and a packet loss rate index; the analysis processing unit is further specifically configured to:
if the network performance index comprises a time delay index, respectively calculating the time delay index value in each transmission period based on the time delay index values corresponding to the plurality of detection data in each transmission period;
if the network performance index comprises a packet loss index, the packet loss index value in each transmission period is calculated based on the packet loss index values corresponding to the plurality of detection data in each transmission period.
In an embodiment of the present application, the parsing processing unit is further specifically configured to:
and summing and averaging network performance index values corresponding to the plurality of detection data for each transmission period to obtain the network performance index value in each transmission period.
In one embodiment of the present application, the detection module 2103 includes:
the acquisition and determination unit is configured to acquire the type of the network performance index and determine a target strategy based on the type of the network performance index;
an acquisition unit configured to acquire network performance index values in a specified number of transmission periods based on a target policy;
the detection unit is configured to obtain a transmission condition for representing that the data transmission has a fault if the network performance index value in the designated number of transmission periods reaches a preset threshold value.
In one embodiment of the present application, the acquiring and determining unit is specifically configured to:
determining a strategy corresponding to the type of the network performance index based on a preset mapping relation table of the type of the network performance index and the strategy, and taking the determined strategy as a target strategy; the mapping relation table of the type and the strategy of the preset network performance indexes is preset with a plurality of types of network performance indexes and strategies corresponding to the plurality of types of network performance indexes respectively.
In one embodiment of the present application, the receiving module 2101 is specifically configured to:
receiving a plurality of buffered probe data packets sent by a message queue; the detection data packets are obtained by detecting network performance in the data transmission process of the data transmission special line according to the detection guideline, and are sent to the message queue for buffer processing.
In one embodiment of the present application, the transmitting module 2104 is further configured to:
and sending the fault information to the alarm party so that the alarm party adopts a specified alarm mode to carry out alarm processing based on the fault information.
Fig. 22 is a block diagram of a control device for data transmission shown in one embodiment of the present application. As shown in fig. 22, the control device for data transmission is configured on a probe side, and the device includes:
the detection module 2201 is configured to detect network performance according to a data transmission process of a data transmission dedicated line to obtain a plurality of detection data packets; the data transmission special line is leased by at least one direction operator in the two data transmission parties;
the sending module 2202 is configured to send a plurality of detection data packets to the streaming computing party, so that the streaming computing party calculates network performance index values in each transmission period included in the data transmission process based on the plurality of detection data packets, detects a data transmission condition of a dedicated data transmission line based on a relationship between the network performance index values in each transmission period and a preset threshold, and sends fault information to the control party when the transmission condition represents that the data transmission has a fault.
In one embodiment of the present application, the sending module 2202 is specifically configured to:
transmitting a plurality of detection data packets to a message queue for buffering; the message queue is used for respectively buffering a plurality of detection data packets obtained by network performance detection of each detection party aiming at the data transmission process of the data transmission special line;
the buffered plurality of probe packets are sent to the streaming calculator via the message queue.
In one embodiment of the present application, the probe includes at least one of a network probe and a gateway device;
if the detecting party comprises a network detector, the network detector is used for detecting network performance aiming at the data transmission process of the data transmission special line to obtain a plurality of detection data packets; wherein, the data transmission special line in one direction corresponds to a network detector;
if the detecting party comprises gateway equipment, the gateway equipment is used for detecting network performance aiming at the data transmission process of a data transmission tunnel contained in the data transmission special line to obtain a plurality of detection data packets; wherein the data transmission tunnel in one direction corresponds to one gateway device.
Fig. 23 is a block diagram of a control device for data transmission shown in one embodiment of the present application. As shown in fig. 23, the control device for data transmission is configured on a control side, and the device includes:
A receiving module 2301 configured to receive failure information sent by a streaming calculator; the method comprises the steps that a stream computing party calculates network performance index values in each transmission period contained in a data transmission process based on a plurality of detection data packets sent by a received detection party, detects the data transmission condition of a data transmission special line based on the relation between the network performance index values in each transmission period and a preset threshold value, and sends the data transmission condition representing that the data transmission has faults;
a determining module 2302 configured to determine a failure type of the data transmission line that has failed to transmit data based on the failure information;
an adjustment module 2303 is configured to make adjustments to the data transmission line that match the fault type.
In one embodiment of the present application, the adjustment module 2303 is specifically configured to:
if the fault type indicates that the whole data transmission special line has faults, adjusting the data transmitted on the data transmission special line to other data transmission lines for transmission;
if the fault type indicates that the data transmission special line has a fault locally, the data transmitted on the data transmission tunnel with the fault contained in the data transmission special line is adjusted to be transmitted on other data transmission tunnels contained in the data transmission special line.
In one embodiment of the present application, the determining module 2302 is specifically configured to:
acquiring a transmission line identifier with a fault from the fault information;
determining an identifier corresponding to the transmission line identifier based on a preset special line identifier and a tunnel identifier table;
if the determined identifier is matched with the dedicated line identifier, obtaining a fault type for representing that the whole data transmission dedicated line has faults;
and if the determined identifier is matched with the tunnel identifier, obtaining a fault type for representing that the data transmission special line has a fault locally.
It should be noted that the apparatus provided in the foregoing embodiment and the method provided in the foregoing embodiment belong to the same concept, and the specific manner in which the respective modules and units perform the operations have been described in detail in the method embodiment.
The embodiment of the application also provides electronic equipment, which comprises: one or more processors; and a memory for storing one or more programs that, when executed by the one or more processors, cause the electronic device to implement a control method of data transmission as before.
Fig. 24 is a schematic diagram of a computer system suitable for use in implementing embodiments of the present application.
It should be noted that, the computer system 2400 of the electronic device shown in fig. 24 is only an example, and should not impose any limitation on the functions and the application scope of the embodiments of the present application.
As shown in fig. 24, the computer system 2400 includes a central processing unit (Central Processing Unit, CPU) 2401, which can perform various appropriate actions and processes, such as performing the methods in the above-described embodiments, according to a program stored in a Read-Only Memory (ROM) 2402 or a program loaded from a storage portion 2408 into a random access Memory (Random Access Memory, RAM) 2403. In the RAM 2403, various programs and data required for system operation are also stored. The CPU 2401, ROM 2402, and RAM 2403 are connected to each other through a bus 2404. An Input/Output (I/O) interface 2405 is also connected to bus 2404.
The following components are connected to the I/O interface 2405: an input portion 2406 including a keyboard, a mouse, and the like; an output portion 2407 including a Cathode Ray Tube (CRT), a liquid crystal display (Liquid Crystal Display, LCD), and a speaker; a storage portion 2408 including a hard disk or the like; and a communication section 2409 including a network interface card such as a LAN (Local Area Network ) card, a modem, or the like. The communication section 2409 performs communication processing via a network such as the internet. The drive 2410 is also connected to the I/O interface 2405 as needed. A removable medium 2411 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is installed on the drive 2410 as needed, so that a computer program read out therefrom is installed into the storage section 2408 as needed.
In particular, according to embodiments of the present application, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present application include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising a computer program for performing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network via the communication portion 2409, and/or installed from the removable medium 2411. When executed by a Central Processing Unit (CPU) 2401, performs the various functions defined in the system of the present application.
It should be noted that, the computer readable medium shown in the embodiments of the present application may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable medium can be, for example, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-Only Memory (ROM), an erasable programmable read-Only Memory (Erasable Programmable Read Only Memory, EPROM), flash Memory, an optical fiber, a portable compact disc read-Only Memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present application, however, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with a computer-readable computer program embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. A computer program embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the foregoing.
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. Where each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units involved in the embodiments of the present application may be implemented by means of software, or may be implemented by means of hardware, and the described units may also be provided in a processor. Wherein the names of the units do not constitute a limitation of the units themselves in some cases.
Another aspect of the present application also provides a computer readable medium having stored thereon a computer program which, when executed by a processor, implements a method of controlling data transmission as before. The computer-readable medium may be included in the electronic device described in the above embodiment or may exist alone without being incorporated in the electronic device.
Another aspect of the present application also provides a computer program product or computer program comprising computer instructions stored in a computer readable medium. The processor of the computer device reads the computer instructions from the computer-readable medium, and the processor executes the computer instructions, so that the computer device performs the control method of data transmission provided in the above-described respective embodiments.
The foregoing is merely a preferred exemplary embodiment of the present application and is not intended to limit the embodiments of the present application, and those skilled in the art may make various changes and modifications according to the main concept and spirit of the present application, so that the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (15)

1. A method for controlling data transmission, the method comprising:
receiving a plurality of detection data packets sent by a detection party; the detection data packet is obtained by detecting network performance of the detection party aiming at the data transmission process of a data transmission special line, and the data transmission special line is leased by an operator in at least one direction of the two data transmission parties;
calculating network performance index values in each transmission period contained in the data transmission process based on the plurality of detection data packets;
detecting the data transmission condition of the data transmission special line based on the relation between the network performance index value in each transmission period and a preset threshold value;
if the data transmission condition represents that the data transmission has faults, fault information is sent to a control party, the fault information is used for indicating the control party to determine the fault type, and the data transmission special line is adjusted to be matched with the fault type.
2. The method of claim 1, wherein said calculating network performance index values for each transmission period included in said data transmission based on said plurality of probe packets comprises:
Determining a transmission period of each detection data packet based on the time stamp information of each detection data packet;
respectively analyzing the detection data packets in each transmission period to obtain analysis data corresponding to each transmission period;
and respectively calculating the network performance index values in each transmission period based on the analysis data corresponding to each transmission period.
3. The method of claim 2, wherein the parsing the probe packets in each transmission period to obtain parsed data corresponding to each transmission period includes:
performing deserialization processing on the detection data packets in each transmission period respectively to obtain detection data packets with appointed structures in each transmission period;
splitting the detection data packets with the appointed structures in each transmission period respectively to obtain a plurality of detection data with the appointed structures in each transmission period;
the calculating the network performance index value in each transmission period based on the analysis data corresponding to each transmission period includes:
network performance index values in each transmission period are calculated based on a plurality of probe data having a specified structure in each transmission period.
4. The method of claim 3, wherein the calculating the network performance index value for each transmission period based on the plurality of probe data having the specified structure for each transmission period, respectively, comprises:
respectively calculating network performance index values corresponding to the plurality of detection data in each transmission period;
and respectively calculating the network performance index values in each transmission period based on the network performance index values corresponding to the plurality of detection data in each transmission period.
5. The method of claim 4, wherein the network performance indicator comprises at least one of a delay indicator and a packet loss rate indicator; the calculating the network performance index value in each transmission period based on the network performance index values corresponding to the plurality of detection data in each transmission period includes:
if the network performance index comprises the time delay index, respectively calculating the time delay index value in each transmission period based on the time delay index values corresponding to the plurality of detection data in each transmission period;
and if the network performance index comprises the packet loss rate index, respectively calculating the packet loss rate index value in each transmission period based on the packet loss rate index values corresponding to the plurality of detection data in each transmission period.
6. The method according to any one of claims 1 to 5, wherein the detecting the data transmission condition of the dedicated data transmission line based on the relationship between the network performance index value and a preset threshold value in each transmission period includes:
acquiring the type of the network performance index, and determining a target strategy based on the type of the network performance index;
acquiring network performance index values in a designated number of transmission periods based on the target strategy;
and if the network performance index value in the designated number of transmission periods reaches the preset threshold value, obtaining the transmission condition used for representing that the data transmission has faults.
7. The method of claim 6, wherein the determining a target policy based on the type of network performance indicator comprises:
determining a strategy corresponding to the type of the network performance index based on a preset mapping relation table of the type of the network performance index and the strategy, and taking the determined strategy as the target strategy; the mapping relation table of the type and the strategy of the preset network performance indexes is preset with a plurality of types of network performance indexes and strategies respectively corresponding to the plurality of types of network performance indexes.
8. A method for controlling data transmission, the method comprising:
receiving fault information sent by a stream computing party; the failure information is sent when the streaming computing party characterizes the data transmission failure based on a plurality of detection data packets sent by the received detection party, calculates network performance index values in each transmission period contained in the data transmission process, and detects the data transmission condition of the data transmission special line based on the relation between the network performance index values in each transmission period and a preset threshold value;
determining a fault type of a data transmission fault generated on the data transmission special line based on the fault information;
and adjusting the data transmission special line to be matched with the fault type.
9. The method of claim 8, wherein said adjusting the data transmission line to match the fault type comprises:
if the fault type indicates that the whole data transmission special line has faults, adjusting the data transmitted on the data transmission special line to other data transmission lines for transmission;
And if the fault type represents that the data transmission special line has a fault locally, adjusting the data transmitted on the data transmission tunnel with the fault contained in the data transmission special line to other data transmission tunnels contained in the data transmission special line for transmission.
10. The method of claim 8 or 9, wherein the determining a failure type of the data transmission line that caused the data transmission failure based on the failure information comprises:
acquiring a transmission line identifier with a fault from the fault information;
determining an identifier corresponding to the transmission line identifier based on a preset special line identifier and a tunnel identifier table;
if the determined identifier is matched with the dedicated line identifier, obtaining a fault type for representing that the whole data transmission dedicated line has faults;
and if the determined identifier is matched with the tunnel identifier, obtaining a fault type for representing that the data transmission special line has a fault locally.
11. A control device for data transmission, the device being configured in a streaming computing side, the device comprising:
the receiving module is configured to receive a plurality of detection data packets sent by a detection party; the detection data packet is obtained by detecting network performance of the detection party aiming at the data transmission process of a data transmission special line, and the data transmission special line is leased by an operator in at least one direction of the two data transmission parties;
A calculation module configured to calculate a network performance index value in each transmission period included in the data transmission process based on the plurality of probe data packets;
the detection module is configured to detect the data transmission condition of the data transmission special line based on the relation between the network performance index value in each transmission period and a preset threshold value;
and the sending module is configured to send fault information to a control party if the data transmission condition represents that the data transmission has faults, wherein the fault information is used for indicating the control party to determine the fault type and adjusting the data transmission special line to be matched with the fault type.
12. A control apparatus for data transmission, the apparatus being configured in a control party, the apparatus comprising:
the receiving module is configured to receive fault information sent by the streaming computing party; the failure information is sent when the streaming computing party characterizes the data transmission failure based on a plurality of detection data packets sent by the received detection party, calculates network performance index values in each transmission period contained in the data transmission process, and detects the data transmission condition of the data transmission special line based on the relation between the network performance index values in each transmission period and a preset threshold value;
A determining module configured to determine a failure type of the data transmission failure generated on the data transmission dedicated line based on the failure information;
and the adjusting module is configured to adjust the data transmission special line to be matched with the fault type.
13. An electronic device, comprising:
one or more processors;
a memory for storing one or more programs that, when executed by the electronic device, cause the electronic device to implement the method of controlling data transmission according to any one of claims 1 to 10.
14. A computer readable medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the control method of data transmission according to any one of claims 1 to 10.
15. A computer program product comprising computer instructions which, when executed by a processor, implement a method of controlling data transmission according to any one of claims 1 to 10.
CN202210709730.3A 2022-06-21 2022-06-21 Data transmission control method and device, equipment and medium Pending CN117319269A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210709730.3A CN117319269A (en) 2022-06-21 2022-06-21 Data transmission control method and device, equipment and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210709730.3A CN117319269A (en) 2022-06-21 2022-06-21 Data transmission control method and device, equipment and medium

Publications (1)

Publication Number Publication Date
CN117319269A true CN117319269A (en) 2023-12-29

Family

ID=89285380

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210709730.3A Pending CN117319269A (en) 2022-06-21 2022-06-21 Data transmission control method and device, equipment and medium

Country Status (1)

Country Link
CN (1) CN117319269A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117692361A (en) * 2024-01-23 2024-03-12 深圳市威铭科技开发有限公司 Gateway fault monitoring method and system based on network communication

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117692361A (en) * 2024-01-23 2024-03-12 深圳市威铭科技开发有限公司 Gateway fault monitoring method and system based on network communication

Similar Documents

Publication Publication Date Title
CN106936709B (en) Remote service access path control method and relevant device
US10992769B2 (en) Data transmission method, apparatus and system
US10951395B2 (en) Data fetching in data exchange networks
US20180139274A1 (en) Application based intelligent edge computing in a low power wide area network environment
CN107624233B (en) VPN transmission tunnel scheduling method and device and VPN client server
CN107317879B (en) A kind of distribution method and system of user's request
CN112039796B (en) Data packet transmission method and device, storage medium and electronic equipment
US11902130B2 (en) Data packet loss detection
CN112788060B (en) Data packet transmission method and device, storage medium and electronic equipment
CN111385298B (en) Data transmission method, medium, device and computing equipment
CN107241280A (en) The dynamic prioritization of network traffics based on prestige
US11057475B2 (en) Methods, apparatus and systems for resuming transmission link
US11411839B1 (en) System and method to correlate end user experience with location
CN113300962A (en) Path acquisition method, access method, device and equipment
CN117319269A (en) Data transmission control method and device, equipment and medium
US10536368B2 (en) Network-aware routing in information centric networking
CN114510711A (en) Method, device, medium and computer equipment for preventing CC attack
CN118171297A (en) Interface authority control method and device, storage medium and electronic equipment
US11245599B2 (en) Network traffic monitoring or storage using a signed uniform resource locator
CN110247847B (en) Method and device for back source routing between nodes
CN109995606B (en) Virtualization deep packet inspection vDPI flow control method and network element equipment
CN115277504A (en) Network traffic monitoring method, device and system
US20160028834A1 (en) Traffic engineering of cloud services
CN108449252B (en) Dump method and device for access log
KR20190077700A (en) Packing Routing method by Edge Cloud in Distributed Cloud System

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40098431

Country of ref document: HK