CN113783787A - Non-real-time data transmission method and device based on cloud edge cooperation - Google Patents

Non-real-time data transmission method and device based on cloud edge cooperation Download PDF

Info

Publication number
CN113783787A
CN113783787A CN202110895992.9A CN202110895992A CN113783787A CN 113783787 A CN113783787 A CN 113783787A CN 202110895992 A CN202110895992 A CN 202110895992A CN 113783787 A CN113783787 A CN 113783787A
Authority
CN
China
Prior art keywords
real
time data
virtual machine
cloud virtual
edge node
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110895992.9A
Other languages
Chinese (zh)
Other versions
CN113783787B (en
Inventor
毕洁东
曹文鹏
张新常
朱效民
耿光刚
延志伟
金小峥
王鲁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong Computer Science Center National Super Computing Center in Jinan
Original Assignee
Shandong Computer Science Center National Super Computing Center in Jinan
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong Computer Science Center National Super Computing Center in Jinan filed Critical Shandong Computer Science Center National Super Computing Center in Jinan
Priority to CN202110895992.9A priority Critical patent/CN113783787B/en
Publication of CN113783787A publication Critical patent/CN113783787A/en
Application granted granted Critical
Publication of CN113783787B publication Critical patent/CN113783787B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00Traffic control in data switching networks
    • H04L47/10Flow control; Congestion control
    • H04L47/12Avoiding congestion; Recovering from congestion
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/14Session management
    • H04L67/141Setup of application sessions

Abstract

The invention relates to a non-real-time data transmission method and a non-real-time data transmission device based on cloud edge cooperation, wherein the method comprises the following steps: the data source end sends a connection message to the target server end through the control center, and the target server end sends a connection confirmation message to the data source end through the control center according to the connection message; based on a path available idle bandwidth measurement mechanism, a data source end and a target server end determine a transmission path through detection; the data source end sends a non-real-time data packet to an edge node based on a path transmission mechanism, and the edge node sends the non-real-time data packet to a cloud virtual machine forwarding node; and the cloud virtual machine forwarding node forwards the non-real-time data packet to a target server side. By combining the cloud edge coordination of the edge node and the cloud virtual machine forwarding node, the available path bandwidth measurement and the path transmission mechanism, network bandwidth resources are fully utilized, network congestion is effectively avoided, and the service quality of non-real-time data transmission is improved.

Description

Non-real-time data transmission method and device based on cloud edge cooperation
Technical Field
The invention relates to the field of non-real-time data transmission, in particular to a non-real-time data transmission method and device based on cloud edge cooperation.
Background
In recent years, non-real-time data transmission is more and more widely applied, such as storage services of a hundred-degree network disk and the like, and uploading services such as bilibilili and youtube and the like. The non-real-time data transmission has a huge user group, so that the service quality of the non-real-time data transmission user is improved, and meanwhile, the influence caused by the non-real-time data transmission flow needs to be considered. Therefore, it is necessary to avoid network congestion caused by non-real-time data transmission traffic so as not to affect the overall service quality of the internet.
Disclosure of Invention
The invention aims to solve the technical problem of the prior art and provides a non-real-time data transmission method and device based on cloud-edge cooperation.
The technical scheme for solving the technical problems is as follows:
a non-real-time data transmission method based on cloud edge cooperation comprises the following steps:
step S1, the data source end sends a connection message to a target server end through a control center, and the target server end sends a connection confirmation message to the data source end through the control center according to the connection message, so as to establish the connection between the data source end and the target server end;
step S2, based on the path available free bandwidth measuring mechanism, the data source end and the target server end determine the transmission path through detection; based on a path transmission mechanism, the data source end sends a non-real-time data packet to an edge node, and the edge node sends the non-real-time data packet to a cloud virtual machine forwarding node; and the cloud virtual machine forwarding node forwards the non-real-time data packet to the target server side.
The invention has the beneficial effects that: by combining the cloud edge coordination of the edge node and the cloud virtual machine forwarding node, the available path bandwidth measurement and the path transmission mechanism, network bandwidth resources are fully utilized, network congestion is effectively avoided, and the service quality of non-real-time data transmission is improved.
Further, the step S1 specifically includes:
the data source end sends the connection message to the control center; the control center receives and analyzes the connection message to obtain a target address, and sends the connection message to the target server according to the target address; and the target server end receives the connection message and sends a connection confirmation message to the data source end through the control center so as to establish connection with the data source end.
Further, the path transmission mechanism comprises a single path transmission mechanism and a multi-path transmission mechanism;
the step S2 specifically includes:
step S21, based on the path available idle bandwidth measuring mechanism, the data source end determines the edge node through detection, and sends the non-real-time data packet to the data cache of the edge node;
step S22, based on the path available idle bandwidth measurement mechanism, the edge node determines a cloud virtual machine forwarding node closest to the edge node through detection, and the cloud virtual machine forwarding node closest to the edge node determines a cloud virtual machine forwarding node next closest to the edge node through detection;
step S23, the edge node sends the non-real-time data packet to the cloud virtual machine forwarding node closest to the edge node based on the single-path transmission mechanism according to a preset threshold value of the data cache; or sending the non-real-time data packet to a plurality of cloud virtual machine forwarding nodes which are next to the edge node based on the multi-path transmission mechanism;
step S24, based on the path available idle bandwidth measuring mechanism, the target server determines the cloud virtual machine forwarding node closest to the target server through detection;
the cloud virtual machine forwarding node closest to the edge node and the plurality of cloud virtual machine forwarding nodes next to the edge node send the non-real-time data packet to the cloud virtual machine forwarding node closest to the target server;
and step S25, the cloud virtual machine forwarding node closest to the target server sends the non-real-time data packet to the target server.
The beneficial effect of adopting the further scheme is that: based on a path available bandwidth measurement mechanism, a data source end, an edge node and a target server end can find the nearest edge node or cloud virtual machine forwarding node through detection, detection and transmission are carried out simultaneously through a path transmission mechanism, network bandwidth resources are fully utilized, transmission efficiency is improved, network congestion is effectively avoided, and service quality of non-real-time data transmission is improved.
Further, the step S23 specifically includes:
judging whether the idle bandwidth of the edge node is sufficient or not according to a preset threshold value of the data cache; if the number of the non-real-time data packets is sufficient, the edge node sends the non-real-time data packets to the cloud virtual machine forwarding node closest to the edge node based on the single-path transmission mechanism; if the number of the non-real-time data packets is not enough, the edge node sends the non-real-time data packets to a plurality of cloud virtual machine forwarding nodes which are next to the edge node through a plurality of paths based on the multi-path transmission mechanism.
The beneficial effect of adopting the further scheme is that: the available bandwidth measurement of the path is combined with the multi-path transmission machine, so that the network bandwidth resource is fully utilized, the transmission efficiency is improved, and the network congestion is effectively avoided.
Further, step S24 specifically includes: judging whether the idle bandwidth of the cloud virtual machine forwarding node closest to the edge node is sufficient or not according to a preset threshold value; if the number of the non-real-time data packets is sufficient, based on the single-path transmission mechanism, the cloud virtual machine forwarding node closest to the edge node sends the non-real-time data packets to the cloud virtual machine forwarding node closest to the target server side; if the number of the non-real-time data packets is insufficient, based on the multi-path transmission mechanism, sending the non-real-time data packets to a plurality of cloud virtual machine forwarding nodes which are close to the edge node; the plurality of cloud virtual machine forwarding nodes which are close to the edge node in the secondary level send the non-real-time data packet to the cloud virtual machine forwarding node which is closest to the target server end;
similarly, whether the idle bandwidth of the cloud virtual machine forwarding nodes close to the edge node secondary level is sufficient or not is judged according to a preset threshold value, and if so, the non-real-time data packet is sent to the cloud virtual machine forwarding node closest to the target server side based on the single-path transmission mechanism; if the number of the non-real-time data packets is insufficient, the non-real-time data packets are sent to a plurality of cloud virtual machine forwarding nodes which are close to the next level of the edge nodes based on the multi-path transmission mechanism; and repeating the steps until the idle bandwidth of the cloud virtual machine forwarding node close to a certain level of the edge node is judged to be sufficient, and sending the non-real-time data packet to the cloud virtual machine forwarding node closest to the target server end.
The beneficial effect of adopting the further scheme is that: the available bandwidth measurement of the path is combined with the multi-path transmission machine, so that the network bandwidth resource is fully utilized, the transmission efficiency is improved, and the network congestion is effectively avoided.
Another technical solution of the present invention for solving the above technical problems is as follows: a non-real-time data transmission device based on cloud edge cooperation comprises a connection establishing module and a data transmission module;
the connection establishing module is used for the data source end to send a connection message to a target server end through a control center, and the target server end sends a connection confirmation message to the data source end through the control center according to the connection message, so that the connection between the data source end and the target server end is established;
the data transmission module is used for determining a transmission path by detecting the data source end and the target server end based on a path available free bandwidth measurement mechanism; based on a path transmission mechanism, the data source end sends a non-real-time data packet to an edge node, and the edge node sends the non-real-time data packet to a cloud virtual machine forwarding node; and the cloud virtual machine forwarding node forwards the non-real-time data packet to the target server side.
Further, the connection establishing module is specifically configured to:
the data source end sends the connection message to the control center; the control center receives and analyzes the connection message to obtain a target address, and sends the connection message to the target server according to the target address; and the target server end receives the connection message and sends a connection confirmation message to the data source end through the control center so as to establish connection with the data source end.
Further, the path transmission mechanism comprises a single path transmission mechanism and a multi-path transmission mechanism;
the data transmission module comprises an edge node transmission unit;
the edge node transmission unit is configured to, based on the path available idle bandwidth measurement mechanism, determine, by the data source, the edge node through detection, and send the non-real-time data packet to a data cache of the edge node;
based on the path available idle bandwidth measurement mechanism, the edge node determines a cloud virtual machine forwarding node closest to the edge node through detection, and the cloud virtual machine forwarding node closest to the edge node determines a cloud virtual machine forwarding node next closest to the edge node through detection;
the edge node sends the non-real-time data packet to a cloud virtual machine forwarding node closest to the edge node based on a single-path transmission mechanism according to a preset threshold value of the data cache; or the non-real-time data packet is sent to a plurality of cloud virtual machine forwarding nodes which are next to the edge node based on a multi-path transmission mechanism.
Further, the data transmission module further comprises a cloud virtual machine forwarding node transmission unit;
the cloud virtual machine forwarding node transmission unit is used for determining the cloud virtual machine forwarding node closest to the target server end by the target server end through measurement based on a path available idle bandwidth measurement mechanism; the cloud virtual machine forwarding node closest to the edge node and the plurality of cloud virtual machine forwarding nodes next to the edge node send the non-real-time data packet to the cloud virtual machine forwarding node closest to the target server;
and the cloud virtual machine forwarding node closest to the target server side sends the non-real-time data packet to the target server side.
In order to solve the technical problem, the present invention further provides a non-real-time data transmission apparatus based on cloud-edge coordination, which includes a memory, a processor, and a computer program stored in the memory and operable on the processor, and is characterized in that when the processor executes the computer program, the non-real-time data transmission method based on cloud-edge coordination as described above is implemented.
Drawings
Fig. 1 is a flowchart of a non-real-time data transmission method based on cloud-edge collaboration according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a non-real-time data transmission method based on cloud-edge coordination according to an embodiment of the present invention;
fig. 3 is a structural diagram of a non-real-time data transmission device based on cloud-edge coordination according to an embodiment of the present invention.
Detailed Description
The principles and features of this invention are described below in conjunction with the following drawings, which are set forth by way of illustration only and are not intended to limit the scope of the invention.
Example one
As shown in fig. 1, a non-real-time data transmission method based on cloud-edge collaboration includes the following steps:
step S1, the data source end sends a connection message to a target server end through a control center, and the target server end sends a connection confirmation message to the data source end through the control center according to the connection message, so as to establish the connection between the data source end and the target server end;
step S2, based on the path available free bandwidth measuring mechanism, the data source end and the target server end determine the transmission path through detection; based on a path transmission mechanism, the data source end sends a non-real-time data packet to an edge node, and the edge node sends the non-real-time data packet to a cloud virtual machine forwarding node; and the cloud virtual machine forwarding node forwards the non-real-time data packet to the target server side.
The edge node is a platform constructed near the edge of the network of the user, and provides functions such as storage and calculation so as to reduce bandwidth and delay loss brought by network transmission.
The cloud virtual machine forwarding nodes comprise a cloud virtual machine forwarding node which is closest to the edge node and the target server, and is close to the secondary, close to the secondary and the like.
The control center is also responsible for detecting the running states of the data source end, the edge node and the cloud virtual machine forwarding node, monitors the running state in the data transmission process and can feed back the actual situation in time.
It should be noted that the path available spare bandwidth measurement mechanism is a method for detecting a recent or secondary or next-secondary near path. The measurement of the available idle bandwidth of the path can be divided into methods such as measurement based on packet interval, measurement based on speed, measurement based on probability, measurement based on a detection packet model and the like, wherein the measurement based on the packet interval is to send a detection message to a network link and calculate the bottleneck bandwidth and the available bandwidth of the link through the round-trip time; the measurement based on the speed is to continuously increase the speed of the detection message to the link to calculate the bottleneck bandwidth and the available bandwidth of the link; the probability-based measurement is to send a low-rate detection packet to a link, and calculate the bottleneck bandwidth and the available bandwidth of the link according to the proportion of the detection packets which do not need to be queued; the information of the path is collected by sending a small number of probe packets based on the measurement of the probe packet model, and the available bandwidth of the path is deduced by combining the model analysis.
The path transmission mechanism comprises a single path transmission mechanism and a multi-path transmission mechanism, and the multi-path transmission mechanism is a mechanism for delivering application packets by adopting a plurality of disjoint paths to increase the connection capacity and reliability.
The path transmission mechanism is different from the path available idle bandwidth measurement mechanism in that the multi-path transmission mechanism transmits data in a plurality of paths, and the path available idle bandwidth measurement mechanism detects the nearest or secondary near path; one is transmission and one is sounding.
In the embodiment, by combining the cloud edge coordination of the edge node and the cloud virtual machine forwarding node, the measurement of the available bandwidth of the path and the path transmission mechanism, the network bandwidth resource is fully utilized, the network congestion is effectively avoided, and the quality of service of the non-real-time data transmission is improved
Preferably, as an embodiment of the present invention, the step S1 specifically includes:
the data source end sends the connection message to the control center; the control center receives and analyzes the connection message to obtain a target address, and sends the connection message to the target server according to the target address; and the target server end receives the connection message and sends a connection confirmation message to the data source end through the control center so as to establish connection with the data source end.
Wherein, still include in the connection message: the data source end sends a connection message to the control center according to the address of the control center.
Preferably, as an embodiment of the present invention, the path transmission mechanism includes a single path transmission mechanism and a multi-path transmission mechanism;
the step S2 specifically includes:
step S21, based on the path available idle bandwidth measuring mechanism, the data source end determines the edge node through detection, and sends the non-real-time data packet to the data cache of the edge node;
step S22, based on the path available idle bandwidth measurement mechanism, the edge node determines a cloud virtual machine forwarding node closest to the edge node through detection, and the cloud virtual machine forwarding node closest to the edge node determines a cloud virtual machine forwarding node next closest to the edge node through detection;
step S23, the edge node sends the non-real-time data packet to the cloud virtual machine forwarding node closest to the edge node based on the single-path transmission mechanism according to a preset threshold value of the data cache; or sending the non-real-time data packet to a plurality of cloud virtual machine forwarding nodes which are next to the edge node based on the multi-path transmission mechanism;
step S24, based on the path available idle bandwidth measuring mechanism, the target server determines the cloud virtual machine forwarding node closest to the target server through detection;
the cloud virtual machine forwarding node closest to the edge node and the plurality of cloud virtual machine forwarding nodes next to the edge node send the non-real-time data packet to the cloud virtual machine forwarding node closest to the target server;
and step S25, the cloud virtual machine forwarding node closest to the target server sends the non-real-time data packet to the target server.
Wherein the non-real-time data packet includes: the data type, source identifier, destination address and non-real-time data;
the cloud virtual machine forwarding node closest to the edge node analyzes the received non-real-time data packet to obtain a target address, and the non-real-time data packet is sent to the cloud virtual machine forwarding node closest to the target server side according to the target address;
the cloud virtual machine forwarding nodes close to the edge node secondary level analyze the received non-real-time data packet to obtain a target address, and the non-real-time data packet is sent to the cloud virtual machine forwarding node closest to the target server side according to the target address;
and the cloud virtual machine forwarding node closest to the target server terminal analyzes the non-real-time data packet to obtain the target address, and sends the non-real-time data packet to the target server terminal according to the target address.
The path transmission mechanism comprises a single path transmission mechanism and a multi-path transmission mechanism, and the multi-path transmission mechanism is a mechanism for delivering application packets by adopting a plurality of disjoint paths to increase the connection capacity and reliability. Colloquially, data is transmitted in multiple paths in a distributed manner.
The path available free bandwidth measuring mechanism is different from the path transmission mechanism in that the path available free bandwidth measuring mechanism is used for detecting a nearest or secondary near path and the like, and the multi-path transmission mechanism is used for transmitting data in a plurality of paths; one is sounding and one is transmitting.
In this embodiment: based on a path available bandwidth measurement mechanism, a data source end, an edge node and a target server end can find the nearest edge node or cloud virtual machine forwarding node through detection, detection and transmission are carried out simultaneously through a path transmission mechanism, network bandwidth resources are fully utilized, transmission efficiency is improved, network congestion is effectively avoided, and service quality of non-real-time data transmission is improved.
Preferably, as an embodiment of the present invention, the step S23 specifically includes:
judging whether the idle bandwidth of the edge node is sufficient or not according to a preset threshold value of the data cache; if the number of the non-real-time data packets is sufficient, the edge node sends the non-real-time data packets to the cloud virtual machine forwarding node closest to the edge node based on the single-path transmission mechanism; if the number of the non-real-time data packets is not enough, the edge node sends the non-real-time data packets to a plurality of cloud virtual machine forwarding nodes which are next to the edge node through a plurality of paths based on the multi-path transmission mechanism.
It should be noted that the preset threshold of the data cache is set at a position of 80% of the cache space of the entire edge node, that is, when the non-real-time data packet occupies less than 80% of the cache space of the edge node, it indicates that the idle bandwidth of the edge node is sufficient, and when the idle bandwidth exceeds 80%, it indicates that the idle bandwidth of the edge node is insufficient. The transmission of the non-real-time data packet to the cloud virtual machine forwarding node which is next to the cache node follows the above rule, and the specific number of the cloud virtual machine forwarding nodes to which the non-real-time data packet needs to be transmitted is determined according to how much the accumulated total rate exceeds the rate of data collection of the edge node. The preset threshold is set at 80% to reserve sufficient buffer space to prevent the whole buffer space from being occupied and causing non-real-time data loss.
In this embodiment: the available bandwidth measurement of the path is combined with the multi-path transmission machine, so that the network bandwidth resource is fully utilized, the transmission efficiency is improved, and the network congestion is effectively avoided.
Preferably, as an embodiment of the present invention, step S24 specifically includes: judging whether the idle bandwidth of the cloud virtual machine forwarding node closest to the edge node is sufficient or not according to a preset threshold value; if the number of the non-real-time data packets is sufficient, based on the single-path transmission mechanism, the cloud virtual machine forwarding node closest to the edge node sends the non-real-time data packets to the cloud virtual machine forwarding node closest to the target server side; if the number of the non-real-time data packets is insufficient, based on the multi-path transmission mechanism, sending the non-real-time data packets to a plurality of cloud virtual machine forwarding nodes which are close to the edge node; the plurality of cloud virtual machine forwarding nodes which are close to the edge node in the secondary level send the non-real-time data packet to the cloud virtual machine forwarding node which is closest to the target server end;
similarly, whether the idle bandwidth of the cloud virtual machine forwarding nodes close to the edge node secondary level is sufficient or not is judged according to a preset threshold value, and if so, the non-real-time data packet is sent to the cloud virtual machine forwarding node closest to the target server side based on the single-path transmission mechanism; if the number of the non-real-time data packets is insufficient, the non-real-time data packets are sent to a plurality of cloud virtual machine forwarding nodes which are close to the next level of the edge nodes based on the multi-path transmission mechanism; and repeating the steps until the idle bandwidth of the cloud virtual machine forwarding node close to a certain level of the edge node is judged to be sufficient, and sending the non-real-time data packet to the cloud virtual machine forwarding node closest to the target server end.
The preset threshold value of the idle bandwidth of the cloud virtual machine forwarding node closest to the edge node is set at the position of 80%, namely when the cache space occupied by the non-real-time data packet does not reach 80%, the idle bandwidth is sufficient, when the cache space occupied by the non-real-time data packet exceeds 80%, the idle bandwidth is insufficient, the cloud virtual machine forwarding node closest to the edge node is judged in the same way, and the cloud virtual machine forwarding node closest to the edge node is detected and transmitted in the same way according to the judgment result.
In this embodiment: the available bandwidth measurement of the path is combined with the multi-path transmission machine, so that the network bandwidth resource is fully utilized, the transmission efficiency is improved, and the network congestion is effectively avoided.
Example two
For convenience of understanding, the present embodiment describes a non-real-time data transmission method based on cloud-edge coordination with a more specific example. As shown in fig. 3, the data source end sends the non-real-time data packet to the nearest edge node, and the edge node sends the non-real-time data packet to the cloud virtual machine forwarding node nearest to the edge node or to the cloud virtual machine forwarding node next to the edge node according to the selection of the idle broadband; the cloud virtual machine forwarding node closest to the edge node sends the non-real-time data packet to the cloud virtual machine forwarding node closest to the target server or to the cloud virtual machine forwarding node closest to the edge node according to the idle broadband selection; similarly, the cloud virtual machine forwarding node close to the edge node secondary level sends the non-real-time data packet to the cloud virtual machine forwarding node close to the edge node next level according to the idle broadband selection, or sends the non-real-time data packet to the cloud virtual machine forwarding node closest to the target server, and the cloud virtual machine forwarding node closest to the target server forwards the non-real-time data packet to the target server.
And the control center monitors the states of the data source, all the cloud virtual machine forwarding nodes and the target server.
EXAMPLE III
The embodiment provides a non-real-time data transmission device based on cloud-edge collaboration, as shown in fig. 3, including a connection establishing module and a data transmission module;
the connection establishing module is used for the data source end to send a connection message to a target server end through a control center, and the target server end sends a connection confirmation message to the data source end through the control center according to the connection message, so that the connection between the data source end and the target server end is established;
the data transmission module is used for determining a transmission path by detecting the data source end and the target server end based on a path available free bandwidth measurement mechanism; based on a path transmission mechanism, the data source end sends a non-real-time data packet to an edge node, and the edge node sends the non-real-time data packet to a cloud virtual machine forwarding node; and the cloud virtual machine forwarding node forwards the non-real-time data packet to the target server side.
Preferably, as an embodiment of the present invention, the connection establishing module is specifically configured to:
the data source end sends the connection message to the control center; the control center receives and analyzes the connection message to obtain a target address, and sends the connection message to the target server according to the target address; and the target server end receives the connection message and sends a connection confirmation message to the data source end through the control center so as to establish connection with the data source end.
Preferably, as an embodiment of the present invention, the path transmission mechanism includes a single path transmission mechanism and a multi-path transmission mechanism; the data transmission module comprises an edge node transmission unit;
the edge node transmission unit is configured to, based on the path available idle bandwidth measurement mechanism, determine, by the data source, the edge node through detection, and send the non-real-time data packet to a data cache of the edge node;
based on the path available idle bandwidth measurement mechanism, the edge node determines a cloud virtual machine forwarding node closest to the edge node through detection, and the cloud virtual machine forwarding node closest to the edge node determines a cloud virtual machine forwarding node next closest to the edge node through detection;
the edge node sends the non-real-time data packet to a cloud virtual machine forwarding node closest to the edge node based on a single-path transmission mechanism according to a preset threshold value of the data cache; or the non-real-time data packet is sent to a plurality of cloud virtual machine forwarding nodes which are next to the edge node based on a multi-path transmission mechanism.
Preferably, as an embodiment of the present invention, the data transmission module further includes a cloud virtual machine forwarding node transmission unit;
the cloud virtual machine forwarding node transmission unit is used for determining the cloud virtual machine forwarding node closest to the target server end by the target server end through measurement based on a path available idle bandwidth measurement mechanism; the cloud virtual machine forwarding node closest to the edge node and the plurality of cloud virtual machine forwarding nodes next to the edge node send the non-real-time data packet to the cloud virtual machine forwarding node closest to the target server;
and the cloud virtual machine forwarding node closest to the target server side sends the non-real-time data packet to the target server side.
The embodiment also provides a non-real-time data transmission device based on cloud edge coordination, which includes a memory, a processor and a computer program stored in the memory and capable of running on the processor, and is characterized in that when the processor executes the computer program, the non-real-time data transmission device based on cloud edge coordination as described above is implemented.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, a division of a unit is merely a logical division, and an actual implementation may have another division, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed.

Claims (10)

1. A non-real-time data transmission method based on cloud edge collaboration is characterized by comprising the following steps:
step S1, the data source end sends a connection message to a target server end through a control center, and the target server end sends a connection confirmation message to the data source end through the control center according to the connection message, so as to establish the connection between the data source end and the target server end;
step S2, based on the path available free bandwidth measuring mechanism, the data source end and the target server end determine the transmission path through detection; based on a path transmission mechanism, the data source end sends a non-real-time data packet to an edge node, and the edge node sends the non-real-time data packet to a cloud virtual machine forwarding node; and the cloud virtual machine forwarding node forwards the non-real-time data packet to the target server side.
2. The cloud-edge-collaboration-based non-real-time data transmission method according to claim 1, wherein the step S1 specifically includes:
the data source end sends the connection message to the control center; the control center receives and analyzes the connection message to obtain a target address, and sends the connection message to the target server according to the target address; and the target server end receives the connection message and sends a connection confirmation message to the data source end through the control center so as to establish connection with the data source end.
3. The cloud-edge-coordination-based non-real-time data transmission method according to claim 1, wherein the path transmission mechanism comprises a single-path transmission mechanism and a multi-path transmission mechanism;
the step S2 specifically includes:
step S21, based on the path available idle bandwidth measuring mechanism, the data source end determines the edge node through detection, and sends the non-real-time data packet to the data cache of the edge node;
step S22, based on the path available idle bandwidth measurement mechanism, the edge node determines a cloud virtual machine forwarding node closest to the edge node through detection, and the cloud virtual machine forwarding node closest to the edge node determines a cloud virtual machine forwarding node next closest to the edge node through detection;
step S23, the edge node sends the non-real-time data packet to the cloud virtual machine forwarding node closest to the edge node based on a single-path transmission mechanism according to a preset threshold value of the data cache; or the non-real-time data packet is sent to a plurality of cloud virtual machine forwarding nodes which are next to the edge node on the basis of the multi-path transmission mechanism;
step S24, based on the path available idle bandwidth measuring mechanism, the target server determines the cloud virtual machine forwarding node closest to the target server through detection; the cloud virtual machine forwarding node closest to the edge node and the plurality of cloud virtual machine forwarding nodes next to the edge node send the non-real-time data packet to the cloud virtual machine forwarding node closest to the target server;
and step S25, the cloud virtual machine forwarding node closest to the target server sends the non-real-time data packet to the target server.
4. The cloud-edge-collaboration-based non-real-time data transmission method according to claim 3, wherein the step S23 specifically includes:
judging whether the idle bandwidth of the edge node is sufficient or not according to a preset threshold value of the data cache; if the number of the non-real-time data packets is sufficient, the edge node sends the non-real-time data packets to the cloud virtual machine forwarding node closest to the edge node based on the single-path transmission mechanism; if the number of the non-real-time data packets is not enough, the edge node sends the non-real-time data packets to a plurality of cloud virtual machine forwarding nodes which are next to the edge node through a plurality of paths based on the multi-path transmission mechanism.
5. The cloud-edge-collaboration-based non-real-time data transmission method according to claim 3, wherein the step S24 specifically includes:
judging whether the idle bandwidth of the cloud virtual machine forwarding node closest to the edge node is sufficient or not according to a preset threshold value; if the number of the non-real-time data packets is sufficient, based on the single-path transmission mechanism, the cloud virtual machine forwarding node closest to the edge node sends the non-real-time data packets to the cloud virtual machine forwarding node closest to the target server side; if the number of the non-real-time data packets is insufficient, based on the multi-path transmission mechanism, sending the non-real-time data packets to a plurality of cloud virtual machine forwarding nodes which are close to the edge node;
similarly, whether the idle bandwidth of the cloud virtual machine forwarding nodes close to the edge node secondary level is sufficient or not is judged according to a preset threshold value, and if so, the non-real-time data packet is sent to the cloud virtual machine forwarding node closest to the target server side based on the single-path transmission mechanism; if the number of the non-real-time data packets is insufficient, the non-real-time data packets are sent to a plurality of cloud virtual machine forwarding nodes which are close to the next level of the edge nodes based on the multi-path transmission mechanism; and repeating the steps until the idle bandwidth of the cloud virtual machine forwarding node close to a certain level of the edge node is judged to be sufficient, and sending the non-real-time data packet to the cloud virtual machine forwarding node closest to the target server end.
6. A non-real-time data transmission device based on cloud edge cooperation is characterized by comprising a connection module and a data transmission module;
the connection establishing module is used for the data source end to send a connection message to a target server end through a control center, and the target server end sends a connection confirmation message to the data source end through the control center according to the connection message, so that the connection between the data source end and the target server end is established;
the data transmission module is used for determining a transmission path by detecting the data source end and the target server end based on a path available free bandwidth measurement mechanism; based on a path transmission mechanism, the data source end sends a non-real-time data packet to an edge node, and the edge node sends the non-real-time data packet to a cloud virtual machine forwarding node; and the cloud virtual machine forwarding node forwards the non-real-time data packet to the target server side.
7. The cloud-edge-collaboration-based non-real-time data transmission device according to claim 6, wherein the connection establishment module is specifically configured to:
the data source end sends the connection message to the control center; the control center receives and analyzes the connection message to obtain a target address, and sends the connection message to the target server according to the target address; and the target server end receives the connection message and sends a connection confirmation message to the data source end through the control center so as to establish connection with the data source end.
8. The cloud-edge-coordination-based non-real-time data transmission device according to claim 6, wherein the path transmission mechanism comprises a single path transmission mechanism and a multi-path transmission mechanism;
the data transmission module comprises an edge node transmission unit;
the edge node transmission unit is configured to, based on the path available idle bandwidth measurement mechanism, determine, by the data source, the edge node through detection, and send the non-real-time data packet to a data cache of the edge node;
based on the path available idle bandwidth measurement mechanism, the edge node determines a cloud virtual machine forwarding node closest to the edge node through detection, and the cloud virtual machine forwarding node closest to the edge node determines a cloud virtual machine forwarding node closest to the next level of the edge node through detection;
the edge node sends the non-real-time data packet to a cloud virtual machine forwarding node closest to the edge node based on a single-path transmission mechanism according to a preset threshold value of the data cache; or the non-real-time data packet is sent to a plurality of cloud virtual machine forwarding nodes which are next to the edge node based on a multi-path transmission mechanism.
9. The non-real-time data transmission device based on cloud edge collaboration as claimed in claim 8, wherein the data transmission module comprises a cloud virtual machine forwarding node transmission unit;
the cloud virtual machine forwarding node transmission unit is used for determining the cloud virtual machine forwarding node closest to the target server end by the target server end through measurement based on a path available idle bandwidth measurement mechanism; the cloud virtual machine forwarding node closest to the edge node and the plurality of cloud virtual machine forwarding nodes next to the edge node send the non-real-time data packet to the cloud virtual machine forwarding node closest to the target server;
and the cloud virtual machine forwarding node closest to the target server side sends the non-real-time data packet to the target server side.
10. A cloud-edge-coordination-based non-real-time data transmission apparatus comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor, when executing the computer program, implements the cloud-edge-coordination-based non-real-time data transmission method according to any one of claims 1 to 5.
CN202110895992.9A 2021-08-05 2021-08-05 Cloud edge cooperation-based non-real-time data transmission method and device Active CN113783787B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110895992.9A CN113783787B (en) 2021-08-05 2021-08-05 Cloud edge cooperation-based non-real-time data transmission method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110895992.9A CN113783787B (en) 2021-08-05 2021-08-05 Cloud edge cooperation-based non-real-time data transmission method and device

Publications (2)

Publication Number Publication Date
CN113783787A true CN113783787A (en) 2021-12-10
CN113783787B CN113783787B (en) 2023-06-13

Family

ID=78836833

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110895992.9A Active CN113783787B (en) 2021-08-05 2021-08-05 Cloud edge cooperation-based non-real-time data transmission method and device

Country Status (1)

Country Link
CN (1) CN113783787B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115086318A (en) * 2022-06-13 2022-09-20 南方电网深圳数字电网研究院有限公司 Cloud edge message cooperation method and device
CN115514651A (en) * 2022-09-16 2022-12-23 山东省计算中心(国家超级计算济南中心) Cloud-edge data transmission path planning method and system based on software-defined stacked network
CN115801811A (en) * 2023-01-09 2023-03-14 江苏云工场信息技术有限公司 Cloud edge coordination method and device

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100189110A1 (en) * 2009-01-29 2010-07-29 Nokia Corporation Multipath data communication
US20150067819A1 (en) * 2013-08-28 2015-03-05 Hola Networks Ltd. System and Method for Improving Internet Communication by Using Intermediate Nodes
CN105141517A (en) * 2015-10-13 2015-12-09 重庆邮电大学 Flexible optical network anycast business energy-saving routing method based on resource perception
CN106712839A (en) * 2017-01-03 2017-05-24 重庆邮电大学 Path protection method based on spectrum availability and protection bandwidth sharing sensing in elastic optical network
WO2017101400A1 (en) * 2015-12-14 2017-06-22 乐视控股(北京)有限公司 Data transmission method, apparatus and system
WO2017115907A1 (en) * 2015-12-28 2017-07-06 전자부품연구원 Transmission device and method for measuring dynamic path state in various network environments
CN107302576A (en) * 2017-06-19 2017-10-27 长安大学 Adaptive service data distribution method based on opportunistic communication under car networking environment
CN107566275A (en) * 2017-10-18 2018-01-09 中南大学 Multi-path transmission method based on the delay inequality opposite sex in data center network
CN107682886A (en) * 2017-09-01 2018-02-09 北京邮电大学 A kind of data transmission method of multipath
CN108882328A (en) * 2018-07-11 2018-11-23 浙江理工大学 A kind of safe topology control method of multipath for invading ability with appearance
CN110858840A (en) * 2018-08-23 2020-03-03 达音网络科技(上海)有限公司 Large-scale real-time multimedia communication technology
CN112256495A (en) * 2020-10-20 2021-01-22 平安科技(深圳)有限公司 Data transmission method and device, computer equipment and storage medium
CN112910713A (en) * 2021-03-02 2021-06-04 山东省计算中心(国家超级计算济南中心) Cloud-edge data distribution transmission method, edge node, control center and storage medium

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100189110A1 (en) * 2009-01-29 2010-07-29 Nokia Corporation Multipath data communication
US20150067819A1 (en) * 2013-08-28 2015-03-05 Hola Networks Ltd. System and Method for Improving Internet Communication by Using Intermediate Nodes
CN105141517A (en) * 2015-10-13 2015-12-09 重庆邮电大学 Flexible optical network anycast business energy-saving routing method based on resource perception
WO2017101400A1 (en) * 2015-12-14 2017-06-22 乐视控股(北京)有限公司 Data transmission method, apparatus and system
WO2017115907A1 (en) * 2015-12-28 2017-07-06 전자부품연구원 Transmission device and method for measuring dynamic path state in various network environments
CN106712839A (en) * 2017-01-03 2017-05-24 重庆邮电大学 Path protection method based on spectrum availability and protection bandwidth sharing sensing in elastic optical network
CN107302576A (en) * 2017-06-19 2017-10-27 长安大学 Adaptive service data distribution method based on opportunistic communication under car networking environment
CN107682886A (en) * 2017-09-01 2018-02-09 北京邮电大学 A kind of data transmission method of multipath
CN107566275A (en) * 2017-10-18 2018-01-09 中南大学 Multi-path transmission method based on the delay inequality opposite sex in data center network
CN108882328A (en) * 2018-07-11 2018-11-23 浙江理工大学 A kind of safe topology control method of multipath for invading ability with appearance
CN110858840A (en) * 2018-08-23 2020-03-03 达音网络科技(上海)有限公司 Large-scale real-time multimedia communication technology
CN112256495A (en) * 2020-10-20 2021-01-22 平安科技(深圳)有限公司 Data transmission method and device, computer equipment and storage medium
CN112910713A (en) * 2021-03-02 2021-06-04 山东省计算中心(国家超级计算济南中心) Cloud-edge data distribution transmission method, edge node, control center and storage medium

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
余东平;张剑峰;王聪;李宁;: "多路并行传输中数据调度算法的优化", 计算机应用 *
李旭;仇颂清;彭进霖;王聪;: "一种改进的移动自组织网多路径路由协议", 兵工学报 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115086318A (en) * 2022-06-13 2022-09-20 南方电网深圳数字电网研究院有限公司 Cloud edge message cooperation method and device
CN115086318B (en) * 2022-06-13 2024-04-05 南方电网数字平台科技(广东)有限公司 Cloud edge message cooperation method and device
CN115514651A (en) * 2022-09-16 2022-12-23 山东省计算中心(国家超级计算济南中心) Cloud-edge data transmission path planning method and system based on software-defined stacked network
CN115514651B (en) * 2022-09-16 2023-08-15 山东省计算中心(国家超级计算济南中心) Cloud edge data transmission path planning method and system based on software-defined stacked network
CN115801811A (en) * 2023-01-09 2023-03-14 江苏云工场信息技术有限公司 Cloud edge coordination method and device
CN115801811B (en) * 2023-01-09 2023-04-28 江苏云工场信息技术有限公司 Cloud edge cooperation method and device

Also Published As

Publication number Publication date
CN113783787B (en) 2023-06-13

Similar Documents

Publication Publication Date Title
CN113783787A (en) Non-real-time data transmission method and device based on cloud edge cooperation
CN111181849B (en) Return source path determining method, determining device, computer equipment and storage medium
CN109314662B (en) Data transmission method and device
JP5353494B2 (en) Communication device and communication method
US11451481B2 (en) Network control apparatus and network control method
CN109787868B (en) Method, system and server for selecting routing path
CN109088829B (en) Data scheduling method, device, storage medium and equipment
US20060221825A1 (en) Congestion control network relay device and method
CN110890994B (en) Method, device and system for determining message forwarding path
US9426080B2 (en) Data communication apparatus, data transmission method, and computer system
CN106612284B (en) Streaming data transmission method and device
JP2000049858A (en) Communication system
EP3295612B1 (en) Uplink performance management
CN106953797B (en) RDMA data transmission method and device based on dynamic connection
CN114513467B (en) Network traffic load balancing method and device of data center
Asmaa et al. A hop-by-hop congestion control mechanisms in NDN networks–A survey
CN112737940A (en) Data transmission method and device
CN102325060A (en) Link bandwidth test method and router
CN111555965B (en) Message pushing method and system suitable for iOS client
CN110557302B (en) Network equipment message observation data acquisition method
CN110324255B (en) Data center network coding oriented switch/router cache queue management method
CN112910795B (en) Edge load balancing method and system based on many sources
CN110572332B (en) Network equipment message observation data acquisition task dividing method
Dong et al. Meet: rack-level pooling based load balancing in datacenter networks
CN112671662A (en) Data stream acceleration method, electronic device, and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant