CN113746647A - Data transmission method, node, electronic device and readable storage medium - Google Patents
Data transmission method, node, electronic device and readable storage medium Download PDFInfo
- Publication number
- CN113746647A CN113746647A CN202010462618.5A CN202010462618A CN113746647A CN 113746647 A CN113746647 A CN 113746647A CN 202010462618 A CN202010462618 A CN 202010462618A CN 113746647 A CN113746647 A CN 113746647A
- Authority
- CN
- China
- Prior art keywords
- node
- transmitted
- slave
- data
- master node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 109
- 238000000034 method Methods 0.000 title claims abstract description 47
- 230000004044 response Effects 0.000 claims abstract description 162
- 239000011159 matrix material Substances 0.000 claims description 37
- 238000001514 detection method Methods 0.000 claims description 3
- 238000012546 transfer Methods 0.000 claims description 2
- 238000013461 design Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000012790 confirmation Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005538 encapsulation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/02—Details
- H04L12/16—Arrangements for providing special services to substations
- H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
- H04L12/1863—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast comprising mechanisms for improved reliability, e.g. status reports
- H04L12/1868—Measures taken after transmission, e.g. acknowledgments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L1/00—Arrangements for detecting or preventing errors in the information received
- H04L1/12—Arrangements for detecting or preventing errors in the information received by using return channel
- H04L1/16—Arrangements for detecting or preventing errors in the information received by using return channel in which the return channel carries supervisory signals, e.g. repetition request signals
- H04L1/18—Automatic repetition systems, e.g. Van Duuren systems
- H04L1/1867—Arrangements specially adapted for the transmitter end
- H04L1/187—Details of sliding window management
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L1/00—Arrangements for detecting or preventing errors in the information received
- H04L1/12—Arrangements for detecting or preventing errors in the information received by using return channel
- H04L1/16—Arrangements for detecting or preventing errors in the information received by using return channel in which the return channel carries supervisory signals, e.g. repetition request signals
- H04L1/18—Automatic repetition systems, e.g. Van Duuren systems
- H04L1/1867—Arrangements specially adapted for the transmitter end
- H04L1/188—Time-out mechanisms
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
- H04L67/1074—Peer-to-peer [P2P] networks for supporting data block transmission mechanisms
- H04L67/1078—Resource delivery mechanisms
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L1/00—Arrangements for detecting or preventing errors in the information received
- H04L1/12—Arrangements for detecting or preventing errors in the information received by using return channel
- H04L1/16—Arrangements for detecting or preventing errors in the information received by using return channel in which the return channel carries supervisory signals, e.g. repetition request signals
- H04L1/18—Automatic repetition systems, e.g. Van Duuren systems
- H04L1/1803—Stop-and-wait protocols
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
The embodiment of the application provides a data transmission method, nodes, electronic equipment and a readable storage medium, which are applied to a cloud computing system, wherein a master node can send data to be transmitted to each slave node in a parallel transmission mode, then obtain response messages corresponding to the slave nodes, and when the master node obtains the response messages corresponding to the slave nodes within preset time, the master node determines that the data to be transmitted is successfully transmitted; otherwise, the main node determines that the transmission of the data to be transmitted fails, and retransmits the data to be transmitted. In other words, in the embodiment of the application, based on the existing hardware configuration of the cloud computing system, the master node sends the data to be transmitted to each slave node in a parallel transmission mode, so that the data transmission efficiency in the cloud computing system can be effectively improved.
Description
Technical Field
The embodiment of the application relates to the technical field of communication, and in particular relates to a data transmission method, a node, an electronic device and a readable storage medium.
Background
Cloud computing (cloud computing) is a distributed computing technology, and the most basic concept thereof is to automatically divide a huge computing processing program into a plurality of small subprograms through a network, and then to send the small subprograms to a huge system consisting of a plurality of servers, and after searching, computing and analyzing, the processing results are returned to a user.
In a typical application scenario of cloud computing, a huge amount of data transmission requirements from a point (master node) to multiple points (slave nodes) are generated. While the traditional Transmission Control Protocol (TCP) Protocol is a connection-oriented, reliable transport layer communication Protocol based on byte streams, and can implement reliable Transmission of point-to-point data, so that the TCP Protocol is applied to data Transmission in cloud computing.
However, if a data transmission requirement from a large number of points (master nodes) to a plurality of points (slave nodes) in cloud computing is to perform data transmission by using a conventional TCP protocol, each piece of data needs to be sent from the master node to the slave node 1, and after the master node and the slave node 1 complete response confirmation, each piece of data needs to be sent from the master node to the slave node 2; after the master node and the slave node 2 complete the acknowledgement, the data is sent from the master node to the slave node 3, … …, and so on until the data in the master node is sent to each slave node, thereby resulting in low data transmission efficiency.
Disclosure of Invention
The embodiment of the application provides a data transmission method, a node, an electronic device and a readable storage medium, which can effectively solve the technical problem of low data transmission efficiency in the current cloud computing system.
In a first aspect, an embodiment of the present application provides a data transmission method, which is applied to a cloud computing system, where the cloud computing system includes a master node and multiple slave nodes, and the master node and each slave node are deployed in the same broadcast domain, and the method includes:
the master node sends data to be transmitted to each slave node in a parallel transmission mode;
the master node acquires response messages corresponding to the slave nodes, wherein the response messages are response messages corresponding to the data to be transmitted;
when the master node acquires the response messages corresponding to the slave nodes within the preset time, the master node determines that the data to be transmitted is transmitted successfully;
when the main node does not acquire a response message corresponding to any one of the plurality of slave nodes within the preset time, the main node determines that the transmission of the data to be transmitted fails, and the main node retransmits the data to be transmitted.
In one possible design, the sending, by the master node, data to be transmitted to the slave nodes in a parallel transmission manner includes:
and the master node transmits the data to be transmitted to each slave node in a multicast or broadcast mode.
In one possible design, the sending, by the master node, data to be transmitted to the slave nodes in a parallel transmission manner includes:
the master node sends target data to be transmitted in a preset sending sliding window to each slave node, wherein the sending sliding window comprises at least two target data to be transmitted;
the acquiring, by the master node, the response message corresponding to each slave node includes:
and the master node receives response message packets sent by the slave nodes, wherein the response message packets comprise response messages corresponding to the target data to be transmitted in the sending sliding window.
In one possible design of the system, the system may be,
after the master node sends the target data to be transmitted in the preset sending sliding window to each slave node, the method further comprises the following steps:
the main node starts a preset timer;
when the timer finishes timing, if the master node does not acquire the response message packet, the master node sends a first message to each slave node, where the first message is used to notify each slave node to send a response message corresponding to the target data to be transmitted in the sending sliding window to the master node.
In one possible design, the obtaining, by the master node, a response message corresponding to each slave node includes:
the master node stores the received response message of each slave node to a preset response record matrix according to the identification information of each slave node, wherein the response record matrix comprises the identification information of each slave node;
when the identification information of each slave node in the response record matrix is stored with a response message correspondingly within a preset time, the master node determines to acquire the response messages corresponding to the plurality of slave nodes within the preset time.
In a possible design, before the master node sends data to be transmitted to the slave nodes in a parallel transmission manner, the method further includes:
the master node detects whether transmission links between the master node and the slave nodes are successfully established;
and when a first slave node which does not successfully establish a transmission link with the master node exists in each slave node, adjusting the response record matrix to ensure that the adjusted response record matrix does not include the identification information of the first slave node.
In a second aspect, an embodiment of the present application provides a node, where the node belongs to a cloud computing system, the cloud computing system includes a plurality of slave nodes, the node is a master node of the cloud computing system, the master node and each slave node are deployed in the same broadcast domain, and the master node includes:
the sending module is used for sending the data to be transmitted to each slave node in a parallel transmission mode;
an obtaining module, configured to obtain a response message corresponding to each slave node, where the response message is a response message corresponding to the data to be transmitted;
the determining module is used for determining that the data to be transmitted is successfully transmitted when the master node acquires the response messages corresponding to the plurality of slave nodes within the preset time; and when the main node does not acquire a response message corresponding to any one of the plurality of slave nodes within the preset time, determining that the data to be transmitted fails to be transmitted, and retransmitting the data to be transmitted.
In one possible design, the sending module is specifically configured to:
and sending the data to be transmitted to each slave node in a multicast or broadcast mode.
In one possible design, the sending module is specifically configured to:
sending target data to be transmitted in a preset sending sliding window to each slave node, wherein the sending sliding window comprises at least two target data to be transmitted; the acquisition module is specifically configured to:
and receiving response message packets sent by the slave nodes, wherein the response message packets comprise response messages corresponding to the target data to be transmitted in the sending sliding window.
In one possible design, the sending module is further configured to:
after target data to be transmitted in a preset transmission sliding window is sent to each slave node, a preset timer is started;
when the timer finishes timing, if the master node does not acquire the response message packet, the master node sends a first message to each slave node, where the first message is used to notify each slave node to send a response message corresponding to the target data to be transmitted in the sending sliding window to the master node.
In one possible design, the obtaining module is specifically configured to:
storing the received response message of each slave node to a preset response record matrix according to the identification information of each slave node, wherein the response record matrix comprises the identification information of each slave node;
the determination module is to:
when the identification information of each slave node in the response record matrix is stored with response messages correspondingly within the preset time, determining that the data to be transmitted is transmitted successfully;
and when the identification information of at least one slave node does not correspondingly store a response message in the response record matrix within the preset time, determining that the data to be transmitted fails to be transmitted.
In one possible design, further comprising:
the detection module is used for detecting whether transmission links between the master node and the slave nodes are successfully established; and when a first slave node which does not successfully establish a transmission link with the master node exists in each slave node, adjusting the response record matrix to ensure that the adjusted response record matrix does not include the identification information of the first slave node.
In a third aspect, an embodiment of the present application provides an electronic device, including: at least one processor and memory;
the memory stores computer-executable instructions;
the at least one processor executes computer-executable instructions stored by the memory, causing the at least one processor to perform the data transfer method as provided by the first aspect.
In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, where computer-executable instructions are stored, and when a processor executes the computer-executable instructions, the data transmission method according to the first aspect is implemented.
According to the data transmission method, the nodes, the electronic equipment and the readable storage medium, the master node can send data to be transmitted to each slave node in a parallel transmission mode, then response messages corresponding to the slave nodes are obtained, and when the master node obtains the response messages corresponding to the slave nodes within the preset time, the master node determines that the data to be transmitted are transmitted successfully; and when the main node does not acquire the response message corresponding to any one of the plurality of slave nodes within the preset time, the main node determines that the transmission of the data to be transmitted fails, and retransmits the data to be transmitted. In the embodiment of the application, based on the existing hardware configuration of the cloud computing system, the master node sends the data to be transmitted to each slave node in a parallel transmission mode, instead of sending the data to be transmitted to a certain slave node first and sending the data to be transmitted to the next slave node after receiving the response message of the slave node, so that the data transmission efficiency in the cloud computing system can be effectively improved; meanwhile, when the main node does not acquire the response message corresponding to any one of the plurality of slave nodes within the preset time, the main node retransmits the data to be transmitted, and the reliability of data transmission can be effectively guaranteed.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to these drawings without inventive exercise.
Fig. 1 is a schematic architecture diagram of a cloud computing system provided in an embodiment of the present application;
fig. 2 is a first flowchart of a data transmission method provided in an embodiment of the present application;
fig. 3 is a schematic flowchart illustrating a data transmission method according to an embodiment of the present application;
fig. 4 is a schematic program module diagram of a node provided in an embodiment of the present application;
fig. 5 is a schematic hardware structure diagram of an electronic device provided in an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The embodiment of the application provides a data transmission method, which can be applied to a cloud computing system, wherein cloud computing (cloud computing) is used as a distributed computing technology, a huge data computing processing program is decomposed into countless small programs through a network, and then the small programs are processed and analyzed through a system consisting of a plurality of servers to obtain results and return the results to a user.
In a typical application scenario of cloud computing, a cloud host cluster is generally distributed in a plurality of racks or even data centers in a range of hundreds of kilometers, and as data is computed and stored in a plurality of nodes, a huge amount of data transmission requirements from a point (master node) to a plurality of points (slave nodes) are generated.
Referring to fig. 1, fig. 1 is a schematic architecture diagram of a cloud computing system provided in an embodiment of the present application. As shown in fig. 1, the cloud computing system provided in this embodiment includes a master node and a plurality of slave nodes, where the master node and each slave node are deployed in the same broadcast domain.
In a possible implementation manner, a broadcast domain may be constructed by using a Virtual Extensible Local Area Network (VXLAN) technology, a master node and each slave node in the cloud computing system are incorporated into the broadcast domain, and the broadcast domain is used to implement parallel information transmission between the master node and a plurality of slave nodes in the cloud computing system.
Referring to fig. 2, fig. 2 is a schematic flowchart of a data transmission method provided in an embodiment of the present application, where an execution main body of the embodiment may be a master node in the embodiment shown in fig. 1. As shown in fig. 2, the method includes:
s201, the master node sends data to be transmitted to each slave node in a parallel transmission mode.
In the embodiment of the application, a parallel and reliable transmission control layer from the main node to each slave node can be constructed on the data link layer, so that parallel data transmission from the main node to each slave node is realized.
S202, the main node acquires response messages corresponding to the slave nodes, wherein the response messages are response messages corresponding to data to be transmitted.
In the embodiment of the present application, after the master node sends the data to be transmitted to each slave node, the slave node that receives the data to be transmitted automatically sends a response message to the master node to notify the master node that the data to be transmitted is currently received.
Optionally, after sending the data to be transmitted to each slave node in a parallel transmission manner, the master node may record the response message and the slave node corresponding to the response message after receiving the response message sent by any slave node.
S203, the master node determines whether to acquire the response message corresponding to each slave node within the preset time. If yes, go to step S204; otherwise, step S205 is executed.
And S204, the main node determines that the data to be transmitted is successfully transmitted and ends the current transmission task.
S205, the main node determines that the transmission of the data to be transmitted fails, and retransmits the data to be transmitted.
In the embodiment of the application, a time length value can be preset in the master node, and the master node starts timing after sending the data to be transmitted to each slave node in a parallel transmission mode. Before timing is finished, if the master node receives response messages corresponding to all the slave nodes, the success of data transmission to be transmitted can be determined, and a current transmission task is finished; if the master node does not receive the response message corresponding to any one of the plurality of slave nodes, it can be determined that the slave node which has not successfully transmitted exists at present, and at this time, the master node needs to retransmit the data to be transmitted, so that the reliability of data transmission can be effectively guaranteed.
According to the data transmission method provided by the embodiment of the application, based on the existing hardware configuration of the cloud computing system, the master node sends the data to be transmitted to each slave node in a parallel transmission mode instead of sending the data to be transmitted to a certain slave node first and sending the data to be transmitted to the next slave node after receiving the response message of the slave node, so that the data transmission efficiency in the cloud computing system can be effectively improved; meanwhile, when the main node does not acquire the response message corresponding to any one of the plurality of slave nodes within the preset time, the main node retransmits the data to be transmitted, and the reliability of data transmission can be effectively guaranteed.
Based on the content described in the foregoing embodiments, in a possible implementation manner of the present application, the master node may send the data to be transmitted to each slave node in a parallel transmission manner in a multicast or broadcast manner.
Optionally, when the host node performs data link layer encapsulation on a related data packet corresponding to the data to be transmitted, the host node may set the destination MAC address as a broadcast MAC address or a multicast MAC address, so as to send the data to be transmitted in the host node to each slave node in a parallel transmission manner.
It can be understood that after the master node sends the data to be transmitted to each slave node in a parallel transmission manner, if each slave node immediately sends a response message to the master node after receiving the data to be transmitted, a situation that a large number of slave nodes send response messages to the master node at the same time in a short time is easily caused, which creates great challenges for the message receiving frequency of the master node and the carrying capacity of the information channel.
In order to avoid the above situation, in another possible embodiment of the present application, the master node may preset a transmission sliding window, where the transmission sliding window includes at least two pieces of data to be transmitted by the target. The master node may send the data to be transmitted of each target in the sending sliding window to each slave node in a parallel transmission manner.
After receiving all the target data to be transmitted in the transmission sliding window sent by the master node, each slave node collects the response messages corresponding to the target data to be transmitted into a response message packet and then sends the response message packet to the master node.
For example, assuming that the cloud computing system includes 1 master node and 10 slave nodes, the master node needs to send 100 pieces of message data to each slave node. If 10 slave nodes send a reply message to the master node immediately after receiving 1 message data, the master node receives 1000 reply messages sent from 10 slave nodes in a short time.
In this embodiment of the present application, the master node sets a transmission sliding window, and assuming that the transmission sliding window may include 10 message data, each slave node does not immediately send a response message to the master node after receiving 1 message data, but waits for receiving 10 message data in the transmission sliding window, and then each slave node respectively summarizes the response messages corresponding to the 10 message data into a response message packet and sends the response message packet to the master node, so that the master node only receives 100 response message packets sent from 10 slave nodes in a short time, and the message receiving frequency of the master node is greatly reduced (from 1000 times to 100 times).
In the data transmission method provided by the embodiment of the application, the master node sets the sending sliding window, and after sending a plurality of data to be transmitted to each slave node according to the sending sliding window, receives the response message packet sent by the slave node, wherein the response message packet includes the response message corresponding to each target data to be transmitted generated by each slave node after receiving each target data to be transmitted in the sending sliding window, so that the response message amount can be greatly reduced, and the transceiving efficiency of the cloud computing system is improved.
In the embodiment of the application, after the master node sends the data to be transmitted of the target in the preset sending sliding window to each slave node, if the data to be transmitted of the target in the sending sliding window is less, the condition of forming the response message packet is not met, or some target slave nodes in the sending sliding window are in failure, the master node may not receive the response message packet corresponding to each slave node.
In order to avoid the above situation, in another possible embodiment of the present application, after the master node sends the target to-be-transmitted data in the preset sending sliding window to each slave node, a preset timer is started; when the timer finishes timing, if the master node does not acquire a response message packet, the master node sends a first message to each slave node, wherein the first message is used for informing each slave node to send a response message corresponding to the target data to be transmitted, which is generated in the sending sliding window, to the master node, so that the time effectiveness of data transmission can be guaranteed.
For example, assuming that the cloud computing system includes 1 master node and 10 slave nodes, the master node needs to send 95 pieces of packet data to each slave node. When the transmission sliding window preset by the master node may include 10 message data, since only 5 message data are transmitted in the last transmission sliding window, each slave node may not generate a response message packet after receiving the 5 message data in the transmission sliding window, and may still wait for 10 message data to be received before generating a response message packet, which inevitably results in a large time delay. Therefore, in this embodiment of the application, after the master node sends the target to-be-transmitted data in the preset sending sliding window to each slave node, a preset timer may be started, and when the timer finishes timing, if the master node does not acquire a response message packet sent by the slave node, the master node sends a first message to each slave node, where the first message is used to notify each slave node to send a response message corresponding to the 5 pieces of message data that have been generated in the sending sliding window to the master node. The slave node may send the response messages corresponding to the 5 pieces of message data to the master node, respectively, or may send the response messages to the master node in the form of a response message packet.
Based on the content described in the foregoing embodiment, in yet another possible implementation manner of the present application, the master node sends data to be transmitted to each slave node in a parallel transmission manner, and then stores the received response message sent by each slave node to a preset response record matrix according to the identification information of each slave node, where the response record matrix includes the identification information of each slave node.
When the identification information of each slave node in the response record matrix is stored with response messages correspondingly within the preset time, the master node determines to acquire the response messages corresponding to the slave nodes within the preset time; and when the identification information of any slave node in the response record matrix does not correspondingly store the response message within the preset time, the master node determines that the transmission of the data to be transmitted fails, and retransmits the data to be transmitted.
Referring to fig. 3, fig. 3 is a schematic flowchart of a data transmission method provided in an embodiment of the present application, where the data transmission method includes:
s301, the main node detects whether transmission links between the main node and each slave node are successfully established.
S302, when a first slave node which does not successfully establish a transmission link with the master node exists in each slave node, adjusting the response recording matrix, so that the adjusted response recording matrix does not include the identification information of the first slave node.
And S303, the master node sends the data to be transmitted to each slave node in a parallel transmission mode.
S304, the main node stores the received response message of each slave node to a response record matrix according to the identification information of each slave node.
S305, when the identification information of each slave node in the response record matrix is stored with the response message correspondingly within the preset time, the master node determines to acquire the response messages corresponding to the plurality of slave nodes within the preset time.
S306, when the response record matrix has at least one piece of identification information of the slave node not corresponding to the stored response message in the preset time, determining that the transmission of the data to be transmitted fails, and retransmitting the data to be transmitted by the master node.
That is, in the embodiment of the present application, if a transmission link between a master node and a certain slave node is not successfully established, the slave node is no longer required to return a response message to the master node, so that when a certain slave node fails, the whole cloud computing system can still be guaranteed to complete data transmission, and the whole system is prevented from being affected by the failure of a certain slave node.
Based on the data transmission method described in the foregoing embodiment, an embodiment of the present application further provides a node, where the node belongs to a cloud computing system, the cloud computing system includes a plurality of slave nodes, the node is a master node of the cloud computing system, and the master node and each slave node are deployed in the same broadcast domain.
Referring to fig. 4, fig. 4 is a schematic diagram of program modules of a node according to an embodiment of the present application, where the master node includes:
the sending module 401 is configured to send data to be transmitted to each slave node in a parallel transmission manner.
An obtaining module 402, configured to obtain a response message corresponding to each slave node, where the response message is a response message corresponding to the to-be-transmitted data.
A determining module 403, configured to determine that data to be transmitted is successfully transmitted when the master node acquires response messages corresponding to the multiple slave nodes within a preset time; and when the main node does not acquire the response message corresponding to any one of the plurality of slave nodes within the preset time, determining that the transmission of the data to be transmitted fails, and retransmitting the data to be transmitted.
The node provided by the embodiment of the application is based on the existing hardware configuration of the cloud computing system, and the data to be transmitted is sent to each slave node in a parallel transmission mode instead of sending the data to be transmitted to a certain slave node first and sending the data to be transmitted to the next slave node after receiving the response message of the slave node, so that the data transmission efficiency in the cloud computing system can be effectively improved; meanwhile, when the main node does not acquire the response message corresponding to any one of the plurality of slave nodes within the preset time, the main node retransmits the data to be transmitted, and the reliability of data transmission can be effectively guaranteed.
In a possible implementation, the sending module 401 is specifically configured to:
and sending the data to be transmitted to each slave node in a multicast or broadcast mode.
In another possible implementation, the sending module 401 is specifically configured to:
and sending target data to be transmitted in a preset sending sliding window to each slave node, wherein the sending sliding window comprises at least two target data to be transmitted.
The obtaining module 402 is specifically configured to:
and receiving response message packets sent by the slave nodes, wherein the response message packets comprise response messages corresponding to the target data to be transmitted in the sending sliding window.
In yet another possible implementation, the sending module 401 is further configured to:
after target data to be transmitted in a preset transmission sliding window is sent to each slave node, a preset timer is started;
when the timer finishes timing, if the master node does not acquire the response message packet, the master node sends a first message to each slave node, where the first message is used to notify each slave node to send a response message corresponding to the target data to be transmitted in the sending sliding window to the master node.
In another possible implementation, the obtaining module 402 is specifically configured to:
and storing the received response message of each slave node into a preset response record matrix according to the identification information of each slave node, wherein the response record matrix comprises the identification information of each slave node.
The determination module 403 is configured to:
when the identification information of each slave node in the response record matrix is stored with response messages correspondingly within the preset time, determining that the data to be transmitted is transmitted successfully; and when the identification information of at least one slave node does not correspondingly store the response message in the response record matrix within the preset time, determining that the transmission of the data to be transmitted fails.
In another possible implementation, the node further includes:
the detection module is used for detecting whether transmission links between the master node and each slave node are successfully established; and when a first slave node which does not successfully establish a transmission link with the master node exists in each slave node, adjusting the response recording matrix, so that the adjusted response recording matrix does not include the identification information of the first slave node.
It can be understood that, an implementation principle of the node provided in the foregoing embodiment is consistent with an implementation principle of the master node in the data transmission method embodiment provided in the foregoing embodiment, and specific reference may be made to the description in the foregoing data transmission method embodiment, which is not described herein again.
Further, based on the data transmission method described in the foregoing embodiment, an embodiment of the present application further provides an electronic device, including: at least one processor and a memory.
Wherein the memory stores computer execution instructions; the at least one processor executes computer-executable instructions stored in the memory, so that the at least one processor performs the data transmission method provided in the above embodiments.
Referring to fig. 5, fig. 5 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present disclosure. As shown in fig. 5, the electronic device 50 provided in the present embodiment includes: a processor 501 and a memory 502; wherein:
The processor 501 is configured to execute the computer-executable instructions stored in the memory to implement the steps performed by the master node in the above embodiments. Reference may be made in particular to the description relating to the method embodiments described above.
Alternatively, the memory 502 may be separate or integrated with the processor 501.
When the memory 502 is provided separately, the electronic device further includes a bus 503 for connecting the memory 502 and the processor 501.
The electronic device provided in this embodiment may be used to implement the technical solutions of the above method embodiments, and the implementation principles and technical effects are similar, which are not described herein again.
An embodiment of the present application further provides a computer-readable storage medium, where a computer executing instruction is stored in the computer-readable storage medium, and when a processor executes the computer executing instruction, the data transmission method as described above is implemented.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described device embodiments are merely illustrative, and for example, the division of the modules is only one logical division, and other divisions may be realized in practice, for example, a plurality of modules may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or modules, and may be in an electrical, mechanical or other form.
The modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment.
In addition, functional modules in the embodiments of the present application may be integrated into one processing unit, or each module may exist alone physically, or two or more modules are integrated into one unit. The unit formed by the modules can be realized in a hardware form, and can also be realized in a form of hardware and a software functional unit.
The integrated module implemented in the form of a software functional module may be stored in a computer-readable storage medium. The software functional module is stored in a storage medium and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) or a processor (processor) to execute some steps of the methods according to the embodiments of the present application.
It should be understood that the Processor may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in the incorporated application may be directly implemented by a hardware processor, or may be implemented by a combination of hardware and software modules in the processor.
The memory may comprise a high-speed RAM memory, and may further comprise a non-volatile storage NVM, such as at least one disk memory, and may also be a usb disk, a removable hard disk, a read-only memory, a magnetic or optical disk, etc.
The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an Extended ISA (EISA) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, the buses in the figures of the present application are not limited to only one bus or one type of bus.
The storage medium may be implemented by any type or combination of volatile or non-volatile memory devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks. A storage media may be any available media that can be accessed by a general purpose or special purpose computer.
An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium. Of course, the storage medium may also be integral to the processor. The processor and the storage medium may reside in an Application Specific Integrated Circuits (ASIC). Of course, the processor and the storage medium may reside as discrete components in an electronic device or host device.
Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.
Claims (14)
1. A data transmission method is applied to a cloud computing system, the cloud computing system comprises a master node and a plurality of slave nodes, the master node and each slave node are deployed in the same broadcast domain, and the method comprises the following steps:
the master node sends data to be transmitted to each slave node in a parallel transmission mode;
the master node acquires response messages corresponding to the slave nodes, wherein the response messages are response messages corresponding to the data to be transmitted;
when the master node acquires the response messages corresponding to the slave nodes within the preset time, the master node determines that the data to be transmitted is transmitted successfully;
when the main node does not acquire a response message corresponding to any one of the plurality of slave nodes within the preset time, the main node determines that the transmission of the data to be transmitted fails, and the main node retransmits the data to be transmitted.
2. The method according to claim 1, wherein the master node sends data to be transmitted to the slave nodes in a parallel transmission manner, and the method comprises the following steps:
the master node sends target data to be transmitted in a preset sending sliding window to each slave node, wherein the sending sliding window comprises at least two target data to be transmitted;
the acquiring, by the master node, the response message corresponding to each slave node includes:
and the master node receives response message packets sent by the slave nodes, wherein the response message packets comprise response messages corresponding to the target data to be transmitted in the sending sliding window.
3. The method of claim 2, wherein after the master node sends the target data to be transmitted in the preset sending sliding window to each slave node, the method further comprises:
the main node starts a preset timer;
when the timer finishes timing, if the master node does not acquire the response message packet, the master node sends a first message to each slave node, where the first message is used to notify each slave node to send a response message corresponding to the target data to be transmitted in the sending sliding window to the master node.
4. The method according to claim 1, wherein the master node sends data to be transmitted to the slave nodes in a parallel transmission manner, and the method comprises the following steps:
and the master node transmits the data to be transmitted to each slave node in a multicast or broadcast mode.
5. The method according to any one of claims 1 to 4, wherein the acquiring, by the master node, the response message corresponding to each slave node comprises:
the master node stores the received response message of each slave node to a preset response record matrix according to the identification information of each slave node, wherein the response record matrix comprises the identification information of each slave node;
when the identification information of each slave node in the response record matrix is stored with a response message correspondingly within a preset time, the master node determines to acquire the response messages corresponding to the plurality of slave nodes within the preset time.
6. The method according to claim 5, wherein before the master node sends the data to be transmitted to the slave nodes in parallel transmission, the method further comprises:
the master node detects whether transmission links between the master node and the slave nodes are successfully established;
and when a first slave node which does not successfully establish a transmission link with the master node exists in each slave node, adjusting the response record matrix to ensure that the adjusted response record matrix does not include the identification information of the first slave node.
7. The node is characterized in that the node belongs to a cloud computing system, the cloud computing system comprises a plurality of slave nodes, the node is a master node of the cloud computing system, the master node and each slave node are deployed in the same broadcast domain, and the master node comprises:
the sending module is used for sending the data to be transmitted to each slave node in a parallel transmission mode;
an obtaining module, configured to obtain a response message corresponding to each slave node, where the response message is a response message corresponding to the data to be transmitted;
the determining module is used for determining that the data to be transmitted is successfully transmitted when the master node acquires the response messages corresponding to the plurality of slave nodes within the preset time; and when the main node does not acquire a response message corresponding to any one of the plurality of slave nodes within the preset time, determining that the data to be transmitted fails to be transmitted, and retransmitting the data to be transmitted.
8. The node according to claim 7, wherein the sending module is specifically configured to:
sending target data to be transmitted in a preset sending sliding window to each slave node, wherein the sending sliding window comprises at least two target data to be transmitted;
the acquisition module is specifically configured to:
and receiving response message packets sent by the slave nodes, wherein the response message packets comprise response messages corresponding to the target data to be transmitted in the sending sliding window.
9. The node of claim 8, wherein the sending module is further configured to:
after target data to be transmitted in a preset transmission sliding window is sent to each slave node, a preset timer is started;
when the timer finishes timing, if the master node does not acquire the response message packet, the master node sends a first message to each slave node, where the first message is used to notify each slave node to send a response message corresponding to the target data to be transmitted in the sending sliding window to the master node.
10. The node according to claim 7, wherein the sending module is specifically configured to:
and sending the data to be transmitted to each slave node in a multicast or broadcast mode.
11. The node according to any one of claims 7 to 10, wherein the obtaining module is specifically configured to:
storing the received response message of each slave node to a preset response record matrix according to the identification information of each slave node, wherein the response record matrix comprises the identification information of each slave node;
the determination module is to:
when the identification information of each slave node in the response record matrix is stored with response messages correspondingly within the preset time, determining that the data to be transmitted is transmitted successfully;
and when the identification information of at least one slave node does not correspondingly store a response message in the response record matrix within the preset time, determining that the data to be transmitted fails to be transmitted.
12. The node of claim 11, further comprising:
the detection module is used for detecting whether transmission links between the master node and the slave nodes are successfully established; and when a first slave node which does not successfully establish a transmission link with the master node exists in each slave node, adjusting the response record matrix to ensure that the adjusted response record matrix does not include the identification information of the first slave node.
13. An electronic device, comprising: at least one processor and memory;
the memory stores computer-executable instructions;
the at least one processor executing the computer-executable instructions stored by the memory causes the at least one processor to perform the data transfer method of any of claims 1 to 6.
14. A computer-readable storage medium having computer-executable instructions stored thereon, which when executed by a processor, implement the data transmission method of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010462618.5A CN113746647B (en) | 2020-05-27 | 2020-05-27 | Data transmission method, node, electronic device and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010462618.5A CN113746647B (en) | 2020-05-27 | 2020-05-27 | Data transmission method, node, electronic device and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113746647A true CN113746647A (en) | 2021-12-03 |
| CN113746647B CN113746647B (en) | 2023-12-19 |
Family
ID=78723865
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010462618.5A Active CN113746647B (en) | 2020-05-27 | 2020-05-27 | Data transmission method, node, electronic device and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113746647B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114552314A (en) * | 2022-03-02 | 2022-05-27 | 深圳市爱普丰电子有限公司 | Data transmission method based on multi-head data line and data line thereof |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003258878A (en) * | 2001-12-27 | 2003-09-12 | Toshiba Kyaria Kk | Method for deciding address for network system, and network terminal |
| CN1642167A (en) * | 2004-01-08 | 2005-07-20 | 华为技术有限公司 | Method for main node supporting different agreement type secondary unit apparatus on secondary node |
| EP1615374A1 (en) * | 2004-07-08 | 2006-01-11 | Siemens Aktiengesellschaft | Method for transmitting and receiving event notifications |
| US7272635B1 (en) * | 2002-10-04 | 2007-09-18 | Domosys Corporation | Method of configuring and managing a network |
| CN101094165A (en) * | 2006-06-19 | 2007-12-26 | 大唐移动通信设备有限公司 | Method, system, and device for controlling implementation of data transmission in local area network |
| JP2016005247A (en) * | 2014-06-19 | 2016-01-12 | 富士電機株式会社 | Network transmission system, and master node and slave node thereof |
| CN106330408A (en) * | 2016-08-25 | 2017-01-11 | 安徽小木文化科技有限公司 | Data transmission system and method |
| CN108243017A (en) * | 2016-12-24 | 2018-07-03 | 华为技术有限公司 | Broadcast implementation method, device and equipment |
| CN110311847A (en) * | 2019-06-26 | 2019-10-08 | 北京和利时系统工程有限公司 | A kind of bulk data transmission method and device |
-
2020
- 2020-05-27 CN CN202010462618.5A patent/CN113746647B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003258878A (en) * | 2001-12-27 | 2003-09-12 | Toshiba Kyaria Kk | Method for deciding address for network system, and network terminal |
| US7272635B1 (en) * | 2002-10-04 | 2007-09-18 | Domosys Corporation | Method of configuring and managing a network |
| CN1642167A (en) * | 2004-01-08 | 2005-07-20 | 华为技术有限公司 | Method for main node supporting different agreement type secondary unit apparatus on secondary node |
| EP1615374A1 (en) * | 2004-07-08 | 2006-01-11 | Siemens Aktiengesellschaft | Method for transmitting and receiving event notifications |
| CN101094165A (en) * | 2006-06-19 | 2007-12-26 | 大唐移动通信设备有限公司 | Method, system, and device for controlling implementation of data transmission in local area network |
| JP2016005247A (en) * | 2014-06-19 | 2016-01-12 | 富士電機株式会社 | Network transmission system, and master node and slave node thereof |
| CN106330408A (en) * | 2016-08-25 | 2017-01-11 | 安徽小木文化科技有限公司 | Data transmission system and method |
| CN108243017A (en) * | 2016-12-24 | 2018-07-03 | 华为技术有限公司 | Broadcast implementation method, device and equipment |
| CN110311847A (en) * | 2019-06-26 | 2019-10-08 | 北京和利时系统工程有限公司 | A kind of bulk data transmission method and device |
Non-Patent Citations (2)
| Title |
|---|
| 王文芳;刘玉;: "基于ZigBee技术的角度同步采集传输系统设计", no. 26, pages 9 - 11 * |
| 隆玲;徐海贤;: "CAN总线实时监测系统的通信协议设计", 中国仪器仪表, no. 02 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114552314A (en) * | 2022-03-02 | 2022-05-27 | 深圳市爱普丰电子有限公司 | Data transmission method based on multi-head data line and data line thereof |
| CN114552314B (en) * | 2022-03-02 | 2024-04-19 | 深圳市爱普丰电子有限公司 | Multi-head data line-based data transmission method and data line thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113746647B (en) | 2023-12-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US4430651A (en) | Expandable and contractible local area network system | |
| CN109690510B (en) | Multicast apparatus and method for distributing data to multiple receivers in high performance computing networks and cloud-based networks | |
| US11563832B2 (en) | Data sending method and device, data receiving method and device, and system | |
| CN111343148A (en) | FGPA communication data processing method, system and device | |
| CN103763374A (en) | Method and device for data transmission based on UDT | |
| CN111181698B (en) | Data processing method, device, equipment and medium | |
| CN113746647A (en) | Data transmission method, node, electronic device and readable storage medium | |
| CN114788199A (en) | Data verification method and device | |
| CN108345621B (en) | Data reconciliation method, system and data system | |
| CN108460044B (en) | Data processing method and device | |
| CN111835801A (en) | File downloading method, device, server, edge device, terminal and medium | |
| CN111371871A (en) | Block chain link point equipment and block chain network system | |
| US20220141153A1 (en) | Server communication method, broadband access server, and system | |
| CN107733979B (en) | Data pushing method, server and system | |
| CN111651282B (en) | Message processing method, message processing device and electronic equipment | |
| CN113259490B (en) | Multi-level node network data transmission method based on UDP transmission protocol | |
| WO2022111326A9 (en) | Data transmission method and apparatus, electronic device and storage medium | |
| CN112181670B (en) | Inter-process communication method and device and Linux equipment | |
| CN113726723B (en) | UDP-based data transmission method, device and equipment | |
| CN114285661B (en) | Private network access method, device, equipment and storage medium | |
| CN117061072B (en) | Message transmission method, device, equipment and storage medium | |
| CN114301960B (en) | Processing method and device for cluster asymmetric traffic, electronic equipment and storage medium | |
| CN110875918B (en) | Trojan communication behavior detection method and device and electronic equipment | |
| CN113750517B (en) | Keyboard operation data transmission method and device and keyboard operation execution method and device | |
| CN115878351B (en) | Message transmission method and device, storage medium and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |