CN107124461A - A kind of data transmission method, apparatus and system - Google Patents
A kind of data transmission method, apparatus and system Download PDFInfo
- Publication number
- CN107124461A CN107124461A CN201710308340.4A CN201710308340A CN107124461A CN 107124461 A CN107124461 A CN 107124461A CN 201710308340 A CN201710308340 A CN 201710308340A CN 107124461 A CN107124461 A CN 107124461A
- Authority
- CN
- China
- Prior art keywords
- data
- identification information
- transmission
- network data
- downloading request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 322
- 238000000034 method Methods 0.000 title claims abstract description 48
- 230000001133 acceleration Effects 0.000 claims abstract description 30
- 238000004891 communication Methods 0.000 claims abstract description 13
- 239000012634 fragment Substances 0.000 claims description 28
- 238000013467 fragmentation Methods 0.000 claims description 5
- 238000006062 fragmentation reaction Methods 0.000 claims description 5
- 238000012546 transfer Methods 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 238000011161 development Methods 0.000 description 5
- 238000007689 inspection Methods 0.000 description 5
- 238000004590 computer program Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/141—Setup of application sessions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/146—Markers for unambiguous identification of a particular session, e.g. session cookie or URL-encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
- H04L67/63—Routing a service request depending on the request content or context
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The embodiments of the invention provide a kind of data transmission method, apparatus and system, the system includes：At least one first transmission equipment and at least one second transmission equipment；At least one first transmission equipment is connected with least one client communication, and at least one first transmission equipment is located at same location with least one client；At least one second transmission equipment is connected with least one server communication, and at least one second transmission equipment is located at same location with least one server.The embodiment of the present invention in client location by setting the first transmission equipment, in server location, the second transmission equipment is set, connected or default acceleration protocol transmission network network data by high concurrent TCP between the second transmission equipment and the first transmission equipment simultaneously, data transfer delay, reduction data packetloss rate can be reduced, it can improve in trans-regional data transmission procedure, the speed of download of client.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a data transmission method, apparatus, and system.
Background
When downloading data, the client sends a data downloading request to the server, and the server sends corresponding data to the client according to the data downloading request. In the prior art, a communication connection established between a client (e.g., a Google browser, a hundredth browser, etc.) and a server is usually a TCP (Transmission Control Protocol) single connection.
For a data transmission process across regions (such as a long-distance data transmission process across provinces, countries, continents, and the like), since the transmission distance is long, if a TCP single connection is still used, the data transmission delay is high, the packet loss rate is high, and finally the downloading speed is slow when a client downloads data.
Disclosure of Invention
The invention aims to provide a data transmission method, a device and a system, which are used for improving the downloading speed of a client in the trans-regional data transmission process.
To achieve the above object, an embodiment of the present invention provides a data transmission system, where the system includes: at least one first transmission device and at least one second transmission device;
the at least one first transmission device is in communication connection with at least one client, and the at least one first transmission device and the at least one client are located in the same region; the at least one second transmission device is in communication connection with at least one server, and the at least one second transmission device and the at least one server are located in the same region;
any one of the at least one first transmission device is configured to receive a first data download request sent by any one of the clients; determining whether the first data downloading request is a long-distance data downloading request or a short-distance data downloading request; if the first data downloading request is a long-distance data downloading request, generating a second data downloading request containing identification information of second transmission equipment, and sending the second data downloading request to the second transmission equipment corresponding to the identification information of the second transmission equipment, so that the second transmission equipment returns network data through high-concurrency TCP connection or a preset acceleration protocol; receiving network data returned by the second transmission equipment, determining client identification information contained in the network data, and sending the network data to a client corresponding to the client identification information;
any one of the at least one second transmission device is configured to receive a second data download request sent by any one of the first transmission devices; determining server identification information contained in the second data downloading request, and sending the second data downloading request to a server corresponding to the server identification information; receiving network data returned by the server; the network data is generated by the server according to the data downloading request; and determining first transmission equipment identification information contained in the network data, and sending the network data to first transmission equipment corresponding to the first transmission equipment identification information through high-concurrency TCP connection or a preset acceleration protocol.
The embodiment of the invention also provides a data transmission method, which is applied to any first transmission equipment in a data transmission system, and the method comprises the following steps:
receiving a first data downloading request sent by any client;
determining whether the first data downloading request is a long-distance data downloading request or a short-distance data downloading request;
if the first data downloading request is a long-distance data downloading request, generating a second data downloading request containing identification information of second transmission equipment, and sending the second data downloading request to the second transmission equipment corresponding to the identification information of the second transmission equipment, so that the second transmission equipment returns network data through high-concurrency TCP connection or a preset acceleration protocol;
and receiving the network data returned by the second transmission equipment, determining client identification information contained in the network data, and sending the network data to a client corresponding to the client identification information.
Further, the step of determining whether the first data download request is a long-distance data download request or a short-distance data download request includes:
determining client identification information and server identification information contained in the first data downloading request;
judging whether the client identification information and the server identification information are identification information of the same area;
if so, determining that the first data downloading request is a short-distance data downloading request;
if not, determining that the first data downloading request is a long-distance data downloading request.
The embodiment of the invention also provides a data transmission method, which is applied to any second transmission equipment in a data transmission system, and the method comprises the following steps:
receiving a second data downloading request sent by any first transmission equipment;
determining server identification information contained in the second data downloading request, and sending the second data downloading request to a server corresponding to the server identification information;
receiving network data returned by the server; the network data is generated by the server according to the data downloading request;
and determining first transmission equipment identification information contained in the network data, and sending the network data to first transmission equipment corresponding to the first transmission equipment identification information through high-concurrency TCP connection or a preset acceleration protocol.
Further, the step of sending the network data to the first transmission device corresponding to the first transmission device identification information includes:
fragmenting the received network data to obtain network data fragments;
and sending each network data fragment to the first transmission equipment corresponding to the first transmission equipment identification information.
Further, the step of fragmenting the received network data to obtain a network data fragment includes:
fragmenting the network data according to the size of the preset data volume to obtain network data fragments;
or,
and fragmenting the network data according to the distribution condition of each program contained in the network data to obtain network data fragments.
An embodiment of the present invention further provides a data transmission apparatus, which is applied to any first transmission device in a data transmission system, and the apparatus includes:
the first receiving module is used for receiving a first data downloading request sent by any client;
the determining module is used for determining whether the first data downloading request is a long-distance data downloading request or a short-distance data downloading request;
a first sending module, configured to generate a second data download request including identification information of a second transmission device if the first data download request is a long-distance data download request, and send the second data download request to a second transmission device corresponding to the identification information of the second transmission device, so that the second transmission device returns network data through a high-concurrency TCP connection or a preset acceleration protocol;
and the second sending module is used for receiving the network data returned by the second transmission equipment, determining client identification information contained in the network data, and sending the network data to the client corresponding to the client identification information.
Further, the determining module includes:
a first determining unit, configured to determine client identification information and server identification information included in the first data download request;
a judging unit, configured to judge whether the client identification information and the server identification information are identification information of the same area;
the second determining unit is used for determining the first data downloading request as a short-distance data downloading request when the judging result of the judging unit is yes;
and the third determining unit is used for determining that the first data downloading request is a long-distance data downloading request when the judging result of the judging unit is negative.
An embodiment of the present invention further provides a data transmission apparatus, which is applied to any second transmission device in a data transmission system, and the apparatus includes:
the second receiving module is used for receiving a second data downloading request sent by any first transmission equipment;
a third sending module, configured to determine server identification information included in the second data download request, and send the second data download request to a server corresponding to the server identification information;
the third receiving module is used for receiving the network data returned by the server; the network data is generated by the server according to the data downloading request;
and the fourth sending module is used for determining the first transmission equipment identification information contained in the network data and sending the network data to the first transmission equipment corresponding to the first transmission equipment identification information through high-concurrency TCP connection or a preset acceleration protocol.
Further, the fourth sending module includes:
the fragmentation unit is used for fragmenting the received network data to obtain network data fragments;
and the sending unit is used for sending each network data fragment to the first transmission equipment corresponding to the first transmission equipment identification information.
An embodiment of the present invention further provides a computer-readable storage medium, where instructions are stored in the computer-readable storage medium, and when the instructions are executed on a computer, the computer is caused to execute any one of the data transmission methods described above.
Embodiments of the present invention also provide a computer program product containing instructions, which when run on a computer, cause the computer to execute any of the above data transmission methods.
According to the data transmission method, the device and the system provided by the embodiment of the invention, the first transmission equipment is arranged in the area where the client is located, the second transmission equipment is arranged in the area where the server is located, and meanwhile, the network data is transmitted between the second transmission equipment and the first transmission equipment through the high-concurrency TCP connection or the preset acceleration protocol, so that the data transmission delay can be reduced, the data packet loss rate can be reduced, and the downloading speed of the client in the trans-regional data transmission process can be improved.
Drawings
Fig. 1 is a schematic structural diagram of a data transmission system according to an embodiment of the present invention;
fig. 2 is a flowchart of a first data transmission method according to an embodiment of the present invention;
fig. 3 is a flowchart of a second data transmission method according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a first data transmission apparatus according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a second data transmission apparatus according to an embodiment of the present invention.
Detailed Description
The technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention.
To achieve the above object, an embodiment of the present invention provides a data transmission system, and fig. 1 is a schematic structural diagram of the data transmission system provided in the embodiment of the present invention, where the system includes: at least one first transmission device 120 and at least one second transmission device 130;
the at least one first transmission device 120 is in communication connection with at least one client 110, and the at least one first transmission device 120 and the at least one client 110 are located in the same region; the at least one second transmission device 130 is in communication connection with at least one server 140, and the at least one second transmission device 130 and the at least one server 140 are located in the same region;
any first transmission device 120 of the at least one first transmission device 120, configured to receive a first data download request sent by any client 110; determining whether the first data downloading request is a long-distance data downloading request or a short-distance data downloading request; if the first data downloading request is a long-distance data downloading request, generating a second data downloading request containing identification information of second transmission equipment, and sending the second data downloading request to the second transmission equipment 130 corresponding to the identification information of the second transmission equipment, so that the second transmission equipment 130 returns network data through high-concurrency TCP connection or a preset acceleration protocol; receiving the network data returned by the second transmission device 130, determining client identification information included in the network data, and sending the network data to the client 110 corresponding to the client identification information;
any second transmission device 130 of the at least one second transmission device 130, configured to receive a second data download request sent by any first transmission device 120; determining the server identification information contained in the second data downloading request, and sending the second data downloading request to the server 140 corresponding to the server identification information; receiving network data returned by the server 140; the network data is generated by the server 140 according to the data download request; determining the first transmission device identification information included in the network data, and sending the network data to the first transmission device 120 corresponding to the first transmission device identification information through a high-concurrency TCP connection or a preset acceleration protocol.
Specifically, in the data transmission system, any client 110 and any server 140 are respectively located in two different regions (for example, the client 110 is located in china, and the server 140 is located in the united states); any first transmission device is in the same area as the client 110 and is in communication connection with the client 110, for example, the connection mode between the client 110 and the first transmission device 120 may be a TCP single connection, but is not limited thereto; any second transmission device 130 is in the same area as the server 140, and is communicatively connected to the server 140, for example, the server 140 is connected to the second transmission device 130 in a TCP single connection, but not limited thereto. In this embodiment, the client 110 may be, but is not limited to, a browser (e.g., Google browser, Baidu browser, etc.) or video software (e.g., storm video, Tencent video, Aiqiyi, etc.).
According to the data transmission system provided by the embodiment of the invention, the first transmission equipment is arranged in the area where the client is located, the second transmission equipment is arranged in the area where the server is located, and meanwhile, the network data is transmitted between the second transmission equipment and the first transmission equipment through the high concurrent TCP connection or the preset acceleration protocol, so that the data transmission delay can be reduced, the data packet loss rate is reduced, the data transmission system is more suitable for the trans-regional data transmission process, can be used for trans-national quality inspection file transmission, video content distribution and the like, the downloading speed of the client is improved, and the user experience is increased; meanwhile, in the application, the first transmission equipment is arranged in the area where the client is located, and the second transmission equipment is arranged in the area where the server is located, so that the development cost is low.
Based on the data transmission system, the embodiment of the invention provides a data transmission method. Fig. 2 is a flowchart of a first data transmission method provided in an embodiment of the present invention, where the method is applicable to any first transmission device in a data transmission system, and the method includes:
s210, receiving a first data downloading request sent by any client.
In this embodiment, the data downloading request may be a request of a user downloading a word file, a request of data required when the user watches a video picture, or a request of data required when the user runs a game when playing the game.
Specifically, when a user downloads a file or watches a video using a client, the client generates a corresponding data download request (i.e., a first data download request) for requesting data from a server, where the first data download request includes client identification information of the client, server identification information of the server for requesting, and first transmission device identification information of any first transmission device, and then sends the first data download request to the first transmission device corresponding to the first transmission device identification information, where the first transmission device receives the first data download request.
It should be noted that the first transmission device identification information of each first transmission device in communication connection with the client may be pre-stored in the client, and the manner of selecting the first transmission device identification information by the client may be random selection; the client may also select the first transmission device identification information of the first transmission device closest to the client according to its current location.
S220, determining whether the first data downloading request is a long-distance data downloading request or a short-distance data downloading request.
In a specific implementation manner of the embodiment of the present invention, the step S220 may include the following steps a1 to a 4:
a1, determining the client identification information and the server identification information contained in the first data downloading request.
A2, judging whether the client identification information and the server identification information are identification information of the same area; if so, perform step A3; if not, step A4 is performed.
A3, determining the first data downloading request as a short-distance data downloading request.
A4, determining the first data downloading request as a long-distance data downloading request.
It should be noted that the client identification information is a code for characterizing the uniqueness of the client; the server identification information is a code for characterizing the uniqueness of the server. The client identification information and the server identification information each include a region code indicating an area in which the client or the server is located. For example, 001 may be a Chinese code and 002 may be a United states code.
Specifically, after receiving the first data download request, the first transmission device analyzes the first data download request, determines client identification information and a server identification included in the first data download request, obtains a region code included in the client identification information and the server identification, and compares the two region codes. If the two region codes are the same, the client identification information and the server identification information are identification information of the same region; and if the two region codes are different, the client identification information and the server identification information are not the identification information of the same region. In this embodiment, a region code manner is adopted to determine whether the client identification information and the server identification information are identification information of the same region, so that the determination process is easier to implement.
If the client identification information and the server identification information are identification information of the same area, the distance between the client and the server is relatively short, and the first data downloading request can be determined to be a short-distance data downloading request; if the client identification information and the server identification information are not identification information of the same region, the distance between the client and the server is relatively long, and the first data downloading request can be determined to be a long-distance data downloading request.
S230, if the first data download request is a long-distance data download request, generating a second data download request including identification information of a second transmission device, and sending the second data download request to a second transmission device corresponding to the identification information of the second transmission device, so that the second transmission device returns network data through a high-concurrency TCP connection or a preset acceleration protocol;
specifically, if the first data download request is a long-distance data download request, the first transmission device analyzes the first data download request, generates a second data download request including identification information of a second transmission device, and sends the second data download request to a second transmission device corresponding to the identification information of the second transmission device.
In this embodiment, the first transmission device may store in advance second transmission device identification information of each second transmission device that is in communication connection with a server (the server is a server corresponding to the server identification information included in the first data download request), and the first transmission device may randomly select any one of the second transmission device identification information.
It should be noted that, after receiving the second data download request, the second transmission device sends the second data download request to the server, and the server generates network data according to the second data download request, where the network data includes client identification information, first transmission device identification information, second transmission device identification information, and server identification information included in the second data download request. And the server returns the network data to the second transmission equipment corresponding to the identification information of the second transmission equipment, and the second transmission equipment sends the network data to the first transmission equipment corresponding to the identification information of the first transmission equipment through high concurrency TCP connection or a preset acceleration protocol.
S240, receiving the network data returned by the second transmission device, determining client identification information included in the network data, and sending the network data to the client corresponding to the client identification information.
Specifically, the first transmission device receives the network data returned by the second transmission device, analyzes the network data, determines client identification information included in the network data, and sends the network data to a client corresponding to the client identification information, so as to complete the whole data transmission process.
According to the data transmission method provided by the embodiment of the invention, the first transmission equipment is arranged in the area where the client is located, the second transmission equipment is arranged in the area where the server is located, and meanwhile, the network data is transmitted between the second transmission equipment and the first transmission equipment through the high concurrent TCP connection or the preset acceleration protocol, so that the data transmission delay can be reduced, the data packet loss rate is reduced, the method is more suitable for the trans-regional data transmission process, can be used for the trans-national quality inspection file transmission, the video content distribution and the like, the downloading speed of the client is improved, and the user experience is increased; meanwhile, in the application, the first transmission equipment is arranged in the area where the client is located, and the second transmission equipment is arranged in the area where the server is located, so that the development cost is low.
Based on the data transmission system, the embodiment of the invention also provides another data transmission method. Fig. 3 is a flowchart of a second data transmission method provided in an embodiment of the present invention, where the method is applicable to any second transmission device in a data transmission system, and the method includes:
and S310, receiving a second data downloading request sent by any first transmission equipment.
And S320, determining the server identification information contained in the second data downloading request, and sending the second data downloading request to a server corresponding to the server identification information.
Specifically, any first transmission device sends a second data download request to a second transmission device, the second transmission device receives and analyzes the second data download request, obtains server identification information included in the second data download request, and then the second transmission device sends the second data download request to a server corresponding to the server identification information.
S330, receiving network data returned by the server; and the network data is generated by the server according to the data downloading request.
In this embodiment, the network data may be data pre-stored in a database of the server, may also be data searched by the server on the internet according to the second data download request, and may also be data obtained by performing a specific operation on locally stored data by using a predetermined algorithm, which is not limited to this.
Specifically, after receiving a second data download request sent by a second transmission device, the server generates corresponding network data according to the second data download request, where the network data includes server identification information, identification information of the second transmission device, identification information of the first transmission device, and client identification information. And the server sends the network data to second transmission equipment corresponding to the second transmission equipment identification information, and the second transmission equipment receives the network data returned by the server.
S340, determining first transmission equipment identification information contained in the network data, and sending the network data to first transmission equipment corresponding to the first transmission equipment identification information through high-concurrency TCP connection or a preset acceleration protocol.
Specifically, the second transmission device analyzes the network data after acquiring the network data to obtain first transmission device identification information included in the network data, and sends the network data to the first transmission device corresponding to the first transmission device identification information through high-concurrency TCP connection or a preset acceleration protocol, and the first transmission device analyzes the network data after acquiring the network data to obtain client identification information included in the network data, and sends the network data to a client corresponding to the client identification information.
Further, after the client obtains the network data, a specific process may be performed on the obtained network data. For example, the network data is output, or a specific calculation is performed using the network data, or the network data is stored in its own database, or the like.
In this embodiment, the high-concurrency TCP connection means that a plurality of TCP single connections simultaneously transmit information; the preset acceleration protocol is a protocol which enables the performance of network data transmission to be higher by adopting an optimization technology on the basis of TCP single connection. For example, the predetermined acceleration Protocol may be a hop-based broadcast routing Protocol (HBBR) or a User Data packet Protocol (UDP-based Data transfer Protocol, UDT), where UDP is an abbreviation of User Data packet Protocol and represents a User Data packet Protocol.
According to the data transmission method provided by the embodiment of the invention, the first transmission equipment is arranged in the area where the client is located, the second transmission equipment is arranged in the area where the server is located, and meanwhile, the network data is transmitted between the second transmission equipment and the first transmission equipment through the high concurrent TCP connection or the preset acceleration protocol, so that the data transmission delay can be reduced, the data packet loss rate is reduced, the method is more suitable for the trans-regional data transmission process, can be used for the trans-national quality inspection file transmission, the video content distribution and the like, the downloading speed of the client is improved, and the user experience is increased; meanwhile, in the application, the first transmission equipment is arranged in the area where the client is located, and the second transmission equipment is arranged in the area where the server is located, so that the development cost is low.
In a specific implementation manner of the embodiment of the present invention, the step of sending the network data to the first transmission device corresponding to the first transmission device identification information includes:
b1, fragmenting the received network data to obtain network data fragments;
b2, sending each network data segment to the first transmission device corresponding to the first transmission device identification information.
In this embodiment, when the second transmission device fragments the received network data, the network data may be fragmented according to the size of the predetermined data volume, for example, the network data fragments are averagely fragmented in a manner that the data volumes of the network data fragments are the same. In another embodiment provided by the present invention, the data size of each network data segment may also be freely set according to the specific situation of the network data, for example, the network data includes a plurality of different programs, and the network data may be fragmented according to the distribution situation of each program included in the network data, and this fragmentation manner may also reduce the probability of errors occurring when each program is fragmented.
Specifically, the second transmission device fragments the received network data to obtain a plurality of network data segments, sequentially marks each network data segment, and sequentially sends each network data segment to the first transmission device in real time according to the marked sequence through high-concurrency TCP connection or a preset acceleration protocol; and the first transmission equipment sends the network data fragments to the client, and the client combines the network data fragments into complete network data according to the marked sequence after receiving the network data fragments. In another embodiment provided by the present invention, the network data may be fragmented in the order in which the network data is actually run.
In the embodiment, a mode of fragmenting the network data is adopted, the received data is fragmented according to a certain size, and each network data fragment is forwarded in real time, so that data receiving and data forwarding can be simultaneously performed, and the data transmission delay is effectively reduced.
Further, when network data is transmitted between the second transmission device and the first transmission device via a high concurrent TCP connection, the data transmission time D that can be saved can be obtained by the following calculation formula:
wherein S is the data size of the network data, x is the download speed when the user adopts TCP single connection to download data, n is the connection number of high concurrent TCP connection, CkFor the download speed of the kth connection, k is 1,2, … n.
Corresponding to the above method embodiment, an embodiment of the present invention further provides a data transmission apparatus, and fig. 4 is a schematic structural diagram of the first data transmission apparatus provided in the embodiment of the present invention, where the apparatus is applicable to any first transmission device in a data transmission system, and the apparatus includes:
a first receiving module 410, configured to receive a first data download request sent by any client;
a determining module 420, configured to determine whether the first data downloading request is a long-distance data downloading request or a short-distance data downloading request;
a first sending module 430, configured to generate a second data download request including identification information of a second transmission device if the first data download request is a long-distance data download request, and send the second data download request to a second transmission device corresponding to the identification information of the second transmission device, so that the second transmission device returns network data through a high-concurrence TCP connection or a preset acceleration protocol;
the second sending module 440 is configured to receive the network data returned by the second transmission device, determine client identification information included in the network data, and send the network data to a client corresponding to the client identification information.
According to the data transmission device provided by the embodiment of the invention, the first transmission equipment is arranged in the area where the client is located, the second transmission equipment is arranged in the area where the server is located, and meanwhile, the network data is transmitted between the second transmission equipment and the first transmission equipment through the high concurrent TCP connection or the preset acceleration protocol, so that the data transmission delay can be reduced, the data packet loss rate is reduced, the data transmission device is more suitable for the trans-regional data transmission process, can be used for trans-national quality inspection file transmission, video content distribution and the like, the downloading speed of the client is improved, and the user experience is increased; meanwhile, in the application, the first transmission equipment is arranged in the area where the client is located, and the second transmission equipment is arranged in the area where the server is located, so that the development cost is low.
Further, the determining module 420 includes:
a first determining unit, configured to determine client identification information and server identification information included in the first data download request;
a judging unit, configured to judge whether the client identification information and the server identification information are identification information of the same area;
the second determining unit is used for determining the first data downloading request as a short-distance data downloading request when the judging result of the judging unit is yes;
and the third determining unit is used for determining that the first data downloading request is a long-distance data downloading request when the judging result of the judging unit is negative.
Fig. 5 is a schematic structural diagram of a second data transmission apparatus provided in an embodiment of the present invention, which may be applied to any second transmission device in a data transmission system, and the apparatus includes:
a second receiving module 510, configured to receive a second data download request sent by any first transmission device;
a third sending module 520, configured to determine server identification information included in the second data download request, and send the second data download request to a server corresponding to the server identification information;
a third receiving module 530, configured to receive network data returned by the server; the network data is generated by the server according to the data downloading request;
a fourth sending module 540, configured to determine first transmission device identification information included in the network data, and send the network data to a first transmission device corresponding to the first transmission device identification information through a high-concurrency TCP connection or a preset acceleration protocol.
According to the data transmission device provided by the embodiment of the invention, the first transmission equipment is arranged in the area where the client is located, the second transmission equipment is arranged in the area where the server is located, and meanwhile, the network data is transmitted between the second transmission equipment and the first transmission equipment through the high concurrent TCP connection or the preset acceleration protocol, so that the data transmission delay can be reduced, the data packet loss rate is reduced, the data transmission device is more suitable for the trans-regional data transmission process, can be used for trans-national quality inspection file transmission, video content distribution and the like, the downloading speed of the client is improved, and the user experience is increased; meanwhile, in the application, the first transmission equipment is arranged in the area where the client is located, and the second transmission equipment is arranged in the area where the server is located, so that the development cost is low.
Further, the fourth sending module 540 includes:
the fragmentation unit is used for fragmenting the received network data to obtain network data fragments;
and the sending unit is used for sending each network data fragment to the first transmission equipment corresponding to the first transmission equipment identification information.
Further, the fragmentation unit is specifically configured to fragment the network data according to the size of the predetermined data volume to obtain a network data fragment; or, the network data is fragmented according to the distribution situation of each program included in the network data to obtain a network data fragment.
In yet another embodiment of the present invention, a computer-readable storage medium is further provided, which has instructions stored therein, and when the computer-readable storage medium runs on a computer, the computer is caused to execute the data transmission method described in any one of the above embodiments.
In yet another embodiment of the present invention, there is also provided a computer program product containing instructions which, when run on a computer, cause the computer to perform any of the data transmission methods described above.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the apparatus and system embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference may be made to some descriptions of the method embodiments for relevant points.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.
Claims (10)
1. A data transmission system, the system comprising: at least one first transmission device and at least one second transmission device;
the at least one first transmission device is in communication connection with at least one client, and the at least one first transmission device and the at least one client are located in the same region; the at least one second transmission device is in communication connection with at least one server, and the at least one second transmission device and the at least one server are located in the same region;
any one of the at least one first transmission device is configured to receive a first data download request sent by any one of the clients; determining whether the first data downloading request is a long-distance data downloading request or a short-distance data downloading request; if the first data downloading request is a long-distance data downloading request, generating a second data downloading request containing identification information of second transmission equipment, and sending the second data downloading request to the second transmission equipment corresponding to the identification information of the second transmission equipment, so that the second transmission equipment returns network data through high-concurrency TCP connection or a preset acceleration protocol; receiving network data returned by the second transmission equipment, determining client identification information contained in the network data, and sending the network data to a client corresponding to the client identification information;
any one of the at least one second transmission device is configured to receive a second data download request sent by any one of the first transmission devices; determining server identification information contained in the second data downloading request, and sending the second data downloading request to a server corresponding to the server identification information; receiving network data returned by the server; the network data is generated by the server according to the data downloading request; and determining first transmission equipment identification information contained in the network data, and sending the network data to first transmission equipment corresponding to the first transmission equipment identification information through high-concurrency TCP connection or a preset acceleration protocol.
2. A data transmission method, applied to any first transmission device in a data transmission system, the method comprising:
receiving a first data downloading request sent by any client;
determining whether the first data downloading request is a long-distance data downloading request or a short-distance data downloading request;
if the first data downloading request is a long-distance data downloading request, generating a second data downloading request containing identification information of second transmission equipment, and sending the second data downloading request to the second transmission equipment corresponding to the identification information of the second transmission equipment, so that the second transmission equipment returns network data through high-concurrency TCP connection or a preset acceleration protocol;
and receiving the network data returned by the second transmission equipment, determining client identification information contained in the network data, and sending the network data to a client corresponding to the client identification information.
3. The method of claim 2, wherein the step of determining whether the first data download request is a long-range data download request or a short-range data download request comprises:
determining client identification information and server identification information contained in the first data downloading request;
judging whether the client identification information and the server identification information are identification information of the same area;
if so, determining that the first data downloading request is a short-distance data downloading request;
if not, determining that the first data downloading request is a long-distance data downloading request.
4. A data transmission method, applied to any second transmission device in a data transmission system, the method comprising:
receiving a second data downloading request sent by any first transmission equipment;
determining server identification information contained in the second data downloading request, and sending the second data downloading request to a server corresponding to the server identification information;
receiving network data returned by the server; the network data is generated by the server according to the data downloading request;
and determining first transmission equipment identification information contained in the network data, and sending the network data to first transmission equipment corresponding to the first transmission equipment identification information through high-concurrency TCP connection or a preset acceleration protocol.
5. The method according to claim 4, wherein the step of sending the network data to the first transmission device corresponding to the first transmission device identification information includes:
fragmenting the received network data to obtain network data fragments;
and sending each network data fragment to the first transmission equipment corresponding to the first transmission equipment identification information.
6. The method of claim 5, wherein the step of fragmenting the received network data to obtain network data fragments comprises:
fragmenting the network data according to the size of the preset data volume to obtain network data fragments;
or,
and fragmenting the network data according to the distribution condition of each program contained in the network data to obtain network data fragments.
7. A data transmission apparatus, applied to any first transmission device in a data transmission system, the apparatus comprising:
the first receiving module is used for receiving a first data downloading request sent by any client;
the determining module is used for determining whether the first data downloading request is a long-distance data downloading request or a short-distance data downloading request;
a first sending module, configured to generate a second data download request including identification information of a second transmission device if the first data download request is a long-distance data download request, and send the second data download request to a second transmission device corresponding to the identification information of the second transmission device, so that the second transmission device returns network data through a high-concurrency TCP connection or a preset acceleration protocol;
and the second sending module is used for receiving the network data returned by the second transmission equipment, determining client identification information contained in the network data, and sending the network data to the client corresponding to the client identification information.
8. The apparatus of claim 7, wherein the determining module comprises:
a first determining unit, configured to determine client identification information and server identification information included in the first data download request;
a judging unit, configured to judge whether the client identification information and the server identification information are identification information of the same area;
the second determining unit is used for determining the first data downloading request as a short-distance data downloading request when the judging result of the judging unit is yes;
and the third determining unit is used for determining that the first data downloading request is a long-distance data downloading request when the judging result of the judging unit is negative.
9. A data transmission apparatus, applied to any second transmission device in a data transmission system, the apparatus comprising:
the second receiving module is used for receiving a second data downloading request sent by any first transmission equipment;
a third sending module, configured to determine server identification information included in the second data download request, and send the second data download request to a server corresponding to the server identification information;
the third receiving module is used for receiving the network data returned by the server; the network data is generated by the server according to the data downloading request;
and the fourth sending module is used for determining the first transmission equipment identification information contained in the network data and sending the network data to the first transmission equipment corresponding to the first transmission equipment identification information through high-concurrency TCP connection or a preset acceleration protocol.
10. The apparatus of claim 9, wherein the fourth sending module comprises:
the fragmentation unit is used for fragmenting the received network data to obtain network data fragments;
and the sending unit is used for sending each network data fragment to the first transmission equipment corresponding to the first transmission equipment identification information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710308340.4A CN107124461A (en) | 2017-05-04 | 2017-05-04 | A kind of data transmission method, apparatus and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710308340.4A CN107124461A (en) | 2017-05-04 | 2017-05-04 | A kind of data transmission method, apparatus and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107124461A true CN107124461A (en) | 2017-09-01 |
Family
ID=59727747
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710308340.4A Pending CN107124461A (en) | 2017-05-04 | 2017-05-04 | A kind of data transmission method, apparatus and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107124461A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108156247A (en) * | 2017-12-27 | 2018-06-12 | 北京金山安全软件有限公司 | Data communication method, device, system, terminal and readable storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101860558A (en) * | 2009-04-13 | 2010-10-13 | 中国网通集团宽带业务应用国家工程实验室有限公司 | Cross-regional peer-to-peer network stream media ordering method and system thereof |
| CN101982955A (en) * | 2010-11-19 | 2011-03-02 | 深圳华大基因科技有限公司 | High-performance file transmission system and method thereof |
| CN103533603A (en) * | 2013-10-31 | 2014-01-22 | 宇龙计算机通信科技(深圳)有限公司 | Wireless communication method and wireless communication equipment |
| CN104158891A (en) * | 2014-08-21 | 2014-11-19 | 腾讯科技（深圳）有限公司 | Method, device and system of cross-regional data transmission, and server |
-
2017
- 2017-05-04 CN CN201710308340.4A patent/CN107124461A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101860558A (en) * | 2009-04-13 | 2010-10-13 | 中国网通集团宽带业务应用国家工程实验室有限公司 | Cross-regional peer-to-peer network stream media ordering method and system thereof |
| CN101982955A (en) * | 2010-11-19 | 2011-03-02 | 深圳华大基因科技有限公司 | High-performance file transmission system and method thereof |
| CN103533603A (en) * | 2013-10-31 | 2014-01-22 | 宇龙计算机通信科技(深圳)有限公司 | Wireless communication method and wireless communication equipment |
| CN104158891A (en) * | 2014-08-21 | 2014-11-19 | 腾讯科技（深圳）有限公司 | Method, device and system of cross-regional data transmission, and server |
Non-Patent Citations (1)
| Title |
|---|
| 姜维等: "《分布式网络系统与Multi-Agent系统编程框架》", 31 December 2015 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108156247A (en) * | 2017-12-27 | 2018-06-12 | 北京金山安全软件有限公司 | Data communication method, device, system, terminal and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108206802B (en) | Method and device for detecting webpage backdoor | |
| AU2012242421B2 (en) | Data acquisition method, device and system | |
| US9774642B2 (en) | Method and device for pushing multimedia resource and display terminal | |
| CN102523314B (en) | Identify the method and apparatus of efficient destination server | |
| WO2017054552A1 (en) | Terminal, cache server, and method for acquiring video slices and device thereof | |
| US8782068B2 (en) | Method, apparatus and system for protocol identification | |
| US10693858B2 (en) | CDN-based access control method and related device | |
| CN104283723B (en) | Network access log processing method and processing device | |
| KR20110076457A (en) | Network apparatus for requesting data based contents name and method thereof | |
| US20060112422A1 (en) | Data transfer using hyper-text transfer protocol (HTTP) query strings | |
| WO2017161760A1 (en) | Data transmission method and device | |
| CN110247985B (en) | Resource downloading method and device, electronic equipment and medium | |
| CN109286957B (en) | Switching method and device of return link, electronic equipment and storage medium | |
| CN102170479A (en) | Updating method of Web buffer and updating device of Web buffer | |
| CN108429701A (en) | network acceleration system | |
| US20180013610A1 (en) | File delivery method, apparatus and system | |
| WO2016037497A1 (en) | Video transmission method, gateway device and video transmission system | |
| US20180159815A1 (en) | Selectively extending life of prefetched content for domain name system content delivery | |
| CN105592083B (en) | Method and device for terminal to access server by using token | |
| CN110198315B (en) | Message processing method and device | |
| KR102158389B1 (en) | Operating method of node considering packet characteristics in content centric network and the node | |
| CN107124461A (en) | A kind of data transmission method, apparatus and system | |
| JP5109901B2 (en) | Session data sharing method | |
| US8412844B2 (en) | Validating download success | |
| JP2015501994A (en) | Method, apparatus and system for obtaining an object |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170901 |
|
| RJ01 | Rejection of invention patent application after publication |