CN111586112B - Data transmission method and device and computer readable storage medium - Google Patents

Data transmission method and device and computer readable storage medium Download PDF

Info

Publication number
CN111586112B
CN111586112B CN202010325855.7A CN202010325855A CN111586112B CN 111586112 B CN111586112 B CN 111586112B CN 202010325855 A CN202010325855 A CN 202010325855A CN 111586112 B CN111586112 B CN 111586112B
Authority
CN
China
Prior art keywords
data packet
client
data
server
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010325855.7A
Other languages
Chinese (zh)
Other versions
CN111586112A (en
Inventor
孟轲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hefei Lianbao Information Technology Co Ltd
Original Assignee
Hefei Lianbao Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hefei Lianbao Information Technology Co Ltd filed Critical Hefei Lianbao Information Technology Co Ltd
Priority to CN202010325855.7A priority Critical patent/CN111586112B/en
Publication of CN111586112A publication Critical patent/CN111586112A/en
Application granted granted Critical
Publication of CN111586112B publication Critical patent/CN111586112B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The invention discloses a data transmission method, a data transmission device and a computer readable storage medium, wherein the data transmission method comprises the following steps: splitting original data into a plurality of data packets; distributing the divided data packets to a plurality of clients for storage respectively, and recording the data packet information stored in each client; receiving a data downloading request of a first client aiming at a required data packet; positioning a second client storing the required data packet according to the received data downloading request; instructing the corresponding second client to transmit the required data packet to the first client. Therefore, in the process of file transmission, data transmission is carried out between the client side and other client sides by using the resources of the client side, the data transmission pressure of the server side is reduced, and the transmission efficiency is further improved.

Description

Data transmission method and device and computer readable storage medium
Technical Field
The present invention relates to the field of data transmission, and in particular, to a data transmission method, apparatus and computer-readable storage medium.
Background
In the prior art, files on a server are often transmitted to hundreds of electronic devices (such as computers) by using a copy-back machine, which causes great working pressure on the server and causes low transmission efficiency.
Disclosure of Invention
The embodiment of the invention provides a data transmission method, a data transmission device and a computer readable storage medium, which have the technical effect of reducing the transmission pressure of a server.
One aspect of the present invention provides a data transmission method, which is applied to a server side, and the method includes: splitting original data into a plurality of data packets; distributing the divided data packets to a plurality of clients for storage respectively, and recording the data packet information stored in each client; receiving a data downloading request of a first client aiming at a required data packet; positioning a second client storing the required data packet according to the received data downloading request; and instructing the corresponding second client to transmit the required data packet to the first client.
In an embodiment, the method further comprises: and if the second client storing the required data packet is not located, transmitting the required data packet in the local memory to the first client.
In an embodiment, the locating to the second client storing the required data package according to the received data download request includes: inquiring the client storing the required data packet from all clients; and selecting the client with the minimum current transmission pressure from the inquired clients as the second client for providing the corresponding data packet transmission.
In an embodiment, after instructing the second client to transmit the required data packet to the first client, the method further comprises: and updating the existing data packet information in the first client.
Another aspect of the present invention provides a data transmission method applied to a client, where the method includes: determining required data packet information according to the original data information and the local existing data packet information; generating a data downloading request aiming at the required data packet information according to the determined required data packet information; and sending the generated data downloading request to a server side so that the server side can download the required data packet to a local memory from other clients or the server.
In an implementation manner, the original data information includes data packet information and corresponding data location information, and the data packet information and the data packets correspond to each other one by one; the determining the required data packet information according to the original data information and the local existing data packet information comprises: determining all missing data packet information according to the original data information and the local existing data packet information; and determining the missing data packet information with the previous data position as the required data packet information from all the missing data packet information.
In an implementation manner, during the process of downloading the required data packet from other clients or from the server to the local memory, the method further includes: judging whether the residual storage space in the memory can store the required data packet or not; and if the residual storage space in the memory is judged not to be capable of storing the required data packet, releasing the data packet with the prior timestamp stored in the memory until the required data packet can be stored in the memory.
In an embodiment, after downloading the required data packet to the local memory, the method further includes: and sending the local existing data packet information to the server so that the server can record the existing data packet information of the current client.
In an embodiment, the method further comprises: and receiving and responding to a data uploading request sent by the server, wherein the data uploading request is used for uploading the specified data packet in the memory to a specified client.
Another aspect of the present invention provides a data transmission apparatus, applied to a server, the apparatus including: the data splitting module is used for splitting the original data into a plurality of data packets; the data packet distribution module is used for distributing the divided data packets to a plurality of clients for storage respectively and recording the data packet information stored in each client; the data downloading request receiving module is used for receiving a data downloading request of a first client aiming at a required data packet; the client positioning module is used for positioning a second client storing the required data packet according to the received data downloading request; and the transmission indicating module is used for indicating the corresponding client to transmit the required data packet to the first client.
Another aspect of the present invention provides a data transmission apparatus, applied to a client, the apparatus including: the data packet determining module is used for determining required data packet information according to the original data information and the local existing data packet information; a download request generation module, configured to generate a data download request for the required data package information according to the determined required data package information; and the download request sending module is used for sending the generated data download request to a server so that the server can download the required data packet to a local memory from other clients or the server.
Another aspect of the present invention provides a computer-readable storage medium applied to a server, where the storage medium includes a set of computer-executable instructions, and when the instructions are executed, the storage medium is used to execute a data transmission method.
Another aspect of the present invention provides a computer-readable storage medium for a client, the storage medium comprising a set of computer-executable instructions which, when executed, perform a data transmission method.
In the embodiment of the invention, in the process of file transmission, data transmission is carried out between the resources of the client and other clients, so that the data transmission pressure of the server is reduced, and the transmission efficiency is further improved.
Drawings
The above and other objects, features and advantages of exemplary embodiments of the present invention will become readily apparent from the following detailed description read in conjunction with the accompanying drawings. Several embodiments of the invention are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which:
in the drawings, the same or corresponding reference numerals indicate the same or corresponding parts.
Fig. 1 is a schematic flow chart illustrating an implementation of a data transmission method applied to a server according to an embodiment of the present invention;
fig. 2 is a schematic diagram illustrating splitting of original data in a data transmission method according to an embodiment of the present invention;
fig. 3 is a schematic diagram illustrating data packet allocation in a data transmission method according to an embodiment of the present invention;
fig. 4 is a schematic flow chart illustrating an implementation of a data transmission method applied to a client according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a data transmission device applied to a server according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a data transmission device applied to a client according to an embodiment of the present invention.
Detailed Description
In order to make the objects, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a schematic flow chart illustrating an implementation of a data transmission method applied to a server according to an embodiment of the present invention;
fig. 2 is a schematic diagram illustrating splitting of original data in a data transmission method according to an embodiment of the present invention;
fig. 3 is a schematic diagram of data packet allocation in a data transmission method according to an embodiment of the present invention.
As shown in fig. 1, in one aspect, the present invention provides a data transmission method applied to a server, where the method includes:
step 101, splitting original data into a plurality of data packets;
step 102, distributing the divided data packets to a plurality of clients for storage respectively, and recording the data packet information stored in each client;
103, receiving a data downloading request of a first client for a required data packet;
104, positioning a second client storing the required data packet according to the received data downloading request;
step 105, instructing the corresponding second client to transmit the required data packet to the first client.
In this embodiment, first, the original data is split into a plurality of data packets, where the original data is a complete file that needs to be transmitted to other clients, and the data sizes of the plurality of data packets may be equal or unequal, and specifically, as shown in fig. 2, fig. 2 shows one of the ways of splitting the original data, specifically, one of the ways of splitting one original data into 17 data packets, and numbers each data packet.
Then, distributing the divided multiple data packets to multiple clients for storage respectively, and recording data packet information stored in each client, where the distribution mode may be random distribution, or may be distribution according to data packet numbers in sequence, specifically, as shown in fig. 3, fig. 3 shows one of the situations of random distribution of original data, and in fig. 3, the data packets distributed to the client 1 are data packet 1, data packet 2, and data packet 4; the data packets distributed by the client 2 are data packet 2, data packet 9 and data packet 10; the data packets distributed by the client 3 are data packets 1-7, data packet 11 and data packet 12; the data packets distributed by the client 4 are data packets 5, 6, 8 and 11-13; the data packets 14-17 are temporarily unassigned. After the distribution is finished, the data packet information stored by each client is recorded.
And then receiving a data downloading request of the first client for the required data package, wherein the data downloading request is generated by the client according to the data package condition of the first client, and it is emphasized that the first client refers to all downloading requesters, not to the client 1 in fig. 3.
Then, according to the received data download request, the second client having the required data package is located, taking the client 2 in fig. 3 as an example, assuming that the client 2 issues a data download request for the data package 3, and the server locates the client 3 having the data package 3 according to the data download request of the client 2, it should be emphasized that the second client refers to the client having the corresponding data package instead of the client 2 in fig. 3.
And finally, instructing the corresponding second client to transmit the required data packet to the first client, specifically, sending a data transmission instruction for the required data packet to the second client, and instructing the second client to transmit the required data packet to the first client by using the intermediate server.
Therefore, in the process of file transmission, data transmission is carried out between the client side and other client sides by using the resources of the client side, the data transmission pressure of the server side is reduced, and the transmission efficiency is further improved.
Furthermore, in order to further improve the transmission efficiency, the data packets obtained by splitting in the server are all loaded into the memory of the server, and when data transmission is needed, the data are directly obtained from the memory of the server.
In an embodiment, the method further comprises:
and if the second client side with the required data packet is not located, transmitting the required data packet in the local memory to the first client side.
In this embodiment, it should be emphasized firstly that when the server allocates the data packets, especially randomly, one or more data packets in the server may not be allocated to any client, so that the required data packets do not exist in any client; there is also a case where the client contains the required packet, but due to memory size limitations, the required packet is not loaded into the memory of the client, which will also result in the server failing to locate the client.
Therefore, if the second client side with the required data packet is not located, the required data packet in the memory of the server is transmitted to the first client side, so that the required data packet is transmitted to the first client side.
In an embodiment, the locating to the second client storing the required data package according to the received data download request includes:
inquiring the client side with the required data packet in all the client sides;
and selecting the client with the minimum current transmission pressure from the inquired clients as a second client for providing corresponding data packet transmission.
In this embodiment, the specific process of step 104 is:
the client side storing the required data packet in all the client sides is queried, and specifically, the client side storing the required data packet can be queried according to the recorded and stored data packet information.
If a plurality of clients meeting the conditions are inquired, the client with the minimum current transmission pressure is selected as a second client providing corresponding data packet transmission, wherein the minimum current transmission pressure can be defined as the minimum current processor occupancy rate or the minimum current transmission task quantity.
Therefore, the client with the minimum current transmission pressure is preferably selected as the second client for data packet transmission, so that the transmission pressure between the clients can be effectively reduced, and the transmission efficiency is further improved.
In an embodiment, after instructing the second client to transmit the required data packet to the first client, the method further comprises:
and updating the existing data packet information in the first client.
In this embodiment, after the second client is instructed to transmit the required data packet to the first client, the existing data packet information for the first client is updated at the server, so that the server can know the data packet condition in the client at the next time of receiving the download request, which is beneficial to improving the transmission efficiency.
Fig. 4 is a schematic flow chart illustrating an implementation of a data transmission method applied to a client according to an embodiment of the present invention;
as shown in fig. 4, another aspect of the embodiments of the present invention provides a data transmission method, applied to a client, where the method includes:
step 201, determining required data packet information according to original data information and local existing data packet information;
step 202, generating a data downloading request aiming at the required data package information according to the determined required data package information;
step 203, sending the generated data downloading request to the server, so that the server can download the required data packet to the local memory from other clients or from the server.
In this embodiment, first, according to original data information and local existing data packet information, required data packet information is determined, where the original data information includes complete data packet information, and this step is to specifically check the original data information and the existing data packet information in the current client one by one, and determine the required data packet information, where the number of the data packets to be determined is generally one, and certainly may be multiple;
and then generating a data downloading request aiming at the required data package information according to the determined required data package information.
Then sending the generated data downloading request to a server side so that the server side can search for the client side containing the required data packet in other client sides; if the client containing the required data packet is searched from other clients, the client is utilized to transmit the required data packet to a local memory through an intermediate server; and if the client containing the required data packet is not searched from other clients, downloading the required data packet to the local memory from the memory of the server.
Further, after the required data packet is stored in the local memory, the data packet in the local memory is copied to the local hard disk.
In one implementation, the original data information includes data packet information and corresponding data location information, and the data packet information and the data packets correspond one to one;
determining required data packet information according to original data information and local existing data packet information, wherein the required data packet information comprises the following steps:
determining all missing data packet information according to the original data information and the local existing data packet information;
and determining the missing data packet information with the previous data position as the required data packet information from all the missing data packet information.
In this embodiment, each packet information corresponds to a data location information, wherein the data location information is the same as the packet number mentioned above, referring to fig. 3, the data location corresponding to the data packet 1 is the first, the data location corresponding to the data packet 2 is the second, and the data location corresponding to the data packet 17 is the last.
Thus, the specific process of step 201 is:
determining all missing data packet information according to the original data information and the local existing data packet information, specifically checking the original data information and the existing data packet information in the current client one by one to determine all missing data packet information;
and then determining the missing data packet information with the previous data position as the required data packet information from all the missing data packet information.
Taking the client 2 in fig. 3 as an example, assuming that existing data packets in the memory and the hard disk of the client 4 are the data packet 2, the data packet 9, and the data packet 10, then the data packets except the data packets 2, 9, and 10 are all missing data packet information, and then the data packet 1 is preferentially selected from all the missing data packet information as the required data packet information.
The benefits of this step are: the client side can preferentially download the data packet with the front data position, and the client side can decompress the data packet with the front data position first, so that the installation efficiency is improved. Taking the client 2 in fig. 3 as an example, assuming that the current client has only the data packets 2, 9, and 10, after the client downloads the data packet 1, the client can decompress the consecutive data packets 1 and 2, the decompression operation is suspended after the current decompression is completed, the downloading of the data packet 3 is waited, and the decompression operation can be continued on the data packet 3 after the data packet 3 is downloaded, thereby improving the installation efficiency.
In an implementation manner, in the process of downloading the required data packet from other clients or from the server to the local memory, the method further includes:
judging whether the residual storage space in the memory can store the required data packet or not;
and if the residual storage space in the memory is judged not to be capable of storing the required data packet, releasing the data packet with the prior timestamp stored in the memory until the required data packet can be stored in the memory.
In this embodiment, because it is considered that the memory of the client is small and may not be enough to store all the data packets, in the process of downloading the required data packets from other clients or from the server to the local memory, it is determined whether the remaining storage space in the memory can store the required data packets; and if the residual storage space in the memory is judged not to be capable of storing the required data packet, releasing the data packet with the prior timestamp stored in the memory until the required data packet can be stored in the memory.
In one embodiment, after downloading the required data packet to the local memory, the method further includes:
and sending the local existing data packet information to the server so that the server can record the existing data packet information of the current client.
In this embodiment, after the required data packet is downloaded to the local memory, the local existing data packet information is sent to the server, so that the server records or checks the existing data packet information of the current client, and the existing data packet of each client can be known exactly in the subsequent data transmission.
In an embodiment, the method further comprises:
and receiving and responding to a data uploading request sent by the server, wherein the data uploading request is used for uploading a specified data packet in the memory to a specified client.
In this embodiment, the client is further configured to receive and respond to a data upload request sent by the server, where the data upload request includes an assigned data packet and an assigned client, and the step specifically includes selecting the assigned data packet according to the received data upload request, and then transmitting the assigned data packet to the assigned client.
Fig. 5 is a schematic structural diagram of a data transmission device applied to a server according to an embodiment of the present invention;
as shown in fig. 5, another aspect of the embodiment of the present invention provides a data transmission device, applied to a server, the device including:
a data splitting module 301, configured to split original data into a plurality of data packets;
a data packet distribution module 302, configured to distribute the divided multiple data packets to multiple clients for storage, and record data packet information stored in each client;
a data download request receiving module 303, configured to receive a data download request of a first client for a required data packet;
a client positioning module 304, configured to position a second client storing a required data packet according to the received data download request;
a transmission instruction module 305, configured to instruct the corresponding client to transmit the required data packet to the first client.
In this embodiment, first, the original data is split into a plurality of data packets by the data splitting module 301, where the original data is a complete file to be transmitted to other clients, and the data sizes of the plurality of data packets may be identical or unequal, as shown in fig. 2, fig. 2 shows one of the ways of splitting the original data, specifically, a copy of the original data is split into 17 data packets, and each data packet is numbered.
Then, the data packet allocation module 302 allocates the divided data packets to a plurality of clients for storage respectively, and records the data packet information stored in each client, where the allocation manner may be random allocation or allocation according to the data packet numbers in sequence, specifically, as shown in fig. 3, fig. 3 shows one of the cases of random allocation of the original data, and in fig. 3, the data packets allocated to the client 1 are data packet 1, data packet 2, and data packet 4; the data packets distributed by the client 2 are data packet 2, data packet 9 and data packet 10; the data packets distributed by the client 3 are data packets 1-7, data packet 11 and data packet 12; the data packets distributed by the client 4 are data packets 5, 6, 8 and 11-13; the data packets 14-17 are temporarily unassigned. After the distribution is finished, the data packet information stored by each client is recorded.
Next, a data download request of the first client for the required data package is received through the data download request receiving module 303, where the data download request is generated by the client according to the data package condition of the first client, it is emphasized that the first client refers to all download requesters, and is not the client 1 in fig. 3.
Then, the client location module 304 locates a second client storing the required data package according to the received data download request, taking the client 2 in fig. 3 as an example, assuming that the client 2 sends a data download request for the data package 3, and the server locates the client 3 containing the data package 3 according to the data download request of the client 2, it should be emphasized that the second client refers to the client containing the corresponding data package instead of the client 2 in fig. 3.
Finally, the transmission instruction module 305 instructs the corresponding second client to transmit the required data packet to the first client, specifically, may instruct the second client to transmit the required data packet to the first client by means of the intermediate server, by sending a data transmission instruction for the required data packet to the second client.
Therefore, in the process of file transmission, data transmission is carried out between the client side and other client sides by using the resources of the client side, the data transmission pressure of the server side is reduced, and the transmission efficiency is further improved.
Fig. 6 is a schematic structural diagram of a data transmission device applied to a client according to an embodiment of the present invention.
As shown in fig. 6, another aspect of the embodiment of the present invention provides a data transmission device, applied to a client, where the device includes:
a data packet determining module 401, configured to determine required data packet information according to original data information and local existing data packet information;
a download request generating module 402, configured to generate a data download request for the required data package information according to the determined required data package information;
a download request sending module 403, configured to send the generated data download request to the server, so that the server downloads the required data packet from another client or from the server to the local memory.
In this embodiment, first, a data packet determining module 401 determines required data packet information according to original data information and local existing data packet information, where the original data information includes complete data packet information, and this step specifically includes checking the original data information and the existing data packet information in the current client one by one to determine the required data packet information, where it is determined that the number of the required data packets is generally one, and certainly may be multiple;
a data download request for the required data package information is then generated by the download request generation module 402 according to the determined required data package information.
Then, the generated data download request is sent to the server through the download request sending module 403, so that the server searches for a client containing a required data packet in other clients; if the client containing the required data packet is searched from other clients, the client is utilized to transmit the required data packet to a local memory through an intermediate server; and if the client containing the required data packet is not searched from other clients, downloading the required data packet to the local memory from the memory of the server.
Another aspect of the present invention provides a computer-readable storage medium applied to a server, where the storage medium includes a set of computer-executable instructions, and when the instructions are executed, the storage medium is configured to perform any one of the data transmission methods described above.
In an embodiment of the present invention, a computer-readable storage medium comprises a set of computer-executable instructions that, when executed, operate to split raw data into a plurality of data packets; distributing the divided data packets to a plurality of clients for storage respectively, and recording the data packet information stored in each client; receiving a data downloading request of a first client aiming at a required data packet; positioning a second client storing the required data packet according to the received data downloading request; and instructing the corresponding second client to transmit the required data packet to the first client.
Therefore, in the process of file transmission, data transmission is carried out between the client side and other client sides by using the resources of the client side, the data transmission pressure of the server side is reduced, and the transmission efficiency is further improved.
Another aspect of the present invention provides a computer-readable storage medium applied to a client, the storage medium comprising a set of computer-executable instructions, which when executed, is configured to perform any one of the above-mentioned data transmission methods.
In an embodiment of the present invention, a computer-readable storage medium comprises a set of computer-executable instructions for a client, the instructions when executed operable to determine required data packet information based on original data information and locally existing data packet information; generating a data downloading request aiming at the required data packet information according to the determined required data packet information; and sending the generated data downloading request to the server side so that the server side can download the required data packet to a local memory from other clients or from the server.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present invention, "a plurality" means two or more unless specifically defined otherwise.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (12)

1. A data transmission method is applied to a server side, and is characterized by comprising the following steps:
splitting original data into a plurality of data packets;
distributing the divided data packets to a plurality of clients for storage respectively, and recording the data packet information stored in each client;
receiving a data downloading request of a first client aiming at a required data packet, wherein the client can preferentially download the data packet with the front data position and can decompress the data packet with the front data position at the moment;
positioning a second client storing the required data packet according to the received data downloading request;
instructing the respective second client to transmit the required data packet to the first client;
and if the second client storing the required data packet is not located, transmitting the required data packet in the local memory of the server to the first client.
2. The method of claim 1, wherein locating the second client storing the required data package according to the received data download request comprises:
inquiring the client side which stores the required data packet in all the client sides;
and selecting the client with the minimum current transmission pressure from the inquired clients as the second client for providing the corresponding data packet transmission.
3. The method of claim 1, wherein after instructing the second client to transmit the required data packet to the first client, the method further comprises:
and updating the existing data packet information in the first client.
4. A data transmission method is applied to a client, and is characterized in that the method comprises the following steps:
determining required data packet information according to the original data information and the local existing data packet information;
generating a data downloading request aiming at the required data packet information according to the determined required data packet information, wherein a client side preferentially downloads a data packet with a front data position, and the client side can decompress the data packet with the front data position at the moment;
and sending the generated data downloading request to a server side so that the server side can download the required data packet to a local memory of the client side from other client sides or from the server side.
5. The method of claim 4, wherein the original data information comprises data packet information and corresponding data location information, and the data packet information corresponds to data packets one to one;
the determining the required data packet information according to the original data information and the local existing data packet information comprises:
determining all missing data packet information according to the original data information and the local existing data packet information;
and determining the missing data packet information with the previous data position as the required data packet information from all the missing data packet information.
6. The method of claim 4, wherein during downloading the required data packet from other clients or from the server to a client local memory, the method further comprises:
judging whether the residual storage space in the memory can store the required data packet or not;
and if the residual storage space in the memory is judged not to be capable of storing the required data packet, releasing the data packet with the prior timestamp stored in the memory until the required data packet can be stored in the memory.
7. The method of claim 4, wherein after downloading the required data package to client local memory, the method further comprises:
and sending the local existing data packet information to the server so that the server can record the existing data packet information of the current client.
8. The method of claim 4, further comprising:
and receiving and responding to a data uploading request sent by the server, wherein the data uploading request is used for uploading the specified data packet in the memory to a specified client.
9. A data transmission apparatus, applied to a server side, the apparatus comprising:
the data splitting module is used for splitting the original data into a plurality of data packets;
the data packet distribution module is used for distributing the divided data packets to a plurality of clients for storage respectively and recording the data packet information stored in each client;
the data downloading request receiving module is used for receiving a data downloading request of a first client aiming at a required data packet, the client preferentially downloads the data packet with the front data position, and the client can decompress the data packet with the front data position at the moment;
the client positioning module is used for positioning a second client storing the required data packet according to the received data downloading request;
a first transmission instruction module, configured to instruct the corresponding client to transmit the required data packet to the first client;
and the second transmission indicating module is used for transmitting the required data packet in the local memory of the server to the first client side if the second client side storing the required data packet is not located.
10. A data transmission apparatus applied to a client, the apparatus comprising:
the data packet determining module is used for determining required data packet information according to the original data information and the local existing data packet information;
the download request generation module is used for generating a data download request aiming at the required data packet information according to the determined required data packet information, and the client side preferentially downloads the data packet with the front data position and can decompress the data packet with the front data position;
and the download request sending module is used for sending the generated data download request to a server so that the server can download the required data packet to a local memory of the server from other clients or from the server.
11. A computer-readable storage medium applied to a server, wherein the storage medium comprises a set of computer-executable instructions, and when the instructions are executed, the storage medium is used for executing the data transmission method according to any one of claims 1 to 3.
12. A computer-readable storage medium for a client, the storage medium comprising a set of computer-executable instructions which, when executed, perform the data transmission method of any one of claims 4 to 8.
CN202010325855.7A 2020-04-23 2020-04-23 Data transmission method and device and computer readable storage medium Active CN111586112B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010325855.7A CN111586112B (en) 2020-04-23 2020-04-23 Data transmission method and device and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010325855.7A CN111586112B (en) 2020-04-23 2020-04-23 Data transmission method and device and computer readable storage medium

Publications (2)

Publication Number Publication Date
CN111586112A CN111586112A (en) 2020-08-25
CN111586112B true CN111586112B (en) 2022-04-15

Family

ID=72111618

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010325855.7A Active CN111586112B (en) 2020-04-23 2020-04-23 Data transmission method and device and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN111586112B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113114740B (en) * 2021-03-29 2023-05-26 深圳云里物里科技股份有限公司 Gateway data transmission method and device, gateway and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101196916A (en) * 2007-12-27 2008-06-11 腾讯科技(深圳)有限公司 Method and device for fragment storage file
CN106161549A (en) * 2015-04-15 2016-11-23 阿里巴巴集团控股有限公司 Method, system, control server and the client of a kind of data transmission
CN108924609A (en) * 2018-07-13 2018-11-30 广州虎牙信息科技有限公司 Method, electronic equipment, device and the storage medium of transmission of flow media data

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006285601A (en) * 2005-03-31 2006-10-19 Fujitsu Ltd File distribution method, and client terminal realizing it
US20130031148A1 (en) * 2011-07-26 2013-01-31 Mark Kern Systems and methods of distributed file storage
US9531802B2 (en) * 2011-11-10 2016-12-27 Kabushiki Kaisha Square Enix Data transmission and reception system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101196916A (en) * 2007-12-27 2008-06-11 腾讯科技(深圳)有限公司 Method and device for fragment storage file
CN106161549A (en) * 2015-04-15 2016-11-23 阿里巴巴集团控股有限公司 Method, system, control server and the client of a kind of data transmission
CN108924609A (en) * 2018-07-13 2018-11-30 广州虎牙信息科技有限公司 Method, electronic equipment, device and the storage medium of transmission of flow media data

Also Published As

Publication number Publication date
CN111586112A (en) 2020-08-25

Similar Documents

Publication Publication Date Title
CN1790266B (en) Method and system for downloading updates
CN110401724B (en) File management method, file transfer protocol server and storage medium
CN110995513B (en) Data sending and receiving method in Internet of things system, internet of things equipment and platform
CN104035800B (en) A kind of delta package generation method, version upgrading method, device and system
CN107105050B (en) Storage and downloading method and system for service objects
CN113778463B (en) Business service deployment method and device
US7237235B2 (en) Application distribution system, and distribution server and distribution method thereof
CN111708743A (en) File storage management method, file management client and file storage management system
CN113411404A (en) File downloading method, device, server and storage medium
CN112799688A (en) Method and device for installing software package in container application, computer equipment and medium
CN111586112B (en) Data transmission method and device and computer readable storage medium
CN103281356A (en) File distribution method and system
CN109951551B (en) Container mirror image management system and method
CN105162747B (en) System and method for compression device and decompression device discovery and handshake
JPH10143449A (en) Data transmitter, data receiver and data file storage medium
CN115878138B (en) Application pre-download method, device, computer and storage medium
JP6172296B2 (en) COMMUNICATION DEVICE, COMMUNICATION METHOD, AND COMMUNICATION PROGRAM
CN111147226B (en) Data storage method, device and storage medium
JP2006164095A (en) Disk system
JP2005100007A (en) Data file saving system and allocation method
CN114584551A (en) File uploading method, electronic equipment and computer program product
JP5162686B2 (en) Method for retrieving object from DM client and device management system related thereto
CN115277671A (en) OTA (over the air) upgrading method and device for vehicle, vehicle and storage medium
CN110430279B (en) File downloading control method and device
CN113592653A (en) Proxy delayed transaction method, computer device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant