CN115242780A - File downloading method and device, downloading manager and readable storage medium - Google Patents
File downloading method and device, downloading manager and readable storage medium Download PDFInfo
- Publication number
- CN115242780A CN115242780A CN202210887722.8A CN202210887722A CN115242780A CN 115242780 A CN115242780 A CN 115242780A CN 202210887722 A CN202210887722 A CN 202210887722A CN 115242780 A CN115242780 A CN 115242780A
- Authority
- CN
- China
- Prior art keywords
- target
- downloading
- file
- download
- node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The application provides a file downloading method, a file downloading device, a downloading manager and a readable storage medium, and relates to the technical field of computers. The method is applied to a download manager, and comprises the following steps: receiving a downloading request sent by user equipment, wherein the downloading request comprises a target URL (uniform resource locator) used for indicating a target file; selecting a target downloading node and a plurality of target transmission nodes from nodes of a resource agent network; the method comprises the steps that a target downloading node is controlled to download a target file based on a target URL, a plurality of slice files sent by the target downloading node in a multi-path simultaneous transmission mode through a plurality of target transmission nodes are received, the plurality of slice files are obtained after the target downloading node slices the target file, and each transmission path is used for transmitting one slice file; and recombining the plurality of slice files into a target file, and sending the target file to the user equipment. Therefore, the downloading relay is carried out by starting a plurality of transmission nodes so as to comprehensively optimize the downloading task efficiency.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a file downloading method, a file downloading device, a file downloading manager and a readable storage medium.
Background
The current downloading technology is usually in a P2P form, and the whole process of obtaining files from the server is initiated by the client. Data transmission quality is generally limited by the network resource status of each component atom on the client, server, and link nodes.
Currently, an internet operator usually forms internet resource scheduling or service load in an SDN (Software-Defined Network) manner or a CDN (Content Delivery Network) manner, but when long-distance bandwidth transmission or large file transmission is performed, the time for completing task waiting is too long, and download failure due to Network fluctuation generally becomes a main pain point for mainly completing a download task.
Disclosure of Invention
The embodiment of the application provides a file downloading method, a file downloading device, a downloading manager and a readable storage medium, which can comprehensively optimize the downloading task efficiency by starting a plurality of transmission nodes to perform downloading relay.
The embodiment of the application can be realized as follows:
in a first aspect, an embodiment of the present application provides a file downloading method, which is applied to a download manager, where the download manager is in communication with a resource agent network, and the resource agent network includes a plurality of nodes, where the method includes:
receiving a downloading request sent by user equipment, wherein the downloading request comprises a target Uniform Resource Locator (URL) for indicating a target file;
selecting a target downloading node and a plurality of target transmission nodes from the nodes of the resource agent network;
controlling the target downloading node to download the target file based on the target URL, and receiving a plurality of slice files sent by the target downloading node through a plurality of target transmission nodes in a multi-path simultaneous transmission mode, wherein the plurality of slice files are obtained by slicing the target file by the target downloading node, and each transmission path is used for transmitting one slice file;
and recombining the plurality of slice files into the target file, and sending the target file to the user equipment.
In a second aspect, an embodiment of the present application provides a file downloading method, which is applied to a user equipment and a downloading system connected in communication, where the downloading system includes a downloading manager connected in communication and a resource proxy network, and the resource proxy network includes a plurality of nodes, and the method includes:
the method comprises the steps that a download manager receives a download request sent by user equipment, wherein the download request comprises a target Uniform Resource Locator (URL) used for indicating a target file;
the download manager selects a target download node and a plurality of target transmission nodes from the nodes of the resource agent network;
the download manager controls the target download node to download the target file based on the target URL;
the target download node slices the target file to obtain a plurality of slice files, and sends the plurality of slice files to the download manager in a multi-path simultaneous transmission mode through the plurality of target transmission nodes, wherein each transmission path is used for transmitting one slice file;
and the download manager recombines the received slice files into the target file and sends the target file to the user equipment.
In a third aspect, an embodiment of the present application provides a file downloading apparatus, which is applied to a download manager, where the download manager is in communication with a resource broker network, the resource broker network includes multiple nodes, and the apparatus includes:
the system comprises a request receiving module, a download request sending by user equipment, a request sending module and a download processing module, wherein the download request comprises a target Uniform Resource Locator (URL) used for indicating a target file;
the selection module is used for selecting a target downloading node and a plurality of target transmission nodes from the nodes of the resource agent network;
a file obtaining module, configured to control the target download node to download the target file based on the target URL, and receive multiple slice files sent by the target download node through multiple target transmission nodes in a multi-path simultaneous transmission manner, where the multiple slice files are obtained by slicing the target file by the target download node, and each transmission path is used for transmitting one slice file;
and the sending module is used for recombining the plurality of slice files into the target file and sending the target file to the user equipment.
In a fourth aspect, an embodiment of the present application provides a download manager, including a processor and a memory, where the memory stores machine executable instructions that can be executed by the processor, and the processor can execute the machine executable instructions to implement the file download method described in the foregoing embodiment.
In a fifth aspect, the present application provides a readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the file downloading method according to the foregoing embodiments.
According to the file downloading method, the file downloading device, the downloading manager and the readable storage medium, the downloading manager selects the target downloading node and the plurality of target transmission nodes from the nodes of the resource agent network under the condition that a downloading request which is sent by user equipment and comprises a target URL used for indicating a target file is received, then the target downloading node is controlled to download the target file based on the target URL, then the plurality of slice files which are sent by the target downloading node in a multi-path simultaneous transmission mode after the target file is sliced into the plurality of slice files are received, and then the plurality of slice files are recombined into the target file and sent to the user equipment. Therefore, the target download node and the target transmission node can be used for downloading relay, and the target file is sliced and then transmitted in a multi-path simultaneous transmission mode, so that the downloading mode has the characteristic of comprehensively optimizing the efficiency of a downloading task.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained according to the drawings without inventive efforts.
Fig. 1 is a schematic diagram of a communication connection between a user equipment and a download system according to an embodiment of the present application;
FIG. 2 is a block diagram of the download manager of FIG. 1;
fig. 3 is a flowchart illustrating a file downloading method according to an embodiment of the present application;
FIG. 4 is a schematic diagram of an improved back link topology provided by an embodiment of the present application;
fig. 5 is a second flowchart illustrating a file downloading method according to an embodiment of the present application;
FIG. 6 is a flowchart illustrating the sub-steps included in step S140 in FIG. 5;
FIG. 7 is a schematic flow chart diagram of sub-steps included in sub-step S142 of FIG. 6;
fig. 8 is a third schematic flowchart of a file downloading method according to an embodiment of the present application;
fig. 9 is a fourth schematic flowchart of a file downloading method according to an embodiment of the present application;
FIG. 10 is a block diagram of a file downloading device according to an embodiment of the present application;
fig. 11 is a second block diagram of a file downloading device according to an embodiment of the present application.
Icon: 100-download manager; 110-a memory; 120-a processor; 130-a communication unit; 200-nodes; 300-a user equipment; 400-a file server; 600-a file download device; 610-a request receiving module; 620-judgment module; 630-a selection module; 640-a file acquisition module; 650-a sending module.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations.
Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present application without making any creative effort, shall fall within the protection scope of the present application.
It is noted that relational terms such as "first" and "second," and the like, may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising a," "8230," "8230," or "comprising" does not exclude the presence of additional like elements in a process, method, article, or apparatus that comprises the element.
In the following, some concepts related to the embodiments of the present application will be explained first.
Multi-source File Transfer Protocol (MFTP): designed to perform P2P-like file sharing.
Peer-to-peer (P2P), also known as peer-to-peer (peer) technology, is a decentralized internet architecture that relies on user groups (peers) to exchange information, and it functions to reduce nodes in the past network transmission to reduce the risk of data loss.
The File Transfer Protocol (FTP) is an application layer Protocol for transferring files between a client and a server over a computer network.
Hash function (Hash function): also known as a hash algorithm, hash function, is a method of creating a small digital "fingerprint" from any kind of data. The hash function compresses a message or data into a digest so that the amount of data becomes small, fixing the format of the data. This function shuffles the data and recreates a fingerprint called a hash value (hashes, hash sums, or hashes).
Content Delivery Network (Content Delivery Network or Content Distribution Network, abbreviated: CDN): the computer network system is connected with each other through the internet, and can quickly and reliably send music, pictures, videos, application programs and other files to users by utilizing a server closest to each user so as to provide high-performance, extensible and low-cost network content for delivering to the users.
Software-Defined Networking (SDN): is a novel network architecture. The control plane (control plane) of the router is separated from the data plane (data plane) by utilizing an OpenFlow protocol, and the control plane is realized in a software mode, so that the centralized management of the control planes scattered on each network device becomes possible.
Node (Node): the present invention refers to each network facility participating in the resource proxy network, which is generally composed of a VPS Server (Virtual Private Server), and has application functions of forwarding, downloading, etc., and nodes are divided into Free nodes (FN, free Node), download nodes (DN, download Node), and Relay nodes (RN, relay Node) according to states.
Uniform Resource Locator (URL): or URL Address, commonly known as web Address, which is a standard resource Address (Address) on the internet, like a house number on the internet.
The current downloading technology is usually in a P2P form, and the whole process of obtaining files from the server is initiated by the client. Data transmission quality is generally limited by the network resource status of each component atom on the client, server, and link nodes.
Currently, internet operators generally adopt SDN and CDN ways to form internet resource scheduling or service load, but when long-distance bandwidth transmission or large file transmission is performed, the waiting time for completing a task is too long, and a download failure caused by network fluctuation generally becomes a main pain point for mainly completing a download task. Current high efficiency download technology is typically MFTP technology but relies on a certain amount of user participation cardinality as well as file participation cardinality. In the MFTP technology, a file is retrieved according to a file hash (e.g., a hash obtained by using a hash function), different blocks of the file are downloaded from multiple sources, and then the file is assembled locally, so that a file downloading operation is completed.
Therefore, in the scheme of downloading the FTP file from the client to the server segment, the downloading rate is limited by network resources, such as bandwidth, of the server segment and the client. While MFTP can perform many-to-one data transmission by retrieving the supply capability comprehensive scheduling of each resource provider in the internet to effectively improve the download efficiency, for unique files, rare files, and unique files, since there are no multiple sources, it is impossible to improve the download quality, and even if the link resources are allowed to expand, it is impossible to improve the download efficiency.
Aiming at the situation that the downloading quality is low due to rate loss possibly caused by long-distance downloading, the embodiment of the application provides a file downloading method, a file downloading device, a downloading manager and a readable storage medium, on the premise that internet resources are allowed to expand (if a demand side has a certain number of idle internet resources (mainly VPS or fixed machine rooms), the expansion is considered to be possible), a target downloading node and a target transmission node are used for downloading relay, the target downloading node slices a target file in the relay process and transmits the target file to the downloading manager in a multi-path simultaneous transmission mode, and then the downloading manager sends the target file obtained through recombination to user equipment, so that the downloading task efficiency can be comprehensively optimized through the target downloading node and a plurality of target transmission nodes.
Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The embodiments and features of the embodiments described below can be combined with each other without conflict.
Referring to fig. 1, fig. 1 is a schematic diagram illustrating a communication connection between a user equipment 300 and a downloading system according to an embodiment of the present disclosure. The user device 300 may be a client device such as a smart phone or a computer. The downloading system comprises a downloading manager 100 and a resource agent network which are in communication connection, wherein the downloading manager 100 is used for collecting downloading requirements sent by a user through user equipment, obtaining a target file corresponding to the downloading requirements through the resource agent network, and then sending the target file to the user equipment. The resource agent network comprises a plurality of nodes 200 which are connected with each other in a communication way, and the nodes 200 can receive the downloading requirements collected in the downloading manager and obtain corresponding files by downloading from the file server 400 or perform file transmission. The nodes in the resource broker network may be distributed globally. The file server 400 stores a file corresponding to the URL. It should be noted that fig. 1 is only an example, and the number of the user devices 300, the nodes 200, and the file servers 400 may be plural.
Referring to fig. 2, fig. 2 is a block diagram illustrating the download manager 100 in fig. 1. The download manager 100 may include a memory 110, a processor 120, and a communication unit 130. The memory 110, the processor 120 and the communication unit 130 are electrically connected to each other directly or indirectly to realize data transmission or interaction. For example, the components may be electrically connected to each other via one or more communication buses or signal lines.
The memory 110 is used to store programs or data. The Memory 110 may be, but is not limited to, a Random Access Memory (RAM), a Read Only Memory (ROM), a Programmable Read-Only Memory (PROM), an Erasable Read-Only Memory (EPROM), an electrically Erasable Read-Only Memory (EEPROM), and the like.
The processor 120 is used to read/write data or programs stored in the memory 110 and perform corresponding functions. For example, the memory 110 stores a file downloading device 600, and the file downloading device 600 includes at least one software functional module which can be stored in the memory 110 in the form of software or firmware (firmware). The processor 120 executes various functional applications and data processing by running software programs and modules stored in the memory 110, such as the file downloading device 600 in the embodiment of the present application, so as to implement the file downloading method in the embodiment of the present application.
The communication unit 130 is used for establishing a communication connection between the download manager 100 and other communication terminals through a network, and for transceiving data through the network.
It should be understood that the configuration shown in fig. 2 is merely a schematic diagram of the configuration of the download manager 100, and that the download manager 100 can include more or fewer components than shown in fig. 2, or have a different configuration than shown in fig. 2. The components shown in fig. 2 may be implemented in hardware, software, or a combination thereof.
Referring to fig. 3, fig. 3 is a schematic flowchart illustrating a file downloading method according to an embodiment of the present disclosure. The method is applied to a download manager 100, and the download manager 100 is in communication with a resource agent network, which includes a plurality of nodes. The following describes the specific flow of the file downloading method in detail. In this embodiment, the method may include step S110, step S140 to step S160.
Step S110, receiving a download request sent by the user equipment.
The user equipment may send a download request to the download manager when there is a download demand. The download request may include a target URL indicating the target file, i.e., a URL including the target file.
Step S140, selecting a target download node and a plurality of target transmission nodes from the nodes of the resource broker network.
After receiving the download request, the download manager may select one node from the nodes included in the resource broker network as a target download node and select multiple nodes as target transmission nodes according to the working conditions of the nodes in the resource broker network.
Step S150, controlling the target downloading node to download the target file based on the target URL, and receiving a plurality of slice files sent by the target downloading node through the plurality of target transmission nodes in a multi-path simultaneous transmission manner.
The download manager may send the target URL to the target download node, and control the target download node to download the target file from a target server corresponding to the target URL based on the target URL. Then, the target download node may slice the target file at the controller of the download manager to obtain a plurality of slice files, and then transmit the plurality of slice files to the download manager through the plurality of target transmission nodes in a multi-path simultaneous transmission manner.
Wherein each transmission path is used for transmitting one slice file. The number of the target transmission nodes can be the same as that of the slice files, and the target transmission nodes are used for forwarding, so that the target download nodes can quickly transmit the target files to the download manager in a slice form through multiple channels, and the file download speed is improved.
The file download link topology in the embodiment of the present application is shown in fig. 4: target download node P max The system is in communication connection with a target server and is used for downloading to obtain a target file; the target download node also passes through a plurality of target transmission nodes P 1 ～P n And sending the plurality of slice files to the download manager by the corresponding multiple paths. Therefore, compared with a mode of directly transmitting the complete target file between the nodes, the method for simultaneously transmitting the slice file through multiple paths can improve the file transmission speed.
Step S160, reorganizing the multiple slice files into the target file, and sending the target file to the user equipment.
After receiving the multiple slice files transmitted by the target download node through the multi-path simultaneous transmission mode, the download manager may recombine the multiple slice files to obtain a complete target file, and then send the target file to the user equipment. Therefore, on the premise that the internet resources are allowed to expand, the efficiency of the downloading task is comprehensively optimized by starting a plurality of transmission nodes to carry out downloading and relaying.
Optionally, in a possible example, after receiving the download request, the download manager may directly determine to distribute the download task to the resource broker network, and obtain the target file corresponding to the download request through the target download node and the plurality of transmission nodes.
Alternatively, in another possible example, it may be determined whether to distribute the download task to the resource broker network based on actual conditions, as shown in fig. 5. Referring to fig. 5, fig. 5 is a second schematic flowchart illustrating a file downloading method according to an embodiment of the present application. In this embodiment, the download request further includes a target size of the target file, and before step S140, the method may further include step S120 and step S130.
And step S120, calculating to obtain the downloading time length according to the target size and the local transmission speed.
Step S130, determining whether the download duration is less than a preset duration.
In this embodiment, the local transmission speed is a transmission speed between the download manager and a target server corresponding to the target URL. The download manager can calculate the download duration according to the target size of the target file and the local transmission speed, namely, the local network download efficiency is calculated. Then, the download duration may be compared with a preset duration to determine whether the download duration is less than the preset duration. The preset duration can be set by combining with actual requirements, and is used for evaluating whether the downloading quality of one downloading task is low or not and needs to be accelerated.
If the download duration is less than the preset duration, step S170 may be executed: and downloading the target file according to the target URL and sending the target file to the user equipment.
The downloading time length is less than the preset time length, the local network downloading efficiency of the downloading task represented by the downloading request is not low, and the downloading quality is better. In this case, the download manager may determine not to distribute the download task to the resource broker network, may download the target file from the target server based directly on the target URL, and then send the target file to the user device.
If the download duration is not less than the preset duration, that is, the download duration is greater than or equal to the preset duration, step S140 may be executed: and selecting a target downloading node and a plurality of target transmission nodes from the nodes of the resource agent network.
The downloading time length is greater than or equal to the preset time length, and the local network downloading efficiency and the downloading quality of the downloading task corresponding to the downloading request are low. In this case, the download manager may determine to distribute the download task to the resource broker network so as to comprehensively optimize the download task efficiency by initiating multiple nodes for download relay.
In this way, the download manager can determine whether the download request has an acceleration requirement by analyzing the download request, and distribute the download task to the resource broker network at times.
This determination process is exemplified below.
Suppose that the local transmission speed is D N (in bps), the download task File size (i.e., the target size of the target File, contact Length) is F D (unit Byte); the local network download efficiency (i.e. download duration is) is:
the unit is s.
Assuming a preset duration of a (e.g., a =3600 s), then at D T When the download task is not less than a, the download manager can determine to distribute the download task to the resource agent network; at D T If the URL is less than a, the download manager can directly download the target file based on the target URL and send the target file to the user equipment.
As a possible implementation manner, the target downloading node and the plurality of target transmission nodes may be selected in a manner shown in fig. 6. Referring to fig. 6, fig. 6 is a flowchart illustrating the sub-steps included in step S140 in fig. 5. In this embodiment, the step S140 may include a sub-step S141 and a sub-step S142.
And a substep S141 of selecting a plurality of idle nodes from the resource broker network.
In this embodiment, the download manager may select a plurality of idle nodes from the resource agent network according to the working conditions of the nodes. For example, the download manager may take as a free node a node in the resource broker network that is not currently tasked with any tasks. It can be understood that the above determination manner of the idle node is only for illustration, and how to select the idle node may be specifically set in combination with actual requirements.
And a substep S142 of selecting the target download node and the target transmission node from the plurality of idle nodes according to the transmission speed.
After the idle nodes are selected, a target download node and a plurality of target transmission nodes capable of shortening the download time length can be selected according to the transmission speed between each idle node and the target server corresponding to the target URL and/or the transmission speed between each idle node.
Referring to fig. 7, fig. 7 is a flowchart illustrating sub-steps included in sub-step S142 in fig. 6. In the present embodiment, the substep S142 may include substeps S1421 to S1424.
And a substep S1421, sending the target URL to each idle node, and receiving a first transmission speed between target servers corresponding to the target URL, which is sent by each idle node.
And a substep S1422, determining a maximum value of the first transmission speeds through comparison, and using an idle node corresponding to the maximum value as the target download node.
And a substep S1423, controlling each remaining idle node to perform speed measurement on the target download node, so as to obtain a second transmission speed between each remaining idle node and the target download node.
And a substep S1424 of selecting the target transmission node from the remaining idle nodes according to the obtained second transmission speed.
In this embodiment, after selecting the idle node, the download manager may send the target URL to each idle node, and enable each idle node to make a request to a target server corresponding to the target URL, so as to obtain a transmission speed between each idle node and the target service. For convenience of description, the transmission speed between each idle node and the target server is referred to as a first transmission speed.
After obtaining the first transmission speed corresponding to each idle node, the maximum value D in the plurality of first transmission speeds can be determined through comparison max And applying the maximum value D max And the corresponding idle node is used as the target downloading node. That is, among the selected idle nodes, the transmission speed between the idle node as the target download node and the target server is fastest.
After the target download node is selected, the idle nodes of the plurality of idle nodes other than the target download node may be referred to as remaining idle nodes. The download controller can control each remaining idle node to carry out speed measurement on the target download node so as to obtain the transmission speed between each remaining idle node and the target download node. For convenience of description, the transmission speed between each remaining idle node and the target download node will be referred to as a second transmission speed.
Then, a plurality of target transmission nodes can be selected from the remaining idle nodes according to the obtained second transmission speed corresponding to each remaining idle node.
Optionally, as a possible implementation manner, the second transmission speed may be selected in order from high to low, and a certain number of idle nodes may be selected as the multiple target transmission nodes.
Optionally, as another possible implementation manner, a second transmission speed corresponding to each remaining idle node may be compared with the local transmission speed, so as to select an idle node with a second transmission speed greater than the local transmission speed as the target transmission node.
For example, in the order from high to low of the second transmission speed, the sequence of the remaining idle nodes is: p 1 、P 2 、P 3 ……P n 、P n+1 823080, if P n Greater than local transmission speed D N 、P n+1 Less than local transmission speed D N Then the free nodes P in the above sequence can be sorted 1 、P 2 、P 3 ……P n As the selected target transmission node.
And under the condition that the target downloading node and the plurality of target transmission nodes are selected, the downloading manager can control the target downloading node to download the target file corresponding to the target URL from the target server corresponding to the target URL, and send the node identification of each selected target transmission node to the target downloading node. The target download node can firstly carry out cache download on the user download requirement acquired by the resource agent network under the control of the download manager, namely, the target file is downloaded, and the downloaded file is stored in the built-in storage space of the target download node. Then, the target download node may slice the target file according to the number of the target transmission nodes to obtain a plurality of slice files. The number of slice files is the same as the number of target transport nodes. Then, the target download node may determine each target transmission node according to the node identifier of each target transmission node, and then transmit a plurality of sliced files obtained after slicing to the download manager in a multi-path simultaneous transmission manner using the plurality of target transmission nodes.
Therefore, the download manager can obtain a plurality of slice files through controlling the nodes, the target file can be obtained through the recombination of the slice files, and the target file is further sent to the user equipment.
It should be noted that the local transmission speed, the first transmission speed, and the second transmission speed all represent download speeds. The distribution and the transmission of the downloading tasks can be realized in encrypted connection, and the method is safe and reliable.
Referring to fig. 8, fig. 8 is a third schematic flowchart of a file downloading method according to an embodiment of the present disclosure. The method can be applied to user equipment and a downloading system which are in communication connection, wherein the downloading system comprises a downloading manager and a resource agent network which are in communication connection, and the resource agent network comprises a plurality of nodes. In this embodiment, the method may include step S210, step S240 to step S270.
Step S210, the download manager receives a download request sent by the user equipment.
And the downloading request comprises a target Uniform Resource Locator (URL) for indicating a target file.
In step S240, the download manager selects a target download node and a plurality of target transmission nodes from the nodes of the resource broker network.
Step S250, the download manager controls the target download node to download the target file based on the target URL.
Step S260, the target download node slices the target file to obtain a plurality of slice files, and sends the plurality of slice files to the download manager in a multi-path simultaneous transmission manner through the plurality of target transmission nodes.
Wherein each transmission path is used for transmitting one slice file.
In step S270, the download manager reassembles the received multiple slice files into the target file, and sends the target file to the user equipment.
Referring to fig. 9, fig. 9 is a fourth flowchart illustrating a file downloading method according to an embodiment of the present disclosure. In this embodiment, the download request further includes a target size of the target file, and before step S140, the method may further include step S220 and step S230.
Step S220, the download manager calculates the download duration according to the target size and the local transmission speed.
Wherein, the local transmission speed is the transmission speed between the download manager and the target server corresponding to the target URL.
In step S230, the download manager determines whether the download duration is less than a preset duration.
If the download duration is less than the preset duration, executing step S270: and the download manager downloads the target file according to the target URL and sends the target file to user equipment.
If the download duration is not less than the preset duration, step S240 is executed.
In this embodiment, for the specific description of the method shown in fig. 8 and fig. 9, reference may be made to the above description of the file downloading method applied to the download manager, and details are not repeated here.
In order to execute the corresponding steps in the foregoing embodiment and various possible manners, an implementation manner of the file downloading apparatus 600 is given below, and optionally, the file downloading apparatus 600 may adopt the device structure of the download manager shown in fig. 2. Further, referring to fig. 10, fig. 10 is a block diagram illustrating a file downloading device 600 according to an embodiment of the present disclosure. It should be noted that the basic principle and the generated technical effects of the file downloading device 600 provided in the present embodiment are the same as those of the above embodiments, and for the sake of brief description, no part of the present embodiment is mentioned, and reference may be made to the corresponding contents in the above embodiments. The file downloading apparatus 600 may be applied to a download manager, the download manager is in communication with a resource agent network, the resource agent network includes a plurality of nodes, and the file downloading apparatus 600 may include: a request receiving module 610, a selecting module 630, a file obtaining module 640 and a sending module 650.
The request receiving module 610 is configured to receive a download request sent by a user equipment. And the downloading request comprises a target Uniform Resource Locator (URL) for indicating a target file.
The selecting module 630 is configured to select a target downloading node and a plurality of target transmission nodes from the nodes of the resource broker network.
The file obtaining module 640 is configured to control the target downloading node to download the target file based on the target URL, and receive multiple slice files that are sent by the target downloading node through the multiple target transmission nodes in a multi-path simultaneous transmission manner. The plurality of slice files are obtained by slicing the target file by the target downloading node, and each transmission path is used for transmitting one slice file.
The sending module 650 is configured to reassemble the plurality of slice files into the target file, and send the target file to the user equipment.
Referring to fig. 11, fig. 11 is a second block diagram of a file downloading device 600 according to an embodiment of the present application. Optionally, in this embodiment, the download request further includes a target size of the target file, and the file downloading apparatus 600 further includes a determining module 620.
The determining module 620 is configured to: calculating to obtain a downloading time length according to the target size and a local transmission speed, wherein the local transmission speed is the transmission speed between the downloading manager and a target server corresponding to the target URL; and judging whether the downloading time length is less than a preset time length.
When the download duration is not less than the preset duration, the selecting module 630 selects a target download node and a plurality of target transmission nodes from the nodes of the resource broker network.
When the downloading time length is less than the preset time length, the file obtaining module 640 is further configured to download the target file according to the target URL, and the sending module 650 is configured to send the target file to the user equipment.
Alternatively, the modules may be stored in the memory 110 shown in fig. 2 in the form of software or Firmware (Firmware) or be fixed in an Operating System (OS) of the download manager 100, and may be executed by the processor 120 in fig. 2. Meanwhile, data, codes of programs, and the like required to execute the above-described modules may be stored in the memory 110.
The embodiment of the application also provides a readable storage medium, on which a computer program is stored, and the computer program realizes the file downloading method when being executed by a processor.
To sum up, the present application provides a file downloading method, apparatus, download manager, and readable storage medium, where the download manager selects a target download node and multiple target transport nodes from nodes of a resource broker network when receiving a download request including a target URL indicating a target file sent by a user device, then controls the target download node to download the target file based on the target URL, and then receives multiple slice files sent by the target download node in a multipath simultaneous transmission manner through the multiple target transport nodes after slicing the target file into multiple slice files, and further reassembles the multiple slice files into the target file, and sends the target file to the user device. Therefore, the target downloading node and the target transmission node can be used for downloading relay, and the target file is sliced and then transmitted in a multi-path simultaneous transmission mode, so that the downloading mode has the characteristic of comprehensively optimizing the efficiency of the downloading task.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented in other ways. The apparatus embodiments described above are merely illustrative, and for example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk, and various media capable of storing program codes.
The foregoing is illustrative of only alternative embodiments of the present application and is not intended to limit the present application, which may be modified or varied by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (10)
1. A file downloading method is applied to a download manager, the download manager is communicated with a resource agent network, the resource agent network comprises a plurality of nodes, and the method comprises the following steps:
receiving a downloading request sent by user equipment, wherein the downloading request comprises a target Uniform Resource Locator (URL) for indicating a target file;
selecting a target downloading node and a plurality of target transmission nodes from the nodes of the resource agent network;
controlling the target downloading node to download the target file based on the target URL, and receiving a plurality of slice files sent by the target downloading node through a plurality of target transmission nodes in a multi-path simultaneous transmission mode, wherein the plurality of slice files are obtained by slicing the target file by the target downloading node, and each transmission path is used for transmitting one slice file;
and recombining the plurality of slice files into the target file, and sending the target file to the user equipment.
2. The method of claim 1, wherein selecting a target download node and a plurality of target transport nodes from the nodes of the resource broker network comprises:
selecting a plurality of idle nodes from the resource broker network;
and selecting the target downloading node and the target transmission node from the idle nodes according to the transmission speed.
3. The method of claim 2, wherein selecting the target download node and the target transport node from the plurality of idle nodes according to the transmission speed comprises:
sending the target URL to each idle node, and receiving a first transmission speed between target servers which are sent by each idle node and correspond to the target URL;
determining the maximum value in the first transmission speed through comparison, and taking an idle node corresponding to the maximum value as the target downloading node;
controlling each remaining idle node to measure the speed of the target downloading node so as to obtain a second transmission speed between each remaining idle node and the target downloading node;
and selecting the target transmission node from the rest idle nodes according to the obtained second transmission speed.
4. The method according to claim 3, wherein said selecting the target transmission node from the remaining idle nodes according to the obtained second transmission speed comprises:
and taking all idle nodes corresponding to a second transmission speed which is higher than a local transmission speed as the target transmission nodes, wherein the local transmission speed is the transmission speed between the download manager and the target server.
5. The method of any of claims 1-4, wherein the download request further includes a target size of the target file, and wherein before selecting the target download node and the plurality of target transport nodes from the nodes of the resource broker network, the method further comprises:
calculating to obtain a downloading time length according to the target size and a local transmission speed, wherein the local transmission speed is the transmission speed between the downloading manager and a target server corresponding to the target URL;
judging whether the downloading time length is less than a preset time length or not;
and if the downloading time length is not less than the preset time length, executing the step of selecting a target downloading node and a plurality of target transmission nodes from the nodes of the resource agent network.
6. The method of claim 5, further comprising:
and if the downloading time length is less than the preset time length, downloading the target file according to the target URL and sending the target file to the user equipment.
7. A file downloading method is applied to user equipment and a downloading system which are in communication connection, wherein the downloading system comprises a downloading manager and a resource agent network which are in communication connection, the resource agent network comprises a plurality of nodes, and the method comprises the following steps:
the method comprises the steps that a download manager receives a download request sent by user equipment, wherein the download request comprises a target Uniform Resource Locator (URL) used for indicating a target file;
the download manager selects a target download node and a plurality of target transmission nodes from the nodes of the resource agent network;
the download manager controls the target download node to download the target file based on the target URL;
the target download node slices the target file to obtain a plurality of slice files, and sends the plurality of slice files to the download manager in a multi-path simultaneous transmission mode through the plurality of target transmission nodes, wherein each transmission path is used for transmitting one slice file;
and the download manager recombines the received slice files into the target file and sends the target file to the user equipment.
8. A file downloading apparatus, adapted to a download manager, the download manager being in communication with a resource broker network, the resource broker network including a plurality of nodes, the apparatus comprising:
the device comprises a request receiving module, a downloading module and a processing module, wherein the request receiving module is used for receiving a downloading request sent by user equipment, and the downloading request comprises a target Uniform Resource Locator (URL) used for indicating a target file;
the selection module is used for selecting a target downloading node and a plurality of target transmission nodes from the nodes of the resource agent network;
a file obtaining module, configured to control the target download node to download the target file based on the target URL, and receive multiple slice files sent by the target download node through multiple target transmission nodes in a multi-path simultaneous transmission manner, where the multiple slice files are obtained by slicing the target file by the target download node, and each transmission path is used for transmitting one slice file;
and the sending module is used for recombining the plurality of slice files into the target file and sending the target file to the user equipment.
9. A download manager comprising a processor and a memory, the memory storing machine executable instructions executable by the processor to implement the file download method of any of claims 1 to 6.
10. A readable storage medium on which a computer program is stored, the computer program, when being executed by a processor, implementing a file download method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210887722.8A CN115242780A (en) | 2022-07-26 | 2022-07-26 | File downloading method and device, downloading manager and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210887722.8A CN115242780A (en) | 2022-07-26 | 2022-07-26 | File downloading method and device, downloading manager and readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115242780A true CN115242780A (en) | 2022-10-25 |
Family
ID=83676344
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210887722.8A Withdrawn CN115242780A (en) | 2022-07-26 | 2022-07-26 | File downloading method and device, downloading manager and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115242780A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106412137A (en) * | 2016-12-20 | 2017-02-15 | 北京并行科技股份有限公司 | File downloading system and file downloading method |
| CN106453122A (en) * | 2016-09-23 | 2017-02-22 | 北京奇虎科技有限公司 | Method and device for selecting streaming data transmission node |
| CN111629075A (en) * | 2020-08-03 | 2020-09-04 | 腾讯科技（深圳）有限公司 | Data downloading method and related device |
| CN112199340A (en) * | 2020-10-23 | 2021-01-08 | 深圳市欢太科技有限公司 | Multithreading file downloading method and device, electronic equipment and storage medium |
| CN113411404A (en) * | 2021-06-24 | 2021-09-17 | 平安普惠企业管理有限公司 | File downloading method, device, server and storage medium |
| CN113645288A (en) * | 2021-08-02 | 2021-11-12 | 北京金山云网络技术有限公司 | Data downloading method and device, computer equipment and storage medium |
-
2022
- 2022-07-26 CN CN202210887722.8A patent/CN115242780A/en not_active Withdrawn
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106453122A (en) * | 2016-09-23 | 2017-02-22 | 北京奇虎科技有限公司 | Method and device for selecting streaming data transmission node |
| CN106412137A (en) * | 2016-12-20 | 2017-02-15 | 北京并行科技股份有限公司 | File downloading system and file downloading method |
| CN111629075A (en) * | 2020-08-03 | 2020-09-04 | 腾讯科技（深圳）有限公司 | Data downloading method and related device |
| CN112199340A (en) * | 2020-10-23 | 2021-01-08 | 深圳市欢太科技有限公司 | Multithreading file downloading method and device, electronic equipment and storage medium |
| CN113411404A (en) * | 2021-06-24 | 2021-09-17 | 平安普惠企业管理有限公司 | File downloading method, device, server and storage medium |
| CN113645288A (en) * | 2021-08-02 | 2021-11-12 | 北京金山云网络技术有限公司 | Data downloading method and device, computer equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2748688C (en) | Multi-source transmission system and method of instant messaging file | |
| US8180853B2 (en) | Method and apparatus for transmitting data in a peer-to-peer network | |
| US8112479B2 (en) | Method, system and device for establishing a peer to peer connection in a P2P network | |
| EP3439239B1 (en) | Data transmission method and system based on peer-to-peer network | |
| CN109347968B (en) | Method, equipment and system for downloading data blocks of resource file | |
| Bocchi et al. | Personal cloud storage benchmarks and comparison | |
| US9173006B2 (en) | Method for live broadcasting in a distributed network and apparatus for the same | |
| CN111200657B (en) | Method for managing resource state information and resource downloading system | |
| EP3087722B1 (en) | Peer-to-peer network prioritizing propagation of objects through the network | |
| KR101215993B1 (en) | P2P Content Distribution Network for Peer-to-Peer Live Streaming | |
| WO2018076765A1 (en) | Content distribution method and device for cloud computing system, computing node and system | |
| CN111327622B (en) | Resource scheduling method and system | |
| CN112954406B (en) | Data downloading method and device, computer equipment and storage medium | |
| CN111200622B (en) | Resource transmission method and device and storage medium | |
| CN110022329B (en) | File transmission method and device, computer readable storage medium and computer equipment | |
| US20050091653A1 (en) | Method and apparatus for load sharing and data distribution in servers | |
| CN103957269A (en) | P2P network node selection method and P2P redirect server | |
| US20240106891A1 (en) | Peer-to-peer network scheduling method and system | |
| CN112769957B (en) | Point-to-point network scheduling method and system | |
| JP2004199578A (en) | Content delivery method, device, program, and storage medium | |
| CN115242780A (en) | File downloading method and device, downloading manager and readable storage medium | |
| JP2004064284A (en) | Traffic control method for p2p network and device, program and recording medium | |
| KR101352630B1 (en) | Virtualized node, user node employing virtualized node, and contents sharing method using virtualized node | |
| Sheu et al. | Mixed P2P-CDN system for media streaming in mobile environment | |
| KR20130065688A (en) | Access to a network of nodes distributed over a communication architecture, using a topology server with multi-criteria selection |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20221025 |