CN114500665A - File fragmentation downloading method, equipment and storage medium adaptive to network environment - Google Patents
File fragmentation downloading method, equipment and storage medium adaptive to network environment Download PDFInfo
- Publication number
- CN114500665A CN114500665A CN202111615716.9A CN202111615716A CN114500665A CN 114500665 A CN114500665 A CN 114500665A CN 202111615716 A CN202111615716 A CN 202111615716A CN 114500665 A CN114500665 A CN 114500665A
- Authority
- CN
- China
- Prior art keywords
- server
- downloading
- download
- user
- network
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 29
- 238000013467 fragmentation Methods 0.000 title claims description 12
- 238000006062 fragmentation reaction Methods 0.000 title claims description 12
- 230000003044 adaptive effect Effects 0.000 title description 4
- 239000012634 fragment Substances 0.000 claims abstract description 27
- 238000012544 monitoring process Methods 0.000 claims abstract description 15
- 230000002457 bidirectional effect Effects 0.000 claims abstract description 10
- 238000012545 processing Methods 0.000 claims abstract description 4
- 230000005540 biological transmission Effects 0.000 claims description 6
- 230000008901 benefit Effects 0.000 abstract description 2
- 230000007246 mechanism Effects 0.000 description 5
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/34—Network arrangements or protocols for supporting network services or applications involving the movement of software or configuration parameters
Abstract
The invention discloses a method, a device and a storage medium for downloading a file fragment in a self-adaptive network environment, wherein the method for downloading the file fragment comprises the following steps: the server carries out fragment processing on the downloaded file; when a user side initiates a downloading request, a server side acquires the bidirectional network conditions of the user side and the server side through network state monitoring, and selects an optimal downloading server to provide a fragmented downloading service. The method of the invention can be self-adapted to the two-way network condition of the user and the server, and effectively improve the stability and reliability of downloading; after each piece is downloaded, the condition of the user network is detected, and high-quality downloading service of the self-adaptive user network is provided; by scheduling among the multiple servers, the limitation of the downloading quantity and the channel of a single server is avoided, and the high-quality fragment downloading service is provided by utilizing the cooperative advantage of the multiple servers.
Description
Technical Field
The invention belongs to the technical field of information, and particularly relates to a file downloading method.
Background
The existing file fragment breakpoint continuous transmission mechanism is mainly based on a client side link state, namely three conditions of link connection, disconnection and heavy chain, adopts a unidirectional download service mechanism, cannot effectively adapt to a network link condition and the current condition of a download server, cannot provide high-quality file fragment download service based on the bidirectional real-time condition of a user network and the server.
Disclosure of Invention
The technical problem to be solved by the present invention is to provide a method, a device and a storage medium for downloading a file fragment, which can effectively adapt to the network link condition and the current condition of a download server and improve the file downloading efficiency, in order to overcome the shortcomings of the prior art.
In order to solve the technical problems, the invention adopts the technical scheme that:
the invention provides a cross-service dynamic scheduling file fragment downloading method in a self-adaptive network environment, which comprises the following steps:
the server-side carries out fragment processing on the downloaded file;
when a user side initiates a downloading request, a server side acquires the bidirectional network conditions of the user side and the server side through network state monitoring, and selects an optimal downloading server to provide a fragmented downloading service.
Selecting an optimal download server to provide the fragmented download service, wherein the optimal download server comprises the following steps:
for each segment, the selection of the optimal download server is made.
The optimal download server judges through the number of download links and the bandwidth capacity of the server.
The optimal download server judges the number of download links and the bandwidth capacity through the server, and comprises the following steps:
firstly, judging whether a threshold value meeting the link quantity and a threshold value meeting the download channel exist in the current server; the link quantity threshold value refers to an upper limit numerical value of the quantity of downloading threads for providing service of the current server; the download channel threshold is a set ratio between the current reserved download bandwidth and the bandwidth of the user and the server link network.
The server side obtains the bidirectional network conditions of the user side and the server side through network state monitoring, and the method comprises the following steps: monitoring and acquiring bandwidth and time delay of a user and a server side at the user side; and monitoring and acquiring the download channel capacity of the server side, which is allocated or reserved for the user.
The file fragment downloading means that when the scheduling of the downloading server changes, the consistency of the downloading sequence of each fragment of the file is realized and the accurate combination/verification of the file at the user side is ensured through the uniform file fragment identification.
The user side initiates a downloading request, which comprises the scenes of starting downloading, interrupting network continuous transmission, switching networks and the like. The starting of downloading refers to that a user directly initiates a downloading request aiming at a certain file; the disconnected network continuous transmission means that the downloading request is initiated again after the network of the user side is disconnected; and network switching, including changes of wifi, wired, 5G, 4G and other networking systems, is performed, so that changes of network conditions are brought.
The file fragmentation downloading method of the invention is characterized in that a cross-server downloading scheduling mechanism is added at a server, the scenes of network switching, continuous transmission interruption and the like at the user side are self-adapted by fusing multiple factors such as user, server bidirectional network link, downloading request quantity and the like, and the cross-server downloading mechanism is adopted to achieve high-quality downloading service facing users by combining the file fragmentation downloading mechanism and aiming at flexible scheduling of a plurality of downloading servers.
Compared with the prior art, the invention has the beneficial effects that:
1. the method of the invention can be self-adapted to the two-way network condition of the user and the server, and effectively improve the stability and reliability of downloading;
2. self-adaptive user network condition change: after each piece is downloaded, the condition of the user network is detected, and high-quality downloading service of the self-adaptive user network is provided;
3. cross-service high-quality fragmented download service: by scheduling among the multiple servers, the limitation of the downloading quantity and the channel of a single server is avoided, and the high-quality fragment downloading service is provided by utilizing the cooperative advantage of the multiple servers.
Drawings
FIG. 1 is a flow chart of the method of the present invention;
FIG. 2 is a flow chart of cross-server downloading.
Detailed Description
The embodiment of the invention provides a file fragmentation downloading method adaptive to a network environment, which comprises the following steps of:
the server performs fragmentation processing (not shown in the figure) on the downloaded file;
when a user side initiates a downloading request, a server side acquires the bidirectional network conditions of the user side and the server side through network state monitoring, and selects an optimal downloading server to provide a fragmented downloading service; the user side initiates a downloading request, and the method comprises the following scenes: and starting downloading, network interruption and continuous transmission and network switching.
Specifically, selecting an optimal download server to provide a fragmented download service includes:
for each segment, the selection of the optimal download server is made. The optimal download server is realized by scheduling the download server.
In one embodiment, for each segment, the selection of the optimal download server is made, see fig. 2, including:
1. after downloading of each fragment file is finished, firstly judging whether the current server-server 1 has the problems of the number of links and the capacity of a download channel, namely judging whether the current server simultaneously has a threshold value meeting the number of links and the download channel reaches the threshold value; the link quantity threshold value refers to an upper limit numerical value of the quantity of downloading threads for providing service of the current server; the download channel threshold is a set ratio between the current reserved download bandwidth and the bandwidth of the user and server link network, for example, the former can only reach 20% of the latter.
2. By the judgment of the first item, when the server 1 cannot provide the high-quality download service, the resource scheduling across the servers is started.
3. The cross-server resource scheduling means that a server 2 capable of providing a better download service is found and scheduled by monitoring the bidirectional link condition of the user and the server in real time.
4. The fragment information is synchronized, and the server 2 obtains the distribution downloading information related to the user through the server 1 to obtain the position of the next fragment.
5. The server 2 provides the user with the next fragmented download service.
In one embodiment, the optimal download server determines the number of download links and bandwidth capacity by the server.
In one embodiment, the determining of the optimal download server by the number of download links and the bandwidth capacity of the server includes:
firstly, judging whether a threshold value meeting the link quantity and a threshold value meeting the download channel exist in the current server; the link quantity threshold value refers to an upper limit numerical value of the quantity of downloading threads for providing service of the current server; the download channel threshold is a set ratio between the current reserved download bandwidth and the bandwidth of the user and the server link network. The set ratio can be set to 20%, that is, the current reserved download bandwidth can only reach 20% of the bandwidth of the user and server link network.
In one embodiment, the server side obtains the bidirectional network conditions of the user side and the server side through network state monitoring, including: monitoring and acquiring bandwidth and time delay of a user and a server side at the user side; and monitoring and acquiring the download channel capacity of the server side, which is allocated or reserved for the user.
The embodiment of the invention also provides file fragment downloading equipment, which comprises a processor and a memory; the memory stores therein a program or instructions that are loaded and executed by the processor to implement the file fragmentation download method of the above embodiments.
The embodiment of the invention also provides a computer readable storage medium, wherein a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the file fragmentation downloading method of the embodiment is realized.
It is clear to those skilled in the art that the technical solution of the present invention, which is essential or part of the technical solution contributing to the prior art, or all or part of the technical solution can be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The method, device and storage medium for downloading files in a network environment adaptive environment provided by the present invention have many methods and ways to implement the technical solution, and the above description is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, a number of improvements and modifications may be made without departing from the principle of the present invention, and these improvements and modifications should also be regarded as the protection scope of the present invention. All the components not specified in this embodiment can be implemented by the prior art.
Claims (9)
1. The file fragmentation downloading method of the self-adaptive network environment is characterized by comprising the following steps:
the server-side carries out fragment processing on the downloaded file;
when a user side initiates a downloading request, a server side acquires the bidirectional network conditions of the user side and the server side through network state monitoring, and selects an optimal downloading server to provide a fragmented downloading service.
2. The method for downloading the file fragment according to claim 1, wherein selecting the optimal download server to provide the fragment download service comprises:
for each segment, the selection of the optimal download server is made.
3. The method of claim 2, wherein the selecting an optimal download server for each segment comprises:
after downloading of one fragment is finished, judging whether a downloading server providing downloading service meets the downloading requirement of the next fragment or not, and starting cross-server resource scheduling if the downloading server does not meet the downloading requirement;
finding out a new download server meeting the download requirement by monitoring the network state in real time;
the new download server obtains the user fragment information through the original download server and provides the download service of the user fragment information.
4. The method of claim 1, wherein the optimal download server determines the number of download links and the bandwidth capacity of the server.
5. The method for downloading the file fragments according to claim 4, wherein the optimal download server determines the number of download links and the bandwidth capacity through the server, comprising:
firstly, judging whether a threshold value meeting the link quantity and a threshold value meeting the download channel exist in the current server; the link quantity threshold value refers to an upper limit numerical value of the quantity of downloading threads for providing service of the current server; the download channel threshold is a set ratio between the current reserved download bandwidth and the bandwidth of the user and the server link network.
6. The file fragmentation downloading method of claim 2, wherein the server side obtains the bidirectional network condition of the user side and the server side through network state monitoring, and the method comprises the following steps: monitoring and acquiring bandwidth and time delay of a user and a server side at the user side; and monitoring and acquiring the download channel capacity of the server side, which is allocated or reserved for the user.
7. The file fragmentation downloading method according to claim 2, wherein the user side initiates a downloading request, comprising the following scenarios: and starting downloading, network interruption and continuous transmission and network switching.
8. A file fragment downloading device comprising a processor and a memory; the memory has stored therein a program or instructions that is loaded and executed by the processor to implement the vehicle file fragmentation download method as claimed in any one of claims 1 to 7.
9. A computer readable storage medium storing thereon a program or instructions which, when executed by a processor, implement the vehicle file fragment downloading method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111615716.9A CN114500665A (en) | 2021-12-28 | 2021-12-28 | File fragmentation downloading method, equipment and storage medium adaptive to network environment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111615716.9A CN114500665A (en) | 2021-12-28 | 2021-12-28 | File fragmentation downloading method, equipment and storage medium adaptive to network environment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114500665A true CN114500665A (en) | 2022-05-13 |
Family
ID=81496281
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111615716.9A Pending CN114500665A (en) | 2021-12-28 | 2021-12-28 | File fragmentation downloading method, equipment and storage medium adaptive to network environment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114500665A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060146703A1 (en) * | 2004-12-16 | 2006-07-06 | Samsung Electronics Co.; Ltd | Dynamic quality-of-service mapping apparatus and method through hybrid monitoring in digital home service |
| CN101478564A (en) * | 2008-12-31 | 2009-07-08 | 西安交通大学 | Adaptive hierarchical transmission structure design method for P2P stream media network |
| CN102223267A (en) * | 2011-06-17 | 2011-10-19 | 北京电子科技学院 | IDS (intrusion detection system) detecting method and IDS detecting equipment |
| CN102238204A (en) * | 2010-04-23 | 2011-11-09 | 腾讯科技（深圳）有限公司 | Network data acquisition method and system |
| CN103139241A (en) * | 2011-11-24 | 2013-06-05 | 腾讯科技（深圳）有限公司 | Off-line download system and method for network resource files |
| CN104244028A (en) * | 2014-06-18 | 2014-12-24 | 华为技术有限公司 | Content distribution method, device and system based on code stream self-adaptation technology |
| CN105450760A (en) * | 2015-12-04 | 2016-03-30 | 中铁工程装备集团有限公司 | P2P-based adaptive resource downloading method |
| CN108337574A (en) * | 2017-01-20 | 2018-07-27 | 中兴通讯股份有限公司 | A kind of flow-medium transmission method and device, system, server, terminal |
-
2021
- 2021-12-28 CN CN202111615716.9A patent/CN114500665A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060146703A1 (en) * | 2004-12-16 | 2006-07-06 | Samsung Electronics Co.; Ltd | Dynamic quality-of-service mapping apparatus and method through hybrid monitoring in digital home service |
| CN101478564A (en) * | 2008-12-31 | 2009-07-08 | 西安交通大学 | Adaptive hierarchical transmission structure design method for P2P stream media network |
| CN102238204A (en) * | 2010-04-23 | 2011-11-09 | 腾讯科技（深圳）有限公司 | Network data acquisition method and system |
| CN102223267A (en) * | 2011-06-17 | 2011-10-19 | 北京电子科技学院 | IDS (intrusion detection system) detecting method and IDS detecting equipment |
| CN103139241A (en) * | 2011-11-24 | 2013-06-05 | 腾讯科技（深圳）有限公司 | Off-line download system and method for network resource files |
| CN104244028A (en) * | 2014-06-18 | 2014-12-24 | 华为技术有限公司 | Content distribution method, device and system based on code stream self-adaptation technology |
| CN105450760A (en) * | 2015-12-04 | 2016-03-30 | 中铁工程装备集团有限公司 | P2P-based adaptive resource downloading method |
| CN108337574A (en) * | 2017-01-20 | 2018-07-27 | 中兴通讯股份有限公司 | A kind of flow-medium transmission method and device, system, server, terminal |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10681127B2 (en) | File upload method and system | |
| CN109769023B (en) | Data transmission method, related server and storage medium | |
| US20150032798A1 (en) | Method And Apparatus For Providing Redundant Data Access | |
| US20140365613A1 (en) | Defragmentation of adaptive streaming segment files in a content delivery network | |
| CN112165436B (en) | Flow control method, device and system | |
| CN112968959B (en) | Resource request method and terminal | |
| CN108829510B (en) | Thread binding processing method and device | |
| WO2016095149A1 (en) | Data compression and storage method and device, and distributed file system | |
| CN105407413A (en) | Distributed video transcoding method and related device and system | |
| CN115225504B (en) | Resource allocation method, device, electronic equipment and storage medium | |
| CN108282668B (en) | Video acquisition method and system | |
| CN111935261A (en) | Response message processing method and device, electronic equipment and storage medium | |
| CN112311826B (en) | Method, device and system for processing access request in content distribution system | |
| CN114500665A (en) | File fragmentation downloading method, equipment and storage medium adaptive to network environment | |
| CN109995824B (en) | Task scheduling method and device in peer-to-peer network | |
| CN111913660A (en) | Dotting data processing method and system | |
| JP6276206B2 (en) | Bandwidth allocation control device and bandwidth allocation control method | |
| CN109688171B (en) | Cache space scheduling method, device and system | |
| CN102647733B (en) | Dynamic adjusting method of PS (Packet Switch) permanent timer and RNC (Radio Network Controller) | |
| CN107426314B (en) | Data downloading method and device | |
| CN104935953A (en) | Network on-demand service providing method and system based on real-time transcoding | |
| CN110636104B (en) | Resource request method, electronic device and storage medium | |
| CN109195187B (en) | Network slice switching method based on log file of network slice server | |
| CN111866960B (en) | Network residing method and device of mobile terminal and computer readable storage medium | |
| KR20150008541A (en) | Method and server for controlling data transmition |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |