CN114650281B

CN114650281B - File downloading method, device, equipment and storage medium based on complex network

Info

Publication number: CN114650281B
Application number: CN202011501966.5A
Authority: CN
Inventors: 胡鹏飞
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2020-12-17
Filing date: 2020-12-17
Publication date: 2023-08-11
Anticipated expiration: 2040-12-17
Also published as: CN114650281A

Abstract

The application discloses a file downloading method, device, equipment and storage medium based on a complex network, wherein the method comprises the following steps: when receiving a seed file of a file to be downloaded from a P2P server, acquiring sharing equipment information, wherein the sharing equipment information comprises an equipment list which is used for sharing the file to be downloaded and belongs to the same network outlet as the downloading equipment; screening sharing equipment which accords with a sharing level corresponding to the downloading equipment from the equipment list; and downloading the files to be downloaded from the sharing device and the file server when the sharing device is screened. According to the scheme, dynamic control of sharing hierarchy among enterprise intranet equipment can be realized, bandwidth pressure of file distribution in an enterprise is relieved, the problems of network congestion and network paralysis are effectively avoided, and file downloading speed is further improved.

Description

File downloading method, device, equipment and storage medium based on complex network

Technical Field

The present application relates generally to the field of internet technologies, and in particular, to a method, an apparatus, a device, and a storage medium for downloading a file based on a complex network.

Background

With the rapid development of internet technology, more and more users share and acquire file resources through a network, and particularly, P2P downloading technology is adopted. The P2P downloading technology refers to that in the process that a client downloads a file from a server, client information sharing the file is exchanged with the server at regular time, the client updates the downloading source node information at the same time, and a file fragment is downloaded to a local place from a corresponding client sharing the file. By adopting the P2P downloading technology, the mode of acquiring resources from a server can be changed into the mode of acquiring resources at multiple points, and the P2P downloading technology can realize file sharing, network communication, file exchange, distributed calculation and the like based on the point-to-point technology.

At present, the related technology can adopt a P2P file sharing downloading technology based on private cloud, however, due to different internal network topological structures, when an internal network terminal downloads and acquires larger file resources from a file downloading server, a large amount of internal network bandwidth of the enterprise can be occupied, so that internal network business congestion and even network paralysis are caused, and normal data communication of other businesses is further affected.

Disclosure of Invention

In view of the foregoing drawbacks or shortcomings in the prior art, it is desirable to provide a method, apparatus, device and storage medium for downloading a file based on a complex network, which can avoid the problems of network congestion and network paralysis and increase the file downloading speed.

In a first aspect, an embodiment of the present application provides a method for downloading a file based on a complex network, where the method includes:

when a seed file of a file to be downloaded is acquired from a P2P server, acquiring sharing equipment information, wherein the sharing equipment information comprises an equipment list which is used for sharing the file to be downloaded and belongs to the same network outlet as the downloading equipment;

screening sharing equipment which accords with a sharing level corresponding to the downloading equipment from the equipment list;

and when the sharing device is screened, downloading the file to be downloaded from the sharing device and the file server.

In a second aspect, an embodiment of the present application provides a file downloading device based on a complex network, where the device includes:

the acquisition module is used for acquiring shared equipment information from the condition that a seed file of a file to be downloaded is acquired from the P2P server, wherein the shared equipment information comprises an equipment list which is used for sharing the file to be downloaded and belongs to the same network outlet as the downloading equipment;

the screening module is used for screening the sharing equipment which accords with the sharing level corresponding to the downloading equipment from the equipment list;

and the downloading module is used for downloading files to be downloaded from the sharing equipment and the file server when the sharing equipment is screened.

In a third aspect, embodiments of the present application provide a computer device including a memory, a processor, and a computer program stored on the memory and executable on the processor, the processor implementing a complex network based file downloading method as described in embodiments of the present application when the program is executed by the processor.

In a fourth aspect, embodiments of the present application provide a computer readable storage medium having stored thereon a computer program for implementing a complex network based file downloading method as described in embodiments of the present application when executed by a processor.

According to the file downloading method, device and equipment based on the complex network and the storage medium, when the seed file of the file to be downloaded is obtained from the P2P server, a device list which is used for sharing the file to be downloaded and belongs to the same network outlet as the downloading device is obtained, sharing devices which accord with the sharing level corresponding to the downloading device are screened from the device list, and when the sharing devices are screened, the file to be downloaded is downloaded from the sharing devices and the file server. According to the technical scheme, the device list which is used for sharing the files to be downloaded and belongs to the same network outlet as the downloading device is obtained, and the sharing device which accords with the sharing level is determined from the device list, so that dynamic control of the sharing level among devices in an enterprise is realized, the bandwidth pressure of file distribution in the enterprise is relieved, the problems of network congestion and network paralysis are effectively avoided, and the file downloading speed is further improved.

Drawings

Other features, objects and advantages of the present application will become more apparent upon reading of the detailed description of non-limiting embodiments, made with reference to the accompanying drawings in which:

FIG. 1 is a schematic diagram of an implementation environment of a conventional file downloading method according to an embodiment of the present application;

FIG. 2 is a diagram of a conventional file downloading method implementation environment according to an embodiment of the present application;

FIG. 3 is a schematic diagram of an implementation environment of a file downloading method based on a complex network according to an embodiment of the present application;

FIG. 4 is a schematic flow chart of a file downloading method based on a complex network according to an embodiment of the present application;

FIG. 5 is a schematic diagram of an interface of the set group configuration information according to an embodiment of the present application;

FIG. 6 is a flowchart of a method for downloading a file based on a complex network according to an embodiment of the present application;

FIG. 7 is a flowchart of a method for downloading a file based on a complex network according to an embodiment of the present application;

FIG. 8 is a flowchart of a file downloading method based on a complex network according to an embodiment of the present application;

FIG. 9 is a flowchart of a method for downloading a file based on a complex network according to an embodiment of the present application;

FIG. 10 is a schematic diagram of a file downloading device based on a complex network according to an embodiment of the present application;

FIG. 11 is a schematic diagram of a file downloading device based on a complex network according to another embodiment of the present application;

fig. 12 is a schematic structural diagram of a computer system according to an embodiment of the present application.

Detailed Description

The application is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be noted that, for convenience of description, only the portions related to the application are shown in the drawings.

It should be noted that, without conflict, the embodiments of the present application and features of the embodiments may be combined with each other. The application will be described in detail below with reference to the drawings in connection with embodiments.

Cloud technology (Cloud technology) refers to a hosting technology for integrating hardware, software, network and other series resources in a wide area network or a local area network to realize calculation, storage, processing and sharing of data.

Cloud technology (Cloud technology) is based on the general terms of network technology, information technology, integration technology, management platform technology, application technology and the like applied by Cloud computing business models, and can form a resource pool, so that the Cloud computing business model is flexible and convenient as required. Cloud computing technology will become an important support. Background services of technical networking systems require a large amount of computing, storage resources, such as video websites, picture-like websites, and more portals. Along with the high development and application of the internet industry, each article possibly has an own identification mark in the future, the identification mark needs to be transmitted to a background system for logic processing, data with different levels can be processed separately, and various industry data needs strong system rear shield support and can be realized only through cloud computing.

A Private Cloud (Private Cloud) is a Cloud infrastructure created with software and hardware resources within a firewall for organizations or departments within an enterprise to share resources within a data center. A private cloud is created, typically cloud device (IaaS, infrastructure as a Service, infrastructure as a service) software in addition to hardware resources.

Private cloud computing also includes three levels of cloud hardware, cloud platform, cloud services. In contrast, cloud hardware is a user's own personal computer or server, rather than a data center of a cloud computing vendor. Cloud computing manufacturers build data centers to provide public cloud services for millions of users, thus requiring tens of millions of servers. Private cloud computing serves only friends and relatives to individuals, and staff and clients and suppliers to businesses, so personal or business's own personal computers or servers are sufficient to provide cloud services.

Public clouds (Public clouds) generally refer to clouds that third party providers provide to users that can use, and are generally available over the Internet, and may be free or low cost, with the core attribute of the Public clouds being shared resource services. There are many examples of such clouds that can provide services throughout the open public network today.

Hybrid clouds (Hybrid clouds) merge Public clouds (Public clouds) and Private clouds (Private clouds), which are the main modes and development directions of Cloud computing in recent years. Private clouds are mainly for enterprise users, and for safety reasons, enterprises prefer to store data in the private clouds, but at the same time wish to obtain computing resources of public clouds, in which case hybrid clouds are increasingly adopted, and mix and match the public clouds and the private clouds to obtain the best effect.

For a clearer description of the present application, the following is an explanation of related art terms:

seed file: the abstract information is used for recording the abstract information of the original file, and comprises the number of fragments of the original file, the size of each fragment and a Message Digest (MD5) value of each fragment.

Message abstract: the MD5 value is used to verify the integrity of network file transmission and prevent the file from being tampered with.

Network segment: generally refers to that portion of a computer network that is capable of direct communication using the same physical layer device, such as a transmission medium, repeater, hub, etc.

TTL: this field specifies the maximum number of segments allowed to pass before the ip packet is dropped by the router.

It can be understood that when an enterprise administrator performs file management such as file distribution and bug repair, corresponding requirements are generally required to be achieved by issuing files in an enterprise intranet, and because of different network topology structures of enterprises, when an intranet terminal obtains file resources from a file download server, a large amount of enterprise intranet bandwidth is occupied, so that network congestion and even network paralysis are caused, and a public cloud-based P2P download technology can be adopted to download the file resources.

P2P (Peer-To-Peer) is a distributed system in which participants share some of the resources (content and services) they own, which can be accessed directly by other Peer nodes without going through intermediate entities. Each node in the system is a resource provider and a resource acquirer, and each node provides services for other nodes and also enjoys the services provided by other nodes.

Currently, when downloading files in a small file or a scene of fewer terminal users, a C/S architecture can be adopted to deploy the files to be downloaded into a file server, and each terminal establishes TCP connection with the file server to transmit the files. For a larger number of end user scenarios, as shown in fig. 1, a P2P download technology is generally adopted, including a plurality of terminal devices such as device a, device B, and device C, a file server, and a P2P server. The device A downloads the file F from the file server, and reports self information to the P2P server after the downloading is completed, wherein the self information comprises the information of the device A and seed information of the file F. When the device B requests to download the same file F, a query request is sent to the P2P server, where the query request is used to query the device information currently being used as a seed, and then the P2P server sends the device information currently being shared with the file F, that is, the device a information, to the device B, so that the device B establishes multiple parallel channels, and meanwhile, downloads the file F from the file server and the currently shared device, that is, the device a in a fragmented manner. Similarly, when the device C requests to download the same file F, the file F is downloaded from the file server, the device a, and the device B in a fragmented manner.

It can be appreciated that the network topologies of different enterprises are greatly different, and fig. 2 shows a common network topology of a large and medium-sized enterprise, where the structure includes a possible master router, a plurality of sub routers and a plurality of clients. The main router is located in a headquarter city A, the enterprise sub-city B and the enterprise sub-city C are respectively provided with sub-routers, the enterprise sub-city B comprises a client area 1 and a client area 2, and the enterprise sub-city C comprises a client area 3 and a client area 4. When the enterprise branches access other branches or the Internet, the enterprise branches need to be filtered and forwarded through the main router of the headquarter city A.

When the sub-clients located in the enterprise sub-city B, such as the client area 1 or the client area 2, can sequentially pass through the sub-routers of the city B to the main router of the city a and transit to the public cloud server to download the file F, and the P2P downloading technology is adopted, when the sub-clients located in the enterprise sub-city C, such as the client area 3 or the client area 4, need to download the same file F, the sub-clients located in the enterprise sub-city C can download the file F from the public cloud server and the client located in the city B at the same time, and because the client area located in the city B communicates with the client area located in the city C, data transmission is performed across network segments through the headquarter main router, so that normal service data communication among the city B, the city C and the headquarter city a causes congestion, even network paralysis. Similarly, when communication is performed between different store client end areas 1 and client end areas 2 in the same enterprise subsection, such as city B, a sub-router in city B is required to forward, which occupies a large amount of bandwidth and may affect normal service data communication among store client end areas 1, client end areas 2 and subsection city B.

The embodiment of the application provides a file downloading method based on a complex network, which can acquire a device list which is used for sharing files to be downloaded and belongs to the same network outlet as downloading devices, and determines sharing devices conforming to a sharing level from the device list, so that when the sharing devices are screened, the files to be downloaded are downloaded from the sharing devices and a file server, the bandwidth pressure of file distribution in an enterprise is relieved, the problems of network congestion and network paralysis are effectively avoided, and the file downloading speed is improved.

Referring to fig. 3, fig. 3 shows an implementation environment architecture diagram of a file downloading method based on a complex network according to an embodiment of the present application. As shown in fig. 3, the implementation environment architecture includes: a plurality of download devices 10, a file server 20, a P2P server 30 and a master server 40.

The downloading device 10 is configured to request the file server 20 and the P2P server 30 for downloading a file, and to send a packet configuration information acquisition request to the main control server 40 to acquire packet configuration information. Alternatively, the downloading device may be a personal computer, a mobile phone, a tablet computer, or the like.

The file server 20, the P2P server 30 and the master server 40 may be configured on separate physical servers, or may be a server cluster or a distributed system formed by a plurality of physical servers, or may be a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDNs, and basic cloud computing services such as big data and artificial intelligence platforms.

The P2P server 30 is configured to be responsible for maintaining state information of all terminal devices of the system and providing information of other terminal devices capable of performing shared resource interaction for each terminal device.

The master control server 40 is configured to perform differentiated grouping configuration information for terminal devices in different partitions in advance according to enterprise scale, network topology structure, and intranet bandwidth allocation, in combination with grouping policy configuration, and further is configured to store feature information corresponding to a file.

The file server 20 is configured to provide file download resources for terminal devices of different partitions.

In order to better understand and explain the file downloading method based on the complex network provided by the embodiment of the present application, the following details are explained by fig. 4 to 12.

Fig. 4 is a flow chart of a file downloading method based on a complex network according to an embodiment of the present application, as shown in fig. 4, where the method is performed by a downloading device, and the method includes:

s101, when a seed file of a file to be downloaded is acquired from a P2P server, acquiring sharing device information, wherein the sharing device information comprises a device list which is used for sharing the file to be downloaded and belongs to the same network outlet as the downloading device.

Specifically, when performing business such as bug fix, business upgrade, software distribution and the like in an enterprise, files need to be issued in the intranet to achieve corresponding requirements, and the business upgrade can comprise version update or virus library upgrade.

In the process of establishing connection between the terminal equipment and the main control server, registration and authorization verification operation are required, wherein registration is required for unregistered terminal equipment before authorization verification is required, and authorization verification is required for registered and unchecked terminal equipment, so that the main control server acquires and stores terminal equipment information passing through authorization, and the terminal equipment information can comprise terminal equipment identification.

The main control server can carry out differentiated grouping configuration information aiming at terminal equipment in different partitions in advance according to enterprise scale, network topology structure and intranet bandwidth allocation condition and grouping strategy configuration, and the grouping configuration information can comprise whether P2P downloading transmission acceleration is started, P2P server address information, P2P sharing level, file uploading time and sharing duration. The terminal devices of different partitions may be terminal devices corresponding to different departments in the enterprise, and may include, for example, different partitions such as a research and development part, a product part, a test part, and the like.

For example, as shown in the interface schematic diagram of fig. 5, different terminal devices may include different partitions such as ungrouped terminals, product parts, development parts, test parts, etc., where the number of ungrouped terminals is 277, the number of product parts is 4, the number of development parts is 4, the number of test parts is 7, and each partition is configured with corresponding configuration content in a differentiated manner, where the configuration content includes, for example, whether to start the transmission acceleration of the intranet P2P, the address information of the P2P server is 10.12.90.229, and when to start the transmission acceleration of the intranet client P2P, the uploading time of the client is 600 minutes, and the sharing level is 1. The shared hierarchy refers to the number of intermediate nodes that the download device passes through when communicating with the seed device in the device list, and the intermediate nodes may be any device having a routing function, for example, but not limited to, a router.

After the downloading equipment registers with the main control server and passes the authorization verification, a grouping configuration acquisition request can be sent to the main control server, the grouping configuration acquisition request carries an equipment identifier, the main control server responds to the grouping configuration acquisition request, determines a grouping of the downloading equipment based on the equipment identifier, inquires grouping configuration information and sends the grouping configuration information to the downloading equipment, wherein the grouping configuration information can comprise whether P2P downloading transmission acceleration is started, P2P server address information, P2P sharing level and the like.

Specifically, after the downloading device obtains the grouping configuration information from the main control server, a characteristic information obtaining request may be sent from the main control server, where the characteristic information obtaining request includes an identifier of a file to be downloaded, the main control server receives and responds to the characteristic information obtaining request, determines characteristic information of the file to be downloaded based on the identifier of the file to be downloaded, and sends the characteristic information of the file to be downloaded to the downloading device, and the downloading device sends a seed file query request to the P2P server, where the seed file query request carries the characteristic information of the file to be downloaded, and the characteristic information may include hash information of the file to be downloaded. And the P2P server responds to the seed file query request, searches a seed file corresponding to the characteristic information of the file to be downloaded from a seed file library based on the characteristic information of the file to be downloaded, obtains a query result and sends the query result to the downloading equipment. When the query result indicates that the P2P server acquires the seed file of the file to be downloaded, the seed file is sent to the downloading device, and the downloading device acquires the seed file, which indicates that the downloading device successfully acquires the seed file.

When the query result indicates that the seed file of the file to be downloaded is not acquired, the failure of the downloading device to acquire the seed file is indicated, namely the file to be downloaded cannot be downloaded through the P2P sharing downloading technology, the downloading can be directly requested to the file server in a conventional HTTP mode, a first transmission channel between the downloading device and the file server is established, and the file to be downloaded is received from the file server based on the first transmission channel between the downloading device and the file server. The seed file comprises fragments of files to be downloaded, fragments of sizes and fragments of information, and the first transmission channel is a data transmission channel for downloading all file files from a file server.

After the downloading device receives the seed file sent by the P2P server, a sharing device query request may be sent to the P2P server, where the sharing device query request includes a file identifier of the file to be downloaded, and the P2P server obtains, in response to the sharing device query request, sharing device information of the file to be downloaded, where the sharing device information is a device list used for sharing the file to be downloaded and belonging to the same network outlet as the client, based on the file identifier query of the file to be downloaded.

It should be noted that, after the downloading of the file is completed, the terminal device will report its own device information and the file identifier of the downloaded file to the P2P server in real time. In order to control the intranet bandwidth, the P2P server may use the same network outlet IP as a dividing standard, so as to respond to the query request of the sharing device, and obtain a device list sharing the file to be downloaded and having the same network outlet as the downloading device according to the file identification query of the file to be downloaded. The list of devices belonging to the same network outlet as the downloading device may be terminal devices that reach the P2P server through the same gateway when communicating with the P2P server.

The gateway is a device for connecting two network segments with different protocols and is used for mutually translating and converting data using different transmission protocols in the two different network segments.

In this embodiment, since the device list which is used for sharing the file to be downloaded and belongs to the same network outlet as the downloading device is obtained, the intranet bandwidth can be controlled, so that the device list returned by the P2P server is more effective, and a large amount of useless device information is prevented from being returned, thereby reducing the data volume of the device list.

S102, screening sharing devices which accord with the sharing level corresponding to the downloading device from the device list.

S103, when the sharing device is screened, downloading the files to be downloaded from the sharing device and the file server.

It should be noted that the above list of devices may include at least one seed production device.

After obtaining the device list which is used for sharing the file to be downloaded and belongs to the same network outlet as the downloading device, a TTL network hop count detection algorithm can be adopted to reject the device information which does not meet the configured sharing level control requirement, so that data transmission across multiple network segments is avoided, and other normal service communication in an enterprise is prevented from being influenced.

The TTL network hop count detection algorithm may be that the downloading device performs connection attempt with the target device, and counts the TTL network hop count. The target device is a seeding device in a device list.

Alternatively, on the basis of the above embodiment, as shown in fig. 6, as an implementation manner, the step S102 may include the following method steps:

s201, determining the network hop count between each seed device and the downloading device in the device list.

S202, comparing whether the number of network hops between each seed making device and the downloading device is smaller than or equal to the sharing level corresponding to the downloading device, wherein the sharing level is the number of intermediate nodes through which communication is carried out between the downloading device and the seed making device.

S203, determining the seed production equipment with the network hop count smaller than or equal to the sharing level as the sharing equipment conforming to the sharing level corresponding to the downloading equipment.

In this step, a communication connection between the downloading device and each of the seed-making devices in at least one of the device lists may be established, and the number of intermediate nodes through which communication is performed with each of the seed-making devices may be determined as the number of network hops. And comparing whether the network hop count between each seed device and the downloading device is smaller than or equal to the sharing level corresponding to the downloading device.

If the network hop count between the seed making device and the downloading device is larger than the sharing level configured for the downloading device in the grouping configuration information, the connection between the downloading device and the seed making device fails, the seed making device is determined to be the seed making device which does not meet the requirements, and the seed making device which does not meet the requirements is removed; if the number of network hops is less than or equal to the configured sharing hierarchy, the connection between the downloading device and the seed device is successful, and the seed device can be used as a sharing device which can be used for sharing the file to be downloaded and accords with the configured sharing hierarchy. The network hop count refers to the number of intermediate nodes through which the downloading device and the seed production device communicate, and the intermediate nodes may be any devices having a routing function.

When the sharing device is obtained through screening, downloading the files to be downloaded from the sharing device and the file server, wherein the files to be downloaded can be obtained through respectively establishing a second transmission channel between the downloading device and the sharing device and a third transmission channel between the downloading device and the file server, and then respectively downloading the files to be downloaded based on the second transmission channel and the third transmission channel, and the second transmission channel is a data transmission channel for downloading the first file fragments from the sharing device; the third transmission channel is a data transmission channel for downloading the second file fragments from the file server, wherein all the file fragments comprise the first file fragments and the second file fragments.

When the shared device is not screened, a first transmission channel between the shared device and the file server can be established, and files to be downloaded are downloaded from the file server.

According to the file downloading method based on the complex network, when the seed file of the file to be downloaded is obtained from the P2P server, a device list which is used for sharing the file to be downloaded and belongs to the same network outlet as the downloading device is obtained, sharing devices which accord with the sharing level corresponding to the downloading device are screened from the device list, and when the sharing devices are screened, the file to be downloaded is downloaded from the sharing devices and the file server. According to the technical scheme, the device list which is used for sharing the files to be downloaded and belongs to the same network outlet as the downloading device is obtained, and the sharing device which accords with the sharing level is determined from the device list, so that dynamic control of the sharing level among devices in an enterprise is realized, the bandwidth pressure of file distribution in the enterprise is relieved, the problems of network congestion and network paralysis are effectively avoided, and the file downloading speed is further improved.

Further, on the basis of the above embodiment, as shown in fig. 7, the step S103 may include the following steps:

s301, respectively establishing a second transmission channel between the shared equipment and a third transmission channel between the file server.

S302, downloading file fragments based on the second transmission channel and the third transmission channel to obtain a plurality of file fragments.

S303, checking each file fragment in the plurality of file fragments based on the seed file.

S304, after each file fragment passes verification, combining the file fragments to obtain the file to be downloaded.

Specifically, after the downloading device determines the sharing device conforming to the sharing hierarchy from the device list, according to the seed file of the file to be downloaded, the downloading device may acquire different file fragment identifiers by using the file fragment as the downloading dimension, then establish a second transmission channel between the downloading device and the sharing device based on the different file fragment identifiers, where the second transmission channel may be a P2P file fragment downloading transmission channel, and establish a third transmission channel between the downloading device and the file server, where the third transmission channel may be an HTTP file fragment downloading channel, and then enable file fragment downloading from the sharing device and the file server respectively, so as to obtain the file to be downloaded based on the second transmission channel and the third transmission channel.

Alternatively, file fragment downloading can be performed based on the second transmission channel and the third transmission channel to obtain a plurality of file fragments, and each file fragment in the plurality of fragments is verified based on the seed file, for example, the hash value of each file fragment recorded in the seed file and the corresponding file fragment size can be compared with the corresponding file fragment obtained by downloading, and when the comparison is consistent, verification is passed; and when the comparison is inconsistent, the verification is failed.

When the file fragment verification fails, the downloading device can download the P2P channel from other devices or download the HTTP channel request from the file server. And after each file fragment passes the verification, combining each file fragment in the plurality of file fragments, thereby obtaining the file to be downloaded.

After the downloading device completes the downloading of the file, the address information of the downloading device and the file information of the file to be downloaded can be sent to the P2P server, so that the P2P server maintains a shared file database according to the reporting information, when other devices which are located at the same network outlet with the downloading device request to send a shared device query request to the P2P server to request the file sharing, the P2P server can use the downloading device as a shared device meeting the sharing level, for example, the P2P server can judge whether the client meets the preset policy requirements of other devices or not, and send the device information meeting the preset policy requirements of other devices to other devices, so as to provide the file P2P sharing service for other devices needing to download the file.

In order to more clearly illustrate the present application, fig. 8 is a flow chart of a file downloading method based on a complex network according to an embodiment of the present application, as shown in fig. 8, the method includes:

s401, the downloading device sends a grouping configuration acquisition request to the main control server, wherein the grouping configuration request carries a device identifier.

S402, the main control server responds to a packet configuration acquisition request sent by the main control server, and obtains packet configuration information based on the packet information inquiry of the equipment identifier.

S403, the master control server sends grouping configuration information to the downloading equipment, wherein the grouping configuration information comprises a sharing hierarchy.

Specifically, after the connection between the downloading device and the main control server is established, registration and authorization verification operations are required, so that the main control server obtains and stores device information passing authorization, and the device information can include a device identifier.

The downloading device sends a grouping configuration acquisition request carrying a device identifier to a main control server, and the main control server responds to the grouping configuration acquisition request, inquires the pre-configured grouping configuration information based on the device identifier and sends the pre-configured grouping configuration information to the downloading device. Wherein the packet configuration information includes: whether to enable P2P download transport acceleration, P2P server address information, P2P sharing hierarchy, etc.

The grouping configuration information for the device configurations of the different groupings is different, for example, 1 for the sharing hierarchy in the partition configuration information of the development part and 2 for the sharing hierarchy in the partition configuration information of the test part. The shared hierarchy refers to the number of intermediate nodes that a device running the client passes through when communicating with the seed device in the device list, which may be any routing-enabled device, including, but not limited to, a router. For example, when the sharing level is 1, communication with other devices is required via one router, and when the sharing level is 2, communication with other devices is required via two routers.

S404, the downloading device sends a seed file query request to the P2P server, wherein the seed file query request carries the characteristic information of the file to be downloaded.

S405, the P2P server responds to the seed file query request, and searches the seed file corresponding to the file to be downloaded according to the characteristic information of the file to be downloaded.

S406, the P2P server sends the seed file to the downloading device.

After the downloading device obtains the grouping configuration information from the main control server, a seed file query request carrying the characteristic information of the file to be downloaded can be sent to the P2P server, the P2P server responds to the seed file query request, searches a seed file corresponding to the file to be downloaded from a seed file library according to the hash information of the file to be downloaded, and sends the seed file corresponding to the file to be downloaded to the downloading device, so that the downloading device obtains the seed file corresponding to the file to be downloaded. The seed file may include file fragments of the file to be downloaded and fragment information, where the fragment information may be fragment size, etc.

S407, when the downloading device receives the seed file of the file to be downloaded, sending a sharing device query request to the P2P server, wherein the sharing device query request comprises the file identification of the file to be downloaded.

And S408, the P2P server responds to the query request of the sharing device, and searches and obtains the sharing device information which is sharing the file to be downloaded and belongs to the same network outlet as the downloading device based on the file identification of the file to be downloaded.

S409, the P2P server transmits the shared device information to the download device.

S410, the downloading device determines sharing devices conforming to the sharing hierarchy from the device list based on the sharing hierarchy, wherein the sharing devices are used for providing files to be downloaded to the downloading device.

As shown in fig. 9, after the downloading device obtains the seed file of the file to be downloaded, a sharing device query request including the file identifier of the file to be downloaded may be sent to the P2P server, and the P2P server may search, in response to the sharing device query request, for the device information that is sharing the file to be downloaded based on the file identifier, and in order to control the intranet bandwidth, may prioritize sharing device information that is located at the same network outlet as the downloading device, where the sharing device information includes a plurality of device lists.

When the downloading device does not acquire the seed file from the P2P server, the downloading device can directly establish a first transmission channel with the file server, and send an http request to the file server so as to transmit an http data stream based on the first transmission channel to download and receive the file to be downloaded.

After the downloading equipment acquires the shared equipment information, P2P shared range control screening is carried out, the downloading equipment and the target equipment are sequentially connected and tried by determining the target equipment from the shared equipment information, TTL network hops are counted, if the network hops exceed the shared level in the acquired grouping configuration information, the downloading equipment is the seed production equipment which does not meet the requirement of the shared level, the equipment which does not meet the requirement of the shared level is removed, and the equipment which meets the configured shared level is screened.

When sharable devices are obtained through screening, namely devices meeting the sharing level corresponding to the downloading devices are obtained, the downloading devices and the devices meeting the requirements establish a second transmission channel for P2P (peer-to-peer) fragmented downloading, and meanwhile, the downloading devices and the file server establish a third transmission channel for HTTP fragmented downloading, namely, the terminal device downloads a plurality of file fragments based on the second transmission channel and the third transmission channel respectively, the final file downloading operation is completed through the P2P and the HTTP double channels together, verification processing is carried out on each file fragment according to the seed files, and therefore the file fragments which pass verification are synthesized are obtained to obtain complete files.

When no sharable device is obtained, namely, no device conforming to the sharing level corresponding to the downloading device is obtained, the downloading device establishes a transmission channel with the file server, downloads a plurality of file fragments corresponding to the file to be downloaded from the file server, performs verification processing on the plurality of file fragments, and synthesizes the file fragments passing the verification processing to obtain a complete file.

Further, after the downloading device finishes downloading the file, the downloading device and the file information of the file to be downloaded can be sent to the P2P server, so that the P2P server maintains a shared file database according to the reported information, and when a new device sends a file sharing request to the P2P server, the completed device information can be used as a new seed device, thereby providing file P2P service for other devices.

For example, assuming that a Device running a client needs to download a file a, the Device requests to a P2P server to download a seed file corresponding to the file a, the P2P server searches that the seed file corresponding to the file a is TorrentA according to hash information corresponding to the file a and sends the seed file to the Device, after the Device acquires the TorrentA of the seed file corresponding to the file a, it requests to the P2P server to acquire the shared Device information for sharing the file a, i.e. to check which devices are sharing the file a, and since the P2P server records all the Device information that is sharing the file a, for example, 2000 pieces of Device information, i.e. 2000 devices are sharing the file a.

In the conventional method, the P2P server records the quality of each Device sharing the file a, where the quality may be that many P2P file fragment downloads have been successfully provided for other devices, which means that the quality of the Device is better, and the Device information with better quality is sent to the client.

After the Device obtains the 100 pieces of Device information, the traditional technology establishes channels with the 100 pieces of Device serving as seed devices one by one for file downloading, but before the channel is established, the Device needs to screen the 100 pieces of devices according to a pre-configured sharing level and a TTL detection scheme to obtain 10 pieces of devices which are finally suitable for P2P downloading, and then establishes a P2P fragment downloading channel.

Because the 100 kinds of devices belong to the same network outlet as the current Device, but the requirement of sharing level is not necessarily met, shared level filtering needs to be performed on the 100 kinds of devices, the filtering process may be that the Device and the target Device perform TTL connection attempt, if the specified shared level is exceeded, connection fails, the Device information of the connection failure is the Device information which does not meet the requirement of shared level configuration, and then the Device which does not meet the requirement of configured shared level is removed, so as to obtain 10 pieces of Device information which meets the requirement.

And then according to a seed file TorrentA corresponding to the file A, wherein the seed file TorrentA comprises file fragments, the file fragments are taken as downloading dimensions, P2P data transmission channels are respectively established with 10 devices meeting the requirements, meanwhile, the Device and a file server establish transmission channels, the P2P and HTTP double channels are started to jointly finish final file downloading operation, and after all file fragments are downloaded, file verification is carried out according to the seed file TorrentA, and the file fragments passing the verification are combined to obtain the finished file.

The embodiment of the application can relieve the bandwidth pressure of file distribution in a service by using a P2P sharing technology in a complex enterprise network environment, avoid the problems of network congestion and network paralysis caused by cross-network-segment file sharing brought by the traditional technology, enable the file downloading transmission in the enterprise to be carried out efficiently and rapidly, and improve the downloading efficiency of the file.

On the other hand, fig. 10 is a schematic structural diagram of a file downloading device based on a complex network according to an embodiment of the present application. The apparatus may be an apparatus in a terminal device, as shown in fig. 10, and the apparatus 800 includes:

an obtaining module 810, configured to obtain, when a seed file of a file to be downloaded is received from a P2P server, shared device information, where the shared device information includes a device list for sharing the file to be downloaded and belonging to the same network outlet as a downloading device;

A screening module 820, configured to screen the sharing devices that conform to the sharing hierarchy corresponding to the downloading device from the device list;

and the downloading module 830 is configured to download the file to be downloaded from the sharing device and the file server when the sharing device is screened.

Optionally, referring to fig. 11, the acquiring module 810 includes:

a sending unit 811, configured to send a shared device query request to the P2P server, where the shared device query request includes a file identifier of a file to be downloaded;

and the receiving unit 812 is configured to receive the shared device information sent by the P2P server, where the shared device information is obtained by searching, by the P2P server, based on the file identifier of the file to be downloaded, in response to the shared device query request.

Optionally, the screening module 820 includes:

a first determining unit 821 for determining the number of network hops between each seed device and the downloading device in the device list;

a comparing unit 822, configured to compare whether the number of network hops between each seed making device and the downloading device is less than or equal to a sharing level corresponding to the downloading device, where the sharing level is the number of intermediate nodes through which communications between the downloading device and the seed making device are performed;

and a second determining unit 823, configured to determine a seeding device with a network hop count less than or equal to the sharing hierarchy as a sharing device conforming to the sharing hierarchy corresponding to the downloading device.

Optionally, the first determining unit 821 is configured to:

communication connection with each seed production device is respectively established;

determining the number of nodes of intermediate nodes through which communication is performed with each seeding device;

the number of nodes is determined as the number of network hops between the seed device and the download device.

Optionally, the device is further configured to:

acquiring characteristic information of a file to be downloaded from a main control server;

sending a seed file query request to the P2P server, so that the P2P server responds to the seed file query request and queries a seed file of the file to be downloaded from a seed file library based on the characteristic information of the file to be downloaded;

and receiving a query result of the P2P server in response to the seed file query request, wherein the query result is used for indicating whether the P2P server acquires the seed file of the file to be downloaded.

Optionally, the device is further configured to:

when the query result indicates that the seed file of the file to be downloaded is not acquired, a first transmission channel between the seed file and the file server is established;

a file to be downloaded is received from a file server based on a first transmission channel with the file server.

Optionally, the device is further configured to:

respectively establishing a second transmission channel between the shared equipment and a third transmission channel between the file server;

Downloading the file fragments based on the second transmission channel and the third transmission channel to obtain a plurality of file fragments;

verifying each of the plurality of file fragments based on the seed file;

and after each file fragment passes verification, combining the file fragments to obtain the file to be downloaded.

Optionally, the device is further configured to:

and sending the address information of the downloading equipment and the file information of the file to be downloaded to the P2P server, so that when the P2P server receives a sharing equipment query request sent by other equipment which is positioned at the same network outlet as the downloading equipment, the downloading equipment is used as sharing equipment conforming to a sharing level.

According to the file downloading device based on the complex network, the shared equipment information is obtained through the obtaining module when the seed file of the file to be downloaded is obtained from the P2P server, the shared equipment which accords with the shared level corresponding to the downloading equipment is screened from the equipment list through the screening module, and the file to be downloaded is obtained through the downloading module in a downloading mode from the shared equipment and the file server when the shared equipment is screened. The device obtains the equipment list which is used for sharing the files to be downloaded and belongs to the same network outlet as the downloading equipment, and determines the sharing equipment which accords with the sharing level from the equipment list, so that the dynamic control of the sharing level among the devices in the enterprise is realized, the bandwidth pressure of file distribution in the enterprise is relieved, the problems of network congestion and network paralysis are effectively avoided, and the file downloading speed is further improved.

In another aspect, an embodiment of the present application further provides an electronic device, where the device includes a memory, a processor, and a computer program stored on the memory and executable on the processor, and where the processor implements the complex network-based file downloading method as described above when the processor executes the program.

Referring now to FIG. 12, there is illustrated a schematic diagram of a computer system 900 suitable for use with an apparatus embodying embodiments of the present application.

As shown in fig. 12, the computer system 900 includes a Central Processing Unit (CPU) 901, which can execute various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 902 or a program loaded from a storage portion 903 into a Random Access Memory (RAM) 903. In the RAM 903, various programs and data necessary for the operation of the system 900 are also stored. The CPU 901, ROM 902, and RAM 903 are connected to each other through a bus 904. An input/output (I/O) interface 905 is also connected to the bus 904.

The following components are connected to the I/O interface 905: an input section 906 including a keyboard, a mouse, and the like; an output portion 907 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and a speaker; a storage portion 908 including a hard disk or the like; and a communication section 909 including a network interface card such as a LAN card, a modem, or the like. The communication section 909 performs communication processing via a network such as the internet. The drive 910 is also connected to the I/O interface 905 as needed. A removable medium 911 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is installed as needed on the drive 910 so that a computer program read out therefrom is installed into the storage section 908 as needed.

In particular, the process described above with reference to fig. 4 may be implemented as a computer software program in accordance with embodiments of the content sharing or processing of the present disclosure. For example, embodiments of the disclosed electronic red envelope processing include a computer program product comprising a computer program tangibly embodied on a machine-readable medium, the computer program comprising program code for performing the method of fig. 4. In such an embodiment, the computer program may be downloaded and installed from the network via the communication portion 909 and/or installed from the removable medium 911.

The computer readable medium shown in the present application may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

In the present application, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various content sharing or processing embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units or modules involved in the embodiments of the present application may be implemented in software or in hardware. The described units or modules may also be provided in a processor, for example, as: a processor includes an acquisition module, a screening module, and a download module. Wherein the names of these units or modules do not constitute a limitation of the unit or module itself in some cases, for example, the acquisition module may also be described as "for acquiring shared device information including a list of devices for sharing a file to be downloaded and belonging to the same network outlet as the download device" from when a seed file of the file to be downloaded is acquired from the P2P server ".

As another aspect, the present application also provides a computer-readable storage medium, which may be a computer-readable storage medium contained in the foregoing apparatus in the foregoing embodiment; or may be a computer-readable storage medium, alone, that is not assembled into a device. The computer-readable storage medium stores one or more programs for use by one or more processors to perform the complex network-based file downloading method described in the present application, specifically:

When receiving a seed file of a file to be downloaded from a P2P server, acquiring sharing equipment information, wherein the sharing equipment information comprises an equipment list which is used for sharing the file to be downloaded and belongs to the same network outlet as the downloading equipment;

and downloading the files to be downloaded from the sharing device and the file server when the sharing device is screened.

The above description is only illustrative of the preferred embodiments of the present application and of the principles of the technology employed. It will be appreciated by persons skilled in the art that the scope of the application referred to in the present application is not limited to the specific combinations of the technical features described above, but also covers other technical features formed by any combination of the technical features described above or their equivalents without departing from the inventive concept. Such as the above-mentioned features and the technical features disclosed in the present application (but not limited to) having similar functions are replaced with each other.

Claims

1. A method for downloading a file based on a complex network, the method comprising:

when receiving a seed file of a file to be downloaded from a P2P server, acquiring sharing equipment information, wherein the sharing equipment information comprises an equipment list which is used for sharing the file to be downloaded and belongs to the same network outlet as the downloading equipment; the device list comprises at least one seed production device;

determining the number of network hops between each of the seed-metering devices and the downloading device in the device list;

comparing whether the number of network hops between each seed making device and the downloading device is smaller than or equal to the sharing level corresponding to the downloading device, wherein the sharing level is the number of intermediate nodes through which communication is carried out between the downloading device and the seed making device;

Determining the seed production equipment with the network hop count smaller than or equal to the sharing level as sharing equipment conforming to the sharing level corresponding to the downloading equipment;

2. The method of claim 1, wherein obtaining shared device information comprises:

sending a sharing equipment query request to the P2P server, wherein the sharing equipment query request comprises a file identifier of the file to be downloaded;

and receiving the shared equipment information sent by the P2P server, wherein the shared equipment information is obtained by searching the P2P server according to the file identification of the file to be downloaded in response to the shared equipment inquiry request.

3. The method of claim 1, wherein determining the number of network hops between each of the seeded devices and the downloading device in the list of devices comprises:

establishing communication connection with each seed production device respectively;

determining the number of nodes of intermediate nodes through which communication is carried out with each seed production device;

and determining the number of the nodes as the number of network hops between the seed production device and the downloading device.

4. The method of claim 1, wherein prior to obtaining shared device information, the method further comprises:

sending a seed file query request to the P2P server, so that the P2P server responds to the seed file query request and queries the seed file of the file to be downloaded from a seed file library based on the characteristic information of the file to be downloaded;

5. The method according to claim 4, wherein the method further comprises:

the file to be downloaded is received from the file server based on a first transmission channel with the file server.

6. The method of claim 1, wherein downloading from the sharing device and file server results in the file to be downloaded, comprising:

Respectively establishing a second transmission channel between the file server and the sharing equipment and a third transmission channel between the file server and the sharing equipment;

verifying each of the plurality of file fragments based on the seed file;

7. The method of claim 1, wherein after downloading the file to be downloaded from the sharing device and file server, the method further comprises:

and sending the address information of the downloading equipment and the file information of the file to be downloaded to the P2P server, so that when the P2P server receives a sharing equipment query request sent by other equipment which is at the same network outlet as the downloading equipment, the downloading equipment is used as sharing equipment conforming to the sharing hierarchy.

8. A complex network-based file downloading apparatus, the apparatus comprising:

the system comprises an acquisition module, a download module and a download module, wherein the acquisition module is used for acquiring shared equipment information when a seed file of a file to be downloaded is acquired from a P2P server, wherein the shared equipment information comprises an equipment list which is used for sharing the file to be downloaded and belongs to the same network outlet as the download equipment; the device list comprises at least one seed production device;

A screening module, configured to determine a number of network hops between each of the seed-making devices and the downloading device in the device list; comparing whether the number of network hops between each seed making device and the downloading device is smaller than or equal to the sharing level corresponding to the downloading device, wherein the sharing level is the number of intermediate nodes through which communication is carried out between the downloading device and the seed making device; determining the seed production equipment with the network hop count smaller than or equal to the sharing level as sharing equipment conforming to the sharing level corresponding to the downloading equipment;

and the downloading module is used for downloading the files to be downloaded from the sharing equipment and the file server when the sharing equipment is screened.

9. The apparatus of claim 8, wherein the acquisition module comprises:

the sending unit is used for sending a sharing equipment query request to the P2P server, wherein the sharing equipment query request comprises the file identification of the file to be downloaded;

the receiving unit is used for receiving the shared equipment information sent by the P2P server, wherein the shared equipment information is obtained by searching the P2P server in response to the shared equipment inquiry request based on the file identification of the file to be downloaded.

10. The apparatus of claim 8, wherein the screening module is further configured to establish a communication connection with each seed device separately; determining the number of nodes of intermediate nodes through which communication is performed with each seeding device; the number of nodes is determined as the number of network hops between the seed device and the download device.

11. The apparatus of claim 8, wherein the apparatus is further configured to obtain, from a master server, characteristic information of a file to be downloaded; sending a seed file query request to the P2P server, so that the P2P server responds to the seed file query request and queries the seed file of the file to be downloaded from a seed file library based on the characteristic information of the file to be downloaded; and receiving a query result of the P2P server in response to the seed file query request, wherein the query result is used for indicating whether the P2P server acquires the seed file of the file to be downloaded.

12. The apparatus of claim 11, wherein the apparatus is further configured to establish a first transmission channel with a file server when the query result indicates that a seed file of a file to be downloaded is not obtained; the file to be downloaded is received from the file server based on a first transmission channel with the file server.

13. The apparatus of claim 8, wherein the download module is further configured to establish a second transmission channel with the sharing device and a third transmission channel with the file server, respectively; downloading the file fragments based on the second transmission channel and the third transmission channel to obtain a plurality of file fragments; verifying each of the plurality of file fragments based on the seed file; and after each file fragment passes verification, combining the file fragments to obtain the file to be downloaded.

14. The apparatus of claim 8, wherein the apparatus is further configured to send address information of the downloading device and file information of the file to be downloaded to the P2P server, so that when the P2P server receives a sharing device query request sent by another device that is at the same network outlet as the downloading device, the downloading device is used as a sharing device conforming to the sharing hierarchy.

15. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor for implementing the complex network based file downloading method according to any of claims 1-7 when said program is executed.

16. A computer readable storage medium having stored thereon a computer program for implementing the complex network based file downloading method according to any of claims 1-7.