WO2007025474A1

WO2007025474A1 - Network communication system and method for downloading the file

Info

Publication number: WO2007025474A1
Application number: PCT/CN2006/002226
Authority: WO
Inventors: Haijun Wu; Bin Fang; Ye Zhu; Yang Song
Original assignee: Tencent Technology (Shenzhen) Company Limited
Priority date: 2005-09-02
Filing date: 2006-08-30
Publication date: 2007-03-08
Also published as: CN1925403A; CN100527672C

Abstract

A network communication system for downloading the file includes: connecting peer to peer (P2P) server, file server, file description (TPT) server and at least one client via a communication network; the said at least one client downloads the TPT file corresponding to the required file from the said TPT server via the said communication network, queries the seed information corresponding to the said file to the said P2P server, and downloads the required file from the other client regarded as seed in the said communication network and/or the said file server according to the downloaded TPT file. By the said network communication system and method of the invention, the download speed of the client in the communication network is not limited by the server capability and network bandwidth bottleneck. Even though there are a great number of clients which access the network at the same time, the download speed is not affected by it.

Description

Network communication system and method for realizing file download

Technical field

The present invention relates to the field of network communication technologies, and in particular, to a network communication system and method for implementing file downloading. Background of the invention

With the continuous development of communication networks, users can obtain more and more useful information from communication networks. Among them, file downloading is one of the main ways for users to obtain information from the communication network. At present, the client on the communication network can download the required data from the server through various communication protocols such as File Transfer Protocol (FTP) or Hypertext Transfer Protocol (HTTP). The principle is shown in Figure 1. In the picture

In 1, the client in the communication network, such as client A and client B, can directly communicate with the server through a communication protocol such as FTP or HTTP, and download the data required by the server. In this way, the sharing of data in the communication network can be realized, and the resources of the system are greatly saved.

The method for downloading data directly from the server by the client can effectively satisfy the downloading requirement of each client when the number of clients accessing the server is small at the same time, but is limited by the hardware processing capability of the server and the network bandwidth. When the number of clients accessing the server exceeds a certain number, the processing capacity and network bandwidth of the server will be bottlenecked, resulting in slower download speeds of each client, especially when users enjoy online multimedia services provided by the communication network, such as online. When listening to music or watching video programs online, the slowdown in download speed will directly affect the quality of service for online multimedia services. Summary of the invention

In order to solve the above technical problem, the present invention provides a network communication system and method for implementing file downloading, so that the download speed of the client in the communication network is not limited by the server processing capability and the network bandwidth bottleneck. Thus, even when the number of clients accessing the server at the same time is large, the speed at which users download files is not affected.

A further object of the present invention is to provide a method for downloading a file, so that the user can enjoy online multimedia services, such as listening to music online or watching videos online, and the like, which greatly satisfies the user's demand for online multimedia service quality.

The network communication system for implementing file downloading according to the present invention comprises: a peer-to-peer (P2P, Peer to Peer) server, a file server, a file description (TPT) server, and more than one client connected through a communication network.

The P2P server is configured to advertise a downloadable file to the one or more clients, and process a login and logout operation of the client through the communication network, and return the file to the client when the client downloads the file. The seed information corresponding to the file and the download configuration parameter; the file server is configured to store the file provided for downloading by the client;

The TPT server is configured to store a TPT file corresponding to the file downloaded by the client;

The one or more clients download the TPT file corresponding to the required file from the TPT server through the communication network, and query the P2P server for other client information and download configuration parameters of the file that has been downloaded in the communication network. And downloading the required files from the other client and/or the file server according to the TPT file and download configuration parameters.

The method for implementing file downloading according to the present invention includes:

After selecting the file to be downloaded, the client downloads the TPT file corresponding to the file corresponding to the file according to the selected file name to the TPT server;

The client queries the peer P2P server according to the file identifier to correspond to the file. Seed information; the client information is returned to the client as seed information corresponding to the file;

The client establishes a connection with the clients according to other client information returned by the P2P server, and exchanges the fragmentation data of the required files from the clients.

It can be seen that the network communication system and method of the present invention combines the peer P2P technology with the existing download method, so that the client can directly download the required file directly from other clients in the communication network. In this way, on the one hand, it can save a lot of server and bandwidth consumption, on the other hand, it can speed up the downloading of data by the client, thereby greatly enhancing the user experience.

In addition, the method of the present invention can download the required fragment data directly from the file server while downloading the fragment data from other clients, so as to ensure the continuity of the fragment data downloaded from the communication network. And orderly, to achieve online multimedia services, but also to avoid the problem of slow download speed in the case of fewer seeds.

Furthermore, the method of the present invention provides accurate information for the seed management of the P2P server by recording the network type or firewall type of all the seeds that have downloaded the same file in the file grouping list, and can download according to the current seed management. The client type of the file selects the optimal seed for the client, further ensuring the download speed of the client. BRIEF DESCRIPTION OF THE DRAWINGS

1 is a schematic diagram of a client downloading data from a server in an existing network communication system; FIG. 2 is a schematic diagram of a client downloading data from a server in a network communication system according to a preferred embodiment of the present invention;

FIG. 3 is a flowchart of a method for implementing multimedia file downloading according to a preferred embodiment of the present invention; Mode for carrying out the invention

The present invention will be further described in detail below with reference to the accompanying drawings and embodiments.

In a preferred embodiment of the present invention, a peer-to-peer Internet technology P2P technology is combined with a file downloading technology, and a mode in which a client downloads data from a single server is changed to a download mode in which data is directly exchanged between clients, thereby A bug that limits the number of clients that simultaneously download files due to server processing bottlenecks.

In addition, in this embodiment, by dividing a file with a large capacity into pieces, the file is divided into several parts, so that the client can simultaneously download different fragments of the same file from multiple clients or file servers in the communication network, and can further Guarantee the download speed of the client. At the same time, since the client that needs to download data can directly download data from other clients in the communication network, the more the number of clients simultaneously downloading data in the communication network, the more concentrated the distribution, and the more effective the data interaction between them is. Ok, so you can greatly increase the download speed of the data.

Based on the above idea, the embodiment provides a network communication system. As shown in FIG. 2, the network communication system mainly includes: a P2P server, a file server, a TPT server, and more than one client. The P2P server, the TPT server, and the file server are respectively connected to the one or more clients through a communication network, so as to implement information interaction between the client and the P2P server, the TPT server, and the file server; each client in the communication network The terminal is also connected to other clients through a communication network to implement data exchange between clients.

The P2P server is mainly responsible for issuing a downloadable file, and processing, by the communication network, a request for login, logout, download, query seed, heartbeat maintenance, and the like of the client; the file server is configured to store a file that is provided for download by the user;

The TPT server is configured to store a TPT file corresponding to each file that is provided for download by the user; The one or more clients download the file corresponding to the required file from the TPT server through the communication network, and download the required file from other clients and/or file servers in the communication network according to the downloaded file. Each piece of data.

During the file downloading process, the client in the communication network can download the TPT file from the TPT server through HTTP, FTP or other various communication methods, and download the fragment data of the required file from the file server, or transmit the data. The Control Protocol (TCP) or User Datagram Protocol (UDP) downloads the individual fragmentation data of the required files from other clients in the communication network.

In the process of downloading the file through the network communication system, the client first needs to select a file to be downloaded from the file published by the P2P server; then, download the TPT file corresponding to the file from the TPT server, and obtain relevant information of the file from the TPT server. For example, the file identifier of the file identifies the FileID, the number of fragmentation data, and the size of each fragmentation data, etc.; next, according to the related information, the P2P server is queried for other client information that is online and downloaded, that is, to the P2P. The server queries the seed; after obtaining the seed, the client downloads the fragment data of the file from the queried seed, and at the same time, in order to ensure the continuity and order of each fragment data of the downloaded file, the client also The required fragmentation data can be downloaded from the file server at the same time.

The method of implementing file downloading of the present invention will be described in detail below through specific embodiments. As shown in FIG. 3, the file downloading method of the present invention specifically includes the following steps:

A. Pre-release the files provided to the user for download on the P2P server, file server, and TPT server.

The release described in this step mainly includes:

First, a TPT file of each file is created according to a file to be downloaded to the user, and the created TPT file is uploaded to the TPT server;

Then, uploading the file provided to the user for uploading to the file server; Finally, the file to be downloaded to the user is published on the P2P server for the user to download and query through the client.

The TPT file mainly includes the file identifier File1D corresponding to the TPT file, the number of fragmented data of the file, the size of each fragment data, the check value of each fragment data, and the TPT file itself. Check value and version number, etc.

The number of fragmented data and the size of the fragment of the file are determined by the size of the file corresponding to the TPT file and the type of service actually selected by the user. For example, if the music service is listened to online, the size of the fragmented data is usually 16K bytes, at this time, the number of fragmented data of the file is equal to the file size and the quotient of 16K bytes, and if the video service is online, the size of the fragmented data is usually 50K bytes, and the fragment of the file at this time The number of data is equal to the file size and the quotient of 50K bytes.

In addition, the file identifier File1D is a check value obtained by verifying the file name of the file, where the file identifier FileID, the check value of each fragment data, or the check value of the TPT file are used. The verification algorithm can be a variety of commonly used verification algorithms, such as Hash operations and the like. For example, in a preferred embodiment of the present invention, the file identifier File1D is a 32-bit integer value obtained after the HASH operation of the file name of the corresponding file.

B. When the user selects a file to be downloaded from the published file through the client, the client downloads the TPT file corresponding to the file according to the file name to be downloaded to the TPT server;

After downloading the TPT file, the client may further parse the TPT file and verify the correctness of the downloaded TPT file. If the check is correct, proceed to step C. Otherwise, the user is prohibited from downloading the file and ending. .

Here, the check is: Verify that the format and version of the TPT file are correct.

The checking may further include adopting a corresponding verification method, such as a HASH operation, The TPT file itself is verified.

C. The client logs in to the P2P server, and the P2P server returns a unique user identifier (UIN) to the client.

The UIN in the step is sequentially selected by the P2P server within a preset value range, and the value range is related to the maximum number of online users that the P2P server can support. For example, if a P2P server can have up to 100,000 online users, The value of UIN can range from 1 to 100,000.

D. After obtaining the UIN, the client sends a download request to the P2P server according to the file selected by the user, and carries the UIN of the client and the FileID of the file to be downloaded in the download request.

E. The P2P server checks whether the UIN of the client and the FilelD of the file to be downloaded are correct, and checks whether the file has been published. If UIN and FilelD are correct and the file has been published, step F is performed; otherwise, the client is notified that the file cannot be Download the file and finish.

In this step, the P2P server checks whether the FilelD of the file to be downloaded is correct. The method of comparing the 32-bit integer value obtained by the HASH operation of the file name of the file to be downloaded is compared with FilelD. If the same, the verification is correct, otherwise the test is not performed. correct.

F. The P2P server adds the UIN of the client to the file grouping list corresponding to the file, and returns the download configuration parameter corresponding to the file to the client.

The file grouping list is to sort all the clients that have downloaded the published file, and the P2P server associates the information of all the clients that download the same file with the file, and associates the same file with the same file. All client information is recorded in the file group list corresponding to the file for the client to query. The client information includes: a client address, a network type of a network where the client is located, or a firewall type.

The download configuration parameters corresponding to the file in the step mainly include: the number of threads started during download, the maximum speed limit/minimum speed limit for each thread uploading and downloading, the P2P upload speed limit, P2P Download the speed limit, the maximum number of connected clients, the interval between querying seeds, and the speed at which P2P downloads can be reduced. The download speed from the file server and the speed at which the P2P download arrives can increase the download speed from the file server and the P2P upload limit. Speed percentage and so on.

The above configuration parameters are determined by the configuration file of the P2P server. The configuration file usually includes two types: default configuration and special configuration. The default configuration includes common configuration parameters for all files, and the special configuration only includes Special configuration parameters for some individual files. If the published file does not have a corresponding special configuration file, the P2P server returns the default configuration parameters to the client. If there is a corresponding special configuration file, the P2P server returns the default configuration parameters together with the special configuration parameters to the client. It should be noted that all configuration files of the P2P server can be dynamically updated, that is, they can be modified or updated while the P2P server is running.

G. After receiving the download configuration parameter corresponding to the file, the client sends its own UIN and FilelD of the file to be downloaded to the P2P server, and queries the P2P server for other client information for downloading the file, that is, queries the P2P server for the seed.

When sending the query seed request, the client may further send the network type or firewall type of the client to the P2P server, and request the P2P server to query other client information having the same network type in the same group according to the network type of the client.

H. The P2P server returns information of other clients in the file group list corresponding to the file according to the UIN and FilelD from the client, that is, returns other seed messages to the client. If the client queries the seed, the client includes the network of the client. Type, the P2P server will further return the firewall-free public network or the client information with the corresponding firewall type to the client according to the network type or firewall type of the client, and return some other types of client information. In this way, the connectivity between the client and the seeds for data interaction is high, and the speed of data transmission will be faster. I. The client attempts to establish a connection with the seed, and queries whether the file or the fragmentation data of the file exists in the seed, and if so, according to the TPT file and the obtained download configuration parameter The seed exchange data, and each piece of data of the file to be downloaded is obtained.

In this step, the client will exchange the required fragment data from the seed by TCP/UDP.

After switching to each fragment data, the client further checks the exchanged fragment data according to the check value of each fragment data parsed from the TPT file downloaded in step B, if the verification If correct, the fragment data is received; otherwise, the fragment data is discarded.

In this step, since the slice data exchanged from the respective seeds is randomly arranged, in order to obtain a complete file, the client also needs to recombine the exchanged slice data into the files to be downloaded in order.

It can be seen from the above process that after adopting P2P technology, the bottleneck problem of the server can be effectively solved, and at the same time, since all online clients share the files downloaded by themselves to other clients of the communication network, communication under normal conditions is There will be enough seeds in the network, and the more clients download the same file, the more concentrated the distribution, the better the data interaction between them, so that one server can support a large number of users to download at the same time, and Can guarantee the download speed of all users.

In addition, by recording the network type or firewall type of all the seeds that have downloaded the same file in the file grouping list, accurate information is provided for the seed management of the P2P server, and the type of the client according to the current file to be downloaded may be The client selects the optimal seed to further guarantee the download speed of the client.

However, since the fragment data exchanged by the above method is randomly arranged, only the client can obtain a correct and complete file after downloading all the fragment data of the file, which is to be a general file download service. Acceptable, but this will give the online multimedia industry For example, listening to music online or watching video programs online brings a large delay and affects the user experience.

Therefore, in a preferred embodiment of the present invention, in order to ensure the continuous ordering of the data fragments downloaded by the client, the client performs the fragment data exchange with the seed, and

The download configuration parameters returned by the P2P server start a common HTTP or FTP download mode, download the required fragment data from the file server, and ensure the continuity and order of the downloaded data fragments by the client through a certain algorithm and communication mechanism. .

For example, in the process of listening to music online, for the music being used for listening, if the music file has not been downloaded completely, the client of the user will preferentially use the HTTP download method to obtain the music playing process from the file server. The required music file fragmentation data, at the same time, for the music files that have not been played or the fragmentation data of the music files, can still be downloaded by P2P download.

The above download method not only speeds up the downloading process, but also reduces the load of the file server, and at the same time ensures the continuous ordering of the downloaded files.

The proportion of the client downloading the fragmented data from the file server is controlled by the download configuration parameter returned by the P2P server, and can be dynamically adjusted according to the actual situation, thereby ensuring that in most cases, most of the fragmented data is passed through Client exchanges are obtained, which can save a lot of server bandwidth resources.

The method described in the above preferred embodiment can support a large number of users to enjoy online multimedia services at the same time, such as listening to music online, or watching video programs online, which greatly satisfies the user's demand for online multimedia service quality.

In the method of the present invention, in order to maintain the connection between the client and the P2P server, once the client logs in to the P2P server, the heartbeat signal is sent to the P2P server periodically, and the P2P server also periodically detects from all the logged in. If the heartbeat signal of the client does not receive the heartbeat signal, the corresponding client is kicked out and the resources allocated for the client are released. Source, and remove the client information from the associated file grouping list.

In addition, after the online multimedia service ends, for example, after the user listens to the music or watches the video program, the client sends a logout request to the server, and then voluntarily quits. After receiving the Logout request from the client, the P2P server releases the resources allocated for the client and deletes the client information from the related file group list.

Claims

Claim

A network communication system for implementing file downloading, characterized in that the network communication system comprises: a peer-to-peer Internet technology P2P server, a file server, a file description TPT server and more than one client connected to each other through a communication network;

The network communication system according to claim 1, wherein the one or more clients download the TPT file corresponding to the required file from the TPT server through the Hypertext Transfer Protocol HTTP or the File Transfer Protocol FTP.

The network communication system according to claim 1 or 2, wherein the one or more clients download the required files from other clients in the communication network through the Transmission Control Protocol TCP or the User Datagram Protocol UDP. Or download the required files from the file server via HTTP or FTP.

A method for downloading a file, the method comprising: after selecting a file to be downloaded, the client downloads the file corresponding to the file according to the selected file name to the file description, and includes the file The TPT file identified by the file; The client queries the peer P2P server for the seed information corresponding to the file; the client information is returned to the client as the seed information corresponding to the file;

The method according to claim 4, wherein the selecting the file to be downloaded comprises:

Make a TPT file corresponding to each file according to the file to be downloaded to the client, and upload the created TPT file to the TPT server;

Upload the file provided to the client for upload to the file server;

The file to be downloaded to the client is published on the P2P server for the client to download and query.

The method according to claim 4, further comprising: before querying the seed information corresponding to the file, further comprising:

The client logs in to the P2P server to obtain the user identifier of the client; the P2P server adds the client to the file grouping list corresponding to the file identifier according to the user identifier.

The method according to claim 4, wherein the TPT file further includes a number of pieces of data of the corresponding file, a size of each piece of data, a check value of each piece of data, and the TPT. The check value and version number of the file;

After the client downloads the TPT file, the method further includes: checking whether the format and version of the downloaded TPT file are correct, and if the check is correct, continuing to perform the operation of querying the seed information corresponding to the file; otherwise, the user is prohibited from downloading the file and End;

After the client exchanges data from other clients in the communication network to the fragmented data, further roots The switched fragment data is verified according to the check value of each fragment data, and if the verification is correct, it is received; otherwise, the fragment data is discarded.

8. The method according to claim 7, wherein the verification uses a hash HASH operation.

The method according to claim 4, further comprising: after the client queries the P2P server for the seed information corresponding to the file, further comprising:

The P2P server verifies that the user identifier of the client and the file identifier of the file to be downloaded are correct, and checks whether the file has been advertised. If the client identifier and the file identifier are correct and the file has been advertised, the P2P server returns The seed information corresponding to the file; otherwise, the notification client cannot download the file and ends.

The method according to claim 9, wherein the file identifier of the file to be downloaded is correct: a 32-bit integer value obtained by HASH operation of the file name of the file to be downloaded and the file The indicators are compared. If they are the same, the test is correct, otherwise the test is incorrect.

The method according to claim 4, wherein when the client requests the seed information corresponding to the file to the P2P server, the network type or firewall type of the client is further sent to the P2P server;

When returning the seed information corresponding to the file, the P2P server further sends the client information with the same network type or firewall type in the file grouping list to the client according to the network type or firewall type of the client. Said client.

The method according to claim 4, wherein, when returning the seed information corresponding to the file, the P2P server further returns a download configuration parameter of the file corresponding to the file to the client;

Each piece of fragmentation data of the file required for the exchange is: the client exchanges the pieces of the required file from the other client according to the download configuration parameter returned by the P2P server. Data.

The method according to claim 12, wherein the downloading configuration parameter is determined by a configuration file of the P2P server, and mainly includes: the number of threads started when downloading, and the maximum uploading and downloading of each thread. Speed limit/minimum speed limit, P2P upload speed limit, P2P download speed limit, maximum number of connected clients, query seed interval, and speed of P2P download arrival can reduce the speed of download from the file server, P2P download arrival At what speed, the speed of downloading from the file server and the percentage of P2P upload speed limit can be increased.

The method according to claim 4, wherein after the client exchanges all the fragment data, the method further comprises: reorganizing the exchanged fragment data into the file to be downloaded in order.

The method according to claim 13, wherein the client further downloads the required fragment data from the file server while performing the fragment data exchange with the other client.

The method according to claim 4, wherein the method further comprises:

After the client logs in to the P2P server, the heartbeat signal is sent to the P2P server periodically. The P2P server periodically detects the heartbeat signal from all the logged-in clients. If the heartbeat signal is not received after the timeout, the corresponding client is kicked out. The client allocates resources and removes the client information from the associated file grouping list.

The method according to claim 4 or 6, wherein the method further comprises: after receiving the exit request from the client, the P2P server releases the resource allocated for the client, and lists the related file from the group Delete the client information.