WO2007143939A1

WO2007143939A1 - Distributed storage network and data distributed storage method

Info

Publication number: WO2007143939A1
Application number: PCT/CN2007/070061
Authority: WO
Inventors: Liang Liang
Original assignee: Huawei Technologies Co., Ltd.
Priority date: 2006-05-29
Filing date: 2007-05-29
Publication date: 2007-12-21
Also published as: CN101083600A

Abstract

A distributed storage network and a data distributed storage method is provided, wherein, the distributed storage network comprises a data provision server for providing data for user terminal; and a user access equipment for accessing the user to the network, and the user access equipment comprises a storage unit for storing the data transmitted to the user terminal; a data play control server for transmitting the data from the data provision server or the user access equipment or the other user terminals to the user terminal upon the user terminal's request. As a result of centralized control by the data play control server, the invention enables the data store in the network equipments in distributed manner, and ensures the efficiency and security for data storage and transmission.

Description

Description Method for distributed storage network and data distribution storage

[1] Technical field

[2] The present invention relates to the field of network data storage technologies, and in particular, to a method for implementing a distributed storage network and data distribution storage.

[3] Background of the invention

[4] In recent years, with the development of network technology, the data storage technology in the network has also been rapidly developed. The data is stored on the network in order to make it easy for network users to access the data.

[5] A network data storage method in the prior art is: storing data on a specific server in the network, a network user who needs to obtain the data, and a request to be sent to the server, and the server adopts HTTP (Hyper) Text Transfer Protocol, Hypertext Transfer Protocol) or FTP (File Transfer

Protocol, such as Protocol, File Transfer Protocol, sends data to the above network users.

[6] In the process of implementing the present invention, the inventor found that the above network data storage method has the following defects: [7] 1. Since the data needs to be sent to each network user in a centralized manner by the server, the server can be limited by the bandwidth capacity of the server. At the same time, the number of network users accommodated is very limited, and when there are many network users, the bandwidth allocated by the server to each network user is very small, which is not conducive to quickly sending data from the server to the network user;

[8] 2. After the network user sends a request to the server through the uplink bandwidth, the server sends the data to the network user through the downlink bandwidth. The data traffic transmitted by the downlink bandwidth is often saturated, but the data traffic of the uplink bandwidth is rarely. Therefore, there is a defect that the uplink bandwidth is seriously wasted in the network.

[9] Another network data storage method in the prior art is: storing data in a distributed storage manner of a network server and a network user, such as BT download data technology, that is, a kind of distributed data storage Application example, SP: The data is stored on the server in the network, or on the network user who has obtained the data through the request. Other network users can obtain data from the server or the network user storing the relevant data through the BT application software. At the same time, the network user can also provide the acquired data to other network users. Although this technology breaks through the bandwidth limitation of the server to a certain extent, it makes the network use Users can get data faster, and the upstream and downstream bandwidths are relatively fully utilized.

[10] In the process of implementing the present invention, the inventors have found that the other network data storage method described above still has the following drawbacks:

[11] 1. Network users who need to obtain data at the same time and provide data to other network users need to install specific software, which adds obstacles to the wider and wider network users joining this distributed data storage network.

[12] 2. Because network servers cannot centrally control the data stored and transmitted in the network, it poses severe challenges for data validity, data security and even intellectual property rights.

[13] Summary of the invention

[14] An object of the embodiments of the present invention is to provide a distributed storage network and a data distribution storage method, so as to realize distributed storage of data in a network, and can centrally control data propagation in a network through a server as data. Safety brings security.

[15] The purpose of the embodiment of the present invention is achieved by the following technical solutions:

[16] A distributed storage network, comprising:

[17] a data providing server for providing data to a user terminal;

[18] a network device, comprising a storage unit, for storing data that can be provided to the user terminal;

[19] The data broadcast control server is configured to control, according to the request of the user terminal, to send data from the data providing server or the network device or other user terminal to the user terminal.

[20] A network device, comprising: a storage unit, configured to store data that can be provided to a user terminal; and send data to the user terminal according to a control command of the data broadcast control server.

[21] A server comprising:

[22] The scheduling control module is configured to control, according to the request of the user terminal, the data corresponding to the request to be sent from the data providing server or the network device or other user terminal to the user terminal.

[23] A method for data distribution storage, storing data provided for a user terminal in a data providing server, the method comprising:

[24] The data broadcast control server controls, according to the request for obtaining data sent by the user terminal, the data providing server to send corresponding data to the user terminal that sends the request;

[25] storing the data sent to the user terminal on at least one of the user terminal and the network device [26] It can be seen from the technical solutions provided by the foregoing embodiments of the present invention that, compared with the prior art, the embodiment of the present invention centrally controls the storage of data and the propagation of data in the network through the data broadcast control server, for data storage, The effectiveness of communication and data security provide protection.

[27] BRIEF DESCRIPTION OF THE DRAWINGS

1 is a schematic diagram of a specific embodiment of a distributed storage network according to an embodiment of the present invention;

2 is a schematic diagram of another specific embodiment of a distributed storage network according to an embodiment of the present invention; [30] FIG. 3 is a schematic flowchart of a specific embodiment of a data distribution and storage method according to an embodiment of the present invention; ;

4 is a flow chart showing another embodiment of a method for data distribution storage disclosed in an embodiment of the present invention.

[32] Mode for carrying out the invention

[33] The embodiment of the present invention discloses a distributed storage network, which stores data distributed to a user terminal in a storage unit of each network device, and centrally schedules and controls data stored in each storage unit through a data broadcast control server. The data corresponding to the request of the user terminal is sent to the user terminal by the data providing server or the user access device or other user terminals in the network.

FIG. 1 is a schematic diagram of a specific embodiment of a distributed storage network according to an embodiment of the present invention. The distributed storage network includes the following units:

[35] The data providing server 110 is configured to provide data for the user terminal 140, and the data may be in a streaming media format, or other data segments that are easy to save, and are not limited thereto.

[36] The data broadcast control server 120 is configured to control the data providing server 110 or send data from the user access device 130 or other user terminal to the user terminal 140 according to the request of the user terminal 140 for obtaining data;

[37] The user access device 130 is configured to access the user terminal 140 to the distributed storage network, and the user access device 130 includes a storage unit for storing by the data providing server 110 or from another user. Data sent to the user terminal 140 by the device 130 or other user terminal.

[38] The user terminal 140 is configured to send a request for obtaining data, and receive data returned by the data providing server 110 or the user access device 130 or other user terminals. Including a storage unit for storing the number of its reception According to.

[39] The data broadcast control server 120 specifically includes:

[40] The data link module 121 is configured to establish, according to the data saved on the data providing server 110, a data link point selected for the user terminal 140, and store the data link point and the user access point. The data in the storage unit of the device 130 or other user terminal establishes a mapping relationship, that is, the user terminal 140 can select data corresponding to the data link point from the data providing server 1 10 or from the user access device by selecting the data link point. 130 or other user terminal sends to the user terminal 140.

[41] The scheduling control module 122 is configured to control, according to a preset algorithm, the data corresponding to the data link point to be accessed from the data providing server 110 or from the user according to a preset algorithm according to a data link point selected by the user terminal 140. The device 130 or other user terminal transmits to the user terminal 140.

[42] The data security module 123 is configured to perform data verification and encryption processing on data that needs to be sent to the user terminal 140.

[43] Moreover, the data security module 123 specifically includes:

[44] An encryption submodule for encrypting data that needs to be sent to the user terminal.

[45] The information extraction submodule is configured to extract feature information in the data sent from the data providing server to the user terminal according to a preset rule, and save the feature information.

[46] a judging sub-module, configured to determine whether feature information of data in the storage unit from the user access device or other user terminal that needs to be sent to the user terminal is related to a feature saved in the data security module 123 The information is consistent. If it is consistent, it indicates that the data is valid data; otherwise, it indicates that the data is invalid data, the data security module 123 discards the data, and the data broadcast control server 120 controls the data corresponding to the request to be provided by the data. The server 110 transmits to the user terminal.

[47] As can be seen from the above, the data is initially stored in the data providing server 110. After the user terminal 140 acquires data according to the request in the distributed storage network, the data corresponding to the request is saved in the user access device 130 or In the user terminal 140; when other user terminals request the data, the data broadcast control server 120 dynamically schedules according to a preset algorithm, and sends data to the request from the data providing server 110 or the user access device 130 or the user terminal 140 by the proximity principle. The user terminal reduces the bandwidth limitation of the data providing server 110 transmitting data to several user terminals at the same time, and improves the convenience of the user terminal to acquire data.

[48] In addition, the data sent to the user is encrypted and the data is validated by the data security module 123. It is verified that the user terminal receiving the data can decrypt the data according to its own characteristics, so as to ensure that the data is distributed and controlled by the data broadcast control server 120 to each user terminal, thereby preventing the random diffusion of data, and the copyright of the data in the network. Fees, etc. bring a viable solution.

FIG. 2 is a schematic diagram of another specific embodiment of a distributed storage network according to an embodiment of the present invention. Compared with the specific embodiment shown in FIG. 1, in this embodiment, the data broadcast control server 120 adopts a distributed hierarchical structure, that is, the data broadcast control server 120 includes a plurality of distributed data broadcast function modules 125, and the data broadcast The function module 125 is as close as possible to the user terminal 140 to hierarchically share the processing tasks of the data broadcast control server 120. For example, the data broadcast function module 125 is connected to the user access device 130, and may also be connected to the network transport layer, or even the data broadcast function. The module 125 can be integrated in the user access device 130, and is not limited thereto.

[50] The data broadcast function module 125 includes -

[51] a data link sub-module, configured to map data stored in the user access device 130 and the storage unit of the user terminal 140 with data in the data providing server 110;

[52] a scheduling control sub-module, configured to control sending data from the user access device 130 or from the user terminal 140 to a user terminal requesting the data;

[53] A data security sub-module, configured to perform data verification and encryption processing encryption on data sent to the user terminal 140.

The data broadcast function module 125 has a similar functional structure to the data broadcast control server 120, and may be a sub-server of the data broadcast control server 120, and will not be described in detail herein.

[55] This embodiment is to speed up the data propagation speed in the distributed storage network by using the distribution grading subsystem for the data broadcast control server 120 to hierarchically process the tasks of the data broadcast control server 120.

In addition, the embodiment of the present invention further discloses a data distribution storage method, which is used for storing data distributed from a data providing server in a network device, so that the user terminal can conveniently acquire the data.

FIG. 3 is a process flow of a specific example of a method according to an embodiment of the present invention, including the following implementation steps.

[58] Step s310: The data providing server stores a plurality of data that can be provided to the user terminal;

[59] Step s320: establishing data stored on the server according to the data, and establishing on the data broadcast control server The data link point selected by the user terminal, the user terminal can request to obtain the data corresponding to the data link point on the data providing server by selecting the data link point;

[60] Step s330: The user terminal accesses the data broadcast control server through the network access provided by the user access device, obtains the data link point information established above, and selects a corresponding data link point according to the data acquired.

[61] Step s340: The data broadcast control server extracts feature information of data corresponding to the data link point selected by the user terminal, and saves the feature information in the data broadcast control server;

[62] Step s350: The data broadcast control server controls the data providing server to encrypt the data corresponding to the data link selected by the user terminal;

[63] Step s360: The data broadcast control server controls the data providing server to send the encrypted data to the user terminal;

[64] Step s370: Store data sent to the user terminal in the user access device or the user terminal;

[65] Step s380: The data stored in the user access device or the user terminal is mapped to the data stored in the data providing server, that is, the data and data stored in the user access device or the user terminal are broadcasted. The data link points in the control server establish a mapping relationship.

[66] According to the process shown in FIG. 3, the data broadcast control server sends the data on the data providing server to the user terminal according to the request of the user terminal, and saves the data in the user who provides network access for the user terminal. The access device or the user terminal that receives the data realizes that the data distribution is stored to the user access device or the user terminal.

[67] After the data distribution is stored in the user access device or the user terminal by using the processing flow shown in FIG. 3, other user terminals may further distribute the data to other user access devices or by requesting the data. Other user terminals.

4 is a process flow of another specific example of the method according to the embodiment of the present invention, which includes the following implementation steps:

[69] Step 410: The user terminal logs in to the data broadcast control server through its corresponding user access device, and selects a data link point corresponding to the data to be acquired, where the foregoing step s380 has been established on the data broadcast control server. The data link point selected by the user terminal, that is, the data link point on the data broadcast control server corresponds to the data on the data providing server, the user access device, and the user terminal; [70] Step 420: The data broadcast control server extracts feature information of the data corresponding to the data link point from the user access device or other user terminal according to the data link point selected by the user terminal.

[71] Step 430: The data broadcast control server compares the extracted feature information with the feature information stored in the data broadcast control server through the foregoing step s340, if the feature information is consistent, then proceeds to step 440, otherwise proceeds to step 480;

[72] Step 440: The data broadcast control server encrypts the data corresponding to the data link point on the user access device or other user terminal;

[73] Step 450: The data broadcast control server controls the user access device or other user terminal to send the encrypted data to the user terminal that selects the data link point;

[74] Step 460: The data sent to the user terminal is stored in the user terminal that selects the data link point and the corresponding user access device;

[75] Step 470: A mapping relationship between the data stored in the user terminal and the corresponding user access device of the selected data link point and the data stored in the data providing server;

[76] Step 480: The data broadcast control server discards the data, and the control data providing server sends the data corresponding to the data link point selected by the user terminal to the user terminal of the selected data link point, and proceeds to step 460.

[77] In summary, the embodiment of the present invention has the following advantages compared with the prior art:

[78] 1. Since the embodiment of the present invention centrally controls the storage of data and the propagation of data in the network through the data broadcast control server, the embodiment of the present invention provides protection for data storage, propagation effectiveness, data security, and the like. ;

[79] 2. The network device that joins the network, for example, the user access device and the user terminal, can store data and provide data for other user terminals accessing the network. Therefore, the embodiment of the present invention can be larger. A wider range of data distribution storage;

[80] 3. Since the data is stored in each network device in the embodiment of the present invention, the data can be provided to other user terminals through the centralized control of the data broadcast control server. Therefore, the embodiment of the present invention can substantially overcome the bandwidth of the data. Limit, and can make full use of the uplink and downlink bandwidth resources in the network.

The above description is only a preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think of within the technical scope disclosed by the present invention. Changes or substitutions are intended to be included within the scope of the invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

Claim

[1] 1. A distributed storage network, comprising:

a data providing server, configured to provide data for the user terminal;

a network device, including a storage unit, configured to store data that can be provided to the user terminal; and a data broadcast control server, configured to control, according to the request of the user terminal, to send data from the data providing server or the network device or other user terminal to the user terminal.

[2] 2. The distributed storage network according to claim 1, wherein the data broadcast control server comprises:

a data link module, configured to provide data connection establishment on the data providing server to the data link point of the user terminal selection request, and establish a mapping relationship between the data link point and the data stored in the storage unit of the network device or other user terminal;

And a scheduling control module, configured to control, according to the request of the user terminal, the data corresponding to the request to be sent to the user terminal from a data providing server or a network device or another user terminal.

[3] The distributed storage network of claim 2, wherein the data broadcast server further comprises:

A data security module is configured to encrypt data sent to the user terminal.

[4] The distributed storage network according to claim 3, wherein the data security module comprises:

An encryption submodule, configured to encrypt data sent to the user terminal;

An information extraction submodule, configured to extract feature information of the data;

The determining submodule is configured to determine whether the feature information of the data in the storage unit of the network device or the other user terminal is the same as the feature information of the corresponding data in the data security module.

[5] The distributed storage network according to claim 1 or 2 or 3 or 4, wherein the data broadcast control server comprises at least one data broadcast function module, configured to implement distribution of the data broadcast control server. Hierarchical management.

[6] 6. A network device, comprising: a storage unit, configured to store data that can be provided to a user terminal; and send data to the user terminal according to a control command of the data broadcast control server.

[7] 7. The network device according to claim 6, wherein the type of the network device comprises: By device, gateway.

[8] 8. A server, comprising:

[9] The server according to claim 8, wherein the server further comprises: a data link module, configured to provide data establishment on the data providing server to the data link point of the user terminal selection request, and The data link point is mapped to data stored in a storage unit of a network device or other user terminal.

[10] The server according to claim 8 or 9, wherein the server further comprises: a data security module, configured to perform encryption processing on data sent to the user terminal.

[11] The server according to claim 10, wherein the data security module comprises an encryption submodule, configured to encrypt data sent to the user terminal;

[12] 12. A method for data distribution storage, characterized in that data provided for a user terminal is stored in a data providing server, the method comprising:

The data broadcast control server controls the data providing server to send corresponding data to the user terminal that sends the request according to the request for obtaining data sent by the user terminal;

And storing the data sent to the user terminal on at least one of the user terminal and the network device.

[13] The method of data distribution storage according to claim 12, wherein the method further comprises:

According to the data saved on the data providing server, a data link point provided to the user terminal is established on the data broadcast control server, and the data link point is mapped with the data stored on the user terminal and the network device.

[14] 14. The data distribution storage method according to claim 13, wherein the data The step of the broadcast control server transmitting the corresponding data to the user terminal that sends the request according to the request for obtaining the data sent by the user terminal, specifically includes:

The user terminal logs in to the data broadcast control server, and selects a data link corresponding to the data to be acquired;

The data broadcast control server controls the data providing server or the network device or other user terminal to send corresponding data to the user terminal according to the data link point selected by the user terminal.

[15] The method of data distribution and storage according to claim 12 or 13 or 14, wherein the method further comprises:

The data broadcast control server controls the data providing server or the network device or other user terminal to encrypt the data, and then sends the data to the user terminal;

The data broadcast control server extracts feature information of data transmitted from the data providing server to the user terminal, and saves the feature information.

[16] The data distribution storage method according to claim 15, wherein the step of the data broadcast control server transmitting the corresponding data to the user terminal further comprises: the data broadcast control server Extracting, from the network device or other user terminal, feature information of data that needs to be sent to the user terminal, and comparing the extracted feature information with feature information of corresponding data stored on the data broadcast control server;

If the extracted feature information is consistent with the feature information of the corresponding data stored in the data broadcast control server, the data broadcast control server controls the user access device or other user terminal to encrypt the data, and then send the Giving the user terminal; otherwise, the data broadcast control server controls to acquire corresponding data from the data providing server and send the data to the user terminal according to the data link point selected by the user terminal.