WO2007143939A1 - Réseau à stockage réparti et procédé de stockage réparti de données - Google Patents
Réseau à stockage réparti et procédé de stockage réparti de données Download PDFInfo
- Publication number
- WO2007143939A1 WO2007143939A1 PCT/CN2007/070061 CN2007070061W WO2007143939A1 WO 2007143939 A1 WO2007143939 A1 WO 2007143939A1 CN 2007070061 W CN2007070061 W CN 2007070061W WO 2007143939 A1 WO2007143939 A1 WO 2007143939A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- data
- user terminal
- server
- broadcast control
- control server
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0653—Monitoring storage devices or systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
- G06F3/0605—Improving or facilitating administration, e.g. storage management by facilitating the interaction with a user or administrator
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/062—Securing storage systems
- G06F3/0623—Securing storage systems in relation to content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Definitions
- the present invention relates to the field of network data storage technologies, and in particular, to a method for implementing a distributed storage network and data distribution storage.
- a network data storage method in the prior art is: storing data on a specific server in the network, a network user who needs to obtain the data, and a request to be sent to the server, and the server adopts HTTP (Hyper) Text Transfer Protocol, Hypertext Transfer Protocol) or FTP (File Transfer
- Protocol such as Protocol, File Transfer Protocol, sends data to the above network users.
- the inventor found that the above network data storage method has the following defects: [7] 1. Since the data needs to be sent to each network user in a centralized manner by the server, the server can be limited by the bandwidth capacity of the server. At the same time, the number of network users accommodated is very limited, and when there are many network users, the bandwidth allocated by the server to each network user is very small, which is not conducive to quickly sending data from the server to the network user;
- Another network data storage method in the prior art is: storing data in a distributed storage manner of a network server and a network user, such as BT download data technology, that is, a kind of distributed data storage Application example, SP:
- the data is stored on the server in the network, or on the network user who has obtained the data through the request.
- Other network users can obtain data from the server or the network user storing the relevant data through the BT application software.
- the network user can also provide the acquired data to other network users.
- this technology breaks through the bandwidth limitation of the server to a certain extent, it makes the network use Users can get data faster, and the upstream and downstream bandwidths are relatively fully utilized.
- An object of the embodiments of the present invention is to provide a distributed storage network and a data distribution storage method, so as to realize distributed storage of data in a network, and can centrally control data propagation in a network through a server as data. Safety brings security.
- a distributed storage network comprising:
- a data providing server for providing data to a user terminal
- a network device comprising a storage unit, for storing data that can be provided to the user terminal;
- the data broadcast control server is configured to control, according to the request of the user terminal, to send data from the data providing server or the network device or other user terminal to the user terminal.
- a network device comprising: a storage unit, configured to store data that can be provided to a user terminal; and send data to the user terminal according to a control command of the data broadcast control server.
- a server comprising:
- the scheduling control module is configured to control, according to the request of the user terminal, the data corresponding to the request to be sent from the data providing server or the network device or other user terminal to the user terminal.
- a method for data distribution storage storing data provided for a user terminal in a data providing server, the method comprising:
- the data broadcast control server controls, according to the request for obtaining data sent by the user terminal, the data providing server to send corresponding data to the user terminal that sends the request;
- FIG. 1 is a schematic diagram of a specific embodiment of a distributed storage network according to an embodiment of the present invention
- FIG. 2 is a schematic diagram of another specific embodiment of a distributed storage network according to an embodiment of the present invention.
- FIG. 3 is a schematic flowchart of a specific embodiment of a data distribution and storage method according to an embodiment of the present invention.
- FIG. 4 is a flow chart showing another embodiment of a method for data distribution storage disclosed in an embodiment of the present invention.
- the embodiment of the present invention discloses a distributed storage network, which stores data distributed to a user terminal in a storage unit of each network device, and centrally schedules and controls data stored in each storage unit through a data broadcast control server.
- the data corresponding to the request of the user terminal is sent to the user terminal by the data providing server or the user access device or other user terminals in the network.
- FIG. 1 is a schematic diagram of a specific embodiment of a distributed storage network according to an embodiment of the present invention.
- the distributed storage network includes the following units:
- the data providing server 110 is configured to provide data for the user terminal 140, and the data may be in a streaming media format, or other data segments that are easy to save, and are not limited thereto.
- the data broadcast control server 120 is configured to control the data providing server 110 or send data from the user access device 130 or other user terminal to the user terminal 140 according to the request of the user terminal 140 for obtaining data;
- the user access device 130 is configured to access the user terminal 140 to the distributed storage network, and the user access device 130 includes a storage unit for storing by the data providing server 110 or from another user. Data sent to the user terminal 140 by the device 130 or other user terminal.
- the user terminal 140 is configured to send a request for obtaining data, and receive data returned by the data providing server 110 or the user access device 130 or other user terminals. Including a storage unit for storing the number of its reception According to.
- the data broadcast control server 120 specifically includes:
- the data link module 121 is configured to establish, according to the data saved on the data providing server 110, a data link point selected for the user terminal 140, and store the data link point and the user access point.
- the data in the storage unit of the device 130 or other user terminal establishes a mapping relationship, that is, the user terminal 140 can select data corresponding to the data link point from the data providing server 1 10 or from the user access device by selecting the data link point. 130 or other user terminal sends to the user terminal 140.
- the scheduling control module 122 is configured to control, according to a preset algorithm, the data corresponding to the data link point to be accessed from the data providing server 110 or from the user according to a preset algorithm according to a data link point selected by the user terminal 140.
- the device 130 or other user terminal transmits to the user terminal 140.
- the data security module 123 is configured to perform data verification and encryption processing on data that needs to be sent to the user terminal 140.
- the data security module 123 specifically includes:
- the information extraction submodule is configured to extract feature information in the data sent from the data providing server to the user terminal according to a preset rule, and save the feature information.
- a judging sub-module configured to determine whether feature information of data in the storage unit from the user access device or other user terminal that needs to be sent to the user terminal is related to a feature saved in the data security module 123 The information is consistent. If it is consistent, it indicates that the data is valid data; otherwise, it indicates that the data is invalid data, the data security module 123 discards the data, and the data broadcast control server 120 controls the data corresponding to the request to be provided by the data. The server 110 transmits to the user terminal.
- the data is initially stored in the data providing server 110.
- the data corresponding to the request is saved in the user access device 130 or In the user terminal 140; when other user terminals request the data, the data broadcast control server 120 dynamically schedules according to a preset algorithm, and sends data to the request from the data providing server 110 or the user access device 130 or the user terminal 140 by the proximity principle.
- the user terminal reduces the bandwidth limitation of the data providing server 110 transmitting data to several user terminals at the same time, and improves the convenience of the user terminal to acquire data.
- the data sent to the user is encrypted and the data is validated by the data security module 123. It is verified that the user terminal receiving the data can decrypt the data according to its own characteristics, so as to ensure that the data is distributed and controlled by the data broadcast control server 120 to each user terminal, thereby preventing the random diffusion of data, and the copyright of the data in the network. Fees, etc. bring a viable solution.
- FIG. 2 is a schematic diagram of another specific embodiment of a distributed storage network according to an embodiment of the present invention.
- the data broadcast control server 120 adopts a distributed hierarchical structure, that is, the data broadcast control server 120 includes a plurality of distributed data broadcast function modules 125, and the data broadcast
- the function module 125 is as close as possible to the user terminal 140 to hierarchically share the processing tasks of the data broadcast control server 120.
- the data broadcast function module 125 is connected to the user access device 130, and may also be connected to the network transport layer, or even the data broadcast function.
- the module 125 can be integrated in the user access device 130, and is not limited thereto.
- the data broadcast function module 125 includes -
- a data link sub-module configured to map data stored in the user access device 130 and the storage unit of the user terminal 140 with data in the data providing server 110;
- a scheduling control sub-module configured to control sending data from the user access device 130 or from the user terminal 140 to a user terminal requesting the data
- a data security sub-module configured to perform data verification and encryption processing encryption on data sent to the user terminal 140.
- the data broadcast function module 125 has a similar functional structure to the data broadcast control server 120, and may be a sub-server of the data broadcast control server 120, and will not be described in detail herein.
- This embodiment is to speed up the data propagation speed in the distributed storage network by using the distribution grading subsystem for the data broadcast control server 120 to hierarchically process the tasks of the data broadcast control server 120.
- the embodiment of the present invention further discloses a data distribution storage method, which is used for storing data distributed from a data providing server in a network device, so that the user terminal can conveniently acquire the data.
- FIG. 3 is a process flow of a specific example of a method according to an embodiment of the present invention, including the following implementation steps.
- Step s310 The data providing server stores a plurality of data that can be provided to the user terminal;
- Step s320 establishing data stored on the server according to the data, and establishing on the data broadcast control server The data link point selected by the user terminal, the user terminal can request to obtain the data corresponding to the data link point on the data providing server by selecting the data link point;
- Step s330 The user terminal accesses the data broadcast control server through the network access provided by the user access device, obtains the data link point information established above, and selects a corresponding data link point according to the data acquired.
- Step s340 The data broadcast control server extracts feature information of data corresponding to the data link point selected by the user terminal, and saves the feature information in the data broadcast control server;
- Step s350 The data broadcast control server controls the data providing server to encrypt the data corresponding to the data link selected by the user terminal;
- Step s360 The data broadcast control server controls the data providing server to send the encrypted data to the user terminal;
- Step s370 Store data sent to the user terminal in the user access device or the user terminal;
- Step s380 The data stored in the user access device or the user terminal is mapped to the data stored in the data providing server, that is, the data and data stored in the user access device or the user terminal are broadcasted.
- the data link points in the control server establish a mapping relationship.
- the data broadcast control server sends the data on the data providing server to the user terminal according to the request of the user terminal, and saves the data in the user who provides network access for the user terminal.
- the access device or the user terminal that receives the data realizes that the data distribution is stored to the user access device or the user terminal.
- Step 410 The user terminal logs in to the data broadcast control server through its corresponding user access device, and selects a data link point corresponding to the data to be acquired, where the foregoing step s380 has been established on the data broadcast control server.
- the data link point selected by the user terminal that is, the data link point on the data broadcast control server corresponds to the data on the data providing server, the user access device, and the user terminal;
- Step 420 The data broadcast control server extracts feature information of the data corresponding to the data link point from the user access device or other user terminal according to the data link point selected by the user terminal.
- Step 430 The data broadcast control server compares the extracted feature information with the feature information stored in the data broadcast control server through the foregoing step s340, if the feature information is consistent, then proceeds to step 440, otherwise proceeds to step 480;
- Step 440 The data broadcast control server encrypts the data corresponding to the data link point on the user access device or other user terminal;
- Step 450 The data broadcast control server controls the user access device or other user terminal to send the encrypted data to the user terminal that selects the data link point;
- Step 460 The data sent to the user terminal is stored in the user terminal that selects the data link point and the corresponding user access device;
- Step 470 A mapping relationship between the data stored in the user terminal and the corresponding user access device of the selected data link point and the data stored in the data providing server;
- Step 480 The data broadcast control server discards the data, and the control data providing server sends the data corresponding to the data link point selected by the user terminal to the user terminal of the selected data link point, and proceeds to step 460.
- the embodiment of the present invention has the following advantages compared with the prior art:
- the network device that joins the network for example, the user access device and the user terminal, can store data and provide data for other user terminals accessing the network. Therefore, the embodiment of the present invention can be larger. A wider range of data distribution storage;
- the embodiment of the present invention can substantially overcome the bandwidth of the data. Limit, and can make full use of the uplink and downlink bandwidth resources in the network.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Transfer Between Computers (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
L'invention concerne un réseau à stockage réparti et un procédé de stockage réparti de données, le réseau à stockage réparti comportant un serveur de mise à disposition de données destiné à mettre des données à la disposition d'un terminal d'utilisateur; et un équipement d'accès pour utilisateur destiné à permettre à l'utilisateur d'accéder au réseau, l'équipement d'accès pour utilisateur comportant une unité de stockage destinée à stocker les données transmises au terminal d'utilisateur; un serveur de contrôle de reproduction de données destiné à transmettre les données du serveur de mise à disposition des données, de l'équipement d'accèspour utilisateur ou des autres terminaux d'utilisateur au terminal d'utilisateur à la demande du terminal d'utilisateur. En raison du contrôle centralisé par le serveur de contrôle de reproduction des données, l'invention permet de stocker des données dans les équipements du réseau de manière répartie et assure l'efficacité et la sécurité du stockage et de la transmission des données.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CNA2006100356789A CN101083600A (zh) | 2006-05-29 | 2006-05-29 | 分布式存储网络及数据分布存储的实现方法 |
CN200610035678.9 | 2006-05-29 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2007143939A1 true WO2007143939A1 (fr) | 2007-12-21 |
Family
ID=38831418
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2007/070061 WO2007143939A1 (fr) | 2006-05-29 | 2007-05-29 | Réseau à stockage réparti et procédé de stockage réparti de données |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN101083600A (fr) |
WO (1) | WO2007143939A1 (fr) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8434156B2 (en) | 2009-09-29 | 2013-04-30 | Huawei Technologies Co., Ltd. | Method, access node, and system for obtaining data |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101998173B (zh) * | 2009-08-27 | 2012-11-07 | 华为技术有限公司 | 分布式媒体共享播控器、媒体播控系统及方法 |
Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6374289B2 (en) * | 1998-10-05 | 2002-04-16 | Backweb Technologies, Ltd. | Distributed client-based data caching system |
US20020114465A1 (en) * | 2000-01-05 | 2002-08-22 | Shen-Orr D. Chaim | Digital content delivery system and method |
US20020194108A1 (en) * | 2001-06-14 | 2002-12-19 | Kitze Christopher Allin | Efficient transportation of digital files in a peer-to-peer file delivery network |
CN1465189A (zh) * | 2001-04-26 | 2003-12-31 | 皇家菲利浦电子有限公司 | 用于分布贮存的p2p网络结构 |
CN1474332A (zh) * | 2002-08-08 | 2004-02-11 | ̩����ʽ���� | 经在线网络分销内容的方法和装置 |
US6742023B1 (en) * | 2000-04-28 | 2004-05-25 | Roxio, Inc. | Use-sensitive distribution of data files between users |
CN1615481A (zh) * | 2002-01-22 | 2005-05-11 | 皇家飞利浦电子股份有限公司 | 对多媒体对象进行分发的方法和系统 |
CN1630842A (zh) * | 2001-11-08 | 2005-06-22 | 皇家飞利浦电子股份有限公司 | 用于对等数据文件服务的系统和方法 |
CN1633109A (zh) * | 2005-01-20 | 2005-06-29 | 杨金钰 | 一种流媒体系统 |
CN1636399A (zh) * | 2002-02-20 | 2005-07-06 | 皇家飞利浦电子股份有限公司 | 使用用户设备的分布式存储网络体系结构 |
CN1645858A (zh) * | 2005-02-24 | 2005-07-27 | 广东省电信有限公司研究院 | 分布式对等流媒体的服务系统及其点播节目的实现方法 |
-
2006
- 2006-05-29 CN CNA2006100356789A patent/CN101083600A/zh active Pending
-
2007
- 2007-05-29 WO PCT/CN2007/070061 patent/WO2007143939A1/fr active Application Filing
Patent Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6374289B2 (en) * | 1998-10-05 | 2002-04-16 | Backweb Technologies, Ltd. | Distributed client-based data caching system |
US20020114465A1 (en) * | 2000-01-05 | 2002-08-22 | Shen-Orr D. Chaim | Digital content delivery system and method |
US6742023B1 (en) * | 2000-04-28 | 2004-05-25 | Roxio, Inc. | Use-sensitive distribution of data files between users |
CN1465189A (zh) * | 2001-04-26 | 2003-12-31 | 皇家菲利浦电子有限公司 | 用于分布贮存的p2p网络结构 |
US20020194108A1 (en) * | 2001-06-14 | 2002-12-19 | Kitze Christopher Allin | Efficient transportation of digital files in a peer-to-peer file delivery network |
CN1630842A (zh) * | 2001-11-08 | 2005-06-22 | 皇家飞利浦电子股份有限公司 | 用于对等数据文件服务的系统和方法 |
CN1615481A (zh) * | 2002-01-22 | 2005-05-11 | 皇家飞利浦电子股份有限公司 | 对多媒体对象进行分发的方法和系统 |
CN1636399A (zh) * | 2002-02-20 | 2005-07-06 | 皇家飞利浦电子股份有限公司 | 使用用户设备的分布式存储网络体系结构 |
CN1474332A (zh) * | 2002-08-08 | 2004-02-11 | ̩����ʽ���� | 经在线网络分销内容的方法和装置 |
CN1633109A (zh) * | 2005-01-20 | 2005-06-29 | 杨金钰 | 一种流媒体系统 |
CN1645858A (zh) * | 2005-02-24 | 2005-07-27 | 广东省电信有限公司研究院 | 分布式对等流媒体的服务系统及其点播节目的实现方法 |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8434156B2 (en) | 2009-09-29 | 2013-04-30 | Huawei Technologies Co., Ltd. | Method, access node, and system for obtaining data |
Also Published As
Publication number | Publication date |
---|---|
CN101083600A (zh) | 2007-12-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10650119B2 (en) | Multimedia data processing method, apparatus, system, and storage medium | |
US8126001B2 (en) | Method and apparatus for multicasting contents between devices in networks | |
US20100005183A1 (en) | Method, System and Apparatus for Converting Media Contents | |
US20230421394A1 (en) | Secure authentication of remote equipment | |
CN104255010A (zh) | 用于在模板模式下有效支持短加密区间的系统和方法 | |
WO2013178010A1 (fr) | Procédé, dispositif et système de distribution de contenu multimédia | |
CN101379794A (zh) | 基于个人网络存储器的对等视频内容分发网络 | |
CN103957436A (zh) | 一种基于ott业务的视频防盗链方法 | |
US8719436B2 (en) | Tunneling non-HTTP traffic through a reverse proxy | |
WO2006069939A1 (fr) | Procede, systeme et appareil permettant de partager un contenu multimedia dans un reseau prive | |
CN102571790B (zh) | 一种用于实现目标文件的加密传输的方法与设备 | |
US20120324090A1 (en) | Resource control method, apparatus, and system in peer-to-peer network | |
CN109547824B (zh) | 一种视频业务服务方法及系统、存储介质及vpn服务器 | |
WO2012083620A1 (fr) | Procédé, moyen et système pour télécharger des fichiers de données multimédias diffusées en continu | |
TWI592046B (zh) | 網路共用裝置、系統及方法 | |
CN102801810A (zh) | 在内容分发网络中隐藏url的方法 | |
WO2011017976A1 (fr) | Procédé et système de service multimédia | |
US11671279B2 (en) | Determining a session key using session data | |
AU2007216943B2 (en) | Method of implementing a state tracking mechanism in a communications session between a server and a client system | |
WO2013056552A1 (fr) | Procédé de traitement de données de service, et dispositif et système correspondants | |
JP2010510568A (ja) | リソース伝送方法及び情報提供方法 | |
JP2005303449A (ja) | 無線通信システム、アクセスポイント、端末および無線通信方法 | |
US20180248969A1 (en) | Method and apparatus for secure content caching and delivery | |
CN106027555B (zh) | 一种采用sdn技术改善内容分发网络安全性的方法及系统 | |
WO2017088575A1 (fr) | Procédé et système de mise en œuvre de service d'ipc basés sur un mécanisme de cryptage |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 07721684 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 07721684 Country of ref document: EP Kind code of ref document: A1 |