WO2007143939A1 - Réseau à stockage réparti et procédé de stockage réparti de données - Google Patents

Réseau à stockage réparti et procédé de stockage réparti de données Download PDF

Info

Publication number
WO2007143939A1
WO2007143939A1 PCT/CN2007/070061 CN2007070061W WO2007143939A1 WO 2007143939 A1 WO2007143939 A1 WO 2007143939A1 CN 2007070061 W CN2007070061 W CN 2007070061W WO 2007143939 A1 WO2007143939 A1 WO 2007143939A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
user terminal
server
broadcast control
control server
Prior art date
Application number
PCT/CN2007/070061
Other languages
English (en)
Chinese (zh)
Inventor
Liang Liang
Original Assignee
Huawei Technologies Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co., Ltd. filed Critical Huawei Technologies Co., Ltd.
Publication of WO2007143939A1 publication Critical patent/WO2007143939A1/fr

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0653Monitoring storage devices or systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604Improving or facilitating administration, e.g. storage management
    • G06F3/0605Improving or facilitating administration, e.g. storage management by facilitating the interaction with a user or administrator
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/062Securing storage systems
    • G06F3/0623Securing storage systems in relation to content
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Definitions

  • the present invention relates to the field of network data storage technologies, and in particular, to a method for implementing a distributed storage network and data distribution storage.
  • a network data storage method in the prior art is: storing data on a specific server in the network, a network user who needs to obtain the data, and a request to be sent to the server, and the server adopts HTTP (Hyper) Text Transfer Protocol, Hypertext Transfer Protocol) or FTP (File Transfer
  • Protocol such as Protocol, File Transfer Protocol, sends data to the above network users.
  • the inventor found that the above network data storage method has the following defects: [7] 1. Since the data needs to be sent to each network user in a centralized manner by the server, the server can be limited by the bandwidth capacity of the server. At the same time, the number of network users accommodated is very limited, and when there are many network users, the bandwidth allocated by the server to each network user is very small, which is not conducive to quickly sending data from the server to the network user;
  • Another network data storage method in the prior art is: storing data in a distributed storage manner of a network server and a network user, such as BT download data technology, that is, a kind of distributed data storage Application example, SP:
  • the data is stored on the server in the network, or on the network user who has obtained the data through the request.
  • Other network users can obtain data from the server or the network user storing the relevant data through the BT application software.
  • the network user can also provide the acquired data to other network users.
  • this technology breaks through the bandwidth limitation of the server to a certain extent, it makes the network use Users can get data faster, and the upstream and downstream bandwidths are relatively fully utilized.
  • An object of the embodiments of the present invention is to provide a distributed storage network and a data distribution storage method, so as to realize distributed storage of data in a network, and can centrally control data propagation in a network through a server as data. Safety brings security.
  • a distributed storage network comprising:
  • a data providing server for providing data to a user terminal
  • a network device comprising a storage unit, for storing data that can be provided to the user terminal;
  • the data broadcast control server is configured to control, according to the request of the user terminal, to send data from the data providing server or the network device or other user terminal to the user terminal.
  • a network device comprising: a storage unit, configured to store data that can be provided to a user terminal; and send data to the user terminal according to a control command of the data broadcast control server.
  • a server comprising:
  • the scheduling control module is configured to control, according to the request of the user terminal, the data corresponding to the request to be sent from the data providing server or the network device or other user terminal to the user terminal.
  • a method for data distribution storage storing data provided for a user terminal in a data providing server, the method comprising:
  • the data broadcast control server controls, according to the request for obtaining data sent by the user terminal, the data providing server to send corresponding data to the user terminal that sends the request;
  • FIG. 1 is a schematic diagram of a specific embodiment of a distributed storage network according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of another specific embodiment of a distributed storage network according to an embodiment of the present invention.
  • FIG. 3 is a schematic flowchart of a specific embodiment of a data distribution and storage method according to an embodiment of the present invention.
  • FIG. 4 is a flow chart showing another embodiment of a method for data distribution storage disclosed in an embodiment of the present invention.
  • the embodiment of the present invention discloses a distributed storage network, which stores data distributed to a user terminal in a storage unit of each network device, and centrally schedules and controls data stored in each storage unit through a data broadcast control server.
  • the data corresponding to the request of the user terminal is sent to the user terminal by the data providing server or the user access device or other user terminals in the network.
  • FIG. 1 is a schematic diagram of a specific embodiment of a distributed storage network according to an embodiment of the present invention.
  • the distributed storage network includes the following units:
  • the data providing server 110 is configured to provide data for the user terminal 140, and the data may be in a streaming media format, or other data segments that are easy to save, and are not limited thereto.
  • the data broadcast control server 120 is configured to control the data providing server 110 or send data from the user access device 130 or other user terminal to the user terminal 140 according to the request of the user terminal 140 for obtaining data;
  • the user access device 130 is configured to access the user terminal 140 to the distributed storage network, and the user access device 130 includes a storage unit for storing by the data providing server 110 or from another user. Data sent to the user terminal 140 by the device 130 or other user terminal.
  • the user terminal 140 is configured to send a request for obtaining data, and receive data returned by the data providing server 110 or the user access device 130 or other user terminals. Including a storage unit for storing the number of its reception According to.
  • the data broadcast control server 120 specifically includes:
  • the data link module 121 is configured to establish, according to the data saved on the data providing server 110, a data link point selected for the user terminal 140, and store the data link point and the user access point.
  • the data in the storage unit of the device 130 or other user terminal establishes a mapping relationship, that is, the user terminal 140 can select data corresponding to the data link point from the data providing server 1 10 or from the user access device by selecting the data link point. 130 or other user terminal sends to the user terminal 140.
  • the scheduling control module 122 is configured to control, according to a preset algorithm, the data corresponding to the data link point to be accessed from the data providing server 110 or from the user according to a preset algorithm according to a data link point selected by the user terminal 140.
  • the device 130 or other user terminal transmits to the user terminal 140.
  • the data security module 123 is configured to perform data verification and encryption processing on data that needs to be sent to the user terminal 140.
  • the data security module 123 specifically includes:
  • the information extraction submodule is configured to extract feature information in the data sent from the data providing server to the user terminal according to a preset rule, and save the feature information.
  • a judging sub-module configured to determine whether feature information of data in the storage unit from the user access device or other user terminal that needs to be sent to the user terminal is related to a feature saved in the data security module 123 The information is consistent. If it is consistent, it indicates that the data is valid data; otherwise, it indicates that the data is invalid data, the data security module 123 discards the data, and the data broadcast control server 120 controls the data corresponding to the request to be provided by the data. The server 110 transmits to the user terminal.
  • the data is initially stored in the data providing server 110.
  • the data corresponding to the request is saved in the user access device 130 or In the user terminal 140; when other user terminals request the data, the data broadcast control server 120 dynamically schedules according to a preset algorithm, and sends data to the request from the data providing server 110 or the user access device 130 or the user terminal 140 by the proximity principle.
  • the user terminal reduces the bandwidth limitation of the data providing server 110 transmitting data to several user terminals at the same time, and improves the convenience of the user terminal to acquire data.
  • the data sent to the user is encrypted and the data is validated by the data security module 123. It is verified that the user terminal receiving the data can decrypt the data according to its own characteristics, so as to ensure that the data is distributed and controlled by the data broadcast control server 120 to each user terminal, thereby preventing the random diffusion of data, and the copyright of the data in the network. Fees, etc. bring a viable solution.
  • FIG. 2 is a schematic diagram of another specific embodiment of a distributed storage network according to an embodiment of the present invention.
  • the data broadcast control server 120 adopts a distributed hierarchical structure, that is, the data broadcast control server 120 includes a plurality of distributed data broadcast function modules 125, and the data broadcast
  • the function module 125 is as close as possible to the user terminal 140 to hierarchically share the processing tasks of the data broadcast control server 120.
  • the data broadcast function module 125 is connected to the user access device 130, and may also be connected to the network transport layer, or even the data broadcast function.
  • the module 125 can be integrated in the user access device 130, and is not limited thereto.
  • the data broadcast function module 125 includes -
  • a data link sub-module configured to map data stored in the user access device 130 and the storage unit of the user terminal 140 with data in the data providing server 110;
  • a scheduling control sub-module configured to control sending data from the user access device 130 or from the user terminal 140 to a user terminal requesting the data
  • a data security sub-module configured to perform data verification and encryption processing encryption on data sent to the user terminal 140.
  • the data broadcast function module 125 has a similar functional structure to the data broadcast control server 120, and may be a sub-server of the data broadcast control server 120, and will not be described in detail herein.
  • This embodiment is to speed up the data propagation speed in the distributed storage network by using the distribution grading subsystem for the data broadcast control server 120 to hierarchically process the tasks of the data broadcast control server 120.
  • the embodiment of the present invention further discloses a data distribution storage method, which is used for storing data distributed from a data providing server in a network device, so that the user terminal can conveniently acquire the data.
  • FIG. 3 is a process flow of a specific example of a method according to an embodiment of the present invention, including the following implementation steps.
  • Step s310 The data providing server stores a plurality of data that can be provided to the user terminal;
  • Step s320 establishing data stored on the server according to the data, and establishing on the data broadcast control server The data link point selected by the user terminal, the user terminal can request to obtain the data corresponding to the data link point on the data providing server by selecting the data link point;
  • Step s330 The user terminal accesses the data broadcast control server through the network access provided by the user access device, obtains the data link point information established above, and selects a corresponding data link point according to the data acquired.
  • Step s340 The data broadcast control server extracts feature information of data corresponding to the data link point selected by the user terminal, and saves the feature information in the data broadcast control server;
  • Step s350 The data broadcast control server controls the data providing server to encrypt the data corresponding to the data link selected by the user terminal;
  • Step s360 The data broadcast control server controls the data providing server to send the encrypted data to the user terminal;
  • Step s370 Store data sent to the user terminal in the user access device or the user terminal;
  • Step s380 The data stored in the user access device or the user terminal is mapped to the data stored in the data providing server, that is, the data and data stored in the user access device or the user terminal are broadcasted.
  • the data link points in the control server establish a mapping relationship.
  • the data broadcast control server sends the data on the data providing server to the user terminal according to the request of the user terminal, and saves the data in the user who provides network access for the user terminal.
  • the access device or the user terminal that receives the data realizes that the data distribution is stored to the user access device or the user terminal.
  • Step 410 The user terminal logs in to the data broadcast control server through its corresponding user access device, and selects a data link point corresponding to the data to be acquired, where the foregoing step s380 has been established on the data broadcast control server.
  • the data link point selected by the user terminal that is, the data link point on the data broadcast control server corresponds to the data on the data providing server, the user access device, and the user terminal;
  • Step 420 The data broadcast control server extracts feature information of the data corresponding to the data link point from the user access device or other user terminal according to the data link point selected by the user terminal.
  • Step 430 The data broadcast control server compares the extracted feature information with the feature information stored in the data broadcast control server through the foregoing step s340, if the feature information is consistent, then proceeds to step 440, otherwise proceeds to step 480;
  • Step 440 The data broadcast control server encrypts the data corresponding to the data link point on the user access device or other user terminal;
  • Step 450 The data broadcast control server controls the user access device or other user terminal to send the encrypted data to the user terminal that selects the data link point;
  • Step 460 The data sent to the user terminal is stored in the user terminal that selects the data link point and the corresponding user access device;
  • Step 470 A mapping relationship between the data stored in the user terminal and the corresponding user access device of the selected data link point and the data stored in the data providing server;
  • Step 480 The data broadcast control server discards the data, and the control data providing server sends the data corresponding to the data link point selected by the user terminal to the user terminal of the selected data link point, and proceeds to step 460.
  • the embodiment of the present invention has the following advantages compared with the prior art:
  • the network device that joins the network for example, the user access device and the user terminal, can store data and provide data for other user terminals accessing the network. Therefore, the embodiment of the present invention can be larger. A wider range of data distribution storage;
  • the embodiment of the present invention can substantially overcome the bandwidth of the data. Limit, and can make full use of the uplink and downlink bandwidth resources in the network.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Transfer Between Computers (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

L'invention concerne un réseau à stockage réparti et un procédé de stockage réparti de données, le réseau à stockage réparti comportant un serveur de mise à disposition de données destiné à mettre des données à la disposition d'un terminal d'utilisateur; et un équipement d'accès pour utilisateur destiné à permettre à l'utilisateur d'accéder au réseau, l'équipement d'accès pour utilisateur comportant une unité de stockage destinée à stocker les données transmises au terminal d'utilisateur; un serveur de contrôle de reproduction de données destiné à transmettre les données du serveur de mise à disposition des données, de l'équipement d'accèspour utilisateur ou des autres terminaux d'utilisateur au terminal d'utilisateur à la demande du terminal d'utilisateur. En raison du contrôle centralisé par le serveur de contrôle de reproduction des données, l'invention permet de stocker des données dans les équipements du réseau de manière répartie et assure l'efficacité et la sécurité du stockage et de la transmission des données.
PCT/CN2007/070061 2006-05-29 2007-05-29 Réseau à stockage réparti et procédé de stockage réparti de données WO2007143939A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CNA2006100356789A CN101083600A (zh) 2006-05-29 2006-05-29 分布式存储网络及数据分布存储的实现方法
CN200610035678.9 2006-05-29

Publications (1)

Publication Number Publication Date
WO2007143939A1 true WO2007143939A1 (fr) 2007-12-21

Family

ID=38831418

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2007/070061 WO2007143939A1 (fr) 2006-05-29 2007-05-29 Réseau à stockage réparti et procédé de stockage réparti de données

Country Status (2)

Country Link
CN (1) CN101083600A (fr)
WO (1) WO2007143939A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8434156B2 (en) 2009-09-29 2013-04-30 Huawei Technologies Co., Ltd. Method, access node, and system for obtaining data

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101998173B (zh) * 2009-08-27 2012-11-07 华为技术有限公司 分布式媒体共享播控器、媒体播控系统及方法

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6374289B2 (en) * 1998-10-05 2002-04-16 Backweb Technologies, Ltd. Distributed client-based data caching system
US20020114465A1 (en) * 2000-01-05 2002-08-22 Shen-Orr D. Chaim Digital content delivery system and method
US20020194108A1 (en) * 2001-06-14 2002-12-19 Kitze Christopher Allin Efficient transportation of digital files in a peer-to-peer file delivery network
CN1465189A (zh) * 2001-04-26 2003-12-31 皇家菲利浦电子有限公司 用于分布贮存的p2p网络结构
CN1474332A (zh) * 2002-08-08 2004-02-11 ̩����ʽ���� 经在线网络分销内容的方法和装置
US6742023B1 (en) * 2000-04-28 2004-05-25 Roxio, Inc. Use-sensitive distribution of data files between users
CN1615481A (zh) * 2002-01-22 2005-05-11 皇家飞利浦电子股份有限公司 对多媒体对象进行分发的方法和系统
CN1630842A (zh) * 2001-11-08 2005-06-22 皇家飞利浦电子股份有限公司 用于对等数据文件服务的系统和方法
CN1633109A (zh) * 2005-01-20 2005-06-29 杨金钰 一种流媒体系统
CN1636399A (zh) * 2002-02-20 2005-07-06 皇家飞利浦电子股份有限公司 使用用户设备的分布式存储网络体系结构
CN1645858A (zh) * 2005-02-24 2005-07-27 广东省电信有限公司研究院 分布式对等流媒体的服务系统及其点播节目的实现方法

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6374289B2 (en) * 1998-10-05 2002-04-16 Backweb Technologies, Ltd. Distributed client-based data caching system
US20020114465A1 (en) * 2000-01-05 2002-08-22 Shen-Orr D. Chaim Digital content delivery system and method
US6742023B1 (en) * 2000-04-28 2004-05-25 Roxio, Inc. Use-sensitive distribution of data files between users
CN1465189A (zh) * 2001-04-26 2003-12-31 皇家菲利浦电子有限公司 用于分布贮存的p2p网络结构
US20020194108A1 (en) * 2001-06-14 2002-12-19 Kitze Christopher Allin Efficient transportation of digital files in a peer-to-peer file delivery network
CN1630842A (zh) * 2001-11-08 2005-06-22 皇家飞利浦电子股份有限公司 用于对等数据文件服务的系统和方法
CN1615481A (zh) * 2002-01-22 2005-05-11 皇家飞利浦电子股份有限公司 对多媒体对象进行分发的方法和系统
CN1636399A (zh) * 2002-02-20 2005-07-06 皇家飞利浦电子股份有限公司 使用用户设备的分布式存储网络体系结构
CN1474332A (zh) * 2002-08-08 2004-02-11 ̩����ʽ���� 经在线网络分销内容的方法和装置
CN1633109A (zh) * 2005-01-20 2005-06-29 杨金钰 一种流媒体系统
CN1645858A (zh) * 2005-02-24 2005-07-27 广东省电信有限公司研究院 分布式对等流媒体的服务系统及其点播节目的实现方法

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8434156B2 (en) 2009-09-29 2013-04-30 Huawei Technologies Co., Ltd. Method, access node, and system for obtaining data

Also Published As

Publication number Publication date
CN101083600A (zh) 2007-12-05

Similar Documents

Publication Publication Date Title
US10650119B2 (en) Multimedia data processing method, apparatus, system, and storage medium
US8126001B2 (en) Method and apparatus for multicasting contents between devices in networks
US20100005183A1 (en) Method, System and Apparatus for Converting Media Contents
US20230421394A1 (en) Secure authentication of remote equipment
CN104255010A (zh) 用于在模板模式下有效支持短加密区间的系统和方法
WO2013178010A1 (fr) Procédé, dispositif et système de distribution de contenu multimédia
CN101379794A (zh) 基于个人网络存储器的对等视频内容分发网络
CN103957436A (zh) 一种基于ott业务的视频防盗链方法
US8719436B2 (en) Tunneling non-HTTP traffic through a reverse proxy
WO2006069939A1 (fr) Procede, systeme et appareil permettant de partager un contenu multimedia dans un reseau prive
CN102571790B (zh) 一种用于实现目标文件的加密传输的方法与设备
US20120324090A1 (en) Resource control method, apparatus, and system in peer-to-peer network
CN109547824B (zh) 一种视频业务服务方法及系统、存储介质及vpn服务器
WO2012083620A1 (fr) Procédé, moyen et système pour télécharger des fichiers de données multimédias diffusées en continu
TWI592046B (zh) 網路共用裝置、系統及方法
CN102801810A (zh) 在内容分发网络中隐藏url的方法
WO2011017976A1 (fr) Procédé et système de service multimédia
US11671279B2 (en) Determining a session key using session data
AU2007216943B2 (en) Method of implementing a state tracking mechanism in a communications session between a server and a client system
WO2013056552A1 (fr) Procédé de traitement de données de service, et dispositif et système correspondants
JP2010510568A (ja) リソース伝送方法及び情報提供方法
JP2005303449A (ja) 無線通信システム、アクセスポイント、端末および無線通信方法
US20180248969A1 (en) Method and apparatus for secure content caching and delivery
CN106027555B (zh) 一种采用sdn技术改善内容分发网络安全性的方法及系统
WO2017088575A1 (fr) Procédé et système de mise en œuvre de service d'ipc basés sur un mécanisme de cryptage

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07721684

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 07721684

Country of ref document: EP

Kind code of ref document: A1