CN105915626A - 一种面向云存储的数据副本初始放置方法 - Google Patents
一种面向云存储的数据副本初始放置方法 Download PDFInfo
- Publication number
- CN105915626A CN105915626A CN201610365538.1A CN201610365538A CN105915626A CN 105915626 A CN105915626 A CN 105915626A CN 201610365538 A CN201610365538 A CN 201610365538A CN 105915626 A CN105915626 A CN 105915626A
- Authority
- CN
- China
- Prior art keywords
- frame
- back end
- local data
- data node
- performance value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0683—Plurality of storage devices
- G06F3/0689—Disk arrays, e.g. RAID, JBOD
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0631—Management of faults, events, alarms or notifications using root cause analysis; using analysis of correlation between notifications, alarms or events based on decision criteria, e.g. hierarchy, tree or time analysis
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0876—Network utilisation, e.g. volume of load or congestion level
- H04L43/0894—Packet rate
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
- H04L67/1008—Server selection for load balancing based on parameters of servers, e.g. available memory or workload
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
- H04L67/101—Server selection for load balancing based on network conditions
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Environmental & Geological Engineering (AREA)
- Computer Hardware Design (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
Claims (7)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610365538.1A CN105915626B (zh) | 2016-05-27 | 2016-05-27 | 一种面向云存储的数据副本初始放置方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610365538.1A CN105915626B (zh) | 2016-05-27 | 2016-05-27 | 一种面向云存储的数据副本初始放置方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN105915626A true CN105915626A (zh) | 2016-08-31 |
CN105915626B CN105915626B (zh) | 2019-02-26 |
Family
ID=56742423
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610365538.1A Active CN105915626B (zh) | 2016-05-27 | 2016-05-27 | 一种面向云存储的数据副本初始放置方法 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN105915626B (zh) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106790578A (zh) * | 2016-12-28 | 2017-05-31 | 梁猛 | 基于权重因子的Hadoop HDFS数据块分布优化算法 |
CN108200169A (zh) * | 2017-12-30 | 2018-06-22 | 广东技术师范学院 | 一种云存储系统的副本初次放置策略控制方法 |
CN108347466A (zh) * | 2017-01-24 | 2018-07-31 | 全球能源互联网研究院 | 一种云存储系统的数据存储方法和装置 |
CN108418858A (zh) * | 2018-01-23 | 2018-08-17 | 南京邮电大学 | 一种面向Geo-distributed云存储的数据副本放置方法 |
CN110535898A (zh) * | 2018-05-25 | 2019-12-03 | 许继集团有限公司 | 大数据存储中副本存放、补全、节点选择方法及管理系统 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102170468A (zh) * | 2011-04-07 | 2011-08-31 | 江苏省电力公司 | 基于内容相似性的分布式储存的副本替换算法 |
US20130144846A1 (en) * | 2011-12-02 | 2013-06-06 | International Business Machines Corporation | Managing redundant immutable files using deduplication in storage clouds |
CN104063501A (zh) * | 2014-07-07 | 2014-09-24 | 电子科技大学 | 基于hdfs的副本平衡方法 |
CN104735107A (zh) * | 2013-12-20 | 2015-06-24 | 中国移动通信集团公司 | 分布式存储系统中数据副本恢复方法及装置 |
CN105511801A (zh) * | 2015-11-12 | 2016-04-20 | 长春理工大学 | 数据存储的方法和装置 |
-
2016
- 2016-05-27 CN CN201610365538.1A patent/CN105915626B/zh active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102170468A (zh) * | 2011-04-07 | 2011-08-31 | 江苏省电力公司 | 基于内容相似性的分布式储存的副本替换算法 |
US20130144846A1 (en) * | 2011-12-02 | 2013-06-06 | International Business Machines Corporation | Managing redundant immutable files using deduplication in storage clouds |
CN104735107A (zh) * | 2013-12-20 | 2015-06-24 | 中国移动通信集团公司 | 分布式存储系统中数据副本恢复方法及装置 |
CN104063501A (zh) * | 2014-07-07 | 2014-09-24 | 电子科技大学 | 基于hdfs的副本平衡方法 |
CN105511801A (zh) * | 2015-11-12 | 2016-04-20 | 长春理工大学 | 数据存储的方法和装置 |
Non-Patent Citations (2)
Title |
---|
付雄等: "数据网格中一种启发式副本放置算法", 《系统工程与电子技术》 * |
付雄等: "树型数据网格环境下副本放置算法研究", 《南京邮电大学学报(自然科学版)》 * |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106790578A (zh) * | 2016-12-28 | 2017-05-31 | 梁猛 | 基于权重因子的Hadoop HDFS数据块分布优化算法 |
CN108347466A (zh) * | 2017-01-24 | 2018-07-31 | 全球能源互联网研究院 | 一种云存储系统的数据存储方法和装置 |
CN108200169A (zh) * | 2017-12-30 | 2018-06-22 | 广东技术师范学院 | 一种云存储系统的副本初次放置策略控制方法 |
CN108418858A (zh) * | 2018-01-23 | 2018-08-17 | 南京邮电大学 | 一种面向Geo-distributed云存储的数据副本放置方法 |
CN110535898A (zh) * | 2018-05-25 | 2019-12-03 | 许继集团有限公司 | 大数据存储中副本存放、补全、节点选择方法及管理系统 |
Also Published As
Publication number | Publication date |
---|---|
CN105915626B (zh) | 2019-02-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105915626A (zh) | 一种面向云存储的数据副本初始放置方法 | |
CN103929454B (zh) | 一种云计算平台中负载均衡存储的方法和系统 | |
CN103425756B (zh) | 一种hdfs中数据块的副本管理策略 | |
CN105320773B (zh) | 一种基于Hadoop平台的分布式重复数据删除系统和方法 | |
CN103139302A (zh) | 考虑负载均衡的实时副本调度方法 | |
CN106161120A (zh) | 动态均衡负载的分布式元数据管理方法 | |
CN104504147B (zh) | 一种数据库集群的资源协调方法、装置及系统 | |
CN104424287B (zh) | 数据查询方法和装置 | |
CN103595805A (zh) | 一种基于分布式集群的数据放置方法 | |
CN103299268B (zh) | 用于确定用户组对数据元素组的数据访问权限的方法及装置 | |
CN104063501B (zh) | 基于hdfs的副本平衡方法 | |
CN103631894A (zh) | 一种基于hdfs的动态副本管理方法 | |
CN106339386A (zh) | 数据库弹性调度方法以及装置 | |
US20190155698A1 (en) | Distributed storage reservation for recovering distributed data | |
CN104281980B (zh) | 基于分布式计算的火力发电机组远程诊断方法及系统 | |
CN105681052A (zh) | 一种用于数据中心分布式文件存储的节能方法 | |
CN107070645A (zh) | 比较数据表的数据的方法和系统 | |
JP2022547673A (ja) | データ処理方法及び関連装置、並びにコンピュータプログラム | |
CN101419600A (zh) | 基于面向对象文件系统的数据副本映射方法及装置 | |
CN110032470A (zh) | 一种基于哈夫曼树的异构部分重复码的构造方法 | |
CN104158902B (zh) | 一种基于请求数的Hbase数据块分配方法及装置 | |
CN103095812B (zh) | 一种基于用户请求响应时间的副本创建方法 | |
Lee et al. | A big data management system for energy consumption prediction models | |
CN106502842B (zh) | 数据恢复方法及系统 | |
CN117033004A (zh) | 负载均衡方法、装置、电子设备及存储介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right |
Effective date of registration: 20201010 Address after: Room b317-7, building 1, No.18, Fenghua Road, Yuhua Economic Development Zone, Nanjing, Jiangsu Province 210000 Patentee after: Nanjing Huizhi Mutual Entertainment Network Technology Co.,Ltd. Address before: 210000 Jiangsu city of Nanjing province Ya Dong new Yuen Road No. 9 Patentee before: NANJING University OF POSTS AND TELECOMMUNICATIONS |
|
TR01 | Transfer of patent right | ||
PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: An initial placement method of data copy for cloud storage Effective date of registration: 20210806 Granted publication date: 20190226 Pledgee: Bank of Jiangsu Limited by Share Ltd. Taishan Nanjing road subbranch Pledgor: Nanjing Huizhi Mutual Entertainment Network Technology Co.,Ltd. Registration number: Y2021980007347 |
|
PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
PC01 | Cancellation of the registration of the contract for pledge of patent right |
Date of cancellation: 20221219 Granted publication date: 20190226 Pledgee: Bank of Jiangsu Limited by Share Ltd. Taishan Nanjing road subbranch Pledgor: Nanjing Huizhi Mutual Entertainment Network Technology Co.,Ltd. Registration number: Y2021980007347 |
|
PC01 | Cancellation of the registration of the contract for pledge of patent right |