CN114375565A - 一种文件块下载方法及装置 - Google Patents

一种文件块下载方法及装置 Download PDF

Info

Publication number
CN114375565A
CN114375565A CN202080024741.7A CN202080024741A CN114375565A CN 114375565 A CN114375565 A CN 114375565A CN 202080024741 A CN202080024741 A CN 202080024741A CN 114375565 A CN114375565 A CN 114375565A
Authority
CN
China
Prior art keywords
node
storage
storage node
storage nodes
file block
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202080024741.7A
Other languages
English (en)
Other versions
CN114375565B (zh
Inventor
徐聪
袁庭球
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN114375565A publication Critical patent/CN114375565A/zh
Application granted granted Critical
Publication of CN114375565B publication Critical patent/CN114375565B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/104—Peer-to-peer [P2P] networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00—Reducing energy consumption in communication networks
    • Y02D30/50—Reducing energy consumption in communication networks in wire-line communication networks, e.g. low power modes or reduced link rate

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

本发明提供了一种文件块下载方法，在P2P网络中，索引节点根据请求节点发送的下载请求，向请求节点发送选取出的预选存储节点，再由请求节点从预选存储节点和存储节点列表中的各个存储节点构成的存储节点集合中选择用于下载目标文件块的目标存储节点。本发明所提供的文件下载方法通过以存储节点列表中的存储节点为基础，迭代选择目标存储节点，可以令选择的目标存储节点越来越接近存储有目标文件块的全部存储节点中性能最优的全局最优存储节点，即得到全局最优解，从而提高文件块的下载效率和下载质量。

Description

PCT国内申请，说明书已公开。

Claims (19)

  1. PCT国内申请，权利要求书已公开。
CN202080024741.7A 2020-07-31 2020-07-31 一种文件块下载方法及装置 Active CN114375565B (zh)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/106280 WO2022021357A1 (zh) 2020-07-31 2020-07-31 一种文件块下载方法及装置

Publications (2)

Publication Number Publication Date
CN114375565A true CN114375565A (zh) 2022-04-19
CN114375565B CN114375565B (zh) 2023-06-06

Family

ID=80036892

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202080024741.7A Active CN114375565B (zh) 2020-07-31 2020-07-31 一种文件块下载方法及装置

Country Status (2)

Country Link
CN (1) CN114375565B (zh)
WO (1) WO2022021357A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114553885A (zh) * 2022-03-02 2022-05-27 上海弘玑信息技术有限公司 基于dht网络的存储方法及装置、电子设备、存储介质

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060168318A1 (en) * 2003-02-12 2006-07-27 Adam Twiss Methods and apparatus for traffic management in peer-to-peer networks
CN101719936A (zh) * 2009-12-09 2010-06-02 成都市华为赛门铁克科技有限公司 提供文件下载服务的方法、装置及缓存系统
CN102195999A (zh) * 2010-03-11 2011-09-21 中国移动通信集团公司 对等网络系统、获取资源的方法及相关装置
US20110282883A1 (en) * 2010-03-26 2011-11-17 Nec (China) Co., Ltd. Indexing server and method therefor
US20120011200A1 (en) * 2010-07-06 2012-01-12 Roxbeam Media Network Corporation Method and apparatus for data storage in a peer-to-peer network
CN102833293A (zh) * 2011-06-17 2012-12-19 腾讯科技（深圳）有限公司 P2sp网络中资源下载的方法及客户端
CN103269351A (zh) * 2012-12-07 2013-08-28 北京奇虎科技有限公司 一种文件下载方法和装置
US20200052885A1 (en) * 2018-08-09 2020-02-13 Spacebook Technology Co. Limited File storage method and apparatus for blockchain network
CN111400250A (zh) * 2020-03-11 2020-07-10 北京文香信息技术有限公司 一种资源获取方法、装置、设备及存储介质
US20210344971A1 (en) * 2018-03-28 2021-11-04 Wangsu Science & Technology Co., Ltd. A method and system for downloading a data resource

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060212584A1 (en) * 2005-03-15 2006-09-21 Qian Xiang Shi Ji (Beijing) Technology Development Co. Ltd. Method and system for accelerating downloading of web page content by a peer-to-peer network
WO2011054375A1 (en) * 2009-11-03 2011-05-12 Telecom Italia S.P.A. Sharing of digital contents in p2p networks exploiting localization data
CN103248695A (zh) * 2013-05-07 2013-08-14 北京奇虎科技有限公司 文件下载方法、系统及cdn中的服务器节点
CN109376122A (zh) * 2018-09-25 2019-02-22 深圳市元征科技股份有限公司 一种文件管理方法、系统及区块链节点设备和存储介质
CN109981751B (zh) * 2019-03-06 2022-06-17 珠海金山网络游戏科技有限公司 一种文件传输方法及系统、计算机设备及存储介质

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060168318A1 (en) * 2003-02-12 2006-07-27 Adam Twiss Methods and apparatus for traffic management in peer-to-peer networks
CN101719936A (zh) * 2009-12-09 2010-06-02 成都市华为赛门铁克科技有限公司 提供文件下载服务的方法、装置及缓存系统
CN102195999A (zh) * 2010-03-11 2011-09-21 中国移动通信集团公司 对等网络系统、获取资源的方法及相关装置
US20110282883A1 (en) * 2010-03-26 2011-11-17 Nec (China) Co., Ltd. Indexing server and method therefor
US20120011200A1 (en) * 2010-07-06 2012-01-12 Roxbeam Media Network Corporation Method and apparatus for data storage in a peer-to-peer network
CN102833293A (zh) * 2011-06-17 2012-12-19 腾讯科技（深圳）有限公司 P2sp网络中资源下载的方法及客户端
CN103269351A (zh) * 2012-12-07 2013-08-28 北京奇虎科技有限公司 一种文件下载方法和装置
US20210344971A1 (en) * 2018-03-28 2021-11-04 Wangsu Science & Technology Co., Ltd. A method and system for downloading a data resource
US20200052885A1 (en) * 2018-08-09 2020-02-13 Spacebook Technology Co. Limited File storage method and apparatus for blockchain network
CN111400250A (zh) * 2020-03-11 2020-07-10 北京文香信息技术有限公司 一种资源获取方法、装置、设备及存储介质

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
侯得果;庄雷;: "基于随机性和文件块相似性的结点选择策略" *
李治军;姜守旭;: "一种缩短下载时间优先的自适应BitTorrent激励协议" *

Also Published As

Publication number Publication date
CN114375565B (zh) 2023-06-06
WO2022021357A1 (zh) 2022-02-03

Similar Documents

Publication Publication Date Title
US10805363B2 (en) Method, device and system for pushing file
EP2721504B1 (en) File processing method, system and server-clustered system for cloud storage
US20120166394A1 (en) Distributed storage system and method for storing objects based on locations
CN110798517B (zh) 去中心化集群负载均衡方法、系统、移动终端及存储介质
WO2013046664A1 (ja) 情報システム、管理装置、データ処理方法、データ構造、プログラム、および記録媒体
WO2018201103A1 (en) Iterative object scanning for information lifecycle management
WO2011137189A1 (en) System and methods for mapping and searching objects in multidimensional space
Hassanzadeh-Nazarabadi et al. Decentralized utility-and locality-aware replication for heterogeneous DHT-based P2P cloud storage systems
CN114375565B (zh) 一种文件块下载方法及装置
CN111405021A (zh) 一种对等节点的数据传输方法、装置、设备及存储介质
CN105868002B (zh) 一种用于在分布式计算中处理重发请求的方法与设备
US20150254102A1 (en) Computer-readable recording medium, task assignment device, task execution device, and task assignment method
CN110798492B (zh) 数据存储方法及装置、数据处理系统
CN114020218B (zh) 混合重复数据删除调度方法及系统
CN115442439A (zh) 分布式缓存集群管理方法、系统、终端及存储介质
Nwe et al. A consistent replica selection approach for distributed key-value storage system
US20180189342A1 (en) Method and system for tree management of trees under multi-version concurrency control
CN106888237B (zh) 一种数据调度方法及系统
CN113037791B (zh) 运维方法和系统、计算机可读存储介质
JP6506773B2 (ja) 情報処理装置、方法およびプログラム
CN111209100B (zh) 一种业务处理和数据源确定方法
CN111857548B (zh) 数据读取方法、装置及系统
US20210185119A1 (en) A Decentralized Load-Balancing Method for Resource/Traffic Distribution
CN117472918B (zh) 数据处理方法、系统、电子设备及存储介质
WO2022222665A1 (zh) 一种请求识别方法、装置、设备及存储介质

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant