WO2021137885A1 - Systems and methods for storing content items in secondary storage - Google Patents

Systems and methods for storing content items in secondary storage Download PDF

Info

Publication number
WO2021137885A1
WO2021137885A1 PCT/US2020/030140 US2020030140W WO2021137885A1 WO 2021137885 A1 WO2021137885 A1 WO 2021137885A1 US 2020030140 W US2020030140 W US 2020030140W WO 2021137885 A1 WO2021137885 A1 WO 2021137885A1
Authority
WO
WIPO (PCT)
Prior art keywords
storage device
content items
processor
clients
secondary storage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2020/030140
Other languages
English (en)
French (fr)
Inventor
William Crowder
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Level 3 Communications LLC
Original Assignee
Level 3 Communications LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Level 3 Communications LLC filed Critical Level 3 Communications LLC
Priority to KR1020227026771A priority Critical patent/KR20220123290A/ko
Priority to CA3163480A priority patent/CA3163480A1/en
Priority to JP2022539295A priority patent/JP7318899B2/ja
Priority to EP20729264.0A priority patent/EP4085594B1/en
Priority to AU2020417157A priority patent/AU2020417157A1/en
Publication of WO2021137885A1 publication Critical patent/WO2021137885A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • H04L67/568Storing data temporarily at an intermediate stage, e.g. caching
    • H04L67/5682Policies or rules for updating, deleting or replacing the stored data
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02Addressing or allocation; Relocation
    • G06F12/08Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/0802Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
    • G06F12/0866Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches for peripheral storage systems, e.g. disk cache
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Definitions

  • the processor generates the dynamic priority list based on frequencies at which the clients respectively request the content items. Additionally or alternatively, optionally the processor generates the dynamic priority list based on numbers of times with which the clients respectively request the content items. Additionally or alternatively, optionally the processor generates the dynamic priority list based on changes in rates at which the clients respectively request the content items. Additionally or alternatively, optionally the processor generates the dynamic priority list based on respective costs of receiving the content items via the network interface. Additionally or alternatively, optionally the processor generates the dynamic priority list based on respective costs of writing the content items to the primary storage device. Additionally or alternatively, optionally the processor generates the dynamic priority list based on respective costs of writing the content items to the secondary storage device. [0009] In some configurations, the computer optionally comprises a node of a content delivery network. Additionally or alternatively, optionally the processor receives the respective requests from the clients and distributes the plurality of content items to the clients responsive to such requests.
  • the present inventor has recognized that also writing each received content item to the secondary storage device may cause computational inefficiencies and may delay the client’s receipt of the respectively requested content item.
  • the secondary storage device may be such that the processor may write received content items thereto relatively slowly as compared to the rate at which it may write such content items to the primary storage device.
  • presently available secondary storage devices such as spinning hard disk drives (HDDs) or solid state drives (SSDs) may have write speeds that at least an order of magnitude slower than the write speeds of primary storage devices such as memory cache. Additionally, repeated overwrite operations may degrade HDDs or SSDs over time, resulting in performance degradations over time and potentially the need for frequent and costly replacements.
  • Any suitable one or more computers or processing circuits within content delivery system 100 or node 200, respectively described with reference to FIGS. 1-2, or any other suitable computer or processing circuit, may be configured for use in a method for storing content items in secondary storage devices, in a manner such as provided herein.
  • FIG. 3 illustrates a flow of operations in an exemplary method 300 for storing content items according to various configurations provided herein.
  • Method 300 described with reference to FIG. 3 may be implemented by any suitable computer comprising a processor, a primary storage device, a secondary storage device, and a network interface.
  • primary storage 126 of caching module 124 receives the content item via a network interface (e.g., network device 220 described with reference to FIG. 2). If the requested content item is already stored in primary storage 126 or in secondary storage 128, then caching module 124 need not send such a content request, and may transfer any appropriate content items from secondary storage 128 to primary storage 126 for distribution. In a manner such as known in the art and as described in greater detail below, caching module 124 may delete certain content items from primary storage device 126 responsive to the respective requests from the clients. For example, the primary storage device may have a limited capacity for storing content items.
  • the processor may periodically or continuously update the dynamic priority list based on respective requests from the clients for those content items over time, as the interests of users may fluctuate over time.
  • the processor may be configured to place higher on the dynamic priority list a content item with a lower cost of writing it to the secondary storage device at that time, than a content item with a higher cost of writing to the secondary storage device at that time.
  • the worthiness value of a content item may be based on any suitable criterion or combination of criteria, such as those provided herein (e.g., frequency of request, number of times of request, rate of request, cost of receiving, cost of writing to primary storage, cost of writing to secondary storage).

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Filling Or Discharging Of Gas Storage Vessels (AREA)
  • Solid-Sorbent Or Filter-Aiding Compositions (AREA)
  • Information Transfer Between Computers (AREA)
PCT/US2020/030140 2020-01-02 2020-04-27 Systems and methods for storing content items in secondary storage Ceased WO2021137885A1 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
KR1020227026771A KR20220123290A (ko) 2020-01-02 2020-04-27 이차 저장소에 콘텐츠 아이템을 저장하기 위한 시스템 및 방법
CA3163480A CA3163480A1 (en) 2020-01-02 2020-04-27 Systems and methods for storing content items in secondary storage
JP2022539295A JP7318899B2 (ja) 2020-01-02 2020-04-27 二次ストレージにコンテンツアイテムを格納するためのシステムおよび方法
EP20729264.0A EP4085594B1 (en) 2020-01-02 2020-04-27 System and method for storing content items in secondary storage
AU2020417157A AU2020417157A1 (en) 2020-01-02 2020-04-27 Systems and methods for storing content items in secondary storage

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US202062956612P 2020-01-02 2020-01-02
US62/956,612 2020-01-02

Publications (1)

Publication Number Publication Date
WO2021137885A1 true WO2021137885A1 (en) 2021-07-08

Family

ID=70918960

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2020/030140 Ceased WO2021137885A1 (en) 2020-01-02 2020-04-27 Systems and methods for storing content items in secondary storage

Country Status (7)

Country Link
US (2) US11463520B2 (https=)
EP (1) EP4085594B1 (https=)
JP (1) JP7318899B2 (https=)
KR (1) KR20220123290A (https=)
AU (1) AU2020417157A1 (https=)
CA (1) CA3163480A1 (https=)
WO (1) WO2021137885A1 (https=)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20240031654A (ko) * 2022-09-01 2024-03-08 현대자동차주식회사 차량에서의 메모리 관리 방법 및 시스템
CN116506566A (zh) * 2023-06-20 2023-07-28 深圳市欣喜连连科技有限公司 一种物联网智能摄像系统数据分布式存储方法及系统

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170134517A1 (en) * 2012-11-27 2017-05-11 Fastly, Inc. Data storage based on content popularity

Family Cites Families (45)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6442601B1 (en) * 1999-03-25 2002-08-27 International Business Machines Corporation System, method and program for migrating files retrieved from over a network to secondary storage
US6721794B2 (en) * 1999-04-01 2004-04-13 Diva Systems Corp. Method of data management for efficiently storing and retrieving data to respond to user access requests
US6701316B1 (en) * 2000-04-07 2004-03-02 Nec Corporation Method and apparatus for intelligent network bandwidth and system resource utilization for web content fetch and refresh
US7058691B1 (en) * 2000-06-12 2006-06-06 Trustees Of Princeton University System for wireless push and pull based services
US7444393B2 (en) * 2001-10-30 2008-10-28 Keicy K. Chung Read-only storage device having network interface, a system including the device, and a method of distributing files over a network
US7437438B2 (en) * 2001-12-27 2008-10-14 Hewlett-Packard Development Company, L.P. System and method for energy efficient data prefetching
US20040086166A1 (en) * 2002-11-01 2004-05-06 Photon Dynamics, Inc. Method and apparatus for flat patterned media inspection
US7275179B1 (en) * 2003-04-24 2007-09-25 Network Appliance, Inc. System and method for reducing unrecoverable media errors in a disk subsystem
WO2006046236A1 (en) * 2004-10-26 2006-05-04 May High-Tech Solutions, Ltd. Method and apparatus for residue detection on a polished wafer
US8447837B2 (en) * 2005-12-30 2013-05-21 Akamai Technologies, Inc. Site acceleration with content prefetching enabled through customer-specific configurations
KR101182523B1 (ko) * 2008-07-28 2012-09-12 삼성전자주식회사 홈 네트워크에서 브라우징 속도를 향상하기 위한 시스템 및방법
WO2011139305A1 (en) * 2010-05-04 2011-11-10 Azuki Systems, Inc. Method and apparatus for carrier controlled dynamic rate adaptation and client playout rate reduction
US8230123B2 (en) * 2010-08-23 2012-07-24 International Business Machines Corporation Using information on input/output (I/O) sizes of accesses to an extent to determine a type of storage device for the extent
US9002826B2 (en) * 2010-10-27 2015-04-07 Qualcomm Incorporated Media file caching for an electronic device to conserve resources
US9336380B2 (en) * 2010-12-15 2016-05-10 Microsoft Technology Licensing Llc Applying activity actions to frequent activities
US8788849B2 (en) * 2011-02-28 2014-07-22 Sandisk Technologies Inc. Method and apparatus for protecting cached streams
GB201108709D0 (en) * 2011-05-24 2011-07-06 Corethree Ltd Core engine
WO2013076763A1 (en) * 2011-11-22 2013-05-30 Hitachi, Ltd. Storage system and control method of storage system
US9503510B2 (en) * 2012-03-10 2016-11-22 Headwater Partners Ii Llc Content distribution based on a value metric
JP2014098978A (ja) * 2012-11-13 2014-05-29 Sony Corp メモリ制御装置、メモリシステム、情報処理システムおよびメモリ制御方法
US9177072B2 (en) * 2013-03-14 2015-11-03 Facebook, Inc. Social cache
US9483191B2 (en) * 2013-03-15 2016-11-01 Arris Enterprises, Inc. Multi-tier storage for delivery of services
US10579664B2 (en) * 2013-09-06 2020-03-03 Realnetworks, Inc. Device-centric media prioritization systems and methods
US9413824B1 (en) * 2015-01-30 2016-08-09 Dropbox, Inc. Storage constrained synchronization of content items based on predicted user access to shared content items using retention scoring
US9185164B1 (en) * 2015-01-30 2015-11-10 Dropbox, Inc. Idle state triggered constrained synchronization of shared content items
WO2016135955A1 (ja) * 2015-02-27 2016-09-01 株式会社日立製作所 不揮発性メモリデバイス
US11385797B2 (en) * 2015-10-05 2022-07-12 Micron Technology, Inc. Solid state storage device with variable logical capacity based on memory lifecycle
US20170168956A1 (en) * 2015-12-15 2017-06-15 Facebook, Inc. Block cache staging in content delivery network caching system
US10120872B2 (en) * 2015-12-28 2018-11-06 Facebook, Inc. Data caching based on requestor identity
WO2017154127A1 (ja) * 2016-03-09 2017-09-14 株式会社日立製作所 ストレージ装置の性能管理方法及び装置
US10404829B2 (en) * 2016-03-11 2019-09-03 Wipro Limited Method and system for achieving improved quality of service (QoS) for content delivery in a SDN controller based communication network
US11048764B2 (en) * 2016-12-30 2021-06-29 Verizon Media Inc. Managing under—and over-represented content topics in content pools
US10289473B2 (en) * 2017-03-23 2019-05-14 Netscout Systems, Inc. Situation analysis
US20190028766A1 (en) * 2017-07-18 2019-01-24 Audible Magic Corporation Media classification for media identification and licensing
US20190044809A1 (en) * 2017-08-30 2019-02-07 Intel Corporation Technologies for managing a flexible host interface of a network interface controller
JP6982468B2 (ja) * 2017-10-27 2021-12-17 キオクシア株式会社 メモリシステムおよび制御方法
US10534832B1 (en) * 2017-11-01 2020-01-14 Amazon Technologies, Inc. Server-side tracking and selection of rotating content
US11294954B2 (en) * 2018-01-04 2022-04-05 Audible Magic Corporation Music cover identification for search, compliance, and licensing
US11449256B2 (en) * 2018-05-15 2022-09-20 Samsung Electronics Co., Ltd. Method for accelerating image storing and retrieving differential latency storage devices based on access rates
US11924304B2 (en) * 2018-07-27 2024-03-05 International Business Machines Corporation Accessing cached data using hash keys
CN110908926B (zh) * 2018-09-14 2022-03-22 慧荣科技股份有限公司 数据储存装置及逻辑至物理地址映射表的写入方法
US11099952B2 (en) * 2018-11-06 2021-08-24 International Business Machines Corporation Leveraging server side cache in failover scenario
US10779023B2 (en) * 2019-01-11 2020-09-15 International Business Machines Corporation Content prediction for cloud-based delivery
US11157209B2 (en) * 2019-01-22 2021-10-26 EMC IP Holding Company LLC Storage allocation techniques using logical region I/O access information and temporal trend prediction
US11323514B2 (en) * 2019-04-30 2022-05-03 EMC IP Holding Company LLC Data tiering for edge computers, hubs and central systems

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170134517A1 (en) * 2012-11-27 2017-05-11 Fastly, Inc. Data storage based on content popularity

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
ANONYMOUS: "Cache replacement policies - Wikipedia", 14 December 2019 (2019-12-14), XP055724087, Retrieved from the Internet <URL:https://en.wikipedia.org/w/index.php?title=Cache_replacement_policies&oldid=930744547> [retrieved on 20200820] *

Also Published As

Publication number Publication date
CA3163480A1 (en) 2021-07-08
JP7318899B2 (ja) 2023-08-01
KR20220123290A (ko) 2022-09-06
US20230026912A1 (en) 2023-01-26
AU2020417157A1 (en) 2022-07-28
US20210211496A1 (en) 2021-07-08
JP2023509125A (ja) 2023-03-07
EP4085594B1 (en) 2024-09-18
EP4085594A1 (en) 2022-11-09
US11463520B2 (en) 2022-10-04

Similar Documents

Publication Publication Date Title
CN102782681B (zh) 用于支持用户内容馈送的机制
US12003808B2 (en) Cache management in content delivery systems
CN114827145B (zh) 服务器集群系统、元数据的访问方法及装置
CN101668046A (zh) 资源缓存方法、资源获取方法及其装置、系统
KR20110050432A (ko) 컨텐츠 전달 네트워크 내의 노드에서 하나 이상의 컨텐츠 아이템을 캐싱하는 방법, 장치 및 제품
US10346303B1 (en) Origin server cache eviction system
US20230026912A1 (en) Systems and methods for storing content items in secondary storage
CN117539915B (zh) 一种数据处理方法及相关装置
US9900384B2 (en) Distributed caching in a communication network
US6973536B1 (en) Self-adaptive hybrid cache
US10341454B2 (en) Video and media content delivery network storage in elastic clouds
US10992743B1 (en) Dynamic cache fleet management
US12050534B1 (en) Multi-tenant caching service in a hosted computing environment
US20260074923A1 (en) Distributing Digital Content With Edge Devices
CN117971896A (zh) 数据处理方法、装置、计算机设备和存储介质
CN119520612A (zh) 缓存更新方法、系统以及装置
CN117061540A (zh) 数据获取方法、装置、计算机设备、存储介质和程序产品
LATENCY et al. INTERNATIONAL JOURNAL OF COMPUTER ENGINEERING & TECHNOLOGY (IJCET)

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20729264

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022539295

Country of ref document: JP

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 3163480

Country of ref document: CA

ENP Entry into the national phase

Ref document number: 2020417157

Country of ref document: AU

Date of ref document: 20200427

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 20227026771

Country of ref document: KR

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2020729264

Country of ref document: EP

Effective date: 20220802