WO2021137885A1 - Systems and methods for storing content items in secondary storage - Google Patents
Systems and methods for storing content items in secondary storage Download PDFInfo
- Publication number
- WO2021137885A1 WO2021137885A1 PCT/US2020/030140 US2020030140W WO2021137885A1 WO 2021137885 A1 WO2021137885 A1 WO 2021137885A1 US 2020030140 W US2020030140 W US 2020030140W WO 2021137885 A1 WO2021137885 A1 WO 2021137885A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- storage device
- content items
- processor
- clients
- secondary storage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
- H04L67/5682—Policies or rules for updating, deleting or replacing the stored data
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
- G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G06F12/0866—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches for peripheral storage systems, e.g. disk cache
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Definitions
- the processor generates the dynamic priority list based on frequencies at which the clients respectively request the content items. Additionally or alternatively, optionally the processor generates the dynamic priority list based on numbers of times with which the clients respectively request the content items. Additionally or alternatively, optionally the processor generates the dynamic priority list based on changes in rates at which the clients respectively request the content items. Additionally or alternatively, optionally the processor generates the dynamic priority list based on respective costs of receiving the content items via the network interface. Additionally or alternatively, optionally the processor generates the dynamic priority list based on respective costs of writing the content items to the primary storage device. Additionally or alternatively, optionally the processor generates the dynamic priority list based on respective costs of writing the content items to the secondary storage device. [0009] In some configurations, the computer optionally comprises a node of a content delivery network. Additionally or alternatively, optionally the processor receives the respective requests from the clients and distributes the plurality of content items to the clients responsive to such requests.
- the present inventor has recognized that also writing each received content item to the secondary storage device may cause computational inefficiencies and may delay the client’s receipt of the respectively requested content item.
- the secondary storage device may be such that the processor may write received content items thereto relatively slowly as compared to the rate at which it may write such content items to the primary storage device.
- presently available secondary storage devices such as spinning hard disk drives (HDDs) or solid state drives (SSDs) may have write speeds that at least an order of magnitude slower than the write speeds of primary storage devices such as memory cache. Additionally, repeated overwrite operations may degrade HDDs or SSDs over time, resulting in performance degradations over time and potentially the need for frequent and costly replacements.
- Any suitable one or more computers or processing circuits within content delivery system 100 or node 200, respectively described with reference to FIGS. 1-2, or any other suitable computer or processing circuit, may be configured for use in a method for storing content items in secondary storage devices, in a manner such as provided herein.
- FIG. 3 illustrates a flow of operations in an exemplary method 300 for storing content items according to various configurations provided herein.
- Method 300 described with reference to FIG. 3 may be implemented by any suitable computer comprising a processor, a primary storage device, a secondary storage device, and a network interface.
- primary storage 126 of caching module 124 receives the content item via a network interface (e.g., network device 220 described with reference to FIG. 2). If the requested content item is already stored in primary storage 126 or in secondary storage 128, then caching module 124 need not send such a content request, and may transfer any appropriate content items from secondary storage 128 to primary storage 126 for distribution. In a manner such as known in the art and as described in greater detail below, caching module 124 may delete certain content items from primary storage device 126 responsive to the respective requests from the clients. For example, the primary storage device may have a limited capacity for storing content items.
- the processor may periodically or continuously update the dynamic priority list based on respective requests from the clients for those content items over time, as the interests of users may fluctuate over time.
- the processor may be configured to place higher on the dynamic priority list a content item with a lower cost of writing it to the secondary storage device at that time, than a content item with a higher cost of writing to the secondary storage device at that time.
- the worthiness value of a content item may be based on any suitable criterion or combination of criteria, such as those provided herein (e.g., frequency of request, number of times of request, rate of request, cost of receiving, cost of writing to primary storage, cost of writing to secondary storage).
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Filling Or Discharging Of Gas Storage Vessels (AREA)
- Solid-Sorbent Or Filter-Aiding Compositions (AREA)
- Information Transfer Between Computers (AREA)
Priority Applications (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020227026771A KR20220123290A (ko) | 2020-01-02 | 2020-04-27 | 이차 저장소에 콘텐츠 아이템을 저장하기 위한 시스템 및 방법 |
| CA3163480A CA3163480A1 (en) | 2020-01-02 | 2020-04-27 | Systems and methods for storing content items in secondary storage |
| JP2022539295A JP7318899B2 (ja) | 2020-01-02 | 2020-04-27 | 二次ストレージにコンテンツアイテムを格納するためのシステムおよび方法 |
| EP20729264.0A EP4085594B1 (en) | 2020-01-02 | 2020-04-27 | System and method for storing content items in secondary storage |
| AU2020417157A AU2020417157A1 (en) | 2020-01-02 | 2020-04-27 | Systems and methods for storing content items in secondary storage |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US202062956612P | 2020-01-02 | 2020-01-02 | |
| US62/956,612 | 2020-01-02 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2021137885A1 true WO2021137885A1 (en) | 2021-07-08 |
Family
ID=70918960
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/US2020/030140 Ceased WO2021137885A1 (en) | 2020-01-02 | 2020-04-27 | Systems and methods for storing content items in secondary storage |
Country Status (7)
| Country | Link |
|---|---|
| US (2) | US11463520B2 (https=) |
| EP (1) | EP4085594B1 (https=) |
| JP (1) | JP7318899B2 (https=) |
| KR (1) | KR20220123290A (https=) |
| AU (1) | AU2020417157A1 (https=) |
| CA (1) | CA3163480A1 (https=) |
| WO (1) | WO2021137885A1 (https=) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20240031654A (ko) * | 2022-09-01 | 2024-03-08 | 현대자동차주식회사 | 차량에서의 메모리 관리 방법 및 시스템 |
| CN116506566A (zh) * | 2023-06-20 | 2023-07-28 | 深圳市欣喜连连科技有限公司 | 一种物联网智能摄像系统数据分布式存储方法及系统 |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170134517A1 (en) * | 2012-11-27 | 2017-05-11 | Fastly, Inc. | Data storage based on content popularity |
Family Cites Families (45)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6442601B1 (en) * | 1999-03-25 | 2002-08-27 | International Business Machines Corporation | System, method and program for migrating files retrieved from over a network to secondary storage |
| US6721794B2 (en) * | 1999-04-01 | 2004-04-13 | Diva Systems Corp. | Method of data management for efficiently storing and retrieving data to respond to user access requests |
| US6701316B1 (en) * | 2000-04-07 | 2004-03-02 | Nec Corporation | Method and apparatus for intelligent network bandwidth and system resource utilization for web content fetch and refresh |
| US7058691B1 (en) * | 2000-06-12 | 2006-06-06 | Trustees Of Princeton University | System for wireless push and pull based services |
| US7444393B2 (en) * | 2001-10-30 | 2008-10-28 | Keicy K. Chung | Read-only storage device having network interface, a system including the device, and a method of distributing files over a network |
| US7437438B2 (en) * | 2001-12-27 | 2008-10-14 | Hewlett-Packard Development Company, L.P. | System and method for energy efficient data prefetching |
| US20040086166A1 (en) * | 2002-11-01 | 2004-05-06 | Photon Dynamics, Inc. | Method and apparatus for flat patterned media inspection |
| US7275179B1 (en) * | 2003-04-24 | 2007-09-25 | Network Appliance, Inc. | System and method for reducing unrecoverable media errors in a disk subsystem |
| WO2006046236A1 (en) * | 2004-10-26 | 2006-05-04 | May High-Tech Solutions, Ltd. | Method and apparatus for residue detection on a polished wafer |
| US8447837B2 (en) * | 2005-12-30 | 2013-05-21 | Akamai Technologies, Inc. | Site acceleration with content prefetching enabled through customer-specific configurations |
| KR101182523B1 (ko) * | 2008-07-28 | 2012-09-12 | 삼성전자주식회사 | 홈 네트워크에서 브라우징 속도를 향상하기 위한 시스템 및방법 |
| WO2011139305A1 (en) * | 2010-05-04 | 2011-11-10 | Azuki Systems, Inc. | Method and apparatus for carrier controlled dynamic rate adaptation and client playout rate reduction |
| US8230123B2 (en) * | 2010-08-23 | 2012-07-24 | International Business Machines Corporation | Using information on input/output (I/O) sizes of accesses to an extent to determine a type of storage device for the extent |
| US9002826B2 (en) * | 2010-10-27 | 2015-04-07 | Qualcomm Incorporated | Media file caching for an electronic device to conserve resources |
| US9336380B2 (en) * | 2010-12-15 | 2016-05-10 | Microsoft Technology Licensing Llc | Applying activity actions to frequent activities |
| US8788849B2 (en) * | 2011-02-28 | 2014-07-22 | Sandisk Technologies Inc. | Method and apparatus for protecting cached streams |
| GB201108709D0 (en) * | 2011-05-24 | 2011-07-06 | Corethree Ltd | Core engine |
| WO2013076763A1 (en) * | 2011-11-22 | 2013-05-30 | Hitachi, Ltd. | Storage system and control method of storage system |
| US9503510B2 (en) * | 2012-03-10 | 2016-11-22 | Headwater Partners Ii Llc | Content distribution based on a value metric |
| JP2014098978A (ja) * | 2012-11-13 | 2014-05-29 | Sony Corp | メモリ制御装置、メモリシステム、情報処理システムおよびメモリ制御方法 |
| US9177072B2 (en) * | 2013-03-14 | 2015-11-03 | Facebook, Inc. | Social cache |
| US9483191B2 (en) * | 2013-03-15 | 2016-11-01 | Arris Enterprises, Inc. | Multi-tier storage for delivery of services |
| US10579664B2 (en) * | 2013-09-06 | 2020-03-03 | Realnetworks, Inc. | Device-centric media prioritization systems and methods |
| US9413824B1 (en) * | 2015-01-30 | 2016-08-09 | Dropbox, Inc. | Storage constrained synchronization of content items based on predicted user access to shared content items using retention scoring |
| US9185164B1 (en) * | 2015-01-30 | 2015-11-10 | Dropbox, Inc. | Idle state triggered constrained synchronization of shared content items |
| WO2016135955A1 (ja) * | 2015-02-27 | 2016-09-01 | 株式会社日立製作所 | 不揮発性メモリデバイス |
| US11385797B2 (en) * | 2015-10-05 | 2022-07-12 | Micron Technology, Inc. | Solid state storage device with variable logical capacity based on memory lifecycle |
| US20170168956A1 (en) * | 2015-12-15 | 2017-06-15 | Facebook, Inc. | Block cache staging in content delivery network caching system |
| US10120872B2 (en) * | 2015-12-28 | 2018-11-06 | Facebook, Inc. | Data caching based on requestor identity |
| WO2017154127A1 (ja) * | 2016-03-09 | 2017-09-14 | 株式会社日立製作所 | ストレージ装置の性能管理方法及び装置 |
| US10404829B2 (en) * | 2016-03-11 | 2019-09-03 | Wipro Limited | Method and system for achieving improved quality of service (QoS) for content delivery in a SDN controller based communication network |
| US11048764B2 (en) * | 2016-12-30 | 2021-06-29 | Verizon Media Inc. | Managing under—and over-represented content topics in content pools |
| US10289473B2 (en) * | 2017-03-23 | 2019-05-14 | Netscout Systems, Inc. | Situation analysis |
| US20190028766A1 (en) * | 2017-07-18 | 2019-01-24 | Audible Magic Corporation | Media classification for media identification and licensing |
| US20190044809A1 (en) * | 2017-08-30 | 2019-02-07 | Intel Corporation | Technologies for managing a flexible host interface of a network interface controller |
| JP6982468B2 (ja) * | 2017-10-27 | 2021-12-17 | キオクシア株式会社 | メモリシステムおよび制御方法 |
| US10534832B1 (en) * | 2017-11-01 | 2020-01-14 | Amazon Technologies, Inc. | Server-side tracking and selection of rotating content |
| US11294954B2 (en) * | 2018-01-04 | 2022-04-05 | Audible Magic Corporation | Music cover identification for search, compliance, and licensing |
| US11449256B2 (en) * | 2018-05-15 | 2022-09-20 | Samsung Electronics Co., Ltd. | Method for accelerating image storing and retrieving differential latency storage devices based on access rates |
| US11924304B2 (en) * | 2018-07-27 | 2024-03-05 | International Business Machines Corporation | Accessing cached data using hash keys |
| CN110908926B (zh) * | 2018-09-14 | 2022-03-22 | 慧荣科技股份有限公司 | 数据储存装置及逻辑至物理地址映射表的写入方法 |
| US11099952B2 (en) * | 2018-11-06 | 2021-08-24 | International Business Machines Corporation | Leveraging server side cache in failover scenario |
| US10779023B2 (en) * | 2019-01-11 | 2020-09-15 | International Business Machines Corporation | Content prediction for cloud-based delivery |
| US11157209B2 (en) * | 2019-01-22 | 2021-10-26 | EMC IP Holding Company LLC | Storage allocation techniques using logical region I/O access information and temporal trend prediction |
| US11323514B2 (en) * | 2019-04-30 | 2022-05-03 | EMC IP Holding Company LLC | Data tiering for edge computers, hubs and central systems |
-
2020
- 2020-04-27 WO PCT/US2020/030140 patent/WO2021137885A1/en not_active Ceased
- 2020-04-27 EP EP20729264.0A patent/EP4085594B1/en active Active
- 2020-04-27 JP JP2022539295A patent/JP7318899B2/ja active Active
- 2020-04-27 US US16/859,918 patent/US11463520B2/en active Active
- 2020-04-27 AU AU2020417157A patent/AU2020417157A1/en not_active Abandoned
- 2020-04-27 KR KR1020227026771A patent/KR20220123290A/ko active Pending
- 2020-04-27 CA CA3163480A patent/CA3163480A1/en active Pending
-
2022
- 2022-10-01 US US17/958,355 patent/US20230026912A1/en not_active Abandoned
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170134517A1 (en) * | 2012-11-27 | 2017-05-11 | Fastly, Inc. | Data storage based on content popularity |
Non-Patent Citations (1)
| Title |
|---|
| ANONYMOUS: "Cache replacement policies - Wikipedia", 14 December 2019 (2019-12-14), XP055724087, Retrieved from the Internet <URL:https://en.wikipedia.org/w/index.php?title=Cache_replacement_policies&oldid=930744547> [retrieved on 20200820] * |
Also Published As
| Publication number | Publication date |
|---|---|
| CA3163480A1 (en) | 2021-07-08 |
| JP7318899B2 (ja) | 2023-08-01 |
| KR20220123290A (ko) | 2022-09-06 |
| US20230026912A1 (en) | 2023-01-26 |
| AU2020417157A1 (en) | 2022-07-28 |
| US20210211496A1 (en) | 2021-07-08 |
| JP2023509125A (ja) | 2023-03-07 |
| EP4085594B1 (en) | 2024-09-18 |
| EP4085594A1 (en) | 2022-11-09 |
| US11463520B2 (en) | 2022-10-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102782681B (zh) | 用于支持用户内容馈送的机制 | |
| US12003808B2 (en) | Cache management in content delivery systems | |
| CN114827145B (zh) | 服务器集群系统、元数据的访问方法及装置 | |
| CN101668046A (zh) | 资源缓存方法、资源获取方法及其装置、系统 | |
| KR20110050432A (ko) | 컨텐츠 전달 네트워크 내의 노드에서 하나 이상의 컨텐츠 아이템을 캐싱하는 방법, 장치 및 제품 | |
| US10346303B1 (en) | Origin server cache eviction system | |
| US20230026912A1 (en) | Systems and methods for storing content items in secondary storage | |
| CN117539915B (zh) | 一种数据处理方法及相关装置 | |
| US9900384B2 (en) | Distributed caching in a communication network | |
| US6973536B1 (en) | Self-adaptive hybrid cache | |
| US10341454B2 (en) | Video and media content delivery network storage in elastic clouds | |
| US10992743B1 (en) | Dynamic cache fleet management | |
| US12050534B1 (en) | Multi-tenant caching service in a hosted computing environment | |
| US20260074923A1 (en) | Distributing Digital Content With Edge Devices | |
| CN117971896A (zh) | 数据处理方法、装置、计算机设备和存储介质 | |
| CN119520612A (zh) | 缓存更新方法、系统以及装置 | |
| CN117061540A (zh) | 数据获取方法、装置、计算机设备、存储介质和程序产品 | |
| LATENCY et al. | INTERNATIONAL JOURNAL OF COMPUTER ENGINEERING & TECHNOLOGY (IJCET) |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20729264 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 2022539295 Country of ref document: JP Kind code of ref document: A |
|
| ENP | Entry into the national phase |
Ref document number: 3163480 Country of ref document: CA |
|
| ENP | Entry into the national phase |
Ref document number: 2020417157 Country of ref document: AU Date of ref document: 20200427 Kind code of ref document: A |
|
| ENP | Entry into the national phase |
Ref document number: 20227026771 Country of ref document: KR Kind code of ref document: A |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2020729264 Country of ref document: EP Effective date: 20220802 |