JPWO2021137885A5 - - Google Patents

Download PDF

Info

Publication number
JPWO2021137885A5
JPWO2021137885A5 JP2022539295A JP2022539295A JPWO2021137885A5 JP WO2021137885 A5 JPWO2021137885 A5 JP WO2021137885A5 JP 2022539295 A JP2022539295 A JP 2022539295A JP 2022539295 A JP2022539295 A JP 2022539295A JP WO2021137885 A5 JPWO2021137885 A5 JP WO2021137885A5
Authority
JP
Japan
Prior art keywords
storage device
content items
processor
requests
secondary storage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2022539295A
Other languages
Japanese (ja)
Other versions
JP7318899B2 (en
JP2023509125A (en
Publication date
Application filed filed Critical
Priority claimed from PCT/US2020/030140 external-priority patent/WO2021137885A1/en
Publication of JP2023509125A publication Critical patent/JP2023509125A/en
Publication of JPWO2021137885A5 publication Critical patent/JPWO2021137885A5/ja
Application granted granted Critical
Publication of JP7318899B2 publication Critical patent/JP7318899B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Claims (15)

コンテンツアイテムを格納するための方法であって、前記方法が、プロセッサと、一次ストレージデバイスと、二次ストレージデバイスと、ネットワークインタフェースとを含むコンピュータによって実装され、前記方法が、
前記ネットワークインタフェースを介して前記一次ストレージデバイスによって、クライアントからのそれぞれの要求に応答して、複数のコンテンツアイテムを受信する段階と、
前記ネットワークインタフェースを介して、前記クライアントからの前記それぞれの要求に応答して、前記一次ストレージデバイスからクライアントに前記複数のコンテンツアイテムを分配する段階と、
前記プロセッサによって、前記複数のコンテンツアイテムのそれぞれのコンテンツアイテムの適性値を生成する段階であって、前記適性値は、前記複数のコンテンツアイテムの他のコンテンツアイテムと比べた、前記それぞれのコンテンツアイテムを前記二次ストレージデバイスに書き込むことの価値を示し、前記適性値は少なくとも要求の頻度と、要求のレートと、要求の回数との組み合わせに基づく、段階と、
前記プロセッサによって、経時的な前記クライアントからの前記それぞれの要求と、前記生成された適性値と、前記二次ストレージデバイスへの前記コンテンツアイテムの書き込みのそれぞれのコストとに基づいて、前記コンテンツアイテムについて動的優先度リストを生成する段階であって、前記それぞれのコストは、前記二次ストレージデバイスに前記コンテンツアイテムを書き込んだ結果として前記二次ストレージデバイスの予想される劣化に基づく、段階と、
前記プロセッサによって、前記動的優先度リストに基づいて、前記コンテンツアイテムのサブセットのみを前記二次ストレージデバイスに書き込む段階と
を備える、方法。 A method for storing content items, said method being implemented by a computer including a processor, a primary storage device, a secondary storage device, and a network interface, said method comprising:
receiving a plurality of content items in response to respective requests from clients by the primary storage device via the network interface;
distributing the plurality of content items from the primary storage device to clients via the network interface in response to the respective requests from the clients;
generating, by the processor, a suitability value for each content item of the plurality of content items, wherein the suitability value compares the respective content item to other content items of the plurality of content items; indicating the value of writing to the secondary storage device, the suitability value being based at least on a combination of frequency of requests, rate of requests, and number of requests;
by the processor based on the respective requests from the client over time , the generated eligibility values, and the respective costs of writing the content items to the secondary storage device; generating a dynamic priority list, wherein the respective costs are based on expected degradation of the secondary storage device as a result of writing the content item to the secondary storage device;
writing, by the processor, only a subset of the content items to the secondary storage device based on the dynamic priority list. 前記一次ストレージデバイスがメモリキャッシュを有し、前記二次ストレージデバイスが大容量ストレージデバイスを有する、請求項１に記載の方法。 2. The method of claim 1, wherein the primary storage device comprises a memory cache and the secondary storage device comprises a mass storage device. 前記一次ストレージデバイスが第１のレートでコンテンツアイテムを受信し、前記二次ストレージデバイスが、前記第１のレートよりも大幅に低い第２のレートでコンテンツアイテムを受信する、請求項１または２に記載の方法。 3. The method of claim 1 or 2, wherein the primary storage device receives content items at a first rate and the secondary storage device receives content items at a second rate substantially lower than the first rate. described method. 前記プロセッサによって、前記クライアントからの前記それぞれの要求に応答して、前記一次ストレージデバイスからコンテンツアイテムを削除する段階をさらに備える、請求項１または２に記載の方法。 3. The method of claim 1 or 2 , further comprising, by the processor, deleting content items from the primary storage device in response to the respective request from the client. 前記プロセッサは、前記クライアントが前記コンテンツアイテムをそれぞれ要求する頻度に基づいて、前記動的優先度リストを生成する、請求項１または２に記載の方法。 3. The method of claim 1 or 2, wherein the processor generates the dynamic priority list based on how often the clients request each of the content items. 前記プロセッサは、前記クライアントが前記コンテンツアイテムをそれぞれ要求する回数に基づいて、前記動的優先度リストを生成する、請求項１または２に記載の方法。 3. The method of claim 1 or 2, wherein the processor generates the dynamic priority list based on the number of times the client requests each of the content items. 前記プロセッサは、前記クライアントが前記コンテンツアイテムをそれぞれ要求するレートの変化に基づいて、前記動的優先度リストを生成する、請求項１または２に記載の方法。 3. The method of claim 1 or 2 , wherein the processor generates the dynamic priority list based on changes in the rate at which the clients request each of the content items. 前記プロセッサが、前記ネットワークインタフェースを介して前記コンテンツアイテムを受信するそれぞれのコストに基づいて、前記動的優先度リストを生成する、請求項１または２に記載の方法。 3. The method of claim 1 or 2, wherein the processor generates the dynamic priority list based on respective costs of receiving the content items via the network interface. 前記プロセッサが、前記一次ストレージデバイスへの前記コンテンツアイテムの書き込みのそれぞれのコストに基づいて、前記動的優先度リストを生成する、請求項１または２に記載の方法。 3. The method of claim 1 or 2, wherein the processor generates the dynamic priority list based on respective costs of writing the content items to the primary storage device. 前記コンピュータが、コンテンツ配信ネットワークのノードを有する、請求項１または２に記載の方法。 3. A method according to claim 1 or 2 , wherein said computer comprises a node of a content distribution network. 前記プロセッサが、前記クライアントから前記それぞれの要求を受信し、そのような要求に応答して前記複数のコンテンツアイテムを前記クライアントに分配する、請求項１または２に記載の方法。 3. A method according to claim 1 or 2 , wherein said processor receives said respective requests from said clients and distributes said plurality of content items to said clients in response to such requests. 前記プロセッサが、前記一次ストレージデバイスからの前記コンテンツアイテムの前記サブセットを前記二次ストレージデバイスに書き込む、請求項１または２に記載の方法。 3. The method of claim 1 or 2 , wherein the processor writes the subset of the content items from the primary storage device to the secondary storage device. 前記プロセッサが、前記ネットワークインタフェースからの前記コンテンツアイテムの前記サブセットを前記二次ストレージデバイスに書き込む、請求項１または２に記載の方法。 3. The method of claim 1 or 2 , wherein the processor writes the subset of the content items from the network interface to the secondary storage device. 前記プロセッサが、前記それぞれのコンテンツアイテムが前記一次ストレージデバイスにおいて利用可能であるかどうかに基づいて、前記動的優先度リストを生成する、請求項１３に記載の方法。 14. The method of claim 13 , wherein said processor generates said dynamic priority list based on whether said respective content item is available in said primary storage device. プロセッサと、一次ストレージデバイスと、二次ストレージデバイスと、ネットワークインタフェースとを備えるコンピュータシステムであって、前記プロセッサが、
前記ネットワークインタフェースを介して前記一次ストレージデバイスによって、クライアントからのそれぞれの要求に応答して、複数のコンテンツアイテムを受信することと、
前記ネットワークインタフェースを介して、前記クライアントからの前記それぞれの要求に応答して、前記一次ストレージデバイスからクライアントに前記複数のコンテンツアイテムを分配することと、
前記プロセッサによって、前記複数のコンテンツアイテムのそれぞれのコンテンツアイテムの適性値を生成することであって、前記適性値は、前記複数のコンテンツアイテムの他のコンテンツアイテムと比べた、前記それぞれのコンテンツアイテムを前記二次ストレージデバイスに書き込むことの価値を示し、前記適性値は少なくとも要求の頻度と、要求のレートと、要求の回数との組み合わせに基づく、生成することと、
前記プロセッサによって、経時的な前記クライアントからの前記それぞれの要求と、前記生成された適性値と、前記二次ストレージデバイスへの前記複数のコンテンツアイテムの書き込みのそれぞれのコストとに基づいて、前記複数のコンテンツアイテムについて動的優先度リストを生成することであって、前記それぞれのコストは、前記二次ストレージデバイスに前記複数のコンテンツアイテムを書き込んだ結果として前記二次ストレージデバイスの予想される劣化に基づく、生成することと、
前記プロセッサによって、前記動的優先度リストに基づいて、前記複数のコンテンツアイテムのサブセットのみを前記二次ストレージデバイスに書き込むことと
を含む動作を実装するように構成されている、コンピュータシステム。 A computer system comprising a processor, a primary storage device, a secondary storage device, and a network interface, wherein the processor:
receiving a plurality of content items in response to respective requests from clients by the primary storage device via the network interface;
distributing the plurality of content items from the primary storage device to clients via the network interface in response to the respective requests from the clients;
generating, by the processor, a suitability value for each content item of the plurality of content items, wherein the suitability value compares the respective content item to other content items of the plurality of content items; indicating the value of writing to the secondary storage device, wherein the eligibility value is based at least on a combination of frequency of requests, rate of requests, and number of requests;
by the processor based on the respective requests from the client over time, the generated eligibility values, and respective costs of writing the plurality of content items to the secondary storage device; content items, wherein each said cost is proportional to expected degradation of said secondary storage device as a result of writing said plurality of content items to said secondary storage device. based on, generating , and
writing only a subset of the plurality of content items to the secondary storage device based on the dynamic priority list.
JP2022539295A 2020-01-02 2020-04-27 Systems and methods for storing content items in secondary storage Active JP7318899B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202062956612P 2020-01-02 2020-01-02
US62/956,612 2020-01-02
PCT/US2020/030140 WO2021137885A1 (en) 2020-01-02 2020-04-27 Systems and methods for storing content items in secondary storage

Publications (3)

Publication Number Publication Date
JP2023509125A JP2023509125A (en) 2023-03-07
JPWO2021137885A5 true JPWO2021137885A5 (en) 2023-05-09
JP7318899B2 JP7318899B2 (en) 2023-08-01

Family

ID=70918960

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2022539295A Active JP7318899B2 (en) 2020-01-02 2020-04-27 Systems and methods for storing content items in secondary storage

Country Status (7)

Country Link
US (2) US11463520B2 (en)
EP (1) EP4085594A1 (en)
JP (1) JP7318899B2 (en)
KR (1) KR20220123290A (en)
AU (1) AU2020417157A1 (en)
CA (1) CA3163480A1 (en)
WO (1) WO2021137885A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116506566A (en) * 2023-06-20 2023-07-28 深圳市欣喜连连科技有限公司 Data distributed storage method and system for intelligent camera system of Internet of things

Family Cites Families (46)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6442601B1 (en) * 1999-03-25 2002-08-27 International Business Machines Corporation System, method and program for migrating files retrieved from over a network to secondary storage
US6721794B2 (en) * 1999-04-01 2004-04-13 Diva Systems Corp. Method of data management for efficiently storing and retrieving data to respond to user access requests
US6701316B1 (en) * 2000-04-07 2004-03-02 Nec Corporation Method and apparatus for intelligent network bandwidth and system resource utilization for web content fetch and refresh
US7058691B1 (en) * 2000-06-12 2006-06-06 Trustees Of Princeton University System for wireless push and pull based services
US7444393B2 (en) * 2001-10-30 2008-10-28 Keicy K. Chung Read-only storage device having network interface, a system including the device, and a method of distributing files over a network
US7437438B2 (en) * 2001-12-27 2008-10-14 Hewlett-Packard Development Company, L.P. System and method for energy efficient data prefetching
US20040086166A1 (en) * 2002-11-01 2004-05-06 Photon Dynamics, Inc. Method and apparatus for flat patterned media inspection
US7275179B1 (en) * 2003-04-24 2007-09-25 Network Appliance, Inc. System and method for reducing unrecoverable media errors in a disk subsystem
WO2006046236A1 (en) * 2004-10-26 2006-05-04 May High-Tech Solutions, Ltd. Method and apparatus for residue detection on a polished wafer
US8447837B2 (en) * 2005-12-30 2013-05-21 Akamai Technologies, Inc. Site acceleration with content prefetching enabled through customer-specific configurations
KR101182523B1 (en) * 2008-07-28 2012-09-12 삼성전자주식회사 System and method for improving of browsing performance in home network
WO2011139305A1 (en) * 2010-05-04 2011-11-10 Azuki Systems, Inc. Method and apparatus for carrier controlled dynamic rate adaptation and client playout rate reduction
US8230123B2 (en) * 2010-08-23 2012-07-24 International Business Machines Corporation Using information on input/output (I/O) sizes of accesses to an extent to determine a type of storage device for the extent
US9002826B2 (en) * 2010-10-27 2015-04-07 Qualcomm Incorporated Media file caching for an electronic device to conserve resources
US9336380B2 (en) * 2010-12-15 2016-05-10 Microsoft Technology Licensing Llc Applying activity actions to frequent activities
US8788849B2 (en) * 2011-02-28 2014-07-22 Sandisk Technologies Inc. Method and apparatus for protecting cached streams
GB201108709D0 (en) * 2011-05-24 2011-07-06 Corethree Ltd Core engine
US8775723B2 (en) * 2011-11-22 2014-07-08 Hitachi, Ltd. Storage system and control method of storage system
US9503510B2 (en) * 2012-03-10 2016-11-22 Headwater Partners Ii Llc Content distribution based on a value metric
JP2014098978A (en) 2012-11-13 2014-05-29 Sony Corp Memory control apparatus, memory system, information processing system, and memory control method
US9491253B2 (en) * 2012-11-27 2016-11-08 Fastly, Inc. Data storage based on content popularity
US9177072B2 (en) * 2013-03-14 2015-11-03 Facebook, Inc. Social cache
US9483191B2 (en) * 2013-03-15 2016-11-01 Arris Enterprises, Inc. Multi-tier storage for delivery of services
US10579664B2 (en) * 2013-09-06 2020-03-03 Realnetworks, Inc. Device-centric media prioritization systems and methods
US9185164B1 (en) * 2015-01-30 2015-11-10 Dropbox, Inc. Idle state triggered constrained synchronization of shared content items
US9413824B1 (en) * 2015-01-30 2016-08-09 Dropbox, Inc. Storage constrained synchronization of content items based on predicted user access to shared content items using retention scoring
US10241909B2 (en) * 2015-02-27 2019-03-26 Hitachi, Ltd. Non-volatile memory device
US11385797B2 (en) * 2015-10-05 2022-07-12 Micron Technology, Inc. Solid state storage device with variable logical capacity based on memory lifecycle
US20170168956A1 (en) * 2015-12-15 2017-06-15 Facebook, Inc. Block cache staging in content delivery network caching system
US10120872B2 (en) * 2015-12-28 2018-11-06 Facebook, Inc. Data caching based on requestor identity
WO2017154127A1 (en) * 2016-03-09 2017-09-14 株式会社日立製作所 Storage device performance management method and device
US10404829B2 (en) * 2016-03-11 2019-09-03 Wipro Limited Method and system for achieving improved quality of service (QoS) for content delivery in a SDN controller based communication network
US11048764B2 (en) * 2016-12-30 2021-06-29 Verizon Media Inc. Managing under—and over-represented content topics in content pools
US10289473B2 (en) * 2017-03-23 2019-05-14 Netscout Systems, Inc. Situation analysis
US20190028766A1 (en) * 2017-07-18 2019-01-24 Audible Magic Corporation Media classification for media identification and licensing
US20190044809A1 (en) * 2017-08-30 2019-02-07 Intel Corporation Technologies for managing a flexible host interface of a network interface controller
JP6982468B2 (en) * 2017-10-27 2021-12-17 キオクシア株式会社 Memory system and control method
US10534832B1 (en) * 2017-11-01 2020-01-14 Amazon Technologies, Inc. Server-side tracking and selection of rotating content
US11294954B2 (en) * 2018-01-04 2022-04-05 Audible Magic Corporation Music cover identification for search, compliance, and licensing
US11449256B2 (en) * 2018-05-15 2022-09-20 Samsung Electronics Co., Ltd. Method for accelerating image storing and retrieving differential latency storage devices based on access rates
US11924304B2 (en) * 2018-07-27 2024-03-05 International Business Machines Corporation Accessing cached data using hash keys
CN110908926B (en) * 2018-09-14 2022-03-22 慧荣科技股份有限公司 Data storage device and writing method of logical-to-physical address mapping table
US11099952B2 (en) * 2018-11-06 2021-08-24 International Business Machines Corporation Leveraging server side cache in failover scenario
US10779023B2 (en) * 2019-01-11 2020-09-15 International Business Machines Corporation Content prediction for cloud-based delivery
US11157209B2 (en) * 2019-01-22 2021-10-26 EMC IP Holding Company LLC Storage allocation techniques using logical region I/O access information and temporal trend prediction
US11323514B2 (en) * 2019-04-30 2022-05-03 EMC IP Holding Company LLC Data tiering for edge computers, hubs and central systems

Similar Documents

Publication Publication Date Title
CN106233275B (en) Data management system and method
CN104243425B (en) A kind of method, apparatus and system carrying out Content Management in content distributing network
US11614970B2 (en) High-throughput parallel data transmission
JP7013510B2 (en) Localized data affinity system and hybrid method
US20080306990A1 (en) System for performing a redistribute transparently in a multi-node system
US20070073990A1 (en) Distribution of data in a distributed shared storage system
US11222258B2 (en) Load balancing for memory channel controllers
KR20200059136A (en) Method for distributing transaction load between shard based on ethereum sharding envirionment
CN106960011A (en) Metadata of distributed type file system management system and method
CN106569892A (en) Resource scheduling method and device
CN114218267A (en) Query request asynchronous processing method and device, computer equipment and storage medium
CN103905512B (en) A kind of data processing method and equipment
CN106940712A (en) Sequence generating method and equipment
JPWO2021137885A5 (en)
US11188258B2 (en) Distributed storage system
Wang et al. Data allocation algorithms for distributed video servers
KR20140049202A (en) Distributed database management system and method
Póvoa et al. Approximation algorithms and heuristics for task scheduling in data‐intensive distributed systems
Jayalakshmi et al. Dynamic data replication across geo-distributed cloud data centres
Ghandour et al. User-based Load Balancer in HBase.
Wang et al. Balanced partition scheme for distributed caching systems to solve load imbalance problems
CN111949218B (en) Load balancing method, system, medium and terminal for high-availability storage system
Mohamad et al. Implementation of Sub-Grid-Federation Model for Performance Improvement in Federated Data Grid
Roy et al. Non-recursive inorder traversal on constructed threaded KD tree for efficient cloud based space partitioning
JP6908880B2 (en) Shared devices, shared systems, sharing methods, and shared programs