DK3400542T3 - Teknikker til udførelse af dataafstemning i fordelte datalagringssystemer - Google Patents

Teknikker til udførelse af dataafstemning i fordelte datalagringssystemer Download PDF

Info

Publication number
DK3400542T3
DK3400542T3 DK17701016.2T DK17701016T DK3400542T3 DK 3400542 T3 DK3400542 T3 DK 3400542T3 DK 17701016 T DK17701016 T DK 17701016T DK 3400542 T3 DK3400542 T3 DK 3400542T3
Authority
DK
Denmark
Prior art keywords
techniques
storage systems
data storage
reconciliation
distributed data
Prior art date
Application number
DK17701016.2T
Other languages
English (en)
Inventor
Ioannis Papapanagiotou
Shailesh Birari
Jason Cacciatore
Minh Do
Christos Kalantzis
Original Assignee
Netflix Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Netflix Inc filed Critical Netflix Inc
Application granted granted Critical
Publication of DK3400542T3 publication Critical patent/DK3400542T3/da

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G06F16/2365—Ensuring data consistency and integrity
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1448—Management of the data involved in backup or backup restore
    • G06F11/1451—Management of the data involved in backup or backup restore by selection of backup contents
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/11—File system administration, e.g. details of archiving or snapshots
    • G06F16/128—Details of file system snapshots on the file-level, e.g. snapshot creation, administration, deletion
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/17—Details of further file system functions
    • G06F16/174—Redundancy elimination performed by the file system
    • G06F16/1744—Redundancy elimination performed by the file system using compression, e.g. sparse files
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/17—Details of further file system functions
    • G06F16/178—Techniques for file synchronisation in file systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00—Network architectures or network communication protocols for network security
    • H04L63/04—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
    • H04L63/0428—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/835—Timestamp
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/84—Using snapshots, i.e. a logical point-in-time copy of the data

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Security & Cryptography (AREA)
  • Quality & Reliability (AREA)
  • Computer Hardware Design (AREA)
  • Computing Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
DK17701016.2T 2016-01-04 2017-01-04 Teknikker til udførelse af dataafstemning i fordelte datalagringssystemer DK3400542T3 (da)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US14/987,649 US11789926B2 (en) 2016-01-04 2016-01-04 Techniques for performing data reconciliation in distributed data store systems
PCT/US2017/012214 WO2017120257A1 (en) 2016-01-04 2017-01-04 Techniques for performing data reconciliation in distributed data store systems

Publications (1)

Publication Number Publication Date
DK3400542T3 true DK3400542T3 (da) 2022-01-03

Family

ID=57861288

Family Applications (1)

Application Number Title Priority Date Filing Date
DK17701016.2T DK3400542T3 (da) 2016-01-04 2017-01-04 Teknikker til udførelse af dataafstemning i fordelte datalagringssystemer

Country Status (7)

Country Link
US (1) US11789926B2 (da)
EP (1) EP3400542B1 (da)
CN (1) CN108701156B (da)
AU (2) AU2017205975A1 (da)
DK (1) DK3400542T3 (da)
MX (1) MX2018008318A (da)
WO (1) WO2017120257A1 (da)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10165077B2 (en) * 2016-06-08 2018-12-25 Microsoft Technology Licensing, Llc Cache management in a composite data environment
US10033827B2 (en) * 2016-06-08 2018-07-24 Microsoft Technology Licensing, Llc Scalable management of composite data collected with varied identifiers
US10331523B2 (en) * 2017-04-04 2019-06-25 International Business Machines Corporation Recovering a failed clustered system using configuration data fragments
US10824612B2 (en) 2017-08-21 2020-11-03 Western Digital Technologies, Inc. Key ticketing system with lock-free concurrency and versioning
US11210211B2 (en) 2017-08-21 2021-12-28 Western Digital Technologies, Inc. Key data store garbage collection and multipart object management
US11210212B2 (en) * 2017-08-21 2021-12-28 Western Digital Technologies, Inc. Conflict resolution and garbage collection in distributed databases
US11055266B2 (en) 2017-08-21 2021-07-06 Western Digital Technologies, Inc. Efficient key data store entry traversal and result generation
US11520905B2 (en) * 2019-11-20 2022-12-06 Kyndryl, Inc. Smart data protection
US11892975B1 (en) * 2021-09-30 2024-02-06 Amazon Technologies, Inc. Asynchronous consistent snapshots in a distributed system
US11907205B1 (en) * 2023-01-23 2024-02-20 Intuit, Inc. Generic parity solution for highly dynamic sources
US11809915B1 (en) 2023-04-05 2023-11-07 Sas Institute Inc. Parallel processing techniques for expediting reconciliation for a hierarchy of forecasts on a computer system
CN116644802A (zh) * 2023-07-19 2023-08-25 支付宝(杭州)信息技术有限公司 模型训练方法及装置

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06324928A (ja) * 1993-05-14 1994-11-25 Mitsubishi Electric Corp ログ生成装置とファイルの異なるバージョンの調停のための装置及び異なる場所にあるコンピュータファイルの異なるバージョンを調停するための装置
US20070106771A1 (en) * 2005-11-10 2007-05-10 International Business Machines Corporation Reconciliation of independently updated distributed data
CN102054035B (zh) 2010-12-29 2013-01-02 北京播思软件技术有限公司 一种基于数据范围的数据库数据同步方法
US10423481B2 (en) * 2014-03-14 2019-09-24 Cisco Technology, Inc. Reconciling redundant copies of media content
CN103870602B (zh) 2014-04-03 2017-05-31 中国科学院地理科学与资源研究所 数据库空间分片复制方法及系统

Also Published As

Publication number Publication date
EP3400542B1 (en) 2021-11-17
AU2020202621A1 (en) 2020-05-14
AU2020202621B2 (en) 2021-10-28
EP3400542A1 (en) 2018-11-14
AU2017205975A1 (en) 2018-07-19
US20170193031A1 (en) 2017-07-06
US11789926B2 (en) 2023-10-17
CN108701156A (zh) 2018-10-23
CN108701156B (zh) 2022-08-23
MX2018008318A (es) 2019-02-25
WO2017120257A1 (en) 2017-07-13

Similar Documents

Publication Publication Date Title
DK3400542T3 (da) Teknikker til udførelse af dataafstemning i fordelte datalagringssystemer
DK3569525T3 (da) Opbevaringssystem
DK3278041T3 (da) Automatiseret kryogent opbevaringssystem
DE112015000710T8 (de) Verteiltes Speichersystem
DK3344562T3 (da) Fremgangsmåde til hentning af en målbeholder opbevaret i et opbevaringssystem
DK3129912T3 (da) Fremgangsmåde og system til sikring af data
DK3241418T3 (da) Varmebortledningssystemer og -fremgangsmåder til datacenter
DK3107841T3 (da) Afkølet opbevaringssystem
DE112015001709A5 (de) Radarsystem mit optimierter Speicherung von Zwischendaten
DK3495959T3 (da) Isolering af klienter i distribueret lagringssystemer
DK2976657T3 (da) Positionsreferencesystem og fremgangsmåde til positionering og sporing af en eller flere genstande
DK3055939T3 (da) Systemer og fremgangsmåder til kommunikation af redundant rammeinformation
DK3383228T3 (da) Opbevaringssystem meddækliste
DK3262513T3 (da) Lagring af data
EP3105708A4 (en) High density in situ barcode reading system
DK3017315T3 (da) Systemer og fremgangsmåder til mærkning af crowd sourced data
DK3277067T3 (da) Modulære datacentersystemer
DK3494493T3 (da) Ompartitionering af data i et distribueret computersystem
DK3321501T3 (da) System til energilagring og -genvinding
DK3369233T3 (da) Fremangsmåder og systemer til forvaltning af oplysninger om indholdsabonnement
HK1244914A1 (zh) 數據存儲系統
DK3209164T4 (da) Lagerreol
DK3188051T3 (da) Systemer og fremgangsmåder til generering af søgeskabeloner
FI20165731L (fi) Puunhakkuutietojärjestelmä
DK3275841T3 (da) Primært filtrerings- og lagringssystem