MX2019004026A - Técnicas para generar instantáneas de conjuntos de datos. - Google Patents

Técnicas para generar instantáneas de conjuntos de datos.

Info

Publication number
MX2019004026A
MX2019004026A MX2019004026A MX2019004026A MX2019004026A MX 2019004026 A MX2019004026 A MX 2019004026A MX 2019004026 A MX2019004026 A MX 2019004026A MX 2019004026 A MX2019004026 A MX 2019004026A MX 2019004026 A MX2019004026 A MX 2019004026A
Authority
MX
Mexico
Prior art keywords
snapshot
compressed record
write state
source dataset
state application
Prior art date
Application number
MX2019004026A
Other languages
English (en)
Inventor
Andrew Koszewnik John
Original Assignee
Netflix Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Netflix Inc filed Critical Netflix Inc
Publication of MX2019004026A publication Critical patent/MX2019004026A/es

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/73—Querying
    • G06F16/738—Presentation of query results
    • G06F16/739—Presentation of query results in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G06F3/0611—Improving I/O performance in relation to response time
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1448—Management of the data involved in backup or backup restore
    • G06F11/1451—Management of the data involved in backup or backup restore by selection of backup contents
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614—Improving the reliability of storage systems
    • G06F3/0619—Improving the reliability of storage systems in relation to data integrity, e.g. data losses, bit errors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/064—Management of blocks
    • G06F3/0641—De-duplication techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/065—Replication mechanisms
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0673—Single storage device
    • G06F3/068—Hybrid storage device
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices
    • G06F3/0685—Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/84—Using snapshots, i.e. a logical point-in-time copy of the data

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Quality & Reliability (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Techniques For Improving Reliability Of Storages (AREA)

Abstract

En varias modalidades, una aplicación de estado de escritura genera una imagen que incluye uno o más valores de datos asociados con un conjunto de datos de origen. En funcionamiento, la aplicación de estado de escritura realiza una o más operaciones de compresión en el conjunto de datos de origen para generar un primer registro comprimido. La aplicación de estado de escritura luego serializa el primer registro comprimido y un segundo registro comprimido para generar una primera lista de registros comprimidos. Finalmente, la aplicación de estado de escritura genera la imagen basándose en la primera lista de registros comprimidos. Cuando se accede a los valores de datos desde la primera imagen, se mantiene el tamaño de la imagen. Ventajosamente, debido a que el tamaño de la imagen es más pequeño que el tamaño del conjunto de datos de origen, algunos consumidores que no pueden almacenar todo el conjunto de datos de origen en la memoria de acceso aleatorio (RAM) son capaces de almacenar la imagen completa en la RAM.
MX2019004026A 2016-10-06 2017-10-05 Técnicas para generar instantáneas de conjuntos de datos. MX2019004026A (es)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US201662405157P 2016-10-06 2016-10-06
US201662425767P 2016-11-23 2016-11-23
US201662428640P 2016-12-01 2016-12-01
US201662432048P 2016-12-09 2016-12-09
US15/725,259 US11747983B2 (en) 2016-10-06 2017-10-04 Techniques for generating snapshots of datasets
PCT/US2017/055399 WO2018067856A1 (en) 2016-10-06 2017-10-05 Techniques for generating snapshots of datasets

Publications (1)

Publication Number Publication Date
MX2019004026A true MX2019004026A (es) 2019-09-09

Family

ID=61828868

Family Applications (2)

Application Number Title Priority Date Filing Date
MX2019004027A MX2019004027A (es) 2016-10-06 2017-10-05 Técnicas para generar y operar los conjuntos de datos en memoria.
MX2019004026A MX2019004026A (es) 2016-10-06 2017-10-05 Técnicas para generar instantáneas de conjuntos de datos.

Family Applications Before (1)

Application Number Title Priority Date Filing Date
MX2019004027A MX2019004027A (es) 2016-10-06 2017-10-05 Técnicas para generar y operar los conjuntos de datos en memoria.

Country Status (7)

Country Link
US (2) US20180101312A1 (es)
EP (2) EP3523735A1 (es)
AU (4) AU2017340759B2 (es)
CA (2) CA3039535C (es)
MX (2) MX2019004027A (es)
PL (1) PL3523734T3 (es)
WO (2) WO2018067856A1 (es)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11422897B2 (en) * 2019-07-31 2022-08-23 Rubrik, Inc. Optimizing snapshot image processing
CN111858158B (zh) * 2020-06-19 2023-11-10 北京金山云网络技术有限公司 数据处理方法、装置及电子设备
CA3210343A1 (en) * 2021-01-31 2022-08-04 Ab Initio Technology Llc Dataset multiplexer for data processing system
WO2023244446A1 (en) * 2022-06-16 2023-12-21 Oracle International Corporation Scalable and secure cross-region and optimized file system replication for cloud scale
US20230409522A1 (en) 2022-06-16 2023-12-21 Oracle International Corporation Scalable and secure cross region and optimized file system delta transfer for cloud scale

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5663721A (en) * 1995-03-20 1997-09-02 Compaq Computer Corporation Method and apparatus using code values and length fields for compressing computer data
EP1056273A3 (en) 1999-05-25 2002-01-02 SeeItFirst, Inc. Method and system for providing high quality images from a digital video stream
CN1411580A (zh) * 2000-01-10 2003-04-16 连接公司 客户机－服务器环境中差异备份系统的管理
US6957362B2 (en) 2002-08-06 2005-10-18 Emc Corporation Instantaneous restoration of a production copy from a snapshot copy in a data storage system
US7756833B2 (en) * 2004-09-22 2010-07-13 Microsoft Corporation Method and system for synthetic backup and restore
US7941619B1 (en) * 2004-11-18 2011-05-10 Symantec Operating Corporation Space-optimized backup set conversion
US20070198659A1 (en) * 2006-01-25 2007-08-23 Lam Wai T Method and system for storing data
US9501365B2 (en) * 2009-12-28 2016-11-22 Netapp, Inc. Cloud-based disaster recovery of backup data and metadata
US9336225B2 (en) 2011-02-24 2016-05-10 A9.Com, Inc. Encoding of variable-length data with unary formats
US10275840B2 (en) 2011-10-04 2019-04-30 Electro Industries/Gauge Tech Systems and methods for collecting, analyzing, billing, and reporting data from intelligent electronic devices
US8949517B2 (en) 2011-10-05 2015-02-03 Lsi Corporation Self-journaling and hierarchical consistency for non-volatile storage
CN104040541B (zh) 2011-12-08 2018-04-10 甲骨文国际公司 用于更高效地使用存储器至cpu带宽的技术
US20170039372A1 (en) * 2013-03-15 2017-02-09 Electro Industries/Gauge Tech Devices, systems and methods for upgrading firmware in intelligent electronic devices
US10277414B2 (en) * 2014-07-18 2019-04-30 Oracle International Corporation Communication gateway services in a networked message distribution system

Also Published As

Publication number Publication date
CA3039535A1 (en) 2018-04-12
WO2018067856A1 (en) 2018-04-12
AU2017340761A1 (en) 2019-05-02
AU2017340759A1 (en) 2019-05-02
US20180101311A1 (en) 2018-04-12
US11747983B2 (en) 2023-09-05
CA3039537A1 (en) 2018-04-12
CA3039535C (en) 2022-07-19
MX2019004027A (es) 2019-09-27
AU2021200723A1 (en) 2021-03-04
CA3039537C (en) 2022-08-16
US20180101312A1 (en) 2018-04-12
EP3523735A1 (en) 2019-08-14
EP3523734B1 (en) 2024-02-14
AU2020204094A1 (en) 2020-07-09
WO2018067858A1 (en) 2018-04-12
PL3523734T3 (pl) 2024-06-10
EP3523734A1 (en) 2019-08-14
AU2017340759B2 (en) 2020-11-05
AU2017340761B2 (en) 2020-03-19

Similar Documents

Publication Publication Date Title
MX2019004026A (es) Técnicas para generar instantáneas de conjuntos de datos.
GB2558478A (en) Copy-Redirect on write
US9851917B2 (en) Method for de-duplicating data and apparatus therefor
WO2015066719A3 (en) Use of solid state storage devices and the like in data deduplication
WO2015026679A3 (en) Disconnected operation for systems utilizing cloud storage
CA2902821C (en) System for metadata management
BR112019000353A2 (pt) método para o registro de uma transação de dados
EP4287026A3 (en) Distributed hardware tracing
SG11201907942QA (en) Blockchain cluster processing system and method, computer device and storage medium
EP4395233A3 (en) Immutable datastore for low-latency reading and writing of large data sets
WO2015066489A3 (en) Efficient implementations for mapreduce systems
MX2023000287A (es) Sistema de captura y descubrimiento de conocimiento.
AU2017280917A1 (en) Relational rendering of holographic objects
GB201317058D0 (en) Systems apparatuses and methods for expanding a memory source into a destination register and compressing a source register into a destinationmemory location
MX2017011793A (es) Deteccion de segmentos de un programa de video.
EP4407500A3 (en) System and method of controllably disclosing sensitive data
EP2889787A3 (en) Adaptive dictionary compression/decompression for column-store databases
EP4209902A4 (en) MEMORY ALLOCATION METHOD, ASSOCIATED APPARATUS AND COMPUTER-READABLE STORAGE MEDIUM
MX2016013227A (es) Metodo para almacenar datos por medio de un dispositivo de almacenamiento y dispositivo de almacenamiento.
TWD193016S (zh) Smart speaker
GB2554508A (en) Workload-adaptive data packing algorithm
CN107408079A8 (zh) 带有一致单元的多级别系统存储器的存储器控制器
SG10201805093TA (en) Key-value storage device supporting snapshot function and operating method thereof
WO2018164919A3 (en) Replicating storage tables used to manage cloud-based resources to withstand storage account outage
AU2014410705A1 (en) Data processing method and apparatus