MX2019004027A - Técnicas para generar y operar los conjuntos de datos en memoria. - Google Patents

Técnicas para generar y operar los conjuntos de datos en memoria.

Info

Publication number
MX2019004027A
MX2019004027A MX2019004027A MX2019004027A MX2019004027A MX 2019004027 A MX2019004027 A MX 2019004027A MX 2019004027 A MX2019004027 A MX 2019004027A MX 2019004027 A MX2019004027 A MX 2019004027A MX 2019004027 A MX2019004027 A MX 2019004027A
Authority
MX
Mexico
Prior art keywords
dataset
memory
size
source
store
Prior art date
Application number
MX2019004027A
Other languages
English (en)
Inventor
Andrew Koszewnik John
Original Assignee
Netflix Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Netflix Inc filed Critical Netflix Inc
Publication of MX2019004027A publication Critical patent/MX2019004027A/es

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/73—Querying
    • G06F16/738—Presentation of query results
    • G06F16/739—Presentation of query results in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G06F3/0611—Improving I/O performance in relation to response time
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1448—Management of the data involved in backup or backup restore
    • G06F11/1451—Management of the data involved in backup or backup restore by selection of backup contents
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614—Improving the reliability of storage systems
    • G06F3/0619—Improving the reliability of storage systems in relation to data integrity, e.g. data losses, bit errors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/064—Management of blocks
    • G06F3/0641—De-duplication techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/065—Replication mechanisms
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0673—Single storage device
    • G06F3/068—Hybrid storage device
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices
    • G06F3/0685—Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/84—Using snapshots, i.e. a logical point-in-time copy of the data

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Quality & Reliability (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Techniques For Improving Reliability Of Storages (AREA)

Abstract

En varias modalidades, un consumidor genera y opera con un conjunto de datos en memoria. En operación, una aplicación de estado de lectura copia una imagen asociada con un conjunto de datos de origen de un almacén de archivos a una memoria de acceso aleatorio (RAM) para generar un conjunto de datos en memoria. De manera notable, el conjunto de datos de origen tiene un primer tamaño, y el conjunto de datos en memoria tiene un segundo tamaño que es más pequeño que el primer tamaño. La aplicación de estado de lectura luego realiza una operación de sólo lectura en el conjunto de datos en memoria para acceder a uno o más valores de datos que se almacenan en el conjunto de datos en memoria y se asocian con el conjunto de datos de origen. Cuando se accede a uno o más valores de datos, se mantiene el segundo tamaño de datos del conjunto de datos en memoria. Ventajosamente, algunos consumidores que no son capaces de almacenar todo el conjunto de datos de origen, son capaces de almacenar la imagen completa en la RAM.
MX2019004027A 2016-10-06 2017-10-05 Técnicas para generar y operar los conjuntos de datos en memoria. MX2019004027A (es)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US201662405157P 2016-10-06 2016-10-06
US201662425767P 2016-11-23 2016-11-23
US201662428640P 2016-12-01 2016-12-01
US201662432048P 2016-12-09 2016-12-09
US15/725,261 US20180101312A1 (en) 2016-10-06 2017-10-04 Techniques for generating and operating on in-memory datasets
PCT/US2017/055401 WO2018067858A1 (en) 2016-10-06 2017-10-05 Techniques for generating and operating on in-memory datasets

Publications (1)

Publication Number Publication Date
MX2019004027A true MX2019004027A (es) 2019-09-27

Family

ID=61828868

Family Applications (2)

Application Number Title Priority Date Filing Date
MX2019004026A MX2019004026A (es) 2016-10-06 2017-10-05 Técnicas para generar instantáneas de conjuntos de datos.
MX2019004027A MX2019004027A (es) 2016-10-06 2017-10-05 Técnicas para generar y operar los conjuntos de datos en memoria.

Family Applications Before (1)

Application Number Title Priority Date Filing Date
MX2019004026A MX2019004026A (es) 2016-10-06 2017-10-05 Técnicas para generar instantáneas de conjuntos de datos.

Country Status (7)

Country Link
US (2) US20180101312A1 (es)
EP (2) EP3523734B1 (es)
AU (4) AU2017340761B2 (es)
CA (2) CA3039537C (es)
MX (2) MX2019004026A (es)
PL (1) PL3523734T3 (es)
WO (2) WO2018067856A1 (es)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11422897B2 (en) * 2019-07-31 2022-08-23 Rubrik, Inc. Optimizing snapshot image processing
CN111858158B (zh) * 2020-06-19 2023-11-10 北京金山云网络技术有限公司 数据处理方法、装置及电子设备
AU2022213420A1 (en) * 2021-01-31 2023-07-27 Ab Initio Technology Llc Dataset multiplexer for data processing system
WO2023244446A1 (en) * 2022-06-16 2023-12-21 Oracle International Corporation Scalable and secure cross-region and optimized file system replication for cloud scale
US20230409522A1 (en) 2022-06-16 2023-12-21 Oracle International Corporation Scalable and secure cross region and optimized file system delta transfer for cloud scale

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5663721A (en) * 1995-03-20 1997-09-02 Compaq Computer Corporation Method and apparatus using code values and length fields for compressing computer data
EP1056273A3 (en) 1999-05-25 2002-01-02 SeeItFirst, Inc. Method and system for providing high quality images from a digital video stream
US6629110B2 (en) * 2000-01-10 2003-09-30 Connected Corporation Administration of a differential backup system in a client-server environment
US6957362B2 (en) 2002-08-06 2005-10-18 Emc Corporation Instantaneous restoration of a production copy from a snapshot copy in a data storage system
US7756833B2 (en) * 2004-09-22 2010-07-13 Microsoft Corporation Method and system for synthetic backup and restore
US7941619B1 (en) * 2004-11-18 2011-05-10 Symantec Operating Corporation Space-optimized backup set conversion
US20070198659A1 (en) * 2006-01-25 2007-08-23 Lam Wai T Method and system for storing data
US8694469B2 (en) * 2009-12-28 2014-04-08 Riverbed Technology, Inc. Cloud synthetic backups
US9195675B2 (en) 2011-02-24 2015-11-24 A9.Com, Inc. Decoding of variable-length data with group formats
US10275840B2 (en) 2011-10-04 2019-04-30 Electro Industries/Gauge Tech Systems and methods for collecting, analyzing, billing, and reporting data from intelligent electronic devices
KR101522848B1 (ko) 2011-10-05 2015-05-26 엘에스아이 코포레이션 비휘발성 스토리지에 대한 셀프-저널링 및 계층적 일치성
CN107545066B (zh) * 2011-12-08 2021-01-15 甲骨文国际公司 用于在易失性存储器内保持关系型数据的列向量的技术
US20170039372A1 (en) * 2013-03-15 2017-02-09 Electro Industries/Gauge Tech Devices, systems and methods for upgrading firmware in intelligent electronic devices
US10277414B2 (en) 2014-07-18 2019-04-30 Oracle International Corporation Communication gateway services in a networked message distribution system

Also Published As

Publication number Publication date
PL3523734T3 (pl) 2024-06-10
CA3039537C (en) 2022-08-16
CA3039535A1 (en) 2018-04-12
WO2018067858A1 (en) 2018-04-12
AU2017340761A1 (en) 2019-05-02
EP3523734B1 (en) 2024-02-14
CA3039537A1 (en) 2018-04-12
US11747983B2 (en) 2023-09-05
EP3523735A1 (en) 2019-08-14
AU2017340759A1 (en) 2019-05-02
WO2018067856A1 (en) 2018-04-12
AU2020204094A1 (en) 2020-07-09
US20180101311A1 (en) 2018-04-12
MX2019004026A (es) 2019-09-09
US20180101312A1 (en) 2018-04-12
EP3523734A1 (en) 2019-08-14
AU2021200723A1 (en) 2021-03-04
CA3039535C (en) 2022-07-19
AU2017340759B2 (en) 2020-11-05
AU2017340761B2 (en) 2020-03-19

Similar Documents

Publication Publication Date Title
MX2019004027A (es) Técnicas para generar y operar los conjuntos de datos en memoria.
US9851917B2 (en) Method for de-duplicating data and apparatus therefor
WO2015066489A3 (en) Efficient implementations for mapreduce systems
EA201990315A1 (ru) Зашифрованный транзит и хранение пользовательских данных
WO2015066719A3 (en) Use of solid state storage devices and the like in data deduplication
MX2021010973A (es) Sistema de captura y descubrimiento de conocimiento.
SG11201900414WA (en) Signature verification system, signature verification method, and storage medium
CN106687911A8 (zh) 不损害数据完整性的在线数据移动
GB2558478A (en) Copy-Redirect on write
CA2902821C (en) System for metadata management
EP2889787A3 (en) Adaptive dictionary compression/decompression for column-store databases
WO2012161777A3 (en) Multi-phase resume from hibernate
IN2013CH06086A (es)
IN2014MU00845A (es)
MX2017002051A (es) Limpieza en el sistema de archivos.
Valman Three faces of HELCOM-institution, organization, policy producer
WO2016049215A3 (en) Dynamic entity inference for developer integration of entity-based external functionality
GB2581696A (en) System and method for analyzing crowdfunding platforms
WO2016174521A8 (en) Multiple read and write port memory
MX2018001255A (es) SISTEMA Y Mí‰TODO PARA LA CREACIí“N Y USO DE ESTRUCTURAS DE DATOS VISUALES DINíMICOS DE CALIDAD ALTA VISUALMENTE DIVERSOS.
SG10201806904QA (en) Cyber attack information processing apparatus, method, and program
JP2014526749A5 (es)
JP2014063540A5 (es)
MX2016006987A (es) Camara compatible con el medio de almacenamiento extraible dividido en multiples particiones.
Jung et al. Performance analysis of open source based distributed deduplication file system