JP7494190B2 - ファイルを更新するための技術 - Google Patents

ファイルを更新するための技術 Download PDF

Info

Publication number
JP7494190B2
JP7494190B2 JP2021544198A JP2021544198A JP7494190B2 JP 7494190 B2 JP7494190 B2 JP 7494190B2 JP 2021544198 A JP2021544198 A JP 2021544198A JP 2021544198 A JP2021544198 A JP 2021544198A JP 7494190 B2 JP7494190 B2 JP 7494190B2
Authority
JP
Japan
Prior art keywords
data
file
difference
dictionary
processors
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2021544198A
Other languages
English (en)
Japanese (ja)
Other versions
JP2022518932A5 (enExample
JP2022518932A (ja
Inventor
オッテン、マーティン
シャーマン、テイラー
ゴフィン、ヘンリー
Original Assignee
バルブ コーポレーション
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by バルブ コーポレーション filed Critical バルブ コーポレーション
Publication of JP2022518932A publication Critical patent/JP2022518932A/ja
Publication of JP2022518932A5 publication Critical patent/JP2022518932A5/ja
Priority to JP2024083003A priority Critical patent/JP2024116161A/ja
Application granted granted Critical
Publication of JP7494190B2 publication Critical patent/JP7494190B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/17—Details of further file system functions
    • G06F16/174—Redundancy elimination performed by the file system
    • G06F16/1744—Redundancy elimination performed by the file system using compression, e.g. sparse files
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/1873—Versioning file systems, temporal file systems, e.g. file system supporting different historic versions of files
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/13—File access structures, e.g. distributed indices
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/60—Software deployment
    • G06F8/65—Updates
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/70—Software maintenance or management
    • G06F8/71—Version control; Configuration management
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/34—Network arrangements or protocols for supporting network services or applications involving the movement of software or configuration parameters 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/04—Protocols for data compression, e.g. ROHC

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Information Transfer Between Computers (AREA)
  • Stored Programmes (AREA)
JP2021544198A 2019-01-30 2019-12-24 ファイルを更新するための技術 Active JP7494190B2 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2024083003A JP2024116161A (ja) 2019-01-30 2024-05-22 ファイルを更新するための技術

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US16/262,431 US11070618B2 (en) 2019-01-30 2019-01-30 Techniques for updating files
US16/262,431 2019-01-30
PCT/US2019/068488 WO2020159651A1 (en) 2019-01-30 2019-12-24 Techniques for updating files

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2024083003A Division JP2024116161A (ja) 2019-01-30 2024-05-22 ファイルを更新するための技術

Publications (3)

Publication Number Publication Date
JP2022518932A JP2022518932A (ja) 2022-03-17
JP2022518932A5 JP2022518932A5 (enExample) 2022-12-13
JP7494190B2 true JP7494190B2 (ja) 2024-06-03

Family

ID=71732926

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2021544198A Active JP7494190B2 (ja) 2019-01-30 2019-12-24 ファイルを更新するための技術
JP2024083003A Pending JP2024116161A (ja) 2019-01-30 2024-05-22 ファイルを更新するための技術

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2024083003A Pending JP2024116161A (ja) 2019-01-30 2024-05-22 ファイルを更新するための技術

Country Status (6)

Country Link
US (2) US11070618B2 (enExample)
EP (2) EP3891618B1 (enExample)
JP (2) JP7494190B2 (enExample)
KR (2) KR20250136937A (enExample)
CN (1) CN113316773A (enExample)
WO (1) WO2020159651A1 (enExample)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10191925B1 (en) 2011-10-27 2019-01-29 Valve Corporation Delivery of digital information to a remote device
US9667730B2 (en) * 2013-03-14 2017-05-30 Comcast Cable Communications, Llc Systems and methods for abandonment detection and mitigation
US11070618B2 (en) 2019-01-30 2021-07-20 Valve Corporation Techniques for updating files
US11886391B2 (en) 2020-05-14 2024-01-30 Valve Corporation Efficient file-delivery techniques
CN113553090B (zh) * 2021-07-26 2023-07-25 网易（杭州）网络有限公司 客户端应用程序的更新控制方法及装置
US12293177B1 (en) * 2022-06-27 2025-05-06 Amazon Technologies, Inc. Techniques for uploading network applications
US20250217134A1 (en) * 2023-12-29 2025-07-03 Google Llc Software application patching
KR102836804B1 (ko) * 2024-01-31 2025-07-18 김준엽 모바일 시뮬레이션 게임 개발 시스템

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004514214A (ja) 2000-11-17 2004-05-13 ビットフォン　コーポレイション 情報をアップデートおよび配布するシステムおよび方法
JP2004287705A (ja) 2003-03-20 2004-10-14 Alpine Electronics Inc 地図記録媒体、地図データ更新方法及びナビゲーション装置
JP2008204287A (ja) 2007-02-21 2008-09-04 Access Co Ltd データ生成方法、データ復元方法、データ生成装置およびデータ復元装置
JP2012069131A (ja) 2006-06-19 2012-04-05 Samsung Electronics Co Ltd ＯＴＡ（Ｏｖｅｒ−ｔｈｅ−ａｉｒ）が可能な携帯装置のためのプログラムアップグレード方法およびシステム

Family Cites Families (56)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5822511A (en) * 1996-09-03 1998-10-13 Motorola, Inc. Smart compare tool and method
US6216175B1 (en) 1998-06-08 2001-04-10 Microsoft Corporation Method for upgrading copies of an original file with same update data after normalizing differences between copies created during respective original installations
US6493721B1 (en) * 1999-03-31 2002-12-10 Verizon Laboratories Inc. Techniques for performing incremental data updates
US7028251B2 (en) * 2000-03-02 2006-04-11 Iora, Ltd. System and method for reducing the size of data difference representations
US8903950B2 (en) * 2000-05-05 2014-12-02 Citrix Systems, Inc. Personalized content delivery using peer-to-peer precaching
US20030182414A1 (en) * 2003-05-13 2003-09-25 O'neill Patrick J. System and method for updating and distributing information
US7260773B2 (en) * 2002-03-28 2007-08-21 Uri Zernik Device system and method for determining document similarities and differences
US6925467B2 (en) 2002-05-13 2005-08-02 Innopath Software, Inc. Byte-level file differencing and updating algorithms
US20040034849A1 (en) * 2002-06-17 2004-02-19 Microsoft Corporation Volume image views and methods of creating volume images in which a file similar to a base file is stored as a patch of the base file
US7320009B1 (en) * 2003-03-28 2008-01-15 Novell, Inc. Methods and systems for file replication utilizing differences between versions of files
JP2005128894A (ja) * 2003-10-24 2005-05-19 Sanyo Electric Co Ltd 不揮発性メモリ書き換え装置
WO2005043279A2 (en) 2003-10-31 2005-05-12 Disksites Research And Development Ltd. Device, system and method for storage and access of computer files
JP4477947B2 (ja) * 2004-06-17 2010-06-09 三菱電機株式会社 差分適用組込み機器システム及び格納データ変更方法
US7664819B2 (en) * 2004-06-29 2010-02-16 Microsoft Corporation Incremental anti-spam lookup and update service
US7640363B2 (en) 2005-02-16 2009-12-29 Microsoft Corporation Applications for remote differential compression
US10127130B2 (en) * 2005-03-18 2018-11-13 Salesforce.Com Identifying contributors that explain differences between a data set and a subset of the data set
CN101382885B (zh) * 2007-09-06 2012-05-09 联想(北京)有限公司 一种数据文件的多版本控制方法及装置
JP5408128B2 (ja) * 2008-05-15 2014-02-05 株式会社ニコン 画像処理装置、画像処理方法、処理装置、およびプログラム
FR2933514B1 (fr) * 2008-07-02 2012-10-19 Canon Kk Procedes et dispositifs de codage et de decodage par similarites pour documents de type xml
US8566362B2 (en) 2009-01-23 2013-10-22 Nasuni Corporation Method and system for versioned file system using structured data representations
US20110029658A1 (en) * 2009-07-24 2011-02-03 Theodore Werth System and methods for providing a multi-device, multi-service platform via a client agent
US8572218B2 (en) * 2009-12-10 2013-10-29 International Business Machines Corporation Transport data compression based on an encoding dictionary patch
US9063968B2 (en) * 2010-08-02 2015-06-23 Cleversafe, Inc. Identifying a compromised encoded data slice
CA2820758A1 (en) * 2010-12-15 2012-06-21 Microsoft Corporation Intelligent code differencing using code clone detection
US8862555B1 (en) * 2011-05-16 2014-10-14 Trend Micro Incorporated Methods and apparatus for generating difference files
US9009428B2 (en) * 2011-07-08 2015-04-14 Hewlett-Packard Development Company, L.P. Data store page recovery
US9792355B2 (en) * 2011-10-25 2017-10-17 Intelligent Views Gmbh Searches for similar documents
US8862556B2 (en) * 2012-06-29 2014-10-14 International Business Machines Corporation Difference analysis in file sub-regions
US9110939B2 (en) * 2012-10-05 2015-08-18 Here Global B.V. Method and apparatus for providing incremental database updates based on delta pages
US8909605B1 (en) * 2013-02-28 2014-12-09 Emc Corporation Method and system for accelerating data movement using change information concerning difference between current and previous data movements
US9418072B2 (en) 2013-03-04 2016-08-16 Vmware, Inc. Cross-file differential content synchronization
US9753987B1 (en) * 2013-04-25 2017-09-05 EMC IP Holding Company LLC Identifying groups of similar data portions
US9747259B2 (en) * 2013-07-03 2017-08-29 Infinote Corporation Searching, reviewing, comparing, modifying, and/or merging documents
RU2571378C2 (ru) * 2013-12-18 2015-12-20 Общество с ограниченной ответственностью "Аби Девелопмент" Устройство и способ поиска различий в документах
US9576013B2 (en) 2014-04-03 2017-02-21 Sap Se Optimizing update operations in in-memory database systems
US9542239B2 (en) * 2014-04-30 2017-01-10 International Business Machines Corporation Resolving write request conflicts in a dispersed storage network
WO2015180052A1 (zh) * 2014-05-28 2015-12-03 北京大学深圳研究生院 一种基于字典库的视频编解码方法及装置
US10353918B2 (en) * 2014-11-07 2019-07-16 Amobee, Inc. High availability and disaster recovery in large-scale data warehouse
US10725987B2 (en) * 2014-11-25 2020-07-28 Sap Se Forced ordering of a dictionary storing row identifier values
US9891831B2 (en) * 2014-11-25 2018-02-13 Sap Se Dual data storage using an in-memory array and an on-disk page structure
EP3252605B1 (en) * 2015-01-26 2022-04-06 Hitachi Astemo, Ltd. Vehicle-mounted control device, program writing device, program generating device and program
US10459805B2 (en) * 2015-04-03 2019-10-29 Oath Inc. Method and system for data recovery in a data system
US20170193230A1 (en) * 2015-05-03 2017-07-06 Microsoft Technology Licensing, Llc Representing and comparing files based on segmented similarity
US10067757B2 (en) 2015-11-20 2018-09-04 Google Llc Dynamic update of an application in compilation and deployment with hot-swapping
US10521117B2 (en) * 2015-11-24 2019-12-31 Sap Se Unified table delta dictionary memory size and load time optimization
US10437854B2 (en) * 2016-06-17 2019-10-08 United States Of America As Represented By The Secretary Of The Navy Method for reconciling similar data sets
US10191737B2 (en) * 2016-06-29 2019-01-29 Accenture Global Solutions Limited Program code comparison and reporting
US11941344B2 (en) * 2016-09-29 2024-03-26 Dropbox, Inc. Document differences analysis and presentation
US10453228B2 (en) * 2017-03-08 2019-10-22 Microsoft Technology Licensing, Llc Difference visualization between data sets
JP6784636B2 (ja) * 2017-04-13 2020-11-11 日立オートモティブシステムズ株式会社 制御装置、プログラム更新システム、プログラム更新方法
US10209983B2 (en) * 2017-04-19 2019-02-19 Servicenow, Inc. Distributed incremental updating of trays using a source control system
US10747723B2 (en) * 2017-11-16 2020-08-18 Verizon Digital Media Services Inc. Caching with dynamic and selective compression of content
US10795688B2 (en) * 2018-07-23 2020-10-06 Datto, Inc. System and method for performing an image-based update
US20200117893A1 (en) * 2018-10-16 2020-04-16 International Business Machines Corporation Determining differences in documents to generate a visualization highlighting the differences between documents
US11070618B2 (en) 2019-01-30 2021-07-20 Valve Corporation Techniques for updating files
US11886390B2 (en) 2019-04-30 2024-01-30 JFrog Ltd. Data file partition and replication

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004514214A (ja) 2000-11-17 2004-05-13 ビットフォン　コーポレイション 情報をアップデートおよび配布するシステムおよび方法
JP2004287705A (ja) 2003-03-20 2004-10-14 Alpine Electronics Inc 地図記録媒体、地図データ更新方法及びナビゲーション装置
JP2012069131A (ja) 2006-06-19 2012-04-05 Samsung Electronics Co Ltd ＯＴＡ（Ｏｖｅｒ−ｔｈｅ−ａｉｒ）が可能な携帯装置のためのプログラムアップグレード方法およびシステム
JP2008204287A (ja) 2007-02-21 2008-09-04 Access Co Ltd データ生成方法、データ復元方法、データ生成装置およびデータ復元装置

Also Published As

Publication number Publication date
US20200244731A1 (en) 2020-07-30
JP2024116161A (ja) 2024-08-27
EP4440083B1 (en) 2026-02-18
US11070618B2 (en) 2021-07-20
CN113316773A (zh) 2021-08-27
US12003580B2 (en) 2024-06-04
KR102858582B1 (ko) 2025-09-12
US20210329071A1 (en) 2021-10-21
EP3891618B1 (en) 2024-11-06
KR20210118073A (ko) 2021-09-29
EP3891618A4 (en) 2022-06-22
JP2022518932A (ja) 2022-03-17
KR20250136937A (ko) 2025-09-16
EP4440083A2 (en) 2024-10-02
EP3891618A1 (en) 2021-10-13
WO2020159651A1 (en) 2020-08-06
EP4440083A3 (en) 2024-10-23

Similar Documents

Publication Publication Date Title
JP7494190B2 (ja) ファイルを更新するための技術
US10715618B2 (en) Compressibility estimation for lossless data compression
JP5819416B2 (ja) データ記憶とデータ送信の最適化
EP1641219A2 (en) Efficient algorithm for finding candidate objects for remote differential compression
CN109993298B (zh) 用于压缩神经网络的方法和装置
EP3376393A1 (en) Data storage method and apparatus
JP2005302004A (ja) 遠隔差分圧縮用の効率的アルゴリズムとプロトコル
JP7700128B2 (ja) スケッチ計算のためのシステムおよび方法
CN112544038A (zh) 存储系统数据压缩的方法、装置、设备及可读存储介质
US11675768B2 (en) Compression/decompression using index correlating uncompressed/compressed content
CN108880559B (zh) 数据压缩方法、数据解压缩方法、压缩设备及解压缩设备
EP3726732B1 (en) Vector processing for segmentation hash values calculation
US12511260B2 (en) File compression using sequence alignment
US11360954B2 (en) System and method for hash-based entropy calculation
US10963437B2 (en) System and method for data deduplication
US10990565B2 (en) System and method for average entropy calculation
CN114253933B (zh) 一种数据集切分和还原的方法及设备
GB2524515A (en) Method to improve compression ratio for a compression engine
US10931794B2 (en) Communication apparatus and communication control method
CN121530385A (zh) 数据处理方法、装置、系统及相关设备
CN112667607B (zh) 一种历史数据的管理方法及相关设备
US11138154B2 (en) System and method for offset-based deduplication
CN119441163A (zh) 一种数据压缩的方法、数据压缩装置及相关设备
CN110968575A (zh) 一种大数据处理系统的去重方法

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20221205

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20221205

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20231129

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20231212

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240222

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20240423

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20240522

R150 Certificate of patent or registration of utility model

Ref document number: 7494190

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150