CN114138414A - Incremental compression method and system for container mirror image - Google Patents

Incremental compression method and system for container mirror image Download PDF

Info

Publication number
CN114138414A
CN114138414A CN202111462218.5A CN202111462218A CN114138414A CN 114138414 A CN114138414 A CN 114138414A CN 202111462218 A CN202111462218 A CN 202111462218A CN 114138414 A CN114138414 A CN 114138414A
Authority
CN
China
Prior art keywords
files
file
mirror image
container
analysis
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202111462218.5A
Other languages
Chinese (zh)
Other versions
CN114138414B (en
Inventor
苏飞
李慧恩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Gac Dayou Spacetime Technology Anqing Co ltd
Original Assignee
Gac Dayou Spacetime Technology Anqing Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Gac Dayou Spacetime Technology Anqing Co ltd filed Critical Gac Dayou Spacetime Technology Anqing Co ltd
Priority to CN202111462218.5A priority Critical patent/CN114138414B/en
Publication of CN114138414A publication Critical patent/CN114138414A/en
Application granted granted Critical
Publication of CN114138414B publication Critical patent/CN114138414B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/10Text processing
    • G06F40/103Formatting, i.e. changing of presentation of documents
    • G06F40/106Display of layout of documents; Previewing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/10Text processing
    • G06F40/194Calculation of difference between files
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • G06F2009/45579I/O management, e.g. providing access to device drivers or storage
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention discloses an incremental compression method of a container mirror image, which comprises the following steps: analyzing the container mirror image layer, decompressing the mirror image layer, temporarily decompressing the files of each layer, and generating a hash value for each file; comparing and analyzing the difference files, comparing the hash values of the files, deleting the files with the same hash value, adding placeholders into a history file library, deleting the same parts of the highly similar files by adopting difference analysis for the files with different hash values, and replacing the different parts of the highly similar files with the placeholders; deep analysis of container mirror images, repackaging mirror image layers, reading a history file library, deleting files with completely same placeholders, packaging files with high similarity in mirror image files, and merging and exporting the difference parts of the files; and optimizing an offline scene, and in an offline exporting scene without the Internet, exporting the mirror image file and further comparing and analyzing the mirror image file. The invention solves the problems of high container mirror image redundancy and high required resource cost in the prior art.

Description

Incremental compression method and system for container mirror image
Technical Field
The invention relates to the technical field of virtual machines, in particular to an incremental compression method and system for container images.
Background
In the existing container technology, the size of a container image almost completely depends on the personal skill of a user, a single image is often hundreds of MB in size, and a single image is often thousands of MB in size, and a plurality of images may be uploaded in one-time system release. The deployment of the original light weight becomes heavier and more complex, and particularly under the project of high-speed iteration, the resource cost becomes a burden. The common solution is to adopt a dockerhub public cloud mode for management, but no solution is provided for the private cloud. Therefore, the prior container has high mirror image redundancy and large resource cost.
Disclosure of Invention
The purpose of the invention is as follows: in order to solve the problems that the redundancy of the prior container mirror image is high and the cost of required resources is high, the invention provides an incremental compression method of the container mirror image, which reduces the size of the capacity mirror image by a method of difference comparison between the historical mirror image and a plurality of mirror images.
The technical scheme is as follows: a method of incremental compression of a container image, comprising the steps of:
(1) analyzing the container mirror image layer, decompressing the mirror image layer, temporarily decompressing the files of each layer, and generating a hash value for each file;
(2) comparing and analyzing the difference files, comparing the hash values of the files, deleting the files with the same hash value, adding placeholders into a history file library, deleting the same parts of the highly similar files by adopting difference analysis for the files with different hash values, and replacing the different parts of the highly similar files with the placeholders;
(3) deep analysis of container mirror images, repackaging mirror image layers, reading a history file library, deleting files with completely same placeholders, packaging files with high similarity in mirror image files, and merging and exporting the difference parts of the files;
(4) optimizing an offline scene, wherein in an offline export scene without the Internet, image files are exported for further comparison and analysis, all image file lists used by a target deployed server are compared, the file list is ensured to have at least more than one comparison and analysis, and the same file character streams or highly similar file character streams in the last comparison and analysis in the file list are subjected to differential comparison;
(5) and (4) image decompression, off-line copy and image loading, processing all image layers and loading into the container system.
The hash value generated for each file in the step (1) is an MD5 hash value.
The difference analysis of the step (2) is to set a storage capacity D1 value, if the file size exceeds a D1 value, the repeated character streams between the individual files are compared to generate a repetition D2 value, wherein the D1 value and the D2 value are dynamically adjusted thresholds, and if the set value is exceeded, the file is represented by a placeholder and links the difference deployment of the files.
The step (5) is as follows:
(5.1) importing a mirror image and decompressing a mirror image layer;
(5.2) checking whether the mirror image file has a placeholder;
(5.3) if there is a placeholder, restoring the placeholder to actual file content;
(5.4) if no placeholder exists, reading the file content, generating a hash value and recording the hash value in a special history library for comparing and analyzing the placeholder at the next time;
(5.5) processing all the mirror image layers, and finally restoring to the original mirror image entity before compression;
(5.6) the Docker system runs a mirror image.
A container mirrored incremental compression system comprising: the system comprises a container mirror image layer analysis module, a difference file comparison analysis module, a container mirror image depth analysis module, an offline scene optimization module and a mirror image decompression module;
the container mirror image layer analysis module decompresses the mirror image layers, temporarily decompresses the files of each layer, and generates a hash value for each file;
the difference file comparison and analysis module is used for comparing hash values of files, deleting the files with the same hash value, adding placeholders into the historical file library, deleting the same parts of the highly similar files by adopting difference analysis for the files with different hash values, and replacing the different parts of the highly similar files with the placeholders;
the container mirror image depth analysis module repacks mirror image layers, reads a historical file library, deletes files with completely the same placeholders, packs files with high similarity in mirror image files, and combines and exports difference parts of the files;
the offline scene optimization module is used for further comparison and analysis before exporting the image file in an offline exporting scene without the Internet, comparing all the image file lists used by the server deployed by a target once, ensuring that the file lists have at least one comparison and analysis, and performing differential comparison on the same file character stream or the file character stream with high similarity existing in the last comparison and analysis in the file lists;
and the mirror image decompression module is used for off-line copying and loading mirror images, processing all mirror image layers and loading the mirror image layers into the container system.
The hash value generated for each file in the container mirror layer analysis module is an MD5 hash value.
The difference analysis in the difference file comparison analysis module is to set a storage capacity D1 value, if the file size exceeds a D1 value, the repeated character streams between the individual files are compared to generate a duplication degree D2 value, wherein the D1 value and the D2 value are dynamically adjusted thresholds, and if the file size exceeds the set value, the file is represented by a placeholder and links the differential deployment of the file.
The mirror image decompression module is as follows: importing a mirror image and decompressing a mirror image layer; checking whether the mirror image file has a placeholder; if the placeholder exists, restoring the placeholder into the actual file content; if no placeholder exists, reading the file content, generating a hash value and recording the hash value in a historical special library for comparing and analyzing the placeholder at the next time; processing all the mirror image layers, and finally restoring to an original mirror image entity before compression; the Docker system runs a mirror image.
Has the advantages that: compared with the prior art, the invention has the following remarkable advantages:
through difference comparison between the historical mirror image and the multi-mirror image, the cost of storage capacity and the IO cost during deployment are greatly reduced; the reduction of the overall deployment file can increase the transmission efficiency of deployment and greatly reduce the cost of network bandwidth; and the offline scene optimization enables the containerization scheme to be easier to implement and deploy in the scenes without Internet and secret.
Drawings
FIG. 1 is a flow chart of a method of incremental compression of a container image.
Detailed Description
The technical scheme of the invention is further explained by combining the attached drawings.
Example 1:
as shown in fig. 1, an incremental compression method for a container image includes the following steps:
(1) analyzing the container mirror image layer, decompressing the mirror image layer, temporarily decompressing the files of each layer, and generating a hash value for each file;
(2) comparing and analyzing the difference files, comparing the hash values of the files, deleting the files with the same hash value, adding placeholders into a history file library, deleting the same parts of the highly similar files by adopting difference analysis for the files with different hash values, and replacing the different parts of the highly similar files with the placeholders;
(3) deep analysis of container mirror images, repackaging mirror image layers, reading a history file library, deleting files with completely same placeholders, packaging files with high similarity in mirror image files, and merging and exporting the difference parts of the files; after analysis, the mirror image is repackaged, files with completely the same placeholders are excluded, and for files with highly similar attributes in the mirror image file, such as class binary files in a jar program, which are 99% similar to the class binary file of another jar program, the second file will only generate 1% of difference content, but not all file content.
(4) Optimizing an offline scene, wherein in an offline export scene without the Internet, image files are exported for further comparison and analysis, all image file lists used by a target deployed server are compared, the file list is ensured to have at least more than one comparison and analysis, and the same file character streams or highly similar file character streams in the last comparison and analysis in the file list are subjected to differential comparison;
(5) and (4) image decompression, off-line copy and image loading, processing all image layers and loading into the container system.
The hash value generated for each file in the step (1) is an MD5 hash value.
The difference analysis of the step (2) is to set a storage capacity D1 value, if the file size exceeds a D1 value, the repeated character streams between the individual files are compared to generate a repetition D2 value, wherein the D1 value and the D2 value are dynamically adjusted thresholds, and if the set value is exceeded, the file is represented by a placeholder and links the difference deployment of the files.
Where the D1 and D2 values are dynamically adjusted thresholds, such as D1-1 MB and D2-60%.
The step (5) is as follows:
(5.1) importing a mirror image and decompressing a mirror image layer;
(5.2) checking whether the mirror image file has a placeholder;
(5.3) if there is a placeholder, restoring the placeholder to actual file content;
(5.4) if no placeholder exists, reading the file content, generating a hash value and recording the hash value in a special history library for comparing and analyzing the placeholder at the next time;
(5.5) processing all the mirror image layers, and finally restoring to the original mirror image entity before compression;
(5.6) the Docker system runs a mirror image.
Example 2:
a container mirrored incremental compression system comprising: the system comprises a container mirror image layer analysis module, a difference file comparison analysis module, a container mirror image depth analysis module, an offline scene optimization module and a mirror image decompression module;
the container mirror image layer analysis module decompresses the mirror image layers, temporarily decompresses the files of each layer, and generates a hash value for each file;
the difference file comparison and analysis module is used for comparing hash values of files, deleting the files with the same hash value, adding placeholders into the historical file library, deleting the same parts of the highly similar files by adopting difference analysis for the files with different hash values, and replacing the different parts of the highly similar files with the placeholders;
the container mirror image depth analysis module repacks mirror image layers, reads a historical file library, deletes files with completely the same placeholders, packs files with high similarity in mirror image files, and combines and exports difference parts of the files; after analysis, the mirror image is repackaged, files with completely the same placeholders are excluded, and for files with highly similar attributes in the mirror image file, such as class binary files in a jar program, which are 99% similar to the class binary file of another jar program, the second file will only generate 1% of difference content, but not all file content.
The offline scene optimization module is used for further comparison and analysis before exporting the image file in an offline exporting scene without the Internet, comparing all the image file lists used by the server deployed by a target once, ensuring that the file lists have at least one comparison and analysis, and performing differential comparison on the same file character stream or the file character stream with high similarity existing in the last comparison and analysis in the file lists;
and the mirror image decompression module is used for off-line copying and loading mirror images, processing all mirror image layers and loading the mirror image layers into the container system.
The hash value generated for each file in the container mirror layer analysis module is an MD5 hash value.
The difference analysis in the difference file comparison analysis module is to set a storage capacity D1 value, if the file size exceeds a D1 value, the repeated character streams between the individual files are compared to generate a duplication degree D2 value, wherein the D1 value and the D2 value are dynamically adjusted thresholds, and if the file size exceeds the set value, the file is represented by a placeholder and links the differential deployment of the file.
Where the D1 and D2 values are dynamically adjusted thresholds, such as D1-1 MB and D2-60%.
The mirror image decompression module is as follows: importing a mirror image and decompressing a mirror image layer; checking whether the mirror image file has a placeholder; if the placeholder exists, restoring the placeholder into the actual file content; if no placeholder exists, reading the file content, generating a hash value and recording the hash value in a historical special library for comparing and analyzing the placeholder at the next time; processing all the mirror image layers, and finally restoring to an original mirror image entity before compression; the Docker system runs a mirror image.
The method is suitable for a scene of repeated iteration, for a system of a mainstream internet, iteration is carried out for many times in a week or a month, file sources of historical analysis are extremely many, the difference comparison efficiency is higher, for example, a certain app only updates a new interface, the whole program is 100MB, 99.9MB is possibly the same, other systems of a container are related to 2000MB, the series of files hardly occupy any space, and the whole compression rate can reach hundreds to tens of thousands of times.

Claims (8)

1. A method of incremental compression of a container image, comprising the steps of:
(1) analyzing the container mirror image layer, decompressing the mirror image layer, temporarily decompressing the files of each layer, and generating a hash value for each file;
(2) comparing and analyzing the difference files, comparing the hash values of the files, deleting the files with the same hash value, adding placeholders into a history file library, deleting the same parts of the highly similar files by adopting difference analysis for the files with different hash values, and replacing the different parts of the highly similar files with the placeholders;
(3) deep analysis of container mirror images, repackaging mirror image layers, reading a history file library, deleting files with completely same placeholders, packaging files with high similarity in mirror image files, and merging and exporting the difference parts of the files;
(4) optimizing an offline scene, wherein in an offline export scene without the Internet, image files are exported for further comparison and analysis, all image file lists used by a target deployed server are compared, the file list is ensured to have at least more than one comparison and analysis, and the same file character streams or highly similar file character streams in the last comparison and analysis in the file list are subjected to differential comparison;
(5) and (4) image decompression, off-line copy and image loading, processing all image layers and loading into the container system.
2. The method for incremental compression of a container image according to claim 1, wherein the hash value generated for each file in step (1) is an MD5 hash value.
3. The incremental compression method for a container image as claimed in claim 1, wherein the difference analysis of step (2) is to set a storage capacity D1 value, if the file size exceeds a D1 value, then compare the repeated character stream between the individual files to generate a repetition D2 value, wherein the D1 value and the D2 value are dynamically adjusted thresholds, and if the set value is exceeded, then the file will be represented by a placeholder and link the differential deployment of the file.
4. A method of incremental compression of a container image according to claim 1, wherein said step (5) is:
(5.1) importing a mirror image and decompressing a mirror image layer;
(5.2) checking whether the mirror image file has a placeholder;
(5.3) if there is a placeholder, restoring the placeholder to actual file content;
(5.4) if no placeholder exists, reading the file content, generating a hash value and recording the hash value in a special history library for comparing and analyzing the placeholder at the next time;
(5.5) processing all the mirror image layers, and finally restoring to the original mirror image entity before compression;
(5.6) the Docker system runs a mirror image.
5. A system for incremental compression of a container image, comprising: the system comprises a container mirror image layer analysis module, a difference file comparison analysis module, a container mirror image depth analysis module, an offline scene optimization module and a mirror image decompression module;
the container mirror image layer analysis module decompresses the mirror image layers, temporarily decompresses the files of each layer, and generates a hash value for each file;
the difference file comparison and analysis module is used for comparing hash values of files, deleting the files with the same hash value, adding placeholders into the historical file library, deleting the same parts of the highly similar files by adopting difference analysis for the files with different hash values, and replacing the different parts of the highly similar files with the placeholders;
the container mirror image depth analysis module repacks mirror image layers, reads a historical file library, deletes files with completely the same placeholders, packs files with high similarity in mirror image files, and combines and exports difference parts of the files;
the offline scene optimization module is used for further comparison and analysis before exporting the image file in an offline exporting scene without the Internet, comparing all the image file lists used by the server deployed by a target once, ensuring that the file lists have at least one comparison and analysis, and performing differential comparison on the same file character stream or the file character stream with high similarity existing in the last comparison and analysis in the file lists;
and the mirror image decompression module is used for off-line copying and loading mirror images, processing all mirror image layers and loading the mirror image layers into the container system.
6. The system of claim 5, wherein the hash value generated for each file in the container image layer analysis module is an MD5 hash value.
7. The incremental compression system for container images as claimed in claim 5, wherein the difference file comparison analysis module performs difference analysis to set a storage capacity D1 value, if the file size exceeds a D1 value, then compares the repeated character stream between the individual files to generate a repetition D2 value, wherein the D1 value and the D2 value are dynamically adjusted thresholds, and if the file size exceeds the set value, then the file is represented by a placeholder and links the difference deployment of the files.
8. The incremental compression system for a container image of claim 5, wherein the image decompression module is to: importing a mirror image and decompressing a mirror image layer; checking whether the mirror image file has a placeholder; if the placeholder exists, restoring the placeholder into the actual file content; if no placeholder exists, reading the file content, generating a hash value and recording the hash value in a historical special library for comparing and analyzing the placeholder at the next time; processing all the mirror image layers, and finally restoring to an original mirror image entity before compression; the Docker system runs a mirror image.
CN202111462218.5A 2021-12-02 2021-12-02 Incremental compression method and system for container mirror image Active CN114138414B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111462218.5A CN114138414B (en) 2021-12-02 2021-12-02 Incremental compression method and system for container mirror image

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111462218.5A CN114138414B (en) 2021-12-02 2021-12-02 Incremental compression method and system for container mirror image

Publications (2)

Publication Number Publication Date
CN114138414A true CN114138414A (en) 2022-03-04
CN114138414B CN114138414B (en) 2023-08-15

Family

ID=80387143

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111462218.5A Active CN114138414B (en) 2021-12-02 2021-12-02 Incremental compression method and system for container mirror image

Country Status (1)

Country Link
CN (1) CN114138414B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114461271A (en) * 2022-04-12 2022-05-10 梯度云科技(北京)有限公司 Container mirror image packaging method and device capable of saving storage space
CN114490544A (en) * 2022-04-18 2022-05-13 梯度云科技(北京)有限公司 Method and device for downloading container mirror image by newly adding host
WO2023193747A1 (en) * 2022-04-08 2023-10-12 International Business Machines Corporation Intelligent layer control of redundant content in container images

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103729580A (en) * 2014-01-27 2014-04-16 国家电网公司 Method and device for detecting software plagiarism
CN106611035A (en) * 2016-06-12 2017-05-03 四川用联信息技术有限公司 Retrieval algorithm for deleting repetitive data in cloud storage
US20170134296A1 (en) * 2015-11-06 2017-05-11 Microsoft Technology Licensing, Llc Reducing Network Bandwidth Utilization During File Transfer
CN107809467A (en) * 2017-10-10 2018-03-16 暨南大学 Container mirror image data deletes method under a kind of cloud environment
CN108509253A (en) * 2018-04-03 2018-09-07 南京中兴软创软件技术有限公司 A kind of method of a large amount of container mirror images of release quickly
CN112181584A (en) * 2019-07-02 2021-01-05 国际商业机器公司 Optimizing image reconstruction for container warehouses
CN113377620A (en) * 2021-06-24 2021-09-10 上海天壤智能科技有限公司 Automatic system self-checking method and system based on Kubernetes

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103729580A (en) * 2014-01-27 2014-04-16 国家电网公司 Method and device for detecting software plagiarism
US20170134296A1 (en) * 2015-11-06 2017-05-11 Microsoft Technology Licensing, Llc Reducing Network Bandwidth Utilization During File Transfer
CN106611035A (en) * 2016-06-12 2017-05-03 四川用联信息技术有限公司 Retrieval algorithm for deleting repetitive data in cloud storage
CN107809467A (en) * 2017-10-10 2018-03-16 暨南大学 Container mirror image data deletes method under a kind of cloud environment
CN108509253A (en) * 2018-04-03 2018-09-07 南京中兴软创软件技术有限公司 A kind of method of a large amount of container mirror images of release quickly
CN112181584A (en) * 2019-07-02 2021-01-05 国际商业机器公司 Optimizing image reconstruction for container warehouses
CN113377620A (en) * 2021-06-24 2021-09-10 上海天壤智能科技有限公司 Automatic system self-checking method and system based on Kubernetes

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023193747A1 (en) * 2022-04-08 2023-10-12 International Business Machines Corporation Intelligent layer control of redundant content in container images
US11803303B1 (en) 2022-04-08 2023-10-31 International Business Machines Corporation Intelligent layer control of redundant content in container images
CN114461271A (en) * 2022-04-12 2022-05-10 梯度云科技(北京)有限公司 Container mirror image packaging method and device capable of saving storage space
CN114461271B (en) * 2022-04-12 2022-06-21 梯度云科技(北京)有限公司 Container mirror image packaging method and device capable of saving storage space
CN114490544A (en) * 2022-04-18 2022-05-13 梯度云科技(北京)有限公司 Method and device for downloading container mirror image by newly adding host

Also Published As

Publication number Publication date
CN114138414B (en) 2023-08-15

Similar Documents

Publication Publication Date Title
CN114138414A (en) Incremental compression method and system for container mirror image
US20230118948A1 (en) Systems and methods for aggregation of cloud storage
US20240176783A1 (en) Systems and methods for secure file management via an aggregation of cloud storage services
US20240015220A1 (en) Aggregation and management among a plurality of storage providers
AU2001238269B2 (en) Hash file system and method for use in a commonality factoring system
US10284433B2 (en) Data synchronization using redundancy detection
KR102386096B1 (en) Encoding of volumetric data to support trusted transactional delivery
US20190188086A1 (en) Redundancy reduction in blockchains
US10965732B2 (en) Streaming zip
CN105120003B (en) A kind of method for realizing data backup under cloud environment
CN109634932A (en) A kind of intelligence contract storage method and storage system
US9158808B2 (en) Object arrangement apparatus for determining object destination, object arranging method, and computer program thereof
Gokulakrishnan et al. Data integrity and recovery management in cloud systems
CN103701907A (en) Processing method and system for continuing to transmit data in server
CN106897260B (en) System and method for restoring historical version of compound document, storage medium and processor
KR101428649B1 (en) Encryption system for mass private information based on map reduce and operating method for the same
CN112182112A (en) Block chain based distributed data dynamic storage method and electronic equipment
Yatskiv et al. Protected Distributed Data Storage Based on Residue Number System and Cloud Services
CN109388335A (en) A kind of date storage method and system
CN115189956A (en) File security sharing method
US20150081649A1 (en) In-line deduplication for a network and/or storage platform
US11513913B2 (en) Method for storage management, electronic device, and computer program product
CN114490509A (en) Tracking change data capture log history
CN115221125A (en) File processing method and device, electronic equipment and readable storage medium
CN112181974A (en) Identification information distribution method, system and storage equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant