CN113204554A - Method and device for realizing sparse writing of object storage system and electronic equipment - Google Patents
Method and device for realizing sparse writing of object storage system and electronic equipment Download PDFInfo
- Publication number
- CN113204554A CN113204554A CN202110511634.3A CN202110511634A CN113204554A CN 113204554 A CN113204554 A CN 113204554A CN 202110511634 A CN202110511634 A CN 202110511634A CN 113204554 A CN113204554 A CN 113204554A
- Authority
- CN
- China
- Prior art keywords
- data
- storage system
- fragment
- offset
- stored
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2219—Large Object storage; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The invention discloses a method for realizing sparse writing of an object storage system, which can write data with any length at any position of an object, wherein the written data does not require continuity, and supports random writing, sparse writing and data modification. In addition, the object storage system in the method provided by the invention actually calculates the blank data segment and the blank object fragment thereof by recording the written data and the positioning information when the target object is completely written, creates the blank object fragment, and returns the blank object fragment by zero complement of the data during reading, so that the data sparse writing of the object storage system is finally realized, the problem of data reading/writing amplification is further avoided, the data to be stored does not need to be migrated or transferred, and the performance of the object storage system can be effectively improved.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a method and a device for realizing sparse writing of an object storage system and electronic equipment.
Background
With the rapid development of internet applications, mass data storage of PB level and even EB level becomes especially important. The object storage system is a novel distributed storage system, and objects are basic entities in the object storage system, and any type of data can be stored by providing an object-based access interface, such as: pictures, video, audio, text, etc. The object storage system effectively solves the problems of limited sharing capacity, poor expansibility and the like of the traditional storage.
However, the existing object storage system only supports sequential writing of synchronous data, and does not support sparse writing of data, thereby causing the problems of slow data transmission speed and poor storage performance of a distributed object storage system in connection with NFS.
Therefore, how to provide a solution to the above technical problem is a problem that needs to be solved by those skilled in the art.
Disclosure of Invention
The invention aims to make up for the defects of the prior art, and provides a method, a device and electronic equipment for realizing sparse writing of an object storage system, so as to solve the problem that the object storage system in the prior art does not support sparse writing of data.
In a first aspect, to solve the above technical problem, the present invention provides a method for implementing sparse write in an object storage system, including:
s1, receiving a data storage request sent by a client, wherein the data storage request comprises a data segment to be stored and input by a target user;
s2, calculating the object fragment and the internal offset corresponding to the data fragment to be stored, writing the data fragment into the corresponding object fragment, and recording the offset and the length of the data fragment;
s3, after receiving all data storage requests sent by the client, determining blank data segments among the data segments to be stored according to the recorded offset and data length corresponding to the data segments, and setting object fragments for the blank data segments according to the offset and data length of the blank data segments, so that the object fragments corresponding to the blank data segments and the object fragments corresponding to the data segments to be stored form the target object.
Optionally, the data storage request in step S1 further includes: an offset and a data length for identifying a storage location of the data segment.
Optionally, the object slice in step S2 is set in the object storage system to store data; the offset of the data segment is a positional offset of the data segment between an address in the target object and a starting address of the target object; the internal offset is a positional offset of the data segment between an address in the object slice and a starting address of the object slice.
Optionally, after the step S3, the method further includes:
s4: updating the metadata of the target object to store the metadata contained by the target object in the object storage system.
Optionally, after the step S4, the method further includes:
s5: receiving a data reading request sent by a client, wherein the data reading request comprises the offset and the data length of a data segment to be read;
s6: and determining the object fragment and the internal offset of the data fragment to be read according to the offset and the data length of the data fragment to be read, and sending corresponding response information to the client according to the data stored in the determined object fragment.
Optionally, the response information includes first response information and second response information;
the step S6 includes:
s6.1: judging whether the data stored in the object fragment is a blank data fragment or not;
s6.2: if the judgment result is yes, the object storage system sends first response information to the client; wherein the first response information comprises a data zero;
s6.3: if the judgment result is negative, the object storage system sends second response information to the client; wherein the second response information includes data fragments stored in the object fragment.
Optionally, after the step S213 and before the step S3, the method further includes:
s214: and judging whether the data storage request sent by the client is received completely.
In a second aspect, based on the method for implementing sparse writing in the object storage system, the invention further provides an electronic device, which is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete mutual communication through the communication bus;
a memory for storing a computer program;
and the processor is used for realizing the method for realizing sparse writing of the object storage system when executing the program stored in the memory.
In a third aspect, to solve the above technical problem, the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of the method for implementing sparse writing by an object storage system as described in any one of the above.
Compared with the prior art, the technical scheme of the invention has at least one of the following beneficial effects:
in the method for realizing sparse writing of the object storage system, data with any length can be written in any position of the object, the written data does not need to have continuity, and random writing, sparse writing and data modification are supported. In addition, the object storage system in the method provided by the invention can calculate the blank data segment and the blank object fragment thereof by recording the written data and the positioning information when the target object is completely written, create the blank object fragment, and return the blank object fragment by zero complement of the data during reading, so that the data sparse writing of the object storage system is finally realized, the problem of data reading/writing amplification is further avoided, the data to be stored does not need to be migrated or transferred, and the performance of the object storage system can be effectively improved.
Drawings
FIG. 1 is a flowchart illustrating a method for implementing sparse write in an object storage system according to the present invention.
Fig. 2 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The following describes in more detail embodiments of the present invention with reference to the schematic drawings. The advantages and features of the present invention will become more apparent from the following description. It is to be noted that the drawings are in a very simplified form and are not to precise scale, which is merely for the purpose of facilitating and distinctly claiming the embodiments of the present invention.
First, terms in the present application are explained:
nfs (network File system): a network file system;
IO (input/output): inputting and outputting;
an object is a complex (similar to a file) of data and data attributes, which is a basic storage unit of the object storage system;
the file gateway of the object storage is a file storage service which provides standard storage protocols such as NFS, CIFS and the like for users based on an object storage system.
As described in the background art, the existing object storage system only supports sequential write-in of synchronous data, and does not support sparse write-in of data, thereby causing the problems of slow data transmission speed and poor storage performance of the distributed object storage system in connection with NFS.
Therefore, the invention provides a method for realizing sparse writing of an object storage system and electronic equipment, and aims to solve the problem that the object storage system in the prior art does not support sparse writing of data.
The present invention will be described in detail below with reference to specific examples.
As shown in fig. 1, the method for implementing sparse write for an object storage system provided by the present invention may include the following steps:
s1, receiving a data storage request sent by a client, wherein the data storage request comprises a data segment to be stored and input by a target user.
Wherein the data storage request may further include: an offset and a data length for identifying a storage location of the data segment.
In this embodiment, the target user may access the object storage system through an object storage system mount point installed in the client. The target user can access the object storage system through the object storage system mount point by data upload operation (write operation) or data read operation, so that the data request sent by the client to the object storage system can be divided into a data storage request and a data read request according to different operation modes of the target user.
For example, in the embodiment of the present invention, the object storage system is first subjected to the sparse write operation, and then subjected to the object read operation. Specifically, after the object storage system receives the data storage request sent by the client, it may parse the request, and execute corresponding steps according to the parsed data.
And S2, calculating the object fragment and the internal offset corresponding to the data fragment to be stored, writing the data fragment into the corresponding object fragment, and recording the offset and the length of the data fragment.
The object fragments are arranged in the object storage system and used for storing data; the internal offset is a positional offset of the data segment between an address in the object slice and a starting address of the object slice.
In this embodiment, the back end of the object storage system may calculate, according to the offset and the data length of the data segment, the internal offset address of the data to be stored in the object storage system and how large the object sharding party is required to store the internal offset address in the object, and directly write the data segment to be stored into the object shard. And then, recording the offset and the data length of the data segment to be stored.
Optionally, the object slice in step S2 is set in the object storage system to store data; the internal offset is a positional offset of the data segment between an address in the object slice and a starting address of the object slice.
Optionally, before the step 3, the method further includes:
s214, judging whether the data storage request sent by the client is received completely.
S3, after receiving all data storage requests sent by the client, determining blank data segments among the data segments to be stored according to the recorded offset and data length corresponding to the data segments, and setting object fragments for the blank data segments according to the offset and data length of the blank data segments, so that the object fragments corresponding to the blank data segments and the object fragments corresponding to the data segments to be stored form the target object.
In this embodiment, when the client completes writing data (synchronizes/commits data), it may also perform a synchronize data operation. Then, the back end of the object storage system may obtain, according to the recorded offset and data length of the data segment to be stored, which recorded data segments need to have a blank data segment inserted therebetween, and calculate which object segments need to have a blank object segment inserted therebetween, that is, create a blank object segment according to the obtained blank object segment information (including the offset and the length). Therefore, the whole object consists of the object fragment and the blank object fragment, and the blank object fragment automatically returns data zero when being read.
Further, after step S3, the method for implementing sparse write by the object storage system provided by the present invention may further include:
s4: updating the metadata of the target object to store the metadata contained by the target object in the object storage system.
In this embodiment, the object storage system may implement sparse writing of data by recording information (including offset and length) written into the stored data segment, and when the target object is completely written, calculating a blank data segment and a blank object fragment thereof, creating the blank object fragment, and returning by zero padding of data during reading.
Further, when the object storage system receives a request sent by the client as a data reading request, it indicates that the request is to perform a data reading operation on the object storage system, and for this reason, a specific implementation of the present invention specifically describes an implementation of how to perform object reading on the object storage system, and specifically includes the following steps:
s5, receiving a data reading request sent by the client, wherein the data reading request comprises the offset and the data length of the data segment to be read.
And S6, determining the object fragment and the internal offset of the data fragment to be read according to the offset and the data length of the data fragment to be read, and sending corresponding response information to the client according to the data stored in the determined object fragment.
Wherein the response information may include first response information and second response information;
in this embodiment, the step S6 specifically includes: s6.1, judging whether the data stored in the object fragment is a blank data fragment or not; s6.2, if the judgment result is yes, the object storage system sends first response information to the client; wherein the first response information comprises a data zero; s6.3, if the judgment result is negative, the object storage system sends second response information to the client; wherein the second response information includes data fragments stored in the object fragment.
In the method for realizing sparse writing of the object storage system, data with any length can be written in any position of the object, the written data does not need to have continuity, and random writing, sparse writing and data modification are supported. In addition, the object storage system in the method provided by the invention actually calculates the blank data segment and the blank object fragment thereof by recording the written data and the positioning information when the target object is completely written, creates the blank object fragment, and returns the blank object fragment by zero complement of the data during reading, so that the data sparse writing of the object storage system is finally realized, the problem of data reading/writing amplification is further avoided, the data to be stored does not need to be migrated or transferred, and the performance of the object storage system can be effectively improved.
The foregoing is a more detailed description of the invention in connection with specific preferred embodiments and it is not intended that the invention be limited to these specific details. For those skilled in the art to which the invention pertains, several equivalent substitutions or obvious modifications can be made without departing from the spirit of the invention, and the same methods or uses should be considered as falling within the scope of the invention.
In summary, in the method for implementing sparse writing in the object storage system provided by the present invention, data of any length can be written in any position of the object, the written data does not require continuity, and random writing, sparse writing and data modification are supported. In addition, the object storage system in the method provided by the invention can calculate the blank data segment and the blank object fragment thereof by recording the written data and the positioning information when the target object is completely written, create the blank object fragment, and return the blank object fragment by zero complement of the data during reading, so that the data sparse writing of the object storage system is finally realized, the problem of data reading/writing amplification is further avoided, the data to be stored does not need to be migrated or transferred, and the performance of the object storage system can be effectively improved.
Moreover, an embodiment of the present invention further provides an electronic device, as shown in fig. 2, including a processor 201, a communication interface 202, a memory 203, and a communication bus 204, where the processor 201, the communication interface 202, and the memory 203 complete mutual communication through the communication bus 204,
a memory 201 for storing a computer program;
the processor 202 is configured to implement the method for implementing sparse writing in the object storage system as described above when executing the program stored in the memory 202.
In addition, other implementation manners of the application setting method implemented by the processor 201 executing the program stored in the memory 203 are the same as those mentioned in the foregoing method embodiment, and are not described herein again.
The communication bus of the terminal may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface is used for communication between the electronic equipment and other equipment.
The Memory may include a Random Access Memory (RAM), or may also include a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the Integrated Circuit may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component.
In yet another embodiment of the present invention, a computer-readable storage medium is further provided, where instructions are stored in the computer-readable storage medium, and when the instructions are executed on a computer, the computer is caused to execute the method for implementing sparse writing for an object storage system as described in any one of the above embodiments.
In yet another embodiment of the present invention, there is also provided a computer program product containing instructions, which when run on a computer, causes the computer to execute the method for implementing sparse writing for any one of the object storage systems in the above embodiments.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.
Claims (9)
1. A method for implementing sparse writes by an object storage system, the method comprising:
s1, receiving a data storage request sent by a client, wherein the data storage request comprises a data segment to be stored and input by a target user;
s2, calculating the object fragment and the internal offset corresponding to the data fragment to be stored, writing the data fragment into the corresponding object fragment, and recording the offset and the length of the data fragment;
s3, after receiving all data storage requests sent by the client, determining blank data segments among the data segments to be stored according to the recorded offset and data length corresponding to the data segments, and setting object fragments for the blank data segments according to the offset and data length of the blank data segments, so that the object fragments corresponding to the blank data segments and the object fragments corresponding to the data segments to be stored form the target object.
2. The method according to claim 1, wherein the data storage request in step S1 further comprises: an offset and a data length for identifying a storage location of the data segment.
3. The method according to claim 1, wherein the object slice of step S2 is provided in the object storage system for storing data; the offset of the data segment is a positional offset of the data segment between an address in the target object and a starting address of the target object; the internal offset is a positional offset of the data segment between an address in the object slice and a starting address of the object slice.
4. The method according to claim 1, wherein after the step S3, the method further comprises:
s4: updating the metadata of the target object to store the metadata contained by the target object in the object storage system.
5. The method according to claim 4, wherein after the step S4, the method further comprises:
s5, receiving a data reading request sent by a client, wherein the data reading request comprises the offset and the length of a data segment to be read;
s6, according to the offset and the length of the data segment to be read, determining the object fragment and the internal offset of the data segment to be read, and according to the data stored in the determined object fragment, sending corresponding response information to the client.
6. The method of claim 5, wherein the response information comprises first response information and second response information;
the step S6 includes:
s6.1, judging whether the data stored in the object fragment is a blank data fragment or not;
s6.2, if the judgment result is yes, the object storage system sends first response information to the client; wherein the first response information comprises a data zero;
s6.3, if the judgment result is negative, the object storage system sends second response information to the client; wherein the second response information includes data fragments stored in the object fragment.
7. The method according to claim 4, wherein before the step S3, the method further comprises:
s214, judging whether the data storage request sent by the client is received completely.
8. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;
a memory for storing a computer program;
a processor for implementing the method for implementing sparse writing for an object storage system as claimed in any one of claims 1 to 7 when executing a program stored in a memory.
9. A computer-readable storage medium, having stored thereon a computer program which, when being executed by a processor, carries out the steps of the method for implementing sparse writing for an object storage system according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110511634.3A CN113204554B (en) | 2021-05-11 | 2021-05-11 | Method and device for realizing sparse writing of object storage system and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110511634.3A CN113204554B (en) | 2021-05-11 | 2021-05-11 | Method and device for realizing sparse writing of object storage system and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113204554A true CN113204554A (en) | 2021-08-03 |
| CN113204554B CN113204554B (en) | 2023-03-31 |
Family
ID=77030911
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110511634.3A Active CN113204554B (en) | 2021-05-11 | 2021-05-11 | Method and device for realizing sparse writing of object storage system and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113204554B (en) |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7533133B1 (en) * | 2004-04-28 | 2009-05-12 | Symantec Operating Corporation | Externally managed file versions |
| CN102279712A (en) * | 2011-08-10 | 2011-12-14 | 北京百度网讯科技有限公司 | Storage control method, system and device applied to network storage system |
| CN103049222A (en) * | 2012-12-28 | 2013-04-17 | 中国船舶重工集团公司第七0九研究所 | RAID5 (redundant array of independent disk 5) write IO optimization processing method |
| CN107015763A (en) * | 2017-03-03 | 2017-08-04 | 北京中存超为科技有限公司 | Mix SSD management methods and device in storage system |
| US20170329541A1 (en) * | 2016-05-11 | 2017-11-16 | Hitachi, Ltd. | Data storage system, process and computer program for such data storage system for reducing read and write amplifications |
| US20180121133A1 (en) * | 2016-10-28 | 2018-05-03 | Atavium, Inc. | Systems and methods for random to sequential storage mapping |
| CN108776682A (en) * | 2018-06-01 | 2018-11-09 | 南京紫光云信息科技有限公司 | The method and system of random read-write object based on object storage |
| US10134427B1 (en) * | 2018-03-07 | 2018-11-20 | International Business Machines Corporation | Storing data on unused areas of a storage medium |
| WO2019184012A1 (en) * | 2018-03-30 | 2019-10-03 | 华为技术有限公司 | Data writing method, client server, and system |
| CN111104063A (en) * | 2019-12-06 | 2020-05-05 | 浪潮电子信息产业股份有限公司 | Data storage method and device, electronic equipment and storage medium |
| CN111399765A (en) * | 2019-12-31 | 2020-07-10 | 杭州海康威视系统技术有限公司 | Data processing method and device, electronic equipment and readable storage medium |
| US20210133159A1 (en) * | 2019-11-01 | 2021-05-06 | EMC IP Holding Company LLC | Methods and systems for allocating free space in a sparse file system |
-
2021
- 2021-05-11 CN CN202110511634.3A patent/CN113204554B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7533133B1 (en) * | 2004-04-28 | 2009-05-12 | Symantec Operating Corporation | Externally managed file versions |
| CN102279712A (en) * | 2011-08-10 | 2011-12-14 | 北京百度网讯科技有限公司 | Storage control method, system and device applied to network storage system |
| CN103049222A (en) * | 2012-12-28 | 2013-04-17 | 中国船舶重工集团公司第七0九研究所 | RAID5 (redundant array of independent disk 5) write IO optimization processing method |
| US20170329541A1 (en) * | 2016-05-11 | 2017-11-16 | Hitachi, Ltd. | Data storage system, process and computer program for such data storage system for reducing read and write amplifications |
| US20180121133A1 (en) * | 2016-10-28 | 2018-05-03 | Atavium, Inc. | Systems and methods for random to sequential storage mapping |
| CN107015763A (en) * | 2017-03-03 | 2017-08-04 | 北京中存超为科技有限公司 | Mix SSD management methods and device in storage system |
| US10134427B1 (en) * | 2018-03-07 | 2018-11-20 | International Business Machines Corporation | Storing data on unused areas of a storage medium |
| WO2019184012A1 (en) * | 2018-03-30 | 2019-10-03 | 华为技术有限公司 | Data writing method, client server, and system |
| CN108776682A (en) * | 2018-06-01 | 2018-11-09 | 南京紫光云信息科技有限公司 | The method and system of random read-write object based on object storage |
| US20210133159A1 (en) * | 2019-11-01 | 2021-05-06 | EMC IP Holding Company LLC | Methods and systems for allocating free space in a sparse file system |
| CN111104063A (en) * | 2019-12-06 | 2020-05-05 | 浪潮电子信息产业股份有限公司 | Data storage method and device, electronic equipment and storage medium |
| CN111399765A (en) * | 2019-12-31 | 2020-07-10 | 杭州海康威视系统技术有限公司 | Data processing method and device, electronic equipment and readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113204554B (en) | 2023-03-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10803016B2 (en) | Predictive models of file access patterns by application and file type | |
| RU2608668C2 (en) | System and method for control and organisation of web-browser cache for offline browsing | |
| CN107153644B (en) | Data synchronization method and device | |
| CN109213604B (en) | Data source management method and device | |
| CN109885577B (en) | Data processing method, device, terminal and storage medium | |
| CN115599747B (en) | Metadata synchronization method, system and equipment of distributed storage system | |
| CN110958300B (en) | Data uploading method, system, device, electronic equipment and computer readable medium | |
| US20230030856A1 (en) | Distributed table storage processing method, device and system | |
| CN107577775B (en) | Data reading method and device, electronic equipment and readable storage medium | |
| CN110990365A (en) | Data synchronization method, device, server and storage medium | |
| CN112948409A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN115114232A (en) | Method, device and medium for enumerating historical version objects | |
| WO2020029588A1 (en) | Data reading method, device, system, and distributed system | |
| CN114691611A (en) | Directory refreshing processing method and device, electronic equipment and storage medium | |
| CN112148206A (en) | Data reading and writing method and device, electronic equipment and medium | |
| CN112286457B (en) | Object deduplication method and device, electronic equipment and machine-readable storage medium | |
| CN113204554B (en) | Method and device for realizing sparse writing of object storage system and electronic equipment | |
| CN111639087A (en) | Data updating method and device in database and electronic equipment | |
| TWI571754B (en) | Method for performing file synchronization control, and associated apparatus | |
| CN107103001B (en) | Method, device and system for acquiring target front-end resource file based on browser | |
| CN112214178B (en) | Storage system, data reading method and data writing method | |
| CN114297284A (en) | Interface quick response method and device, electronic equipment and storage medium | |
| CN111078643B (en) | Method and device for deleting files in batch and electronic equipment | |
| WO2015154678A1 (en) | File processing method, device, and network system | |
| CN111459411B (en) | Data migration method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |