CN117828132A - Database real-time log hybrid storage method and system - Google Patents

Database real-time log hybrid storage method and system Download PDF

Info

Publication number
CN117828132A
CN117828132A CN202311702311.8A CN202311702311A CN117828132A CN 117828132 A CN117828132 A CN 117828132A CN 202311702311 A CN202311702311 A CN 202311702311A CN 117828132 A CN117828132 A CN 117828132A
Authority
CN
China
Prior art keywords
log data
data
uploading
real
database
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311702311.8A
Other languages
Chinese (zh)
Inventor
梁庆聪
叶小朋
魏兴国
李跃森
李文斌
王德勇
朱杰铭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tianyi Cloud Technology Co Ltd
Original Assignee
Tianyi Cloud Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tianyi Cloud Technology Co Ltd filed Critical Tianyi Cloud Technology Co Ltd
Priority to CN202311702311.8A priority Critical patent/CN117828132A/en
Publication of CN117828132A publication Critical patent/CN117828132A/en
Pending legal-status Critical Current

Links

Abstract

The application relates to the technical field of data storage, in particular to a database real-time log hybrid storage method and system, wherein the method comprises the following steps: when receiving a data storage request of a user, acquiring log data from a database in real time; writing the obtained log data into a read-write area of a local disk, and transferring the log data to an uploading buffer area of the local disk after the writing is completed; uploading the log data of the uploading buffer area to a cloud storage space; detecting the usage amount of the disk space of the read-write area in real time, and when the usage amount of the disk space reaches a preset threshold value, confirming whether the log data of the uploading buffer area is uploaded; and if the uploading is completed, deleting the real-time log data of the uploading buffer area. In the application, the local disk and the cloud storage space are mapped into a unified file system in advance, so that real-time log backup of a database at a file system level can be provided. According to the technical scheme, data storage can be efficiently carried out on large-batch log data.

Description

Database real-time log hybrid storage method and system
Technical Field
The application relates to the technical field of data storage, in particular to a database real-time log hybrid storage method and system.
Background
Local disk storage is a conventional data storage method that uses a local storage medium such as a hard disk or a flash memory to store data. The local disk storage has the advantages of high access speed, short response time and very effective on a large number of read-write operations. However, the disadvantage of local disk storage is the limited storage capacity and the high storage cost.
Object storage is an emerging data storage approach that uses cloud storage space services to store data. The object storage has the advantages of large storage capacity, low storage cost and high expandability and reliability. However, object storage has the disadvantage of relatively slow access, long response time, and is not suitable for a large number of read and write operations.
When the logs in the database are stored, if the local disk storage is adopted, the logs are affected by the limitation of the storage capacity of the local disk storage, and if the object storage of the cloud storage space is adopted, the problems that the access speed is relatively slow, the response time is long and the method is not suitable for a large number of read-write operations can occur.
Disclosure of Invention
In order to solve the problem that a single storage method is difficult to efficiently store large-batch log data in the related technology at least to a certain extent, the application provides a database real-time log hybrid storage method and system.
The scheme of the application is as follows:
according to a first aspect of an embodiment of the present application, there is provided a database real-time log hybrid storage method, including:
when receiving a data storage request of a user, acquiring log data from a database in real time;
writing the obtained log data into a read-write area of a local disk, and transferring the log data to an uploading buffer area of the local disk after the writing is completed;
uploading the log data of the uploading buffer area to a cloud storage space;
detecting the disk space usage amount of the local disk in real time, and when the disk space usage amount reaches a preset threshold value, confirming whether the log data of the uploading buffer area is uploaded completely or not;
if the uploading is completed, deleting the real-time log data of the uploading buffer area;
the local disk and the cloud storage space are mapped into a unified file system in advance.
Preferably, before writing the obtained log data into the read-write area of the local disk, the method further includes:
and writing the acquired log data into a pre-configured data buffer area.
Preferably, after obtaining log data from the database in real time, the method further comprises:
and analyzing the log data based on the type and version of the database.
Preferably, the method further comprises:
recording the process of writing the log data into a read-write area of the local disk as metadata;
it is determined whether writing is completed according to the recording of the metadata.
Preferably, the method further comprises:
recording the process of uploading the log data to the cloud storage space as metadata;
and determining whether the uploading is finished according to the record of the metadata.
Preferably, the metadata is stored locally and is backed up synchronously in the cloud storage space.
Preferably, after the real-time log data of the uploading buffer area is deleted, when the disk space usage of the read-write area still reaches a preset threshold, the log data is stopped from being acquired from the database until the disk space usage of the read-write area falls below the preset threshold.
Preferably, the method further comprises:
after the abnormal restart, the process before the abnormal restart is resumed according to the record of the metadata.
Preferably, the method further comprises:
and feeding back the data storage result to the user.
According to a second aspect of embodiments of the present application, there is provided a database real-time log hybrid storage system, including:
the data acquisition module is used for acquiring log data from the database in real time when receiving a data storage request of a user;
the data writing module is used for writing the acquired log data into a read-write area of the local disk, and transferring the log data to an uploading buffer area of the local disk after the writing is completed;
the data uploading module is used for uploading the log data of the uploading buffer area to the cloud storage space;
the memory detection module is used for detecting the disk space usage amount of the local disk in real time, and confirming whether the log data of the uploading buffer area are uploaded or not when the disk space usage amount reaches a preset threshold value;
and the data deleting module is used for deleting the real-time log data of the uploading buffer area when the uploading is completed.
The technical scheme that this application provided can include following beneficial effect: the database real-time log hybrid storage method comprises the following steps: when receiving a data storage request of a user, acquiring log data from a database in real time; writing the obtained log data into a read-write area of a local disk, and transferring the log data to an uploading buffer area of the local disk after the writing is completed; uploading the log data of the uploading buffer area to a cloud storage space; detecting the usage amount of the disk space of the read-write area in real time, and when the usage amount of the disk space reaches a preset threshold value, confirming whether the log data of the uploading buffer area is uploaded; and if the uploading is completed, deleting the real-time log data of the uploading buffer area. In the technical scheme, the local disk and the cloud storage space are mapped into a unified file system in advance, so that real-time log backup of a database at a file system level can be provided. According to the technical scheme, the mixed storage of the database real-time logs is realized based on the local disk storage and the cloud storage space storage, so that a more flexible and efficient file storage scheme is provided. According to the technical scheme, the log data is firstly written into the local disk, so that the data can be quickly recorded and local backup is ensured, the quick access and response speed of the data are improved, and the local storage is used for temporarily storing the data. And after the log data is written into the local disk, uploading the log data to a cloud storage space for data backup and long-term storage. And meanwhile, when the storage space of the local disk is insufficient, the log data uploaded to the cloud storage space is deleted to release the storage space of the local disk, so that the problem of limited storage capacity of the local disk is solved. According to the technical scheme, data storage can be efficiently carried out on large-batch log data.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.
FIG. 1 is a flow chart of a method for hybrid storage of database real-time logs according to an embodiment of the present application;
FIG. 2 is a schematic flow diagram of log data in a local disk and a cloud storage space according to an embodiment of the present disclosure;
fig. 3 is a schematic structural diagram of a database real-time log hybrid storage system according to an embodiment of the present application.
Reference numerals: 21. a data acquisition module; 22. a data writing module; 23. a data uploading module; 24. a memory detection module; 25. and a data deleting module.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present application as detailed in the accompanying claims.
Example 1
Fig. 1 is a flow chart of a database real-time log hybrid storage method according to an embodiment of the present invention, and referring to fig. 1, a database real-time log hybrid storage method includes:
s11: when receiving a data storage request of a user, acquiring log data from a database in real time;
in databases, real-time journals are used to record changes to all database operations, including insert, update, and delete operations.
It should be noted that, in specific practice, log data is obtained from the database in real time in a subscription mode through the adapter. Through the subscription mode, the adapter module subscribes to the real-time log of the database to obtain instant information about database operations.
Once the adapter subscribes to the real-time log of the database, real-time log data obtained from the database may be received. These data contain details of the database operation, how the data was changed, and when the data was changed.
S12: writing the obtained log data into a read-write area of a local disk, and transferring the log data to an uploading buffer area of the local disk after the writing is completed;
local disk storage is a conventional data storage method that uses a local storage medium such as a hard disk or a flash memory to store data. The local disk storage has the advantages of high access speed, short response time and very effective on a large number of read-write operations. However, the disadvantage of local disk storage is the limited storage capacity and the high storage cost.
S13: uploading the log data of the uploading buffer area to a cloud storage space;
cloud storage, i.e., object storage, is an emerging data storage modality that uses cloud storage space services to store data. The object storage has the advantages of large storage capacity, low storage cost and high expandability and reliability. However, object storage has the disadvantage of relatively slow access, long response time, and is not suitable for a large number of read and write operations.
S14: detecting the disk space usage amount of a local disk in real time, and when the disk space usage amount reaches a preset threshold value, confirming whether the log data of the uploading buffer area is uploaded completely or not;
s15: if the uploading is completed, deleting the real-time log data of the uploading buffer area;
the local disk and the cloud storage space are mapped into a unified file system in advance.
It should be noted that, the real-time log has a backup requirement, but different database types have different backup tools and methods, and the technical scheme in this embodiment maps the local disk and the cloud storage space into a unified file system, and provides real-time log backup of the database at the file system level.
In specific practice, a file system based on user space is adopted to realize a driver program, and a local disk and cloud storage space are mapped into a unified file system.
In specific practice, a unified interface of the local disk I/O and the cloud storage space OS is realized through the I/O adaptation module, and is exposed to the outside as OLHybrid Interface (the name of the interface or the interface). The operating system to which it is interfaced employs a common interface such as os.File, os.FileInfo, os.Read, os.Write, etc.
In specific practice, a user initiates an I/O flow, and a user space process initiates an I/O request, namely a data storage request;
OLhybrid Fs (File management System) converts I/O requests into standard system calls;
the system call is transferred to a kernel mode driver, and the driver forwards the I/O request to OLhybrid Fs;
the OLhybrid Fs process executes corresponding operation (such as reading file data) and returns the operation to the system driver;
the system driver passes the results back to the kernel, which returns the results to the user space process.
As shown in fig. 2, in this embodiment, the local disk is divided into a read-write area and an upload buffer area.
The read-write area and the upload buffer area can be allocated according to a ratio of 7:3.
The obtained log data is firstly written into a read-write area of the local disk, the written log data has the condition of uploading, and the written log data is transferred from the read-write area to an uploading buffer area of the local disk to be uploaded to a cloud storage space.
Since the data in the upload buffer is log data which has been written, the log data in the write area includes data being written and data to be transferred to the upload buffer. The data of the upload buffer may be referred to as history data, and the log data of the write area may be referred to as current data.
When the disk space usage of the read-write area reaches a preset threshold (for example, more than 70%), disk space recovery is started, namely whether the uploading of the log data of the uploading buffer area is completed is confirmed, and if the uploading is completed, the real-time log data of the uploading buffer area is deleted.
Note that, in this embodiment, the technical solution inherits the characteristics of Log Data In Anyone, and ensures that data must be stored in the cloud storage space or the local disk, so it is necessary to confirm whether the log data in the upload buffer is uploaded.
It should be noted that, before writing the obtained log data into the read-write area of the local disk, the method further includes:
and writing the acquired log data into a pre-configured data buffer area.
It should be noted that, the data buffer is a temporary storage area for storing data to be processed, and in this embodiment, the acquired log data is written into a pre-configured data buffer so as to reduce the requirement for reading and writing on the local disk. This helps to improve performance and reduce the burden of local disk read-write operations.
It should be noted that, after acquiring log data from the database in real time, the method further includes:
the log data is parsed based on the type and version of the database.
It should be noted that, after log data is obtained from the database, parsing operations are performed, and these logs are interpreted according to the type and version of the database, which is helpful for understanding the nature of database operations, how data is written into the database, and how these operations are handled correctly.
It should be noted that the method further includes:
recording the process of writing the log data into a read-write area of the local disk as metadata;
it is determined whether writing is completed according to the recording of the metadata.
The method further comprises the steps of:
recording the process of uploading the log data to the cloud storage space as metadata;
and determining whether the uploading is finished according to the record of the metadata.
Further, the metadata is stored locally and is backed up synchronously in the cloud storage space.
It should be noted that, to ensure the security and integrity of data,
the process of writing the log data into the read-write area of the local disk and the process of uploading the log data to the cloud storage space are recorded as metadata, and the metadata is mainly information describing data attributes and is used for supporting functions such as indication storage positions, historical data, resource searching, file recording and the like. The metadata in this embodiment is used to describe the read-write result of log data.
It should be noted that, the metadata body is stored locally and is backed up synchronously in the cloud storage space, so that synchronization between the local metadata body and the backup metadata in the cloud storage space is ensured, and metadata loss is prevented.
Further, after the abnormal restart, the process before the abnormal restart is resumed according to the record of the metadata.
If the data storage process exits under abnormal conditions, the last process is fetched from the metadata during restarting, and the process before abnormal restarting is recovered.
After the real-time log data of the uploading buffer area is deleted, when the usage amount of the disk space still reaches a preset threshold value, the log data is stopped from being acquired from the database until the usage amount of the disk space of the reading and writing area is reduced below the preset threshold value.
It can be understood that after the real-time log data of the uploading buffer is deleted, when the usage amount of the disk space still reaches the preset threshold, it proves that enough disk space cannot be recovered, at this time, subscription needs to be temporarily stopped, further uploading is waited for being completed, and after more disk space is released for the local disk, subscription is restored.
It should be noted that, in the data storage process, the data storage result is also fed back to the user in real time, so that the user can master the progress of data storage at any time.
It can be appreciated that the database real-time log hybrid storage method in this embodiment includes: when receiving a data storage request of a user, acquiring log data from a database in real time; writing the obtained log data into a read-write area of a local disk, and transferring the log data to an uploading buffer area of the local disk after the writing is completed; uploading the log data of the uploading buffer area to a cloud storage space; detecting the usage amount of the disk space of the read-write area in real time, and when the usage amount of the disk space reaches a preset threshold value, confirming whether the log data of the uploading buffer area is uploaded; and if the uploading is completed, deleting the real-time log data of the uploading buffer area. In the technical scheme of the embodiment, the local disk and the cloud storage space are mapped into a unified file system in advance, so that real-time log backup of the database at the file system level can be provided. According to the technical scheme, the mixed storage of the database real-time logs is realized based on the local disk storage and the cloud storage space storage, so that a more flexible and efficient file storage scheme is provided. According to the technical scheme, the log data is firstly written into the local disk, so that the data can be quickly recorded, local backup is ensured, the quick access and response speed of the data are improved, and the local storage is used for temporarily storing the data. And after the log data is written into the local disk, uploading the log data to a cloud storage space for data backup and long-term storage. And meanwhile, when the storage space of the local disk is insufficient, the log data uploaded to the cloud storage space is deleted to release the storage space of the local disk, so that the problem of limited storage capacity of the local disk is solved. According to the technical scheme, data storage can be efficiently performed on large-batch log data.
Example two
A database real-time log hybrid storage system, referring to fig. 3, comprising:
a data acquisition module 21, configured to acquire log data from a database in real time when receiving a data storage request of a user;
the data writing module 22 is configured to write the obtained log data into a read-write area of the local disk, and transfer the log data to an upload buffer area of the local disk after the writing is completed;
the data uploading module 23 uploads the log data of the uploading buffer area to the cloud storage space;
the memory detection module 24 is configured to detect a disk space usage amount of the local disk in real time, and confirm whether the log data in the upload buffer area is uploaded when the disk space usage amount reaches a preset threshold;
and the data deleting module 25 is used for deleting the real-time log data of the uploading buffer area when the uploading is completed.
The database real-time log hybrid storage system in this embodiment includes: the device comprises a data acquisition module 21, a data writing module 22, a data uploading module 23, a memory detection module 24 and a data deleting module 25. The data acquisition module 21 acquires log data from the database in real time when receiving a data storage request of a user; the data writing module 22 writes the acquired log data into a read-write area of the local disk, and transfers the log data to an uploading buffer area of the local disk after the writing is completed; the data uploading module 23 uploads the log data of the uploading buffer area to the cloud storage space; the memory detection module 24 detects the usage amount of the disk space in the read-write area in real time, and confirms whether the log data of the uploading buffer area is uploaded or not when the usage amount of the disk space reaches a preset threshold value; the data deleting module 25 deletes the real-time log data of the upload buffer when the upload is completed. In the technical scheme of the embodiment, the local disk and the cloud storage space are mapped into a unified file system in advance, so that real-time log backup of the database at the file system level can be provided. According to the technical scheme, the mixed storage of the database real-time logs is realized based on the local disk storage and the cloud storage space storage, so that a more flexible and efficient file storage scheme is provided. According to the technical scheme, the log data is firstly written into the local disk, so that the data can be quickly recorded, local backup is ensured, the quick access and response speed of the data are improved, and the local storage is used for temporarily storing the data. And after the log data is written into the local disk, uploading the log data to a cloud storage space for data backup and long-term storage. And meanwhile, when the storage space of the local disk is insufficient, the log data uploaded to the cloud storage space is deleted to release the storage space of the local disk, so that the problem of limited storage capacity of the local disk is solved. According to the technical scheme, data storage can be efficiently performed on large-batch log data.
The system further comprises:
and the data caching module is used for writing the acquired log data into a pre-configured data caching area.
The system further comprises:
and the data analysis module is used for analyzing the log data based on the type and version of the database.
The system further comprises:
the metadata module is used for recording the process of writing the log data into the read-write area of the local disk as metadata; determining whether writing is completed according to the record of the metadata;
recording the process of uploading the log data to the cloud storage space as metadata; determining whether the uploading is completed according to the record of the metadata;
the metadata is stored locally and synchronously backed up in the cloud storage space.
The system further comprises:
and the exception handling module is used for recovering the process before abnormal restarting according to the record of the metadata after the abnormal restarting.
The system further comprises:
and the feedback module is used for feeding back the data storage result to the user.
It is to be understood that the same or similar parts in the above embodiments may be referred to each other, and that in some embodiments, the same or similar parts in other embodiments may be referred to.
It should be noted that in the description of the present application, the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. Furthermore, in the description of the present application, unless otherwise indicated, the meaning of "plurality" means at least two.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and further implementations are included within the scope of the preferred embodiment of the present application in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the embodiments of the present application.
It is to be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, the various steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, may be implemented using any one or combination of the following techniques, as is well known in the art: discrete logic circuits having logic gates for implementing logic functions on data signals, application specific integrated circuits having suitable combinational logic gates, programmable Gate Arrays (PGAs), field Programmable Gate Arrays (FPGAs), and the like.
Those of ordinary skill in the art will appreciate that all or a portion of the steps carried out in the method of the above-described embodiments may be implemented by a program to instruct related hardware, where the program may be stored in a computer readable storage medium, and where the program, when executed, includes one or a combination of the steps of the method embodiments.
In addition, each functional unit in each embodiment of the present application may be integrated in one processing module, or each unit may exist alone physically, or two or more units may be integrated in one module. The integrated modules may be implemented in hardware or in software functional modules. The integrated modules may also be stored in a computer readable storage medium if implemented in the form of software functional modules and sold or used as a stand-alone product.
The above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, or the like.
In the description of the present specification, a description referring to terms "one embodiment," "some embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present application. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiments or examples. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
Although embodiments of the present application have been shown and described above, it will be understood that the above embodiments are illustrative and not to be construed as limiting the application, and that variations, modifications, alternatives, and variations may be made to the above embodiments by one of ordinary skill in the art within the scope of the application.

Claims (10)

1. The database real-time log hybrid storage method is characterized by comprising the following steps of:
when receiving a data storage request of a user, acquiring log data from a database in real time;
writing the obtained log data into a read-write area of a local disk, and transferring the log data to an uploading buffer area of the local disk after the writing is completed;
uploading the log data of the uploading buffer area to a cloud storage space;
detecting the disk space usage amount of the local disk in real time, and when the disk space usage amount reaches a preset threshold value, confirming whether the log data of the uploading buffer area is uploaded completely or not;
if the uploading is completed, deleting the real-time log data of the uploading buffer area;
the local disk and the cloud storage space are mapped into a unified file system in advance.
2. The method of claim 1, wherein prior to writing the obtained log data to the read-write area of the local disk, the method further comprises:
and writing the acquired log data into a pre-configured data buffer area.
3. The method of claim 1, wherein after obtaining log data from the database in real time, the method further comprises:
and analyzing the log data based on the type and version of the database.
4. The method according to claim 1, wherein the method further comprises:
recording the process of writing the log data into a read-write area of the local disk as metadata;
it is determined whether writing is completed according to the recording of the metadata.
5. The method according to claim 4, wherein the method further comprises:
recording the process of uploading the log data to the cloud storage space as metadata;
and determining whether the uploading is finished according to the record of the metadata.
6. The method of any of claims 4-5, wherein the metadata is stored locally and is backed up synchronously in cloud storage.
7. The method of claim 1, wherein after the real-time log data of the upload buffer is deleted, when the disk space usage of the read-write area still reaches a preset threshold, the log data is stopped from being acquired from the database until the disk space usage of the read-write area falls below the preset threshold.
8. The method according to claim 4, wherein the method further comprises:
after the abnormal restart, the process before the abnormal restart is resumed according to the record of the metadata.
9. The method according to claim 1, wherein the method further comprises:
and feeding back the data storage result to the user.
10. A database real-time log hybrid storage system, comprising:
the data acquisition module is used for acquiring log data from the database in real time when receiving a data storage request of a user;
the data writing module is used for writing the acquired log data into a read-write area of the local disk, and transferring the log data to an uploading buffer area of the local disk after the writing is completed;
the data uploading module is used for uploading the log data of the uploading buffer area to the cloud storage space;
the memory detection module is used for detecting the disk space usage amount of the local disk in real time, and confirming whether the log data of the uploading buffer area are uploaded or not when the disk space usage amount reaches a preset threshold value;
and the data deleting module is used for deleting the real-time log data of the uploading buffer area when the uploading is completed.
CN202311702311.8A 2023-12-12 2023-12-12 Database real-time log hybrid storage method and system Pending CN117828132A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311702311.8A CN117828132A (en) 2023-12-12 2023-12-12 Database real-time log hybrid storage method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311702311.8A CN117828132A (en) 2023-12-12 2023-12-12 Database real-time log hybrid storage method and system

Publications (1)

Publication Number Publication Date
CN117828132A true CN117828132A (en) 2024-04-05

Family

ID=90503628

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311702311.8A Pending CN117828132A (en) 2023-12-12 2023-12-12 Database real-time log hybrid storage method and system

Country Status (1)

Country Link
CN (1) CN117828132A (en)

Similar Documents

Publication Publication Date Title
US8250033B1 (en) Replication of a data set using differential snapshots
US7440966B2 (en) Method and apparatus for file system snapshot persistence
US8738588B2 (en) Sequential media reclamation and replication
US9176853B2 (en) Managing copy-on-writes to snapshots
EP2333653A1 (en) Information backup/restoring apparatus and information backup/restoring system
US20080168218A1 (en) Backup system with continuous data protection
JP2005301497A (en) Storage management system, restoration method and its program
US7567994B2 (en) Method and apparatus to proactively capture and transmit dense diagnostic data of a file system
US20170329706A1 (en) Volatile cache reconstruction after power failure
US20140214766A1 (en) Storage system and control device
CN106528338B (en) Remote data copying method, storage device and storage system
CN111240879B (en) SAS card firmware log collection method, system, device and storage medium
US20080040368A1 (en) Recording notations per file of changed blocks coherent with a draining agent
CN110825559A (en) Data processing method and equipment
CN113254394B (en) Snapshot processing method, system, equipment and storage medium
CN113076220A (en) Data processing method and device, electronic equipment and computer readable medium
CN110147296B (en) Data processing method, device, equipment and readable storage medium
US11487428B2 (en) Storage control apparatus and storage control method
US20050262033A1 (en) Data recording apparatus, data recording method, program for implementing the method, and program recording medium
CN117828132A (en) Database real-time log hybrid storage method and system
CN109165117B (en) Data processing method and system
US7865472B1 (en) Methods and systems for restoring file systems
CN114328007B (en) Container backup and restoration method, device and medium thereof
CN115328696A (en) Data backup method in database
US20070271311A1 (en) Disk array device and data management method for managing master data and replication data replicated from master data

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination