WO2021184996A1

WO2021184996A1 - Data storage method and apparatus for database

Info

Publication number: WO2021184996A1
Application number: PCT/CN2021/075501
Authority: WO
Inventors: 熊刚; 许友松
Original assignee: 华为技术有限公司
Priority date: 2020-03-20
Filing date: 2021-02-05
Publication date: 2021-09-23
Also published as: CN113495883A

Abstract

Disclosed are a data storage method and apparatus for a database, wherein same are used for providing a data storage means, which is efficient and has low maintenance costs, for a database. The method comprises: when it is detected that data in a database changes (401), a data processing apparatus recording a first log (402); the first log being preferentially stored in a first memory (403); and when the data processing apparatus determines that the storage space in the first memory is insufficient, for example, less than a first threshold value, switching to a second memory to continue to record the first log (404), wherein the first memory and the second memory are deployed in different devices. A log of a database is no longer confined to a local memory, and when the storage space in a first memory is insufficient, switching to another memory can be performed to continue to store the log, such that the way in which the database stores data is more efficient. Multiple memories can be deployed in different devices, and no large local disk is required, so that the disk maintenance costs of the database can be effectively reduced.

Description

Data storage method and device for database

Technical field

This application relates to the field of communication technology, and in particular to a data storage method and device for a database.

Background technique

At present, the files involved in the database, such as the log that records data changes in the database, the sorted files generated by the execution of efflux, etc., are usually placed on the same disk, such as all on the local disk or on the cloud disk.

For the case where the files involved in the database service are placed on the local disk, more local disk space is required, which increases the maintenance cost.

For the case where the files involved in the database service are placed on a cloud disk, remote direct memory access (RDMA) technology is required to read the data in the cloud disk, and the efficiency of data reading and writing is poor.

In summary, there is an urgent need for an efficient and low-maintenance database data storage method.

Summary of the invention

The present application provides a data storage method and device for a database, so as to provide an efficient and low-maintenance database data storage method.

In the first aspect, the embodiments of the present application provide a data storage method for a database, which is executed by a data processing device. In the method: the data processing device can record a first log when a data change in the database is detected. A log is preferentially stored in the first memory. When the data processing device determines that the storage space in the first memory is insufficient, for example, less than the first threshold, it can switch to the second memory to continue recording the first log, the first memory and the second memory Deploy in different devices.

Through the above method, the log of the database is no longer limited to the local storage. When the storage space in the first storage is insufficient, it can be switched to other storage to continue to store the log, making the data storage method of the database more efficient and multiple storages can be deployed In different devices, large local disks are no longer needed, which can effectively reduce the disk maintenance cost of the database.

In a possible implementation manner, in addition to the log of the database, the sorting file generated by the database during the sorting process may also be stored in a similar manner. Exemplarily, when the data processing device receives a database sorting request, it can sort the data in the database according to the received database sorting request; the data processing device can also generate a sorting file in the process of sorting the data. The sorted file may be stored in the first memory, and when the data processing apparatus determines that the storage space of the first memory is less than the second threshold, it may switch to the second memory and continue to save the second memory. The above method is only an example of receiving a database sorting request. In some scenarios, when data in the database needs to be queried, the data processing device will also sort the data in the database to generate a sorting file. The sorting file can also be stored in the above-mentioned manner.

Through the above method, the sorting files generated during the data sorting process in the database can be stored in multiple memories, which improves the data storage efficiency of the database, and the multiple memories are distributed and deployed, reducing the maintenance cost of the local disk.

In a possible implementation manner, for the database, extended memory and memory can also be set. The extended memory and memory can be used to store data with a higher read and write frequency in the database. The extended memory and memory can be deployed in the first memory. It may also be another memory independent of the first memory. The data processing device may store data in the database with a read and write frequency greater than the third threshold in the extended memory based on the read and write frequency of the data in the database; when the data processing device needs to read the data in the extended memory , The data can be read from the extended memory to the internal memory, and the data processing device can read the data from the internal memory.

Through the above method, the setting of the extended memory can effectively expand the storage space of the memory, so that more data can be stored in the extended memory, and ensure that these data can be efficiently read and written.

In a possible implementation, the data processing device can also eliminate the data with low read and write frequency in the extended memory in time. The data processing device first detects the read and write frequency of the data in the extended memory; if the read and write frequency is stored in the extended memory When the data is lower than the third threshold, the data whose read and write frequency is lower than the third threshold in the extended memory can be eliminated.

Through the above method, the data processing device can eliminate the cold data in the extended memory in time, and effectively utilize the storage space in the extended memory.

In a possible implementation manner, the data processing device may also back up the first log stored in the first storage and the second storage. After the first log is backed up, the first log may be cleared; afterwards, if the database is If there is a data change, the data processing device may continue to record the second log of the database in the first memory according to the data change of the database.

Through the above method, when there is free storage space in the first storage (such as clearing the first log), the log can be continued to be stored in the first storage to effectively utilize the storage space of the first storage.

In a possible implementation manner, the data processing device may delete the sorting file after sorting the data in the database according to the sorting file.

Through the above method, the data processing device deletes the sorted files in time, which can ensure that there is free storage space in the first memory and the second memory so as to store other valid data.

In a possible implementation, the data processing apparatus may also record the correspondence between the data page and the data page identifier in the extended memory. For example, save the correspondence in the non-volatile memory, and when the device where the first memory is located is restarted Afterwards, the data processing device may reorganize the extended memory in the first memory according to the corresponding relationship.

Through the above method, the data processing device can quickly organize and expand the memory after the device is restarted.

In the second aspect, the embodiments of the present application also provide a data processing device, and the beneficial effects can be referred to the description of the first aspect and will not be repeated here. The device has the function of realizing the behavior in the method example of the first aspect described above. The function can be realized by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above-mentioned functions. In a possible design, the structure of the device includes a processing unit, a determining unit, and a switching unit. These units can perform the corresponding functions in the above-mentioned method example of the first aspect. For details, please refer to the detailed description in the method example. Do repeat.

In a third aspect, an embodiment of the present application also provides a computing device. The computing device includes a processor and a memory, and may also include a communication interface. The processor executes the program instructions in the memory to execute the above-mentioned first aspect or In the method provided by any possible implementation of the first aspect, the memory is coupled with the processor and stores program instructions and data necessary to perform data synchronization. The communication interface is used to communicate with other devices (such as client devices).

In a fourth aspect, the present application provides a computing device system, which includes at least one computing device. Each computing device includes a memory and a processor. The processor of at least one computing device may be used to access the code in the memory to execute the first aspect or the method provided in any possible implementation manner of the first aspect.

In a fifth aspect, the present application provides a non-transitory readable storage medium. When the non-transitory readable storage medium is executed by a computing device, the computing device executes the foregoing first aspect or any of the first aspects. Possible implementation. The storage medium stores the program. The storage medium includes, but is not limited to, volatile memory, such as random access memory, non-volatile memory, such as flash memory, hard disk drive (HDD), and solid state drive (SSD).

In a sixth aspect, the present application provides a computing device program product. The computing device program product includes computer instructions. When executed by a computing device, the computing device can execute the foregoing first aspect or any possible aspect of the first aspect. Method to realize. The computer program product may be a software installation package. In the case where the method provided in the foregoing first aspect or any possible implementation of the first aspect needs to be used, the computer program product may be downloaded and executed on a computing device. Program product.

Description of the drawings

Figure 1 is a schematic diagram of the architecture of a system provided by this application;

Figure 2 is a schematic diagram of another system structure provided by this application;

Figure 3 is a schematic diagram of another system structure provided by this application;

FIG. 4 is a schematic diagram of a data storage method for a database provided by this application;

FIG. 5 is a schematic structural diagram of a data processing device provided by this application;

FIG. 6 is a schematic diagram of a computing device provided by an embodiment of this application;

FIG. 7 is a schematic diagram of a computing device in a computing device system provided by an embodiment of the application.

Detailed ways

As shown in FIG. 1, it is a schematic diagram of a system structure provided by an embodiment of this application. The system includes a data processing apparatus 100, a first memory 200 and a second memory 300.

The first memory 200 may include a volatile memory (volatile memory), such as a random access memory (random access memory, RAM). The first memory may also include non-volatile memory (NVM), such as read-only memory (ROM), flash memory, hard disk drive (HDD), or solid state drive (solid disk drive). -state drive, SSD). The first memory may also include a combination of the above types. The first memory 200 is similar to the second memory 300. For details, please refer to the foregoing content, which will not be repeated here. The first storage 200 and the second storage 300 are deployed in different data centers and located in different devices. For example, the first storage 200 is a local disk, and the second storage 300 is a cloud disk.

The first memory 200 and the second memory 300 are used to store data in the database and related files of the database, such as logs (such as physical logs and logical logs), sort files, and so on.

The first storage 200 may also include an extended memory and a memory, and the extended memory and the memory are used to store data with a relatively high read and write frequency in the database.

The data processing device 100 may be a hardware device, such as a server, a terminal computing device, etc., or a software device, specifically a set of software systems running on a hardware computing device. The embodiment of the present application does not limit the location where the data processing device 100 is deployed. Exemplarily, as shown in FIG. 2, the data processing apparatus 100 may run in a cloud computing device system (including at least one cloud computing device, such as a server, etc., in the embodiment of the present application, the cloud computing device system is a data center), It can also run on an edge computing device system (including at least one edge computing device, such as a server, a desktop computer, etc., the edge computing device system in the embodiment of this application is a data center), or it can run on various terminal computing devices, For example: notebook computers, personal desktop computers, etc.

The data processing device 100 can also be a device composed of multiple parts logically. For example, the data processing device 100 can include a processing unit, a determining unit, and a switching unit. Each component of the data processing device 100 can be deployed in different systems. Or in the server. Exemplarily, as shown in Fig. 3, each part of the device can run in three environments of cloud computing equipment system, edge computing equipment system or terminal computing equipment respectively, and can also run in any two of these three environments. middle. The cloud computing equipment system, the edge computing equipment system and the terminal computing equipment are connected by a communication path, which can communicate and transmit data with each other. The data storage method for the database provided by the embodiment of the present application is executed by the combined parts of the data processing apparatus 100 running in three environments (or any two of the three environments).

The first memory 200 can be deployed in the same system or in the same hardware device as the data processing device 100, so that the data processing device 100 can read data from the first memory 200 more efficiently. This application does not limit the second memory 300. The deployment location only needs to ensure that the first storage 200 and the second storage 300 are deployed in different data centers.

In the embodiment of the present application, the data processing device 100 can generate a log according to the change status of the data in the database. When the free storage space in the first storage 200 is greater than the first threshold, the generated log is preferentially stored in the first storage 200 As the log is generated and stored, the storage space in the first storage 200 gradually decreases. When the free storage space in the first disk is less than the first threshold, the data processing device 100 switches to the second storage 300 to continue storing the log. It can be seen from the above that the logs can be stored in at least two different first memories 200, which can effectively improve the utilization of different memories and ensure that the logs of the database can be completely saved.

The following is a data storage method for a database provided by an embodiment of the present application with reference to FIG. 4, and the method includes:

Step 401: The data processing device 100 detects the data change of the database. Data changes in the database include but are not limited to: insert, delete, and update of data. Among them, data insertion refers to adding new data to the database, data deletion refers to deleting data in the database, and data updating refers to changing one data in the database to another data.

Step 402: The data processing device 100 generates a first log according to the data change of the database.

In the database, the log is used to record the data changes sent by the database of the recorder, such as data insertion, deletion, and update. When the data in the database changes, the data processing device 100 will generate a corresponding log after checking the data change. In this embodiment of the application, it is distinguished from the log generated by the subsequent data processing device 100. In step 402 The generated log is called the first log.

Step 403: When the free storage space in the first memory 200 is not less than the first threshold, the data processing apparatus 100 stores the first log in the first memory 200.

Step 404: When the data processing device 100 determines that the free storage space in the first storage 200 is less than the first threshold, it switches to the second storage 300 to continue storing the first log.

In the embodiment of the present application, the storage order of the logs is the first storage 200 -> the second storage 300. In other words, the data processing device 100 preferentially saves the first log in the first memory 200, and when the free storage space in the first memory 200 is insufficient (for example, less than the first threshold), it switches to the second memory 300 to continue storing the first log. One log.

In the database, a fixed file is configured for storing logs. The file can be called a log file. The size of the log file is fixed, usually a preset value. As the data in the database changes, the data processing device 100 generates When the size of the first log reaches the preset value, the database cannot continue to make data changes. At this time, the first log needs to be backed up. After the backup is completed, the first log can be cleared, which means that the first log stored in the first storage 200 and the second storage 300 are deleted.

After the first log is cleared, if there are still data changes in the database, the data processing device 100 can continue to generate a log. For convenience of description, the log generated by the data processing device 100 is referred to herein as the second log, which is similar to the first log. The data processing device 100 preferentially saves the second log in the first memory 200, and when the free storage space of the first memory 200 is insufficient, it switches to the second memory 300 to continue to store the second memory 300.

In the foregoing content, the storage method of the log in the first storage 200 and the second storage 300 is introduced. The data processing device 100 may also use a similar storage method for other data in the database (such as sorted files).

When the data processing device 100 receives the data sorting request, it may sort the data in the database according to the received request to feed back the sorted data.

When the data processing device 100 sorts the data in the database, a sorting file is generated, and the sorting file records the sequence of the sorted data. The sort file can also record the storage location of the data and the index number of the data.

After the data processing device 100 generates the sorted file, the sorted file can be stored in the first storage 200 first. As the sorted file is stored in the first storage 200, the free storage space in the first storage 200 becomes less and less. When the free storage space in the first storage 200 is insufficient (for example, less than the second threshold), it is switched to the second storage 300 to continue storing the sorted files.

After the data processing device 100 finishes sorting the data in the database and determines the sorting result according to the sorting file, the sorting file can be deleted.

That is to say, the storage order of the sorted files is the first memory 200 -> the second memory 300, and the first memory 200 is first stored in the first memory 200, and the second memory 300 is second.

In the above description, taking the request received by the data processing device 100 as a data sorting request as an example, when the data processing device 100 acrobatics receives a data query request, in order to be able to query the data processing device 100 more quickly, it can also query the data in the database. The sorting is performed to generate a sorting file. The storage method of the sorting file is similar to the foregoing method, and will not be repeated here.

It can be seen from the foregoing that the data processing device 100 can store logs and sorted files in the first memory 200 and the second memory 300, and this data storage method is more flexible for data storage and effectively expands the data storage space.

As a possible implementation manner, the first storage 200 may be a local disk of the database, and the second storage 300 is deployed in a cloud computing device system, that is, the second storage 300 is a cloud disk, and related files or data of the database may be extended to Cloud storage, the files involved in the database can be distributed on local disks and cloud disks. This storage method combines the scalability of cloud disks and can also effectively save maintenance costs.

It should be noted that the embodiment of the present application only takes two memories included in the system as an example. In some scenarios, a larger number of memories may be included, and the location of data storage is more flexible, and the utilization rate of the memory can also be effectively improved. .

In addition to the data storage method mentioned in the foregoing, the embodiment of the present application can also expand the memory (buffer pool) in the device where the database is deployed, for example, an extended memory (extend buffer pool) is set in the first memory.

In order to further highlight the role of memory expansion, the memory is explained first. The read and write frequency of data in the database is usually different. When the existing data processing device 100 manages the data in the database, the memory can place the read and write frequency in the database. Higher data. Generally, the frequency of reading and writing data in the memory is relatively high, and the data processing device 100 can obtain data from the memory first, which can effectively improve the read and write data of the data, and further improve the processing efficiency of the data processing device 100.

However, the memory space is usually limited, and it is not possible to store all data with higher read and write frequency in the memory. The data stored in the memory may also be updated, which will eliminate some data with higher read and write frequency, resulting in data processing devices. 100 needs to load these data from the second memory 300, and for this purpose, an extended memory can be added.

The extended memory can store data whose data read/write frequency is greater than the third threshold, in order to make the extended memory store data whose data read/write frequency is greater than the third threshold. The data processing device 100 can periodically update the data in the extended memory, store data with a data read and write frequency greater than the third threshold in the extended memory, and can also eliminate data stored in the extended memory with a read and write frequency lower than the third threshold.

The following is an explanation of how data is moved into the extended memory and the data in the extended memory is eliminated:

(1). The data is moved into the extended memory.

When the data processing device 100 migrates data into the extended memory, it can first locate the data to be migrated. The data processing device 100 may use the data in the internal memory as the data to be migrated in.

Generally, when data is stored in a memory, the data in the database is usually organized in fixed-size data units, such as data pages. The size of data stored in each data page (page) is the same, and each data page is configured with an identity (ID). The data processing device 100 can realize rapid positioning of the data page through the identification of each data page in the memory.

As a possible implementation manner, in the first memory 200 and the second memory 300, a hash map (hash map) may be used to organize the identification of the data page and the data page, and the data processing apparatus 100 may be based on the hash table and according to the data The identification of the page locates to the data page.

(2) Data is moved out of the extended memory.

When the data processing device 100 eliminates data from the extended memory, it can first locate the data to be moved out. For example, the data processing apparatus 100 can use a page replacement algorithm, such as least recently used (LRU), to determine which data page that the extended memory finds is less used, and the data in the data page is the data to be migrated out.

When the data processing device 100 needs to read data in the database, it can first obtain the data from the memory or the extended memory. The extended memory further expands the amount of data that the memory can store, ensuring more read and write frequencies. The data of can be stored in the first memory, which can improve the efficiency of data reading and writing.

As a possible implementation manner, the data processing apparatus 100 may also record the corresponding relationship between the data page in the extended memory and the identifier of the data page, and store the corresponding relationship in the non-volatile memory. When the first device restarts At the time, you can directly call the previously saved correspondence to reorganize the extended memory so that you can quickly locate the data page stored in the extended memory.

Based on the same inventive concept as the method embodiment, an embodiment of the present application also provides a data processing device, which is configured to execute the method performed by the data processing device 100 in the method embodiment shown in FIG. 4. As shown in FIG. 5, the data processing device 500 includes a processing unit 501, a determining unit 502, and a switching unit 503, and the aforementioned modules may be software modules. Specifically, in the data processing device 500, a connection is established between units through a communication path.

The processing unit 501 is configured to record the first log of the database in the first memory according to the data change of the database. The processing unit 501 may execute steps 401 to 403 as shown in FIG. 4.

The determining unit 502 is configured to determine that the storage space of the first memory is less than a first threshold. The determining unit 502 may execute the method of determining that the storage space of the first memory is less than the first threshold in step 404 shown in FIG. 4.

The switching unit 503 is configured to switch the processing unit 501 to the first log of the second memory recording database after the determining unit 502 determines that the storage space of the first memory is less than the first threshold, where the first memory and the second memory are deployed and In different devices. The switching unit 503 may execute the method of exactly switching to the second memory to record the first log in step 404 as shown in FIG. 4.

In a possible implementation manner, the device further includes a sorting unit 504.

After receiving the database sorting request, the sorting unit 504 can sort the data in the database according to the received database sorting request; the processing unit 501 saves the sorting file generated during the sorting process in the first memory;

After the determining unit 502 determines that the storage space of the first memory is smaller than the second threshold, the switching unit 503 may cause the processing unit 501 to switch to the second memory to save the second memory.

In a possible implementation manner, the first memory includes extended memory and memory;

The processing unit 501 can store the data in the database with a read and write frequency greater than the third threshold in the read and write frequency of the data in the database, and read the data in the extended memory to the memory.

In a possible implementation manner, the processing unit 501 may also eliminate data whose read/write frequency is lower than the third threshold in the extended memory.

In a possible implementation manner, after the processing unit 501 switches to the second memory to record the first log of the database, it may also clear the first log after the first log is backed up; according to the data change of the database, the first log is changed in the first memory. Record the second log in the database.

In a possible implementation manner, after the processing unit 501 saves the second sorting file generated during the sorting process in the second memory, the sorting file may be deleted after the sorting unit 504 finishes sorting the data in the database according to the sorting file.

In a possible implementation manner, the processing unit 501 may also record the corresponding relationship between the data page and the data identifier in the extended memory, and reorganize the extended memory according to the corresponding relationship after the device where the first memory is located is restarted.

The division of modules in the embodiments of this application is illustrative, and it is only a logical function division. In actual implementation, there may be other division methods. In addition, the functional modules in the various embodiments of this application can be integrated into one process. In the device, it can also exist alone physically, or two or more modules can be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or software functional modules.

If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the technical solution of the present application essentially or the part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , Including several instructions to enable a terminal device (which may be a personal computer, a mobile phone, or a network device, etc.) or a processor to execute all or part of the steps of the method in each embodiment of the present application. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (read-only memory, ROM), random access memory (random access memory, RAM), magnetic disks or optical disks and other media that can store program codes. .

The computing device 600 is shown in FIG. 6. The computing device 600 includes a bus 601, a processor 602, a communication interface 603, and a memory 604. The processor 602, the memory 604, and the communication interface 603 communicate through a bus 601.

The processor 602 may be a central processing unit (CPU). The memory 604 may include a volatile memory (volatile memory), such as a random access memory (random access memory, RAM). The memory 604 may also include a non-volatile memory (non-volatile memory), such as read-only memory (ROM), flash memory, HDD or SSD. Executable code is stored in the memory, and the processor 602 executes the executable code to execute the aforementioned data storage method (the method shown in FIG. 4). The memory 604 may also include an operating system and other software modules required for running processes. The operating system can be LINUX ^TM , UNIX ^TM , WINDOWS ^TM etc.

Specifically, the memory 604 stores the modules in the aforementioned data processing apparatus 500. In addition to storing the aforementioned multiple modules, the memory 604 may also include other software modules required for running processes such as an operating system. The operating system can be LINUX ^TM , UNIX ^TM , WINDOWS ^TM etc.

The present application also provides a computing device system. The computing device system includes at least one computing device 700 as shown in FIG. 7. The computing device 700 includes a bus 701, a processor 702, a communication interface 703, and a memory 704. The processor 702, the memory 704, and the communication interface 703 communicate through a bus 701. At least one computing device 700 in the computing device system communicates with each other through a communication path.

The processor 702 may be a CPU. The memory 704 may include volatile memory, such as random access memory. The memory 704 may also include non-volatile memory, such as read-only memory, flash memory, HDD or SSD. Executable code is stored in the memory 704, and the processor 702 executes the executable code to perform any part or all of the aforementioned data synchronization method. The memory may also include an operating system and other software modules required for running processes. The operating system can be LINUX, UNIX, WINDOWS ^TM, etc.

Specifically, any one or any multiple modules of the aforementioned data processing apparatus 500 are stored in the memory 704. In addition to storing any one or more of the aforementioned units, the memory 704 may also include other software modules required for running processes, such as an operating system. The operating system can be LINUX, UNIX, WINDOWS ^TM, etc.

At least one computing device 700 in the computing device system establishes communication with each other through a communication network, and each computing device runs any one or any multiple units in the data processing apparatus 500. At least one computing device 700 collectively performs the aforementioned data storage operation.

The descriptions of the processes corresponding to each of the above figures have their respective focuses. For parts that are not described in detail in a certain process, please refer to the related descriptions of other processes.

In the above-mentioned embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented by software, it can be implemented in the form of a computer program product in whole or in part. The computer program product for data synchronization includes one or more computer program instructions for data synchronization. When the computer program instructions for data synchronization are loaded and executed on a computer, the data synchronization program according to the embodiment of the present invention is generated in whole or in part. Process or function.

The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website, computer, server, or data center. Transmission to another website, computer, server, or data center via wired (such as coaxial cable, optical fiber, digital subscriber line, or wireless (such as infrared, wireless, microwave, etc.)). The computer-readable storage medium includes A readable storage medium of computer program instructions for classification model training. The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or data center integrated with one or more available media. The usable medium may be a magnetic medium (for example, a floppy disk, a hard disk, a magnetic tape), an optical medium (for example, a DVD), or a semiconductor medium (for example, an SSD).

Claims

A data storage method for a database, characterized in that the method includes:

Recording the first log of the database in the first memory according to the data change of the database;

After determining that the storage space of the first memory is less than the first threshold, switch to the second memory to record the first log of the database, where the first memory and the second memory are deployed in different devices.
The method of claim 1, wherein the method further comprises:

Sorting the data in the database according to the received database sorting request;

Saving the sorting file generated in the sorting process in the first memory;

After determining that the storage space of the first memory is smaller than the second threshold, switch to the second memory and continue to save the second memory.
The method according to claim 1 or 2, wherein the first memory includes an extended memory and a memory, and the method further comprises:

Based on the read and write frequency of the data in the database, storing data in the database with a read and write frequency greater than a third threshold in the extended memory;

Read the data in the extended memory to the memory.
The method of claim 3, wherein the method further comprises:

Eliminate the data whose read and write frequency is lower than the third threshold in the extended memory.
The method according to any one of claims 1 to 4, wherein after the switching to the second memory to record the first log of the database, the method further comprises:

Clearing the first log after the backup of the first log is completed;

The second log of the database is recorded in the first memory according to the data change of the database.
5. The method according to any one of claims 1 to 5, characterized in that, after storing the second sorted file generated in the sorting process in the second memory, the method further comprises:

After the data in the database is sorted according to the sorting file, the sorting file is deleted.
The method according to claim 3 or 4, wherein the method further comprises:

Record the correspondence between data pages and data identifiers in the extended memory;

After the device where the first memory is located is restarted, the extended memory is reorganized according to the corresponding relationship.
A data processing device, characterized in that the device includes a processing unit, a determining unit, and a switching unit:

The processing unit is configured to record the first log of the database in the first memory according to the data change of the database;

The determining unit is configured to determine that the storage space of the first memory is less than a first threshold;

The switching unit is configured to switch the processing unit to the second memory to record the first log of the database after the determining unit determines that the storage space of the first memory is less than the first threshold; Wherein, the first memory and the second memory are deployed in different devices.
The device according to claim 8, wherein the device further comprises a sorting unit:

The sorting unit is configured to sort the data in the database according to the received database sorting request;

The processing unit is configured to save the sorting file generated in the sorting process in the first memory;

The determining unit is further configured to determine that the storage space of the first memory is less than a second threshold;

The switching unit is further configured to switch the processing unit to the second memory to save the second memory after the determining unit determines that the storage space of the first memory is less than a second threshold.
9. The device according to claim 8 or 9, wherein the first memory includes an extended memory and a memory;

The processing unit is further configured to store data in the database with a read-write frequency greater than a third threshold in the extended memory based on the read-write frequency of the data in the database, and store data in the extended memory The data is read into the memory.
The device of claim 10, wherein:

The processing unit is also used to eliminate data whose read and write frequency is lower than a third threshold in the extended memory.
The device according to any one of claims 8 to 11, wherein after the processing unit is switched to the second memory to record the first log of the database, it is further configured to:

Clearing the first log after the backup of the first log is completed;

The second log of the database is recorded in the first memory according to the data change of the database.
The device according to any one of claims 9-12, wherein after the processing unit saves the second sorting file generated in the sorting process in the second memory, it is further used for:

After the data in the database is sorted according to the sorting file, the sorting file is deleted.
The device according to claim 10 or 11, wherein the processing unit is further configured to record the correspondence between data pages and data identifiers in the extended memory;

After the device where the first memory is located is restarted, the extended memory is reorganized according to the corresponding relationship.
A computing device, characterized in that the computing device includes a processor and a memory;

The memory is used to store computer program instructions;

The processor invokes computer program instructions in the memory to execute the method according to any one of claims 1 to 7.
A computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to make a computer execute the method according to any one of claims 1 to 7.