WO2024012349A1

WO2024012349A1 - Data processing method, ssd controller, electronic device and readable storage medium

Info

Publication number: WO2024012349A1
Application number: PCT/CN2023/106134
Authority: WO
Inventors: 田海东; 薛晓勇; 王飞
Original assignee: 中兴通讯股份有限公司
Priority date: 2022-07-15
Filing date: 2023-07-06
Publication date: 2024-01-18
Also published as: CN117435121A

Abstract

A data processing method, a solid state disk (SSD) controller (200), an electronic device and a computer-readable storage medium. The data processing method comprises: acquiring an operation instruction which is sent when a key-value storage application of a host (100) is triggered (S100); and according to the operation instruction, controlling a co-processing module (50) in the SSD controller (200) to perform data scheduling processing (S200).

Description

Data processing method, SSD controller, electronic device and readable storage medium

Cross-references to related applications

This application is filed based on a Chinese patent application with application number 202210830277.1 and a filing date of July 15, 2022, and claims the priority of the Chinese patent application. The entire content of the Chinese patent application is hereby incorporated by reference into this application.

Technical field

Embodiments of the present application relate to, but are not limited to, the field of data processing technology, and in particular, to a data processing method, a solid state drive SSD controller, electronic equipment, and a computer-readable storage medium.

Background technique

The key-value storage system uses key-value pairs as the most basic storage unit and is a non-relational database; the storage architecture of existing key-value storage systems usually adopts the von Neumann architecture computer system; for computer systems based on von Neumann In the structured computer system, storage and calculation are separated. The central control processor needs to read data from the storage medium and then process it. Data transmission has become the bottleneck of this system architecture, affecting the data processing efficiency.

Contents of the invention

Embodiments of the present application provide a data processing method, a solid state drive SSD controller, electronic equipment, and a computer-readable storage medium.

In the first aspect, embodiments of the present application provide a data method, which is applied to a solid-state drive SSD controller. The SSD controller includes a co-processing module. The data processing method includes: obtaining the key value storage application of the host that is triggered. The operation instruction sent under the condition; the co-processing module is controlled to perform data scheduling processing according to the operation instruction.

In a second aspect, embodiments of the present application also provide another data processing method, applied to a host, where the host includes a key-value storage application, and the data processing method includes: when the key-value storage application is triggered Send an operation instruction to the solid state drive SSD controller, so that the co-processing module in the SSD controller performs data scheduling processing.

In a third aspect, embodiments of the present application also provide an SSD controller. The SSD controller includes a co-processing module; the SSD controller is used to obtain the operation instructions sent when the key-value storage application of the host is triggered; and controlling the co-processing module to perform data scheduling processing according to the operation instructions.

In a fourth aspect, embodiments of the present application also provide an electronic device, including one of the following: an SSD controller as described above; or a memory, a processor, and a computer program stored in the memory and executable on the processor. , when the processor executes the computer program, the data processing method as described above is implemented.

In a fifth aspect, embodiments of the present application further provide a computer-readable storage medium storing computer-executable instructions, and the computer-executable instructions are used to execute the data processing method as described above.

Description of drawings

Figure 1 is a schematic diagram of a system architecture for executing a data processing method provided by an embodiment of the present application;

Figure 2 is a schematic diagram of a system architecture for executing a data processing method provided by another embodiment of the present application;

Figure 3 is a flow chart of a data processing method provided by an embodiment of the present application;

Figure 4 is a specific flow chart of data scheduling in the data processing method provided by an embodiment of the present application;

Figure 5 is a specific flow chart of data scheduling based on instruction parsing information in the data processing method provided by an embodiment of the present application;

Figure 6 is a specific flow chart of data scheduling based on instruction parsing information in a data processing method provided by another embodiment of the present application;

Figure 7 is a specific flow chart of data scheduling based on the first index command parsing information in a data processing method based on instruction parsing information provided by an embodiment of the present application;

Figure 8 is a specific flow chart of data scheduling based on the second index instruction parsing information and data packaging parsing information in a data processing method based on instruction parsing information provided by an embodiment of the present application;

Figure 9 is a specific flow chart of the first data packaging process in the data processing method based on the second index instruction parsing information and the data packaging parsing information provided by an embodiment of the present application;

Figure 10 is a specific flow chart of the second data packaging process in the data processing method based on the second index instruction parsing information and the data packaging parsing information provided by an embodiment of the present application;

Figure 11 is a flow chart of a data processing method provided by another embodiment of the present application;

Figure 12 is a flow chart of a data processing method provided by another embodiment of the present application;

Figure 13 is a flow chart for sending operation instructions of a data processing method provided by another embodiment of the present application;

Figure 14 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

Detailed ways

In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be described in detail below with reference to the drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application and are not used to limit the present application.

It should be noted that although the functional modules are divided in the device schematic diagram and the logical sequence is shown in the flow chart, in some cases, the modules can be divided into different modules in the device or the order in the flow chart can be executed. The steps shown or described. The terms "first", "second", etc. in the description, claims, and above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific sequence or sequence.

This application provides a data processing method, an SSD controller, an electronic device and a computer-readable storage medium to obtain the operation instructions sent when the key-value storage application of the host is triggered; and then controls the co-processing module to process data according to the operation instructions. Scheduling processing, in which the co-processing module is located in the SSD controller; through the above settings, data scheduling processing can be performed in the SSD controller, reducing the computing power consumption of the host, and there is no need to control the SSD through the host as in the past Data scheduling can only be performed by reading data from one side of the controller, eliminating the scheduling data transmission process between the host and the SSD controller, thus improving the efficiency of data processing.

The embodiments of the present application will be described below with reference to the accompanying drawings.

As shown in Figure 1, Figure 1 is a schematic diagram of a system architecture for executing a data processing method provided by an embodiment of the present application. In the example of Figure 1, the system architecture includes a host 100 and a solid state disk (Solid State Disk, SSD) controller 200. The host 100 includes a key-value storage application 101. The SSD controller 200 includes a co-processing module 50. The host 100 Connected to the SSD controller 200, the key-value storage application 101 can issue operation instructions to the SSD controller 200, and the co-processing module 50 in the SSD controller 200 can execute the operation instructions issued by the key-value storage application 101.

As shown in Figure 2, Figure 2 is a schematic diagram of a system architecture for executing a data processing method provided by another embodiment of the present application. In the example of Figure 2, the system architecture includes a host 100, a solid-state disk controller 200, a volatile memory 300, and a non-volatile memory 400; the host 100 includes a key-value storage application 101 and an underlying open channel SSD driver 102. , the SSD controller 200 includes an embedded central processor 201, a data packaging circuit 202, an index maintenance circuit 203, a host interface processing module 204, a volatile memory controller 205 and a non-volatile memory interface control circuit 206; the SSD controller 200, Volatile memory 300 and non-volatile memory 400 constitute an open channel flash memory storage device. The key-value storage application 101 on the host 100 side can issue relevant operation instructions to the SSD controller 200. For example, the operation instructions can be read operation instructions, write operation instructions, erase operation instructions, data packaging operation instructions and indexing. Maintenance operation instructions; the underlying open channel SSD driver 102 can transmit the operation instructions issued by the key-value storage application 101 to the SSD controller 200; the embedded central processor 201, data packaging circuit 202, and index maintenance circuit in the SSD controller 200 203. The host interface processing module 204, the volatile memory controller 205 and the non-volatile memory interface control circuit 206 are connected through a bus. The host interface processing module 204 performs data connection with the underlying open channel SSD driver 102. The volatile memory controller 205 performs data connection with the volatile memory 300, and the non-volatile memory interface control circuit 206 performs data connection with the non-volatile memory 400; the embedded central processor 201 can perform data packaging circuit 202, index maintenance circuit 203, and host interface processing module 204. The volatile memory controller 205 and the non-volatile memory interface control circuit 206 perform control processing; the host interface processing module 204 can parse the operation instructions sent from the host 100 side, and then transmit the parsed information to the embedded center The processor 201, and then the embedded central processor 201 can control the corresponding circuit modules to perform corresponding operations. It is worth noting that the co-processing module 50 mentioned in the above embodiments of this application includes but is not limited to the data packaging circuit 202 and the index maintenance circuit 203.

In some embodiments of the present application, the underlying open channel SSD driver 102 is supported by driver software, and the driver software includes a Flash Translation Layer (FTL); FTL converts logical addresses in the SSD into physical addresses in actual memory. Software layer, including functions such as garbage collection, address mapping, and wear leveling. It is worth noting that the driver of the underlying open channel SSD driver 102 of this application needs to support co-processing commands and open channel solid state drive commands. Among them, the co-processing commands can include data packaging commands and index maintenance commands, and the open channel solid state drive commands can Including read commands, write commands and erase commands.

In some embodiments of the present application, the volatile memory controller 205 can schedule and process data in the volatile memory 300; the non-volatile memory interface control circuit 206 can schedule and process the data in the non-volatile memory 400.

The system architecture and application scenarios described in the embodiments of this application are for the purpose of explaining the technical solutions of the embodiments of this application more clearly, and do not constitute a limitation on the technical solutions provided by the embodiments of this application. Those skilled in the art will know that with the system architecture With the evolution of technology and the emergence of new application scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

Those skilled in the art can understand that the system architecture shown in Figures 1 and 2 does not constitute a limitation on the embodiments of the present application, and may include more or less components than shown in the figures, or combine certain components, or Different component arrangements.

Based on the structure of the above system architecture, various embodiments of the data processing method of the present application are proposed.

As shown in Figure 3, Figure 3 is a flow chart of a data processing method provided by an embodiment of the present application. The method is applied to an SSD controller, and the SSD controller includes a co-processing module. The method includes but is not limited to steps S100 and S200:

Step S100, obtain the operation instructions sent when the key-value storage application of the host is triggered;

Step S200: Control the co-processing module to perform data scheduling processing according to the operation instructions.

In an embodiment of the present application, the operation instructions sent when the key-value storage application of the host is triggered are obtained; and then based on The co-processing module is controlled according to the operation instructions to perform data scheduling processing, wherein the co-processing module is located in the SSD controller; through the above settings, data scheduling processing can be performed in the SSD controller, reducing the computing power consumption of the host, and eliminating the need for Data scheduling needs to be done by reading data from one side of the SSD controller through the host as in the past, which eliminates the scheduling data transmission process between the host and the SSD controller, thus improving the efficiency of data processing.

It is worth noting that when the key-value storage application is triggered, relevant operation instructions will be issued. In the embodiment of the present application, the operation instructions mainly refer to data packaging operation instructions and index maintenance operation instructions.

It is worth noting that the key-value storage system in the embodiment of the present application uses key-value pairs as the most basic storage unit and is a non-relational database. The host in the embodiment of this application is responsible for running key-value storage applications, and the data is stored in a storage unit that supports open-channel solid-state drives.

In the embodiment of the present application, the above method is applicable to the key-value storage system of an open-channel SSD. The open-channel SSD is a special solid-state drive that does not implement a memory translation layer in the firmware of the drive, but converts the physical solid-state drive into a key-value storage system. Storage management tasks are offloaded to the host side.

It is worth noting that the co-processing module is a functional module capable of processing co-processing commands. In the embodiment of the present application, the co-processing module includes but is not limited to a data packaging circuit and an index maintenance circuit. For example, when a key-value storage application needs to perform an index maintenance operation, the host side will send an index maintenance operation instruction to the SSD controller; upon receiving the index maintenance operation instruction, the SSD controller will control its internal index maintenance circuit. Relevant data scheduling processing to complete corresponding index maintenance operation instructions.

As shown in Figure 4, the SSD controller includes an embedded central processor and a host interface processing module. The above step S200 includes but is not limited to step S210 and step S220:

Step S210, parse the operation instruction based on the host interface processing module to obtain instruction parsing information;

Step S220: Based on the instruction parsing information, the embedded central processor is used to control the co-processing module to perform data scheduling processing.

In one embodiment of the present application, the SSD controller also includes an embedded central processor and a host interface processing module; in the process of data scheduling by the SSD controller according to the operation instructions, the operation instructions are first parsed based on the host interface processing module. Obtain the instruction parsing information; then based on the instruction parsing information, the embedded central processor will control the corresponding co-processing module to perform data scheduling processing to complete the corresponding operation instructions on one side of the SSD controller and reduce the computing power of the host. Capacity consumption, and there is no need to read data from the side of the SSD controller through the host as in the past to perform data scheduling, eliminating the scheduling data transmission process between the host and the SSD controller, thus improving the efficiency of data processing .

It is worth noting that the host interface processing module in the SSD controller can parse the operation instructions to obtain the instruction parsing information; then transmit the instruction parsing information to the embedded central processor, and the embedded central processor can control the operation according to the instruction parsing information. The corresponding co-processing module performs data scheduling processing. For example, when the operation instruction includes an index maintenance instruction, the embedded central processor will control the index maintenance circuit to perform work to complete the index maintenance instruction.

As shown in Figure 5, the co-processing module includes an index maintenance circuit. The above step S220 includes but is not limited to step S221:

Step S221: When the operation instruction includes a first index maintenance operation instruction, use the embedded central processor to control the index maintenance circuit to perform data scheduling processing.

In an embodiment of the present application, when the operation instruction includes the first index maintenance operation instruction, the host interface processing module parses the first index maintenance operation instruction, and then the embedded central processor can parse the first index maintenance operation instruction according to the host interface processing module. The information control index maintenance circuit performs data scheduling processing to complete corresponding operation instructions.

As shown in Figure 6, the co-processing module includes an index maintenance circuit and a data packaging circuit. The above step S220 includes but is not limited to step S222:

Step S222: When the operation instructions include the second index maintenance operation instruction and the data packaging operation instruction, use the embedded central processor to control the index maintenance circuit and the data packaging circuit to perform data scheduling processing.

In an embodiment of the present application, when the operation instructions include the second index maintenance operation instruction and the data packaging operation instruction, the host interface processing module parses the second index maintenance operation instruction and the data packaging operation instruction, and then the embedded central processing The processor can control the index maintenance circuit and the data packaging circuit to perform data scheduling processing based on the information parsed by the host interface processing module to complete the corresponding operation instructions.

As shown in Figure 7, the above step S221 includes but is not limited to step S2211, step S2212 and step S2213:

Step S2211, parse the first index maintenance operation instruction based on the host interface processing module to obtain the first index instruction parsing information;

Step S2212: Based on the first index instruction parsing information, the embedded central processor is used to control the index maintenance circuit to perform the first index maintenance operation, so that the high-frequency key values stored in the memory of the host are read into the volatile memory and established based on the high-frequency key values. first index;

Step S2213: Write the first index into the volatile memory and the non-volatile memory.

In an embodiment of the present application, the first index maintenance operation instruction is first parsed based on the host interface processing module to obtain the first index instruction parsing information; then based on the first index instruction parsing information, the embedded central processor is used to control the index maintenance The circuit performs a first index maintenance operation, so that the high-frequency key value stored in the host is read into the volatile memory and the first index is established based on the high-frequency key value; finally, the first index is written into the volatile memory and the non-volatile memory.

It is worth noting that the SSD controller receives the first index maintenance operation instruction from the host. The first index maintenance operation instruction is parsed by the host interface processing module and then enters the embedded central processor; the embedded central processor schedules the index maintenance circuit to work. At this time, the index maintenance circuit sends a command to the host interface processing module to store the data stored in the host. The high-frequency key values in the memory are read into the volatile memory, and the first index is established based on the high-frequency key values. The first index includes: value and storage address; after the operation is completed, the newly generated first index is written back to the volatile memory. and non-volatile memory.

In the embodiment of this application, the key-value storage application in the host needs to perform the first index maintenance operation, and needs to provide an index maintenance command to the underlying open channel SSD driver, so that the underlying open channel SSD driver sends the first index maintenance command to the SSD controller. An index maintenance operation instruction.

As shown in Figure 8, the above step S222 includes but is not limited to step S2221 and step S2222:

Step S2221, parse the second index maintenance operation instruction and the data packaging operation instruction based on the host interface processing module to obtain the second index instruction parsing information and data packaging parsing information;

Step S2222: Based on the second index instruction parsing information and data packaging parsing information, use the embedded central processor to control the index maintenance circuit and the data packaging circuit to perform data scheduling processing.

In an embodiment of the present application, the second index maintenance operation instruction and the data packaging operation instruction are first parsed based on the host interface processing module to obtain the second index instruction parsing information and data packaging parsing information; and then the information and data are parsed based on the second index instruction. Pack and parse information, and use the embedded central processor to control the index maintenance circuit and data packaging circuit for data scheduling and processing.

It is worth noting that the SSD controller receives the second index maintenance operation instruction and data packaging operation instruction from the host. The second index maintenance operation instructions and data packaging operation instructions enter the embedded central processor after being parsed by the host interface processing module; the embedded central processor can schedule the index maintenance circuit and the data packaging circuit to work.

In the embodiment of this application, the key-value storage application in the host needs to perform data packaging operations, and needs to provide data packaging operation instructions and second index maintenance instructions to the underlying open channel SSD driver, so that the underlying open channel SSD driver The controller sends the second index maintenance operation instruction and the data packaging operation instruction; then the host interface processing module parses the second index maintenance operation instruction and the data packaging operation instruction to obtain the second index instruction parsing information and data packaging parsing information, and finally the embedded The central processing unit controls the index maintenance circuit and the data packaging circuit to perform data scheduling processing according to the second index instruction parsing information and the data packaging parsing information.

As shown in Figure 9, the above step S2222 includes but is not limited to step S2223, step S2224 and step S2225:

Step S2223, the embedded central processor controls the data packaging circuit to perform the first data packaging process, so that the cache data stored in the memory table of the host is read into the volatile memory;

Step S2224: Perform a first index creation process on the cache data stored in the volatile memory according to the index maintenance circuit to obtain a second index, and transfer the cache data stored in the volatile memory to the non-volatile memory through the data packaging circuit ;

Step S2225: Write the cache data and the second index into the non-volatile memory.

In one embodiment of the present application, the embedded central processor controls the data packaging circuit to perform the first data packaging process, so that the cached data stored in the memory table of the host is read into the volatile memory; and then the index maintenance circuit is used to perform the first data packaging process. The cached data in the volatile memory undergoes a first index creation process to obtain a second index, and the cached data stored in the volatile memory is transferred to the non-volatile memory through the data packaging circuit; finally, the cached data and the second index are written into the non-volatile memory to complete the data packaging operation instructions.

It is worth noting that the memory table in the host memory is read into the volatile memory, and then storage space in the non-volatile memory is allocated to it; after the space is allocated, the index maintenance circuit is started to generate a second index, which records the layer The address of each page in the basic storage unit of the non-volatile memory and the range of stored key values. While establishing the index, the data packaging circuit will move the data cached in the volatile memory to the non-volatile memory. After the operation is completed , the data and the second index need to be written back to the non-volatile memory to complete the data packaging operation instruction.

It is worth noting that a co-processing mechanism is set up for the background packaging command of the key-value storage application, so that the processing unit is located closer to the data, avoiding lengthy data transmission time between the host and the storage device and saving the host's computing power. And a co-processing mechanism is set up for the index maintenance command of the key-value storage application, which can establish maintenance while executing the packaging command or maintain the index specifically for specific data, saving background processing time and improving service bandwidth.

Understandably, open-channel SSDs can incorporate redundant software stacks. Key-value storage applications already include garbage collection functions, eliminating the need for the underlying FTL to perform garbage collection operations. At the same time, moving storage unit management rights upward can make full use of underlying storage resources and avoid the fragmentation and inefficiency of continuous data caused by redundant software stacks. Storage and other issues.

As shown in Figure 10, the above step S2222 includes but is not limited to step S2226, step S2227, step S2228 and step S2229:

Step S2226, the embedded central processor controls the data packaging circuit to perform the second data packaging process, so that the initial storage data stored in the sorted string table of the non-volatile memory is read into the volatile memory;

Step S2227, merge and sort the initial storage data stored in the volatile memory to obtain the adjustment data;

Step S2228: Perform a second index creation process on the adjustment data stored in the volatile memory according to the index maintenance circuit to obtain a third index, and transfer the adjustment data stored in the volatile memory to the non-volatile memory through the data packaging circuit ;

Step S2229: Write the adjustment data and the third index into the non-volatile memory.

In one embodiment of the present application, the embedded central processor controls the data packaging circuit to perform the second data packaging process, so that the initial storage data stored in the sorted string table of the non-volatile memory is read into the volatile memory; and then the The initial storage data stored in the volatile memory is merged and sorted to obtain the adjustment data; then the second index creation process is performed on the adjustment data stored in the volatile memory according to the index maintenance circuit to obtain the third index, and the third index is obtained through the data packaging circuit. The adjustment data stored in the volatile memory is transferred to the non-volatile memory; finally, the adjustment data and the third index are written into the non-volatile memory.

It is worth noting that the data packaging circuit reads the two basic storage units stored in the non-volatile memory into the volatile memory, then allocates new storage space in the non-volatile memory and performs a merge sort operation. The new The generated data is cached in volatile memory; after the merge sort is completed, the index maintenance circuit is started to generate a third index. This index records the address of each page in the basic storage unit of this layer and the range of stored key values. While establishing the index, The data packaging circuit transfers the adjustment data cached in the volatile memory to the non-volatile memory. After the operation is completed, the adjustment data and the third index are written back to the non-volatile memory.

As shown in Figure 11, steps after the above step S200 include but are not limited to step S300:

Step S300: After the data scheduling process is completed, an operation completion notification message is sent to the host.

In one embodiment of the present application, after the data scheduling process is completed, one side of the SSD controller will also send operation completion notification information to the host to inform the host that the relevant operation instructions have been completed.

For example, when the host issues an index maintenance operation instruction, the SSD controller side will send an operation completion notification message to the host after completing the index maintenance operation to inform the host that the index maintenance operation has been completed; when the host What is issued is the data packaging operation command. When the data packaging operation is completed, the side of the SSD controller will send an operation completion notification message to the host to inform the host that the data packaging operation has been completed.

As shown in Figure 12, Figure 12 is a flow chart of a data processing method provided by another embodiment of the present application. The method is applied to the host, and the host includes a key-value storage application. The method includes but is not limited to step S400:

Step S400: When the key-value storage application is triggered, an operation instruction is sent to the solid-state drive SSD controller, so that the co-processing module in the SSD controller performs data scheduling processing.

In an embodiment of the present application, when the key-value storage application is triggered, an operation instruction is sent to the SSD controller, so that the co-processing module in the SSD controller can perform data scheduling processing to complete the corresponding operation instruction.

In an embodiment of the present application, the operation instructions sent when the key-value storage application of the host is triggered are obtained; and then the co-processing module is controlled to perform data scheduling processing according to the operation instructions, wherein the co-processing module is located in the SSD controller; through the above Settings enable data scheduling processing in the SSD controller, reducing the computing power consumption of the host, and there is no need to read data from the side of the SSD controller through the host as in the past to perform data scheduling, eliminating the need for The data transmission process is scheduled between the host and the SSD controller, thereby improving the efficiency of data processing.

As shown in Figure 13, the host includes an underlying open channel SSD driver, and the above step S400 includes but is not limited to step S410 and step S420.

Step S410, trigger the key-value storage application to generate operation instructions;

Step S420: Send the operation command to the solid state drive SSD controller based on the underlying open channel SSD driver.

In one embodiment of the present application, triggering the key-value storage application will generate an operation instruction, and then based on the underlying open channel SSD driver, the operation instruction generated by the key-value storage application will be sent to the SSD controller for processing, so that the SSD controller can Complete the corresponding operation instructions.

Another embodiment of the present application provides an SSD controller, the SSD controller includes a co-processing module;

The SSD controller is used to obtain the operation instructions sent when the key-value storage application of the host is triggered; and to control the co-processing module to perform data scheduling processing according to the operation instructions.

It is worth noting that setting the co-processing module in the SSD controller enables data scheduling and processing in the SSD controller, reducing the computing power consumption of the host, and does not require a step from the SSD controller through the host as in the past. Data scheduling can be performed only by reading data on the side, eliminating the scheduling data transmission process between the host and the SSD controller, thereby improving the efficiency of data processing.

In addition, as shown in Figure 14, one embodiment of the present application also provides an electronic device 700. The electronic device 700 includes one of the following: the SSD controller in the above embodiment; or,

Memory 720, processor 710, and a computer program stored on memory 720 and executable on processor 710.

The processor 710 and the memory 720 may be connected through a bus or other means.

It should be noted that the electronic device 700 in this embodiment and the data processing method in the above embodiments belong to the same inventive concept, so these embodiments have the same implementation principles and technical effects, which will not be described in detail here.

The non-transitory software programs and instructions required to implement the data processing method of the above embodiment are stored in the memory 720. When executed by the processor 710, the data processing method in the above embodiment is executed, for example, executing the above-described FIG. 3 The method steps S100 to S200 in Figure 4, the method steps S210 to S220 in Figure 4, the method step S221 in Figure 5, the method step S222 in Figure 6, the method steps S2211 to S2213 in Figure 7, the method steps in Figure 8 S2221 to S2222, method steps S2223 to S2225 in Figure 9, method steps S2226 to S2229 in Figure 10, method step S300 in Figure 11, method step S400 in Figure 12, and method steps S410 to S420 in Figure 13.

In addition, one embodiment of the present application also provides a computer-readable storage medium that stores computer-executable instructions, and the computer-executable instructions are executed by a processor 710, for example, by the above-mentioned scheduling device. Execution of a processor 710 in the embodiment 700 can cause the above-mentioned processor 710 to execute the data processing method in the above embodiment, for example, execute the above-described method steps S100 to S200 in Figure 3 and method step S210 in Figure 4 to S220, method step S221 in Figure 5, method step S222 in Figure 6, method steps S2211 to S2213 in Figure 7, method steps S2221 to S2222 in Figure 8, method steps S2223 to S2225 in Figure 9, Figure Method steps S2226 to S2229 in Figure 10, method steps S300 in Figure 11, method step S400 in Figure 12, and method steps S410 to S420 in Figure 13.

Embodiments of this application include: obtaining the operation instructions sent when the key-value storage application of the host is triggered; and then controlling the co-processing module to perform data scheduling processing according to the operation instructions, wherein the co-processing module is located in the SSD controller; through the above device It is determined that data scheduling can be performed in the SSD controller, reducing the computing power consumption of the host, and there is no need to read data from the side of the SSD controller through the host as in the past to perform data scheduling, eliminating the need for a host Scheduling the data transmission process with the SSD controller, thereby improving the efficiency of data processing.

Those of ordinary skill in the art can understand that all or some steps and systems in the methods disclosed above can be implemented as software, firmware, hardware, and appropriate combinations thereof. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit . Such software may be distributed on computer-readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). As is known to those of ordinary skill in the art, the term computer storage media includes volatile and nonvolatile media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. sexual, removable and non- Remove the media. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, Digital Versatile Disk (DVD) or other optical disk storage, magnetic cassettes, tapes, disk storage or other magnetic storage devices, or may Any other medium used to store the desired information and that can be accessed by a computer. Additionally, it is known to those of ordinary skill in the art that communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media .

Claims

A data processing method, applied to a solid state drive SSD controller, the SSD controller includes a co-processing module, the data processing method includes:

Obtain the operation instructions sent when the host's key-value storage application is triggered;

The co-processing module is controlled to perform data scheduling processing according to the operation instructions.
The data processing method according to claim 1, wherein the SSD controller includes an embedded central processor and a host interface processing module, and controlling the co-processing module to perform data scheduling processing according to the operating instructions includes:

Parse the operation instructions based on the host interface processing module to obtain instruction parsing information;

Based on the instruction parsing information, the embedded central processor is used to control the co-processing module to perform data scheduling processing.
The data processing method according to claim 2, wherein the co-processing module includes an index maintenance circuit, and the embedded central processor is used to control the co-processing module to perform data scheduling processing based on the instruction parsing information. ,include:

When the operation instruction includes a first index maintenance operation instruction, the embedded central processor is used to control the index maintenance circuit to perform data scheduling processing.
The data processing method according to claim 2, wherein the co-processing module includes an index maintenance circuit and a data packaging circuit, and the embedded central processor is used to control the co-processing module based on the instruction parsing information. Perform data scheduling processing, including:

In the case where the operation instructions include a second index maintenance operation instruction and a data packaging operation instruction, the embedded central processor is used to control the index maintenance circuit and the data packaging circuit to perform data scheduling processing.
The data processing method according to claim 3, wherein when the operation instructions include a first index maintenance operation instruction, the embedded central processor is used to control the index maintenance circuit to perform data scheduling processing, include:

The first index maintenance operation instruction is parsed based on the host interface processing module to obtain the first index instruction parsing information;

Based on the first index instruction parsing information, the embedded central processor is used to control the index maintenance circuit to perform a first index maintenance operation, so that the high-frequency key values stored in the memory of the host are read into the volatile memory and Establish a first index based on the high-frequency key value;

The first index is written to the volatile memory and non-volatile memory.
The data processing method according to claim 4, wherein the embedded central processor is used to control the index maintenance circuit when the operation instructions include a second index maintenance operation instruction and a data packaging operation instruction. Perform data scheduling processing with the data packaging circuit, including:

Based on the host interface processing module, the second index maintenance operation instruction and the data packaging operation instruction are parsed to obtain the second index instruction parsing information and data packaging parsing information;

Based on the second index instruction parsing information and the data packaging parsing information, the embedded central processor is used to control the index maintenance circuit and the data packaging circuit to perform data scheduling processing.
The data processing method according to claim 6, wherein using the embedded central processor to control the index maintenance circuit and the data packaging circuit to perform data scheduling processing includes:

The embedded central processor controls the data packaging circuit to perform the first data packaging process, so that the cache data stored in the memory table of the host is read into the volatile memory;

According to the index maintenance circuit, the cache data stored in the volatile memory is subjected to a first index creation process to obtain a second index, and through the data packaging circuit, all the cache data stored in the volatile memory are Move the cached data to non-volatile memory;

The cache data and the second index are written into the non-volatile memory.
The data processing method according to claim 6, wherein using the embedded central processor to control the index maintenance circuit and the data packaging circuit to perform data scheduling processing includes:

The embedded central processor controls the data packaging circuit to perform the second data packaging process, so that the initial storage data stored in the sorted string table of the non-volatile memory is read into the volatile memory;

Merge and sort the initial storage data stored in the volatile memory to obtain the adjustment data;

According to the index maintenance circuit, the second index creation process is performed on the adjustment data stored in the volatile memory to obtain a third index, and through the data packaging circuit, all the adjustment data stored in the volatile memory are The adjustment data is transferred to the non-volatile memory;

The adjustment data and the third index are written into the non-volatile memory.
The data processing method according to claim 1, wherein after controlling the co-processing module to perform data scheduling processing according to the operating instructions, the method further includes:

After the data scheduling processing is completed, operation completion notification information is sent to the host.
A data processing method, applied to a host, where the host includes a key-value storage application, and the data processing method includes:

When the key-value storage application is triggered, an operation instruction is sent to the solid state drive SSD controller, so that the co-processing module in the SSD controller performs data scheduling processing.
The data processing method according to claim 10, wherein the host includes an underlying open channel SSD driver, and when the key-value storage application is triggered, sending operation instructions to the solid state drive SSD controller includes:

Trigger the key-value storage application to generate operation instructions;

The operating instructions are sent to the solid state drive SSD controller based on the underlying open channel SSD driver.
A solid state drive SSD controller, including a co-processing module;

The SSD controller is used to obtain an operation instruction sent when the key-value storage application of the host is triggered; and to control the co-processing module to perform data scheduling processing according to the operation instruction.
An electronic device, including one of the following:

The SSD controller as claimed in claim 12; or,

A memory, a processor and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the data processing method according to any one of claims 1 to 9 or claim 10 is implemented. The data processing method described in any one of to 11.
A computer-readable storage medium storing computer-executable instructions, the computer-executable instructions being used to execute the data processing method as described in any one of claims 1 to 9 or any one of claims 10 to 11 data processing methods.