KR20230011871A - Virtualization device including storage device and computational device, and method of operating the same - Google Patents

Abstract

According to an embodiment of the present disclosure, a virtualization device communicates with a host device executing a virtual machine, and includes a computational storage virtualization (CSV) device, a storage device, and a computation device. An operating method of a virtualization device includes the steps of: receiving, from a host device, a first address of a virtual machine, a second address of a storage device, and a first request indicating a read operation; obtaining a third address of a real machine corresponding to the virtual machine and a fourth address of a computation device based on the first request; providing, to the storage device, a second request indicating the second address, the fourth address, and a redirection; providing, to the computation device, raw data based on the second request; providing, to the computation device, a third request indicating the third address, the fourth address, and a processing operation; generating processed data based on the third request and the raw data; and providing, to the host device, the processed data. According to the embodiment of the present disclosure, a resource burden of the host device can be reduced by providing an operation resource through a hardware accelerator.

Description

Virtualization device including a storage device and a computing device, and method of operating the same

The present disclosure relates to a virtualization device, and more particularly, to a virtualization device including a storage device and a computing device, and a method for operating the same.

Storage virtualization technology provides virtual machines with the resources of real storage devices. A virtual machine may be a software-implemented computing environment, and an operating system or application may be installed and executed on the virtual machine. The virtual machine may read data stored in the real storage device according to a read request or store data in the real storage device according to a write request.

In order to efficiently manage large amounts of data and improve security, the storage device may store compressed or encrypted data by a processor of a host device or a separate computing device instead of storing data received from a virtual machine as it is. When an operation technology for a virtual machine is implemented as software, a burden on resources of a host device may increase and data processing speed may decrease. There may be a need for a method of providing computational and storage resources to virtual machines while reducing the resource burden of host devices and ensuring high-speed data communication between devices.

According to one embodiment of the present disclosure, a virtualization device including a storage device and a computing device, and a method for operating the virtualization device are provided.

According to an embodiment of the present disclosure, a virtualization device communicates with a host device running a virtual machine, and includes a Computational Storage Virtualization (CSV) device, a storage device, and a computing device. The method of operating the virtualization device may include receiving, by the CSV device, a first request indicating a first address of the virtual machine, a second address of the storage device, and a read operation from the host device; Acquiring, by a CSV device, a third address of a real machine corresponding to the virtual machine and a fourth address of the computing device based on the first request; 2 addresses, the fourth address, and providing a second request indicating redirection, by the storage device, providing raw data to the computing device based on the second request, by the CSV device , providing, to the computing device, a third request indicating the third address, the fourth address, and a processing operation, by the computing device, processing data based on the third request and the raw data; generating, and providing, by the computing device, the processed data to the host device.

According to an embodiment of the present disclosure, a virtualization device communicates with a host device running a virtual machine, and includes a Computational Storage Virtualization (CSV) device, a storage device, and a computing device. The method of operating the virtualization device may include receiving, by the CSV device, a first request indicating a first address of the virtual machine, a second address of the storage device, and a write operation from the host device; Acquiring, by the CSV device, a third address of a real machine corresponding to the virtual machine and a fourth address of the computing device based on the first request; 3 providing a second request indicating an address, the fourth address, and a processing operation; receiving, by the computing device, from the host device, raw data based on the second request; generating processed data based on the second request and the raw data, and a third request indicating, by the CSV device, to the storage device, the second address, the fourth address, and a store operation. providing, receiving, by the storage device, the processed data from the computing device based on the third request, and storing the processed data by the storage device. .

According to an embodiment of the present disclosure, a virtualization device includes a storage device configured to store first data, a computing device configured to process the first data, and process second data of a virtual machine executed by a host device. , a Computational Storage Virtualization (CSV) device, and a Peripheral Component Interconnect express (PCIe) circuit connected to the storage device, the calculation device, the CSV device, and the host device. The CSV device receives a first request including a first address of the virtual machine and a second address of the storage device from the host device, and a third address of a real machine corresponding to the virtual machine and the computing device obtains a fourth address of, determines whether the first request indicates a read operation or a write operation, and if it is determined that the first request indicates the read operation, the second address, the fourth address, provide a second request to the storage device indicating redirection, and provide a third request to the computing device indicating a first processing operation of the third address, the fourth address, and the first data; and if it is determined that the first request points to the write operation, providing the computing device with a fourth request pointing to the third address, the fourth address, and a second processing operation of the second data; and 2 address, the fourth address, and a fifth request indicating a storage operation to the storage device.

According to one embodiment of the present disclosure, a virtualization device including a storage device and a computing device, and a method for operating the virtualization device are provided.

In addition, by providing computational resources through a hardware accelerator, the resource burden of the host device is reduced, direct communication between different devices is ensured based on the address of the computing device and the address of the real machine corresponding to the virtual machine, and A virtualization device that flexibly manages storage resources and computational resources and a method for operating the same are provided.

1 is a block diagram of a storage system according to an embodiment of the present disclosure.
2 is a block diagram illustrating the storage system of FIG. 1 according to some embodiments of the present disclosure.
3 is a block diagram illustrating the storage system of FIG. 1 according to some embodiments of the present disclosure.
4 is a diagram illustrating a command format according to some embodiments of the present disclosure.
5 is a diagram illustrating the reserved field of FIG. 4 according to some embodiments of the present disclosure.
6 is a flowchart illustrating a method of operating a virtualization device according to some embodiments of the present disclosure.
7 is a diagram illustrating a read operation of a storage system according to some embodiments of the present disclosure.
8 is a diagram illustrating a write operation of a storage system according to some embodiments of the present disclosure.
9 is a diagram illustrating direct communication between devices of a storage system according to some embodiments of the present disclosure.
10 is a block diagram illustrating a storage system having flexible scalability according to some embodiments of the present disclosure.
11 is a block diagram illustrating a storage system according to some embodiments of the present disclosure.
12 is a block diagram illustrating a storage system according to some embodiments of the present disclosure.
13 is a flowchart illustrating a read operation of a virtualization device according to some embodiments of the present disclosure.
14 is a flowchart illustrating a write operation of a virtualization device according to some embodiments of the present disclosure.

Hereinafter, embodiments of the present disclosure will be described clearly and in detail to the extent that those skilled in the art can easily practice the embodiments of the present disclosure.

Components described with reference to terms such as unit, unit, module, layer, etc. used in the detailed description and functional blocks shown in the drawings are software, hardware, or a combination thereof. can be implemented in the form For example, software can be machine code, firmware, embedded code, and application software. For example, the hardware may include an electrical circuit, an electronic circuit, a processor, a computer, an integrated circuit, integrated circuit cores, a pressure sensor, an inertial sensor, a microelectromechanical system (MEMS), a passive component, or a combination thereof. .

1 is a block diagram of a storage system according to an embodiment of the present disclosure. Referring to FIG. 1 , a storage system 100 includes a host device 110, a computational storage virtualization (CSV) device 120, a storage device 130, a computing device 140, and input/output (I/O) memory. It may include a management unit 150 and a Peripheral Component Interconnect express (PCIe) circuit 160 .

The storage system 100 may provide a virtual machine (VM). A virtual machine (VM) may be a software-implemented computing environment, and an operating system or application may be installed and executed on the virtual machine (VM). In some embodiments, the storage system 100 may be a server device. For example, the storage system 100 may be a server device that provides a cloud computing environment including a virtual machine (VM) for users.

The host device 110 may include a processor and host memory. The processor of the host device 110 may execute a virtual machine (VM) by executing a command stored in the host memory. For example, the processor of the host device 110 may actually perform operations for an operating system (OS) and applications executed on a virtual machine (VM).

The processor of the host device 110 may manage data processing requests (eg, read requests, write requests, etc.) of the virtual machine (VM). The host memory may manage data to be provided to the storage device 130 according to a write request from a virtual machine (VM) and data to be received according to a read request from the storage device 130 .

The CSV device 120 may provide a virtualization environment according to a virtual machine (VM) to the storage device 130 and the computing device 140 . The CSV device 120 may provide storage resources and computational resources to a virtual machine (VM) without the resource management burden of the host device 110 .

For example, the CSV device 120 may communicate with a host device 110 running a virtual machine (VM). The CSV device 120 may communicate with the storage device 130 and the computing device 140 . The CSV device 120 may change a request of a virtual machine (VM) into requests that can be performed by the storage device 130 and the computing device 140 . The storage device 130 and the computing device 140 may process a request of a virtual machine (VM) without the resource management burden of the host device 110 according to the assistance of the CSV device 120 .

In some embodiments, CSV device 120 may ensure direct communication between different devices. For example, the CSV device 120 directly communicates data between the host device 110 and the storage device 130 through the PCIe circuit 160, and the host device 110 and the computing device 140 It may assist in directly communicating data, and in direct communication of data between the storage device 130 and the computing device 140 . Communicating data directly may also be referred to as Direct Memory Access (DMA) communication.

In some embodiments, CSV device 120 may be implemented as a hardware accelerator. For example, the CSV device 120 may be implemented as a Field Programmable Gate Array (FPGA). FPGAs can be hardware that manages storage and computational resources for virtual machines (VMs).

In some embodiments, the CSV device 120 may flexibly manage storage resources and computational resources. For example, the CSV device 120 provides resources to a plurality of storage devices and a plurality of computing devices in order to process requests from a plurality of virtual machines (VMs) without the resource management burden of the host device 110. can be assigned. A more detailed description of this will be described later along with FIG. 10 .

The storage device 130 may store data. For example, the storage device 130 may provide data according to a read request of the virtual machine (VM) or store data according to a write request of the virtual machine (VM). The storage device 130 may store data processed by the arithmetic device 140 .

The computing device 140 may process data provided from the storage device 130 or the host device 110 . For example, when a read request is issued from a virtual machine (VM), according to management of the CSV device 120, the storage device 130 provides stored raw data to the computing device 140, and the computing device 140 ) processes the raw data, and the processing device 140 may provide the processed data to the host device 110 .

As another example, when a write request is issued from a virtual machine (VM), according to the management of the CSV device, the processing device 140 receives raw data from the host device 110, and the processing device 140 receives the raw data. Data is processed, and the storage device 130 may store the data processed by the arithmetic device 140 .

In some embodiments, computing device 140 may perform compression or encryption of data. For example, when a read request is issued from a virtual machine (VM), the computing device 140 receives raw data corresponding to the read request from the storage device 130, decompresses or decrypts the raw data, and compresses the raw data. The released or decrypted data may be provided to the host device 110 .

As another example, when a write request is issued from a virtual machine (VM), the processing device 140 receives raw data corresponding to the write request from the host device 110, compresses or encrypts the raw data, and compresses the raw data. Encrypted or encrypted data may be provided to the storage device 130 .

In some embodiments, computing device 140 may be implemented as a hardware accelerator. For example, the computing device 140 may be implemented as an FPGA. An FPGA can be hardware that provides computational resources.

The I/O memory management unit 150 may manage a mapping relationship between a virtual address of a virtual machine (VM) and a real address of a real machine (ie, the host device 110 ) corresponding to the virtual machine (VM). For example, the virtual machine (VM) may be implemented as software executed by a processor of the host device 110, and a virtual address for data managed by the virtual machine (VM) is a host memory of the host device 110. may correspond to a real address for data stored in . The I/O memory management unit 150 may translate a virtual address into a corresponding physical address, or a physical address into a corresponding virtual address.

In some embodiments, when the CSV device 120 includes an address conversion table that manages a mapping relationship between virtual addresses and real addresses, the I/O memory management unit 150 may be omitted. Alternatively, the address management table and the I/O memory management unit 150 in the CSV device 120 may be used together for management of virtual addresses and real addresses.

The PCIe circuit 160 may be connected to the host device 110 , the CSV device 120 , the storage device 130 , the computing device 140 , and the I/O memory management unit 150 . PCIe circuitry 160 may provide a direct interface environment to any combination of CSV device 120, storage device 130, computing device 140, and I/O memory management unit 150. For example, the storage device 130 may directly communicate data with the computing device 140 through the PCIe circuitry 160 .

As described above, according to the present disclosure, the CSV device 120 provides a virtualization environment to the storage device 130 and the computing device 140 . Since the CSV device 120 is implemented as separate hardware rather than a software module, the resource management burden of the host device 110 can be reduced. The CSV device 120 may ensure direct communication with any combination of the host device 110 , the storage device 130 , and the computing device 140 by converting a request from a virtual machine (VM).

2 is a block diagram illustrating the storage system of FIG. 1 according to some embodiments of the present disclosure. Referring to FIGS. 1 and 2 , the storage system 100 may be divided into a host side and a storage side. The storage side may also be referred to as a virtualization device (VD).

The host side may include a host device 110 and a virtual machine (VM) executed by the host device 110 . A host device may include a CSV driver. The CSV driver may be software that stores information required for communication with the CSV device 120. The host device 110 can communicate with the CSV device 120 by executing the CSV driver.

The storage side may include a CSV device 120 , a storage device 130 , an arithmetic device 140 , and an I/O memory management unit 150 .

The CSV device 120 may communicate with the host device 110 directly or through the I/O memory management unit 150 . The CSV device 120 may include a single root input/output virtualization (SR-IOV) adapter 121 and a device orchestra 122 .

The SR-IOV adapter 121 may provide an interface with a virtual machine (VM). The SR-IOV adapter 121 enables a virtual machine (VM) to access the storage device 130 or the computing device 140 without going through a separate software layer.

The device orchestra 122 may identify a virtual machine (VM) through the SR-IOV adapter 121 . Device orchestra 122 can identify storage device 130 and computing device 140 . The device orchestra 122 may allocate storage resources of the storage device 130 and computational resources of the computing device 140 to virtual machines (VMs).

The device orchestra 122 may generate a redirection request to be provided to the storage device 130 and a processing request to be provided to the computing device 140 based on the read request provided from the virtual machine (VM). For example, the redirection request may be implemented by changing the destination address of the read request provided from the virtual machine (VM) to the computing device 140 instead of the storage device 130 . The device orchestra 122 may generate a processing request to be provided to the computing device 140 and a storage request to be provided to the storage device 130 based on the write request provided from the virtual machine (VM).

The storage device 130 may communicate with the CSV device 120 and the computing device 140 . According to a request from the CSV device 120, the storage device 130 directly provides data to the computing device 140 through the PCIe circuit 160 or directly transmits data processed by the computing device 140. can be received as

The computing device 140 may communicate with the CSV device 120 and the storage device 130 . According to a request from the CSV device 120, the arithmetic device 140 directly provides processed data to the storage device 130 through the PCIe circuit 160 or directly transmits data from the storage device 130. can be received as

3 is a block diagram illustrating the storage system of FIG. 1 according to some embodiments of the present disclosure. 1 and 3, the storage system 100 includes a host device 110, a CSV device 120, a storage device 130, an arithmetic device 140, an I/O memory management unit 150, and PCIe circuitry 160 may be included.

The storage system 100 may identify a virtual machine (VM) as a target virtual machine among a plurality of virtual machines. The storage system 100 may identify the storage device 130 as a target storage device among a plurality of storage devices. The storage system 100 may identify the computational device 140 as a target computational device among a plurality of computational devices.

The storage system 100 may flexibly allocate storage resources of a plurality of storage devices and compute resources of a plurality of computing devices in order to process requests from a plurality of virtual machines. When the number of virtual machines, the number of storage devices, and the number of computing devices increase or decrease, respectively, the storage system 100 may reallocate storage resources and computational resources for the changed virtual environment.

The host device 110 may execute a virtual machine (VM). A virtual machine (VM) may include a Virtual Submission Queue (VSQ) and a Virtual Completion Queue (VCQ). VSQ may be a memory in which a command requested by a virtual machine (VM) is written. A VCQ may be a memory that receives a completion indicating completion of processing of a command written to a corresponding VSQ. VSQ and VCQ may have a correspondence relationship with each other. Virtual addresses of VSQ and VCQ may correspond to portions of the host memory of the host device 110 .

The host device 110 may include a host memory. The storage device 130 may include a buffer memory. The computing device 140 may include a buffer memory. Any combination of the host memory of the host device 110 , the buffer memory of the storage device 130 , and the buffer memory of the computing device 140 may communicate data directly through the PCIe circuit 160 .

The I/O memory management unit 150 may communicate with the host device 110 and the CSV device 120 . The I/O memory management unit 150 may convert a virtual address provided from the host device 110 into a real address and provide the real address to the CSV device 120 . The I/O memory management unit 150 may convert a real address provided from the CSV device 120 into a virtual address and provide the virtual address to the host device 110 . In some embodiments, when the CSV device 120 includes an address conversion table that manages a mapping relationship between virtual addresses and real addresses, the I/O memory management unit 150 may be omitted.

The CSV device 120 may include an SR-IOV adapter 121 and a device orchestra 122 .

SR-IOV adapter 121 may communicate with host device 110 and device orchestra 122 . The SR-IOV adapter 121 may include a plurality of Virtual Functions (VFs). Each of the plurality of VFs may correspond to a plurality of virtual machines (VMs). Each of the plurality of VFs may provide an interface with a corresponding virtual machine (VM). The VF may allow a corresponding virtual machine (VM) to access the storage device 130 and the computing device 140 through the device orchestra 122 without going through a software layer. Each of the plurality of VFs within the SR-IOV adapter 121 may operate like an independent device. A VF may support allocation of storage resources and computational resources to corresponding virtual machines (VMs).

Device orchestra 122 may communicate with SR-IOV adapter 121 , storage device 130 , computing device 140 , and I/O memory management unit 150 . Device orchestra 122 may include storage interface circuitry, computing device interface circuitry, and a resource manager.

The storage interface circuitry may provide an interface between the resource manager and the storage device 130 . The storage interface circuit may include a Submission Queue (SQ) and a Completion Queue (CQ). SQ corresponds to a command written in VSQ and may be a memory in which a command to be provided to the storage device 130 is written. CQ may be a memory that receives a completion indicating completion of processing of a command written to a corresponding SQ. SQ and CQ may have a correspondence relationship with each other.

The computing device interface circuitry may provide an interface between the resource manager and the computing device 140 .

The resource manager may receive a request from a virtual machine (VM) through the SR-IOV adapter 121 . The resource manager may communicate with the storage device 130 through a storage interface. The resource manager may communicate with the computing device 140 through a computing device interface circuit.

The resource manager may change some fields of a request from a virtual machine (VM) and provide them to the storage device 130 or the computing device 140 . A more detailed description of the changed field will be described later along with FIGS. 4 and 5 .

A resource manager may manage a plurality of virtual machines (VMs), a plurality of storage devices, and a plurality of computing devices. For example, the resource manager may identify a target storage device among a plurality of storage devices by referring to indices of the plurality of storage devices. The resource manager may identify a target computing device among the plurality of computing devices by referring to indices of the plurality of computing devices. The resource manager may allocate storage resources of the identified storage device and computational resources of the identified computing device to virtual machines (VMs).

A resource manager may manage mapping between a virtual machine (VM) and the storage device 130 . For example, VSQ and VCQ of a virtual machine (VM) may correspond to SQ and CQ of a storage interface circuit, respectively. A layer of commands to be written to VSQ may be different from a layer of commands to be written to SQ. A layer of completion to be written in CQ may be different from a layer of completion to be written in VCQ. The resource manager may fetch a command written to the VSQ, change a layer of the fetched command, and write the layer-changed command to the SQ. The resource manager may fetch the completion written in the CQ, change the layer of the fetched completion, and write the completion whose layer is changed in the VCQ.

In some embodiments, the resource manager may follow the Non-Volatile Memory express (NVMe) standard. For example, the resource manager may receive a doorbell from the host device 110 notifying that a command has been written to the VSQ. The resource manager can fetch commands written to the VSQ. The resource manager may write a layer-changed command in SQ based on the fetched command. The resource manager may provide the doorbell to the storage device 130 . The storage device 130 may fetch a command whose SQ layer is changed. The storage device 130 may communicate with the arithmetic device 140 to process commands.

After processing the command, the storage device 130 may write completion to CQ. The storage device 130 may provide an interrupt to the resource manager. The resource manager may fetch the completion written in the CQ and write the completion whose layer is changed in the VCQ based on the fetched completion. The resource manager may provide the doorbell to the storage device 130 . The resource manager may provide interrupts to the host device 110 . The host device 110 may process the completion written in the VCQ. The host device 110 may provide a doorbell to a resource manager.

In some embodiments, a resource manager may include an address translation table. The address conversion table may manage a mapping relationship between virtual addresses and real addresses. The resource manager may convert a virtual address into a real address or a real address into a virtual address by referring to the address translation table. In this case, the I/O memory management unit 150 may be omitted, or the address conversion table and the I/O memory management unit 150 may be used together.

In some embodiments, the resource manager may include an inner-computational device. The inter-computing device may process data received from the storage device 130 or process data received from the host device 110 . The inter-computing unit may perform functions similar to arithmetic unit 140 . In this case, the arithmetic unit 140 may be omitted, or the inter- arithmetic unit and the arithmetic unit 140 may be used together. A more detailed description of the inter-computing device will be given later in conjunction with FIGS. 11 and 12 .

4 is a diagram illustrating a command format according to some embodiments of the present disclosure. Referring to FIGS. 1 and 4 , a command format of a command received from the host device 110 will be described.

In some embodiments, the command format may follow the NVMe standard. For example, the command format is 'Op', 'Flags', 'CID', 'Namespace Identifier', 'Reserved Field', 'Metadata', 'PRP1', 'PRP2', 'SLBA' ', 'length', 'Control', 'Dsmgmt', 'Appmask', and 'Apptag'.

'Op' may indicate an opcode or an operation code. For example, 'Op' may indicate whether an operation to be processed by a command is a read operation or a write operation.

'Flags' can manage flag values for a persistent memory region.

'CID' may indicate a command identifier. A command identifier can be used to distinguish a command from other commands.

A 'namespace identifier' can be used to distinguish a namespace from other namespaces. A namespace may be a space for allocating names to files in a file system.

A 'reserved field' may refer to areas that may be changed according to design.

'Metadata' may describe data to be processed according to a command or indicate information related thereto.

'PRP1' may indicate a first physical region page. 'PRP2' may indicate a second physical area page. The first and second physical area pages may indicate memory addresses used for DMA communication.

'SLBA' may indicate a start logical block address. When multiple virtual machines share one storage device, different offset values may be provided to each of the multiple virtual machines through 'SLBA' so that addresses used by the multiple virtual machines do not overlap. Each of several virtual machines may refer to an address to which an offset value is added.

'Length' may indicate the length of bytes of a data block. 'Control' can be used to control data transmission. Dsmgmt', 'Appmask', and 'Apptag' may be fields managed by an operating system or file system of a virtual machine (VM) or host device 110 .

According to some embodiments of the present disclosure, the CSV device 120 may generate a request that can be processed by the storage device 130 or the computing device 140 by changing a reserved field of a command. The reserved field may include a CSV command suggested according to an embodiment of the present disclosure. A more detailed description of the reserved field will be described later along with FIG. 5 .

5 is a diagram illustrating the reserved field of FIG. 4 according to some embodiments of the present disclosure. 1, 4, and 5, the reserved field of the command received from the host device 110 is the location where the CSV command is stored (eg, fields corresponding to the CSV command in the host device 110). stored location).

The CSV command may include at least one of an operator chain identifier, a source address, a destination address, a source size, a destination size, a request identifier, a physical device identifier, a type, a direct parameter, a file parameter, a direct parameter pointer, and a file parameter pointer. .

The operator chain identifier may indicate the type of operation to be processed by the computing device 140 . For example, the operator chain identifier may indicate an encryption operation, a compression operation, or an encryption and compression operation as an operation to be processed by the operation unit 140 . Alternatively, the operator chain identifier may indicate a decryption operation, a decompression operation, or a decryption and decompression operation as an operation to be processed by the operation unit 140 .

The source address may indicate the location of a source requesting processed data. The destination address may indicate the location of a destination to receive the processed data.

For example, when a read request is issued from a virtual machine (VM), the source address may point to a buffer memory in the computing device 140 after redirecting raw data of the storage device 130 to the computing device 140. there is. The destination address may indicate a host memory of the host device 110 executing the virtual machine (VM) in order to provide data processed by the computing device 140 to the virtual machine (VM).

As another example, when a write request is issued from a virtual machine (VM), the source address is such that the processing unit 140 receives the raw data from the host device 110 before the processing unit 140 generates the processed data. To do this, it may refer to the host memory of the host device 110 executing the virtual machine (VM). The destination address may point to a buffer memory of the arithmetic device 140 to process the raw data by the arithmetic device 140 before storing the data in the storage device 130 .

In some embodiments, the location of the buffer memory of the storage device 130 may be managed by the SLBA of the command of FIG. 4 . For example, when a read request or a write request is issued from a virtual machine (VM), the SLBA of the command of the host device 110 of FIG. 4 may indicate the buffer memory of the storage device 130 .

The source size may indicate the size of data to be transmitted according to the source address.

The destination size may indicate the size of data to be transmitted according to the destination address.

A request identifier may indicate an action indicated by the request. For example, the request identifier is an operation indicated by the request and may indicate one of operations such as a read operation, a write operation, a processing operation, a redirection operation, and a storage operation. A request identifier can manage dependencies between different requests. For example, if the request ID of the current request and the request ID of the previous request are the same, the storage system 100 may suspend execution of the current request until processing of the previous request is completed.

The physical device identifier may indicate an index of the storage device 130 and an index of the computing device 140 . For example, the storage system 100 may include a plurality of storage devices and a plurality of computing devices. The storage system 100 may identify the storage device 130 as a target storage device among a plurality of storage devices by referring to the indices written in the physical device identifiers, and the processing device as a target processing device among the plurality of processing devices. (140) can be identified.

The type may indicate whether access to the storage device 130 is required.

The direct parameter may indicate a location in the host memory of the host device 110 where information used for a processing operation of the computing device is stored. For example, the direct parameter may indicate a location in the host memory where parameters such as functions, algorithms, hash functions, key-values, etc. used in processing operations such as compression, decompression, encryption, and decryption are stored.

The file parameter may indicate a location in the storage device 130 where copied information used for a processing operation of the computing device is stored. For example, the file parameter may indicate a location in the storage device 130 where parameters such as functions, algorithms, hash functions, key-values, etc. used for processing operations such as compression, decompression, encryption, and decryption are copied.

The direct parameter pointer may be a field for storing a pointer used for direct parameter transmission.

The file parameter pointer may be a field for storing a pointer used to transmit file parameters.

6 is a flowchart illustrating a method of operating a virtualization device according to some embodiments of the present disclosure. Referring to FIGS. 2 and 6 , a method of operating the virtualization device (VD) will be described.

In step S110, the virtualization device (VD) may receive a request from the host device 110 executing the virtual machine (VM).

In step S120, the virtualization device (VD) may determine whether the request in step S110 indicates a computational storage operation. For example, the virtualization device (VD) may determine that the reserved field of the request indicates a computational storage operation if it exists, and may determine that it does not indicate a computational storage operation if the reserved field of the request is null. Upon determining that the request points to a computational storage operation, the virtualization device (VD) may perform step S130. Upon determining that the request does not indicate a computational storage operation, the virtualization device (VD) may perform step S170.

In step S130 , the virtualization device VD may acquire the address of the real machine corresponding to the virtual machine VM and the address of the computing device 140 . A real machine corresponding to a virtual machine (VM) may refer to the host device 110 .

In some embodiments, in step S130, the virtualization device (VD) checks whether a direct parameter or file parameter of the reserved field of the request exists, and if the direct parameter or file parameter exists, the direct parameter or file parameter is read. can

In step S140, the virtualization device (VD) may determine whether the request in step S110 indicates a read operation. When determining that the request indicates a read operation, the virtualization device VD may perform step S150. If it is determined that the request does not indicate a read operation, the virtualization device (VD) may perform step S160.

In step S150 , the CSV device 120 of the virtualization device (VD) may provide a read data redirection request to the storage device 130 . In this case, the redirection request may refer to providing raw data stored in the storage device 130 to the computing device 140 .

In step S151 , the CSV device 120 of the virtualization device VD may provide the processing device 140 with a request to process read data. At this time, the read data processing request means that the processing device 140 processes the read data received from the storage device 130 and the processing device 140 provides the processed read data to the host device 110. can point

Returning to step S140 again, if it is determined in step S140 that the request does not indicate a read operation, the virtualization device may perform step S160.

In step S160 , the CSV device 120 of the virtualization device VD may provide the processing device 140 with a request to process write data. At this time, the write data processing request may indicate that the processing device 140 receives the write data from the host device 110 and that the processing device 140 processes the write data.

In step S161 , the CSV device 120 of the virtualization device VD may provide the storage device 130 with a request to store the processed write data. In this case, the storage request may indicate that the storage device 130 receives processed write data from the computing device 140 and that the storage device 130 stores the processed write data.

Returning to step S120 again, if it is determined in step S120 that the request does not indicate a computational storage operation, the virtualization device (VD) may perform step S170.

In step S170, the virtualization device (VD) may perform a normal storage operation. A normal storage operation may refer to a general read operation or a general write operation without processing operations such as compression, decompression, encryption, and decryption by an internal-computing unit in the calculation device 140 or the CSV device 120. .

7 is a diagram illustrating a read operation of a storage system according to some embodiments of the present disclosure. 1 and 7 , the storage system 100 includes a host device 110 running a virtual machine (VM), a CSV device 120, a storage device 130, an arithmetic device 140, and a PCIe circuit. (160).

According to some embodiments of the present disclosure, the storage system 100 may perform a read operation according to a request from a virtual machine (VM). The read operation may include the first to seventh operations (① to ⑦).

In a first operation (①), the host device 110 executing the virtual machine (VM) sends a first address ADD1, a second address ADD2, and a first request RQ1 indicating a read operation to the CSV device. (120) can be provided. The read operation may refer to reading raw data RDT stored in the storage device 130 . The first address ADD1 may indicate a virtual address of the virtual machine VM. The second address ADD2 may indicate a location where raw data RDT is stored in the storage device 130 .

In the second operation (②), the CSV device 120 may obtain the third address ADD3 and the fourth address ADD4 based on the first request RQ1. The third address ADD3 may indicate a location of a real machine corresponding to the virtual machine VM (ie, a location in the host memory of the host device 110). The fourth address ADD4 may indicate a location in the buffer memory of the processing device 140 to process the raw data RDT of the storage device 130 .

In the third operation (③), the CSV device 120 may provide the second address ADD2, the fourth address ADD4, and the second request RQ2 indicating redirection to the storage device 130. Redirection may refer to providing data stored in the storage device 130 to the computing device 140 through the PCIe circuit 160 .

In a fourth operation ④, the storage device 130 may provide the raw data RDT to the calculation device 140 based on the second request RQ2. For example, the storage device 130 performs DMA communication with the computing device 140 through the PCIe circuit 160 based on the second address ADD2 and the fourth address ADD4 of the second request RQ2. can be performed. The storage device 130 provides the raw data RDT to the calculation device 140 and then provides completion to the CSV device 120, so that the CSV device 120 processes the second request RQ2. can inform

In the fifth operation (⑤), the CSV device 120 may provide the third address ADD3, the fourth address ADD4, and the third request RQ3 indicating the processing operation to the calculating device 140. . The processing operation may refer to processing (eg, decompression, decoding, etc.) of the raw data RDT by the arithmetic device 140 .

In the sixth operation (⑥), the processing device 140 may generate the processed data PDT by processing the raw data RDT based on the third request RQ3. The processed data PDT may be decompressed data or decrypted data.

In a seventh operation (⑦), the processing device 140 may provide the processed data PDT to the host device 110 based on the third request RQ3. For example, the arithmetic device 140 performs DMA communication with the host device 110 through the PCIe circuit 160 based on the third address ADD3 and the fourth address ADD4 of the third request RQ3. can be performed. After providing the processed data (PDT) to the host device 110, the computing device 140 may provide a done notification to the CSV device 120. The CSV device 120 may issue a completion for the virtual machine (VM) in response to the completion notification.

8 is a diagram illustrating a write operation of a storage system according to some embodiments of the present disclosure. 1 and 8 , the storage system 100 includes a host device 110 running a virtual machine (VM), a CSV device 120, a storage device 130, an arithmetic device 140, and a PCIe circuit. (160).

According to some embodiments of the present disclosure, the storage system 100 may perform a write operation according to a request from a virtual machine (VM). The write operation may include the first to eighth operations ① to ⑧.

In a first operation (①), the host device 110 executing the virtual machine (VM) sends a first address ADD1, a second address ADD2, and a first request RQ1 indicating a write operation to the CSV device. (120) can be provided. The write operation may refer to writing raw data RDT corresponding to a virtual address of the virtual machine VM to the storage device 130 . The first address ADD1 may indicate a virtual address of the virtual machine VM. The second address ADD2 may indicate a location in the storage device 130 where the processed data PDT corresponding to the raw data RDT is stored.

In the second operation (②), the CSV device 120 may obtain the third address ADD3 and the fourth address ADD4 based on the first request RQ1. The third address ADD3 may indicate a location of a real machine corresponding to the virtual machine VM (ie, a location in the host memory of the host device 110). The fourth address ADD4 may indicate a location in the buffer memory of the computing device 140 to process the raw data RDT of the virtual machine VM.

In the third operation ③, the CSV device 120 may provide the third address ADD3, the fourth address ADD4, and the second request RQ2 indicating the processing operation to the calculation device 140. . The processing operation involves the processing device 140 receiving raw data RDT from the host device 110 and the processing device 140 processing (eg, compressing, encrypting, etc.) the raw data RDT. can point

In the fourth operation ④, the processing device 140 may receive the raw data RDT from the host device 110 based on the second request RQ2. For example, the arithmetic device 140 performs DMA communication with the host device 110 through the PCIe circuit 160 based on the third address ADD3 and the fourth address ADD4 of the second request RQ2. can be performed.

In a fifth operation (⑤), the processing device 140 may generate the processed data PDT by processing the raw data RDT based on the second request RQ2. The processed data PDT may be compressed data or encrypted data. After generating the processed data PDT, the computing device 140 may provide a completion notification to the CSV device 120 .

In a sixth operation (⑥), the CSV device 120 may provide the second address ADD2, the fourth address ADD4, and the third request RQ3 indicating a storage operation to the storage device 130. . The storage operation may indicate that the storage device 130 receives the processed data PDT from the computing device 140 and that the storage device 130 stores the processed data PDT.

In a seventh operation ( ⑦ ), the storage device 130 may receive the processed data PDT from the processing device 140 based on the third request RQ3 . For example, the storage device 130 performs DMA communication with the computing device 140 through the PCIe circuit 160 based on the second address ADD2 and the fourth address ADD4 of the third request RQ3. can be performed.

In an eighth operation (⑧), the storage device 130 may store the processed data PDT based on the third request RQ3. The storage device 130 may store the processed data PDT and then provide completion to the CSV device 120 . The CSV device 120 may provide the completion to the virtual machine (VM) based on the completion received from the storage device 130 .

9 is a diagram illustrating direct communication between devices of a storage system according to some embodiments of the present disclosure. Referring to FIG. 9 , the storage system 100 may include a host device 110 , a CSV device 120 , a storage device 130 , an arithmetic device 140 , and a PCIe circuit 160 .

Any combination of the host device 110 , the storage device 130 , and the computing device 140 may directly communicate data (ie, perform DMA communication) through PCIe communication. 9 illustrates an operation in which the processing device 140 provides the processed data PDT to the host device 110 or the storage device 130 as a source, but the host device 110 And the storage device 130 may also act as a source similar to what will be described later.

The CSV device 120 may provide a source address and a destination address to the computing device 140 . The source address may be a fourth address ADD4 indicating a location of the buffer memory of the computing device 140 . The destination address may indicate the host device 110 or the storage device 130 capable of communicating with the computing device 140 through the PCIe circuit 160 .

For example, an address in the range '0 to 1023' may be the third address ADD3 corresponding to the host device 110 . When the CSV device 120 provides an address in the range of '0 to 1023' to the arithmetic device 140 as a destination address, the arithmetic device 140 refers to the destination address and via the PCIe circuit 160 the host device ( 110) can be directly provided with the processed data PDT.

As another example, an address in the range '1024 to 2047' may be the second address ADD2 corresponding to the storage device 130 . When the CSV device 120 provides an address in the range '1024 to 2047' as a destination address to the calculation device 140, the calculation device 140 refers to the destination address, and via the PCIe circuit 160, the storage device ( 130) may be directly provided with the processed data PDT.

10 is a block diagram illustrating a storage system having flexible scalability according to some embodiments of the present disclosure. Referring to FIG. 10 , the storage system 100 may manage resource allocation among a plurality of virtual machines, a plurality of storage devices, and a plurality of computing devices.

The storage system 100 may include a set of virtual machines, a set of storage devices, a set of computing devices, an SR-IOV adapter 121 , and a device orchestra 122 .

The virtual machine set may include first to Nth virtual machines VM_1 to VM_N. The storage device set may include first to M th storage devices 130_1 to 130_M. The arithmetic device set may include first to Lth arithmetic devices 140_1 to 140_L. Here, N, M, and L are arbitrary natural numbers.

SR-IOV adapter 121 may communicate with a set of virtual machines. The SR-IOV adapter 121 may include a plurality of VFs. The plurality of VFs may provide interfaces between the first to Nth virtual machines VM_1 to VM_N and the resource manager.

The storage interface circuitry may communicate with a set of storage devices. The storage interface circuit may provide an interface between the first to M th storage devices 130_1 to 130_M and the resource manager.

The computing device interface circuit can communicate with a set of computing devices. The computing device interface circuit may provide an interface between the first to Lth computing devices 140_1 to 140_L and the resource manager.

A resource manager may manage resource allocation among a set of virtual machines, a set of storage devices, and a set of computing devices. For example, the resource manager may allocate the first storage device 130_1 and the first computing device 140_1 to the first virtual machine VM_1. Alternatively, the resource manager may allocate the first and second storage devices 130_1 and 130_2 and the first and second processing devices 140_1 and 140_2 to the first virtual machine VM_1.

When the number of virtual machines increases or decreases, when the number of storage devices increases or decreases, or when the number of computing devices increases or decreases, the resource manager provides storage resources and computational resources to virtual machines according to the changed virtualization environment. can be allocated flexibly.

When storage resources or computational resources are insufficient, storage resources or computational resources may be flexibly expanded by adding another storage device or another computational device to the PCIe circuit 160 of FIG. 1 .

11 is a block diagram illustrating a storage system according to some embodiments of the present disclosure. Referring to FIG. 11 , a storage system 200 according to some embodiments of the present disclosure is described.

The storage system 200 may manage requests from a virtual machine (VM). The storage system 200 may include a host device 210 , a CSV device 220 , a storage device 230 , and an I/O memory management unit 250 . The CSV device 220 may include an SR-IOV adapter 221 and a device orchestra 222 .

Features of the virtual machine (VM), the host device 210, the SR-IOV adapter 221, the storage device 230, and the I/O memory management unit 250 are similar to those of the virtual machine (VM) of FIG. 3, the host device 110 , the SR-IOV adapter 121 , the storage device 130 , and the I/O memory management unit 150 have similar features, so detailed description thereof is omitted.

Device orchestra 222 may include a resource manager, storage interface circuitry, and an inter-computing device. The inter-computing unit may include an accelerator and a buffer memory. Accelerators may provide computational resources. For example, an accelerator may perform operations such as compression, decompression, encryption, and decryption. The buffer memory of the inter-computing device may directly communicate with the buffer memory of the storage device 230 and the host memory of the host device 210 through a PCIe circuit. The resource manager may allocate storage resources of the storage device 230 and computational resources of the internal-computing device to the virtual machine (VM). That is, the inter-computing unit may perform a function similar to that of the arithmetic unit 140 of FIG. 3 .

In some embodiments, CSV device 220 may be implemented as a hardware accelerator. For example, the CSV device 220 may be implemented as an FPGA. An FPGA can be hardware that provides computational resources and manages computational resources and storage resources for virtual machines (VMs).

12 is a block diagram illustrating a storage system according to some embodiments of the present disclosure. Referring to FIG. 12 , a storage system 300 according to some embodiments of the present disclosure is described. The storage system 300 may manage requests from a virtual machine (VM). The storage system 300 may include a host device 310 , a CSV device 320 , a storage device 330 , an arithmetic device 340 , and an I/O memory management unit 350 . The CSV device 320 may include an SR-IOV adapter 321 and a device orchestra 322 .

Features of a virtual machine (VM), host device 310, SR-IOV adapter 321, storage device 330, computing device 340, and I/O memory management unit 350 are similar to those of the virtual machine in FIG. (VM), the host device 110, the SR-IOV adapter 121, the storage device 130, the computing device 140, and the I / O memory management unit 150, since the features are similar, detailed Descriptions are omitted.

Device orchestra 322 may include resource managers, inter-computing devices, storage interface circuitry, and computing device interface circuitry.

The inter-computing unit may include an accelerator and a buffer memory. Accelerators may provide computational resources. The computing device 340 may provide computing resources. The resource manager may comprehensively manage the internal-computing device and the computing device 340 to allocate computing resources to virtual machines (VMs).

13 is a flowchart illustrating a read operation of a virtualization device according to some embodiments of the present disclosure. Referring to FIG. 13 , a read operation of the virtualization device VD will be described. The virtualization device (VD) may communicate with the host device 110 running the virtual machine. The virtualization device (VD) may include a CSV device 120 , a storage device 130 , and an arithmetic device 140 .

In step S210, the virtualization device VD receives a first address ADD1, a second address ADD2, and a first request RQ1 indicating a read operation from the host device 110 by the CSV device 120. can receive The first address ADD1 may indicate a virtual address of a virtual machine executed by the host device 110 . The second address ADD2 may indicate a location in the storage device 130 where raw data corresponding to a read operation is stored.

In operation S220 , the virtualization device VD may acquire the third address ADD3 from the first address ADD1 by the CSV device 120 . The first address ADD1 may be a virtual address of a virtual machine. The third address ADD3 may be an address of a real machine (ie, the host device 110) corresponding to the virtual machine. The CSV device 120 may obtain the third address ADD3 from the first address ADD1 by referring to the built-in address conversion table. Alternatively, the virtualization device VD may further include an I/O memory management unit, and the CSV device 120 receives the third address ADD3 corresponding to the first address ADD1 from the I/O memory management unit. can receive

In step S221 , the virtualization device VD may designate a fourth address ADD4 indicating the location of the buffer memory of the computing device 140 by the CSV device 120 . For example, the CSV device 120 may identify the computing device 140 and allocate computing resources of the computing device 140 to a virtual machine (VM).

In step S230, the virtualization device VD provides the second address ADD2, the fourth address ADD4, and the second request RQ2 indicating redirection to the storage device 130 by the CSV device 120. can do. Redirection may refer to storage device 130 providing raw data to computing device 140 .

In operation S240 , the virtualization device VD may provide raw data to the computing device 140 based on the second request RQ2 by the storage device 130 . Raw data may be compressed data or encrypted data.

In step S241 , the virtualization device (VD) may provide the first completion (COMP1) to the CSV device 120 after processing the raw data by the storage device 130 . The first completion may be written to the CQ of the CSV device 120.

In step S250, the virtualization device VD, by the CSV device 120, responds to the first completion COMP1 by indicating the third address ADD3, the fourth address ADD4, and a processing operation. Request RQ3 may be provided to computing device 140 . The processing operation may indicate that the processing device 140 processes raw data and the processing device 140 provides the processed data to the host device 110 .

In step S260 , the virtualization device VD may process raw data by the computing device 140 . For example, the processing unit 140 may generate processed data by decompressing or decoding raw data. The processed data may be decompressed data or decrypted data.

In step S270 , the virtualization device VD may provide data processed by the computing device 140 based on the third request RQ3 to the host device 110 .

In step S280 , the virtualization device (VD) may provide a completion notification to the CSV device 120 through the computing device 140 .

In step S281 , the virtualization device VD may provide the second completion COMP2 to the host device 110 by the CSV device 120 in response to the completion notification. The second completion COMP2 may be written to the VCQ of the virtual machine VM.

14 is a flowchart illustrating a write operation of a virtualization device according to some embodiments of the present disclosure. Referring to FIG. 14 , a write operation of the virtualization device VD will be described. The virtualization device (VD) may communicate with the host device 110 running the virtual machine. The virtualization device (VD) may include a CSV device 120 , a storage device 130 , and an arithmetic device 140 .

In step S310, the virtualization device VD receives a first address ADD1, a second address ADD2, and a first request RQ1 indicating a write operation from the host device 110 by the CSV device 120. can receive The first address ADD1 may indicate a virtual address of a virtual machine executed by the host device 110 . The second address ADD2 may indicate a location in the storage device 130 where processed data is to be stored after raw data corresponding to a write operation is processed.

In step S320 , the virtualization device VD may acquire the third address ADD3 from the first address ADD1 by the CSV device 120 . The first address ADD1 may be a virtual address of a virtual machine. The third address ADD3 may be an address of a real machine (ie, the host device 110) corresponding to the virtual machine. The CSV device 120 may obtain the third address ADD3 from the first address ADD1 by referring to the built-in address conversion table. Alternatively, the virtualization device VD may further include an I/O memory management unit, and the CSV device 120 receives the third address ADD3 corresponding to the first address ADD1 from the I/O memory management unit. can receive

In step S321 , the virtualization device VD may designate a fourth address ADD4 indicating the location of the buffer memory of the computing device 140 through the CSV device 120 . For example, the CSV device 120 may identify the computing device 140 and allocate computing resources of the computing device 140 to a virtual machine (VM).

In step S330, the virtualization device VD sends the third address ADD3, the fourth address ADD4, and the second request RQ2 indicating a processing operation to the calculation device 140 by the CSV device 120. can provide The processing operation may refer to the processing device 140 receiving raw data from the host device 110 and processing the raw data by the processing device 140 .

In step S340 , the virtualization device VD may receive raw data from the host device 110 based on the second request RQ2 by the computing device 140 . Raw data may be uncompressed data or unencrypted data.

In step S350 , the virtualization device VD may process raw data by the computing device 140 . For example, computing device 140 may generate processed data by compressing or encrypting raw data. The processed data may be compressed data or encrypted data.

In step S351 , the virtualization device (VD) may provide a completion notification to the CSV device 120 through the computing device 140 .

In step S360, the virtualization device VD sends, by the CSV device 120, the second address ADD2, the fourth address ADD4, and the third request RQ3 indicating the storage operation in response to the completion notification. It may be provided to the storage device 130 .

In operation S370 , the virtualization device VD may receive data processed by the storage device 130 from the calculation device 140 based on the third request RQ3 .

In step S380 , the virtualization device VD may store data processed by the storage device 130 .

In step S390 , the virtualization device VD may store the processed data by the storage device 130 and then provide the first completion COMP1 to the CSV device 120 . The first completion may be written to the CQ of the CSV device 120.

In step S391 , the virtualization device VD may provide a second completion COMP2 to the host device 110 through the CSV device 120 in response to the first completion COMP1 . The second completion COMP2 may be written to the VCQ of the virtual machine VM.

The foregoing are specific embodiments for carrying out the present invention. The present invention will include not only the above-described embodiments, but also embodiments that can be simply or easily changed in design. In addition, the present invention will also include techniques that can be easily modified and practiced using the embodiments. Therefore, the scope of the present invention should not be limited to the above-described embodiments and should not be defined by the following claims as well as those equivalent to the claims of this invention.

Claims (20)

A method of operating a virtualization device that communicates with a host device running a virtual machine and includes a Computational Storage Virtualization (CSV) device, a storage device, and a computing device:
receiving, by the CSV device, a first request indicating a first address of the virtual machine, a second address of the storage device, and a read operation from the host device;
obtaining, by the CSV device, a third address of a real machine corresponding to the virtual machine and a fourth address of the computing device based on the first request;
providing, by the CSV device, a second request indicating the second address, the fourth address, and redirection to the storage device;
providing, by the storage device, raw data to the computing device based on the second request;
providing, by the CSV device, a third request indicating the third address, the fourth address, and a processing operation to the computing device;
generating, by the computing device, processed data based on the third request and the raw data; and
and providing, by the computing device, the processed data to the host device. According to claim 1,
The virtualization device further includes a Peripheral Component Interconnect express (PCIe) circuit connected to the host device, the CSV device, the storage device, and the computing device;
Providing, by the storage device, the raw data to the computing device based on the second request comprises:
directly providing, by the storage device, the raw data based on the fourth address of the second request to the computing device via the PCIe circuit; and
The step of providing, by the computing device, the processed data to the host device:
and directly providing, by the computing device, the processed data based on the third address of the third request to the host device via the PCIe circuit. According to claim 1,
Each of the first request, the second request, and the third request is implemented by changing a reserved field of a command format of a Non-Volatile Memory Express (NVMe) standard. According to claim 3,
The Reserved Field is:
an Operator Chain Identifier indicating a type of the processing operation of the computing device;
a source address indicating a location of a source requesting the processed data;
a destination address indicating a location of a destination receiving the processed data;
a source size indicating the size of data to be transmitted according to the source address;
destination size indicating the size of data to be transmitted according to the destination address;
a request identifier that manages dependencies between different requests pointing to the same kind of operations;
a physical device identifier indicating an index of the storage device and an index of the computing device;
a type indicating whether access to the storage device is required;
a direct parameter indicating a location in the host device where information used in the processing operation of the computing device is stored;
a file parameter indicating a location in the storage device where copied information used in the processing operation of the computing device is stored;
a direct parameter pointer used to transmit the direct parameters; and
A method of pointing to at least one of the file parameter pointers used to transmit the file parameter. According to claim 1,
the raw data in the storage device is compressed data or encrypted data; and
The processed data by the computing device is decompressed data or decrypted data. According to claim 1,
Acquiring, by the CSV device, the third address of the real machine corresponding to the virtual machine and the fourth address of the computing device based on the first request:
determining, by the CSV device, whether the first request indicates a computational storage operation by referring to a reserved field of the first request; and
and if the CSV device determines that the first request points to the computational storage operation, obtaining the third address and the fourth address. According to claim 1,
Providing, by the storage device, the raw data to the computing device based on the second request comprises:
providing, by the storage device, a first completion to the CSV device after providing the raw data;
Providing, by the CSV device, to the computing device the third request indicating the third address, the fourth address, and the processing operation comprises:
providing, by the CSV device, the third request to the computing device in response to the first completion; and
The step of providing, by the computing device, the processed data to the host device:
providing, by the computing device, a done notification to the CSV device after providing the processed data; and
and providing, by the CSV device, a second completion to the host device in response to the completion notification. According to claim 1,
Acquiring, by the CSV device, the third address of the real machine corresponding to the virtual machine and the fourth address of the computing device based on the first request:
and obtaining, by the CSV device, the third address based on the first address by referring to an address conversion table in the CSV device. According to claim 1,
The virtualization device further includes an input/output (I/O) memory management unit communicating with the host device and the CSV device, and
Acquiring, by the CSV device, the third address of the real machine corresponding to the virtual machine and the fourth address of the computing device based on the first request:
converting, by the I/O memory management unit, the first address to the third address based on the first request; and
and receiving, by the CSV device, the third address from the I/O memory management unit. According to claim 1,
The virtualization device identifies the virtual machine as a target virtual machine among a plurality of virtual machines, identifies the storage device as a target storage device among a plurality of storage devices, and identifies the storage device as a target computing device among a plurality of storage devices. A method configured to identify a computing device. According to claim 1,
The CSV device is implemented with a first Field Programmable Gate Array (FPGA), and
The computing device is implemented as a second FPGA. According to claim 1,
The method of claim 1 , wherein the computing unit is implemented as an inter-computing unit of the CSV device. A method of operating a virtualization device that communicates with a host device running a virtual machine and includes a Computational Storage Virtualization (CSV) device, a storage device, and a computing device:
receiving, by the CSV device, a first request indicating a first address of the virtual machine, a second address of the storage device, and a write operation from the host device;
obtaining, by the CSV device, a third address of a real machine corresponding to the virtual machine and a fourth address of the computing device based on the first request;
providing, by the CSV device, to the computing device a second request indicating the third address, the fourth address, and a processing operation;
receiving, by the computing device, raw data from the host device based on the second request;
generating, by the computing device, processed data based on the second request and the raw data;
providing, by the CSV device, to the storage device a third request indicating the second address, the fourth address, and a store operation;
receiving, by the storage device, the processed data from the computing device based on the third request; and
and storing the processed data by the storage device. According to claim 13,
The virtualization device further includes a Peripheral Component Interconnect express (PCIe) circuit connected to the host device, the CSV device, the storage device, and the computing device;
Receiving, by the computing device, the raw data from the host device based on the second request comprises:
directly receiving, by the computing device, the raw data based on the third address of the second request from the host device via the PCIe circuit; and
Receiving, by the storage device, the processed data from the computing device based on the third request comprises:
and directly receiving, by the storage device, the processed data based on the fourth address of the third request from the computing device via the PCIe circuit. According to claim 13,
Each of the first request, the second request, and the third request is implemented by changing a reserved field of a command format of a Non-Volatile Memory Express (NVMe) standard. According to claim 15,
The Reserved Field is:
an Operator Chain Identifier indicating a type of the processing operation of the computing device;
a source address indicating a location of a source requesting the processed data;
a destination address indicating a location of a destination receiving the processed data;
a source size indicating the size of data to be transmitted according to the source address;
a destination size indicating the size of data to be transmitted according to the destination address;
a request identifier that manages dependencies between different requests pointing to the same kind of operations;
a physical device identifier indicating the index of the CSV device, the index of the storage device, and the index of the computing device;
a type indicating whether access to the storage device is required;
a direct parameter indicating a location in the host device where information used in the processing operation of the computing device is stored;
a file parameter indicating a location in the storage device where copied information used in the processing operation of the computing device is stored;
a direct parameter pointer used to transmit the direct parameters; and
A method of pointing to at least one of the file parameter pointers used to transmit the file parameter. According to claim 13,
The raw data of the host device is uncompressed data or unencrypted data, and
wherein the processed data by the computing device is compressed data or encrypted data. According to claim 13,
Generating, by the computing device, the processed data based on the second request and the raw data comprises:
providing, by the computing device, a done notification to the CSV device after generating the processed data;
Providing, by the CSV device, the third request indicating the second address, the fourth address, and the store operation to the storage device comprises:
providing, by the CSV device, the third request to the storage device in response to the completion notification; and
Storing, by the storage device, the processed data includes:
providing, by the storage device, a first completion to the CSV device after storing the processed data; and
and providing, by the CSV device, a second completion to the host device in response to the first completion. a storage device configured to store first data;
an arithmetic device configured to process the first data and to process second data of a virtual machine executed by a host device;
Computational Storage Virtualization (CSV) devices; and
Including a Peripheral Component Interconnect express (PCIe) circuit connected to the storage device, the calculation device, the CSV device, and the host device,
The CSV device:
receive a first request including a first address of the virtual machine and a second address of the storage device from the host device;
obtain a third address of a real machine corresponding to the virtual machine and a fourth address of the computing device;
determine whether the first request indicates a read operation or a write operation;
If it is determined that the first request indicates the read operation, the second address, the fourth address, and a second request indicating redirection are provided to the storage device, and the third address, the fourth address, and providing a third request to the computing device indicating a first processing operation of the first data; And
if it is determined that the first request points to the write operation, providing the computing device with a fourth request pointing to the third address, the fourth address, and a second processing operation of the second data; and 2 address, the fourth address, and a fifth request indicating a storage operation to the storage device. According to claim 19,
The CSV device:
a single root input/output virtualization (SR-IOV) adapter including a virtual function (VF) providing an interface with the virtual machine; and
identifying the virtual machine through the VF, allocating a resource of the storage device and a resource of the computing device to the virtual machine, and acquiring the third address and the fourth address based on the first request; and a device orchestra configured to generate the second request and the third request based on the first request or generate the fourth request and the fifth request based on the first request.

Images