CN113687772A - Virtualization block storage system and data storage method - Google Patents

Virtualization block storage system and data storage method Download PDF

Info

Publication number
CN113687772A
CN113687772A CN202110803730.5A CN202110803730A CN113687772A CN 113687772 A CN113687772 A CN 113687772A CN 202110803730 A CN202110803730 A CN 202110803730A CN 113687772 A CN113687772 A CN 113687772A
Authority
CN
China
Prior art keywords
branch
storage
data center
local area
interface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN202110803730.5A
Other languages
Chinese (zh)
Inventor
颜俐君
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Inspur Intelligent Technology Co Ltd
Original Assignee
Suzhou Inspur Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Inspur Intelligent Technology Co Ltd filed Critical Suzhou Inspur Intelligent Technology Co Ltd
Priority to CN202110803730.5A priority Critical patent/CN113687772A/en
Publication of CN113687772A publication Critical patent/CN113687772A/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061Improving I/O performance
    • G06F3/0611Improving I/O performance in relation to response time
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0662Virtualisation aspects

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

本发明提出了一种虚拟化块存储系统和数据存储方法,该系统包括数据中心局域网和若干分支局域网;数据中心局域网和分支局域网通过广义网通信;数据中心局域网包括数据中心块存储设备接口,以及与数据中心块存储设备接口分别相连的数据中心虚拟存储阵列接口和物理数据存储阵列设备;分支局域网包括分支块存储设备接口和分支虚拟阵列接口;物理数据存储阵列设备中虚拟出第一逻辑存储器,建立第一逻辑存储器与分支块存储设备接口的地址映射;数据中心虚拟存储阵列接口通过第一逻辑存储器与分支虚拟阵列接口通信。基于该系统,还提出数据存储方法,本发明在计算实例内运行从而能否更加灵活和有效地使用有限的容量,减少时间延迟。

Figure 202110803730

The invention provides a virtualized block storage system and a data storage method. The system includes a data center local area network and several branch local area networks; the data center local area network and the branch local area networks communicate through a generalized network; the data center local area network includes a data center block storage device interface, and a data center virtual storage array interface and a physical data storage array device respectively connected to the data center block storage device interface; the branch local area network includes a branch block storage device interface and a branch virtual array interface; a first logical memory is virtualized in the physical data storage array device, An address mapping between the first logical memory and the branch block storage device interface is established; the data center virtual storage array interface communicates with the branch virtual array interface through the first logical memory. Based on the system, a data storage method is also proposed, and the present invention operates within a computing instance so as to be able to use the limited capacity more flexibly and efficiently, and reduce time delay.

Figure 202110803730

Description

Virtualization block storage system and data storage method
Technical Field
The invention belongs to the technical field of virtualization storage, and particularly relates to a virtualization block storage system and a data storage method.
Background
Many physical storage devices, such as hard disk drives, are too small, too slow, and too unreliable for enterprise storage operations. As a result, many file servers are connected through a Storage Area Network (SAN) to a large number of remote data storage devices, such as disk arrays, tape libraries, and optical drive jukeboxes. For file and application servers, a storage area network appears to be one or more locally attached storage devices. Storage area networks use protocols such as iSCSI and fibre channel protocols to communicate with storage clients. These storage area network protocols are based on reading and writing data blocks of a storage device and typically operate below the level of the file system. Large organizations, such as businesses, are often geographically distributed over many independent locations called branches. For example, an enterprise may have offices or branches in New York, San Francisco, and India. Each branch location may include its own internal local area network for exchanging data within the branch. Additionally, the branches may be connected via a wide area network for exchanging data between the branches. Typical branch LAN installations also require data storage for their local client systems and application servers. For example, a typical branch LAN installation may include a file server for storing data for client systems and application services. In existing systems, the data store for the branch is located at the branch site and is directly connected to the branch LAN. Thus, each branch requires its own file server and associated data storage device.
Virtualization technology may allow sharing of data storage hardware between multiple users by providing each user with a virtualized data store that may be distributed across multiple data storage devices, each such virtualized data store acting as a distinct logical data store, providing the illusion to the users that they are the only operators and administrators of the data storage resources. In response to client requests, various virtual machine types optimized for different types of applications, such as compute intensive applications, memory intensive applications, and the like, may be established at a data center of some cloud computing provider networks. Further, advanced services that rely on virtual computing services of such provider networks, such as some database services whose database instances are instantiated using virtual machines of the virtual computing services, may also be available to provider network clients. For certain types of applications, however, such as applications that handle very large amounts of data that must be stored in customer premises outside of the provider network, for example, services that are limited to using hardware located at a data center of the provider network to provide virtualized resources may not be optimal for latency-related and/or other reasons. Traditionally, a group of block storage servers supporting block storage services partition the physical storage devices (e.g., solid state drives, magnetic drives, etc.) to which they are attached into a number of logical volumes. A block storage server may support hundreds or even thousands of instances of storage resources. These block storage servers are typically executed in a "bare metal" configuration, where the server software executes in an operating system environment that runs directly on dedicated server hardware, rather than on a virtual machine or within a container. Such bare metal block storage server designs may not be well suited for substrate expansion because capacity in expansion of the provider substrate may be significantly limited compared to capacity in the area of availability. For example, some substrate extensions may have only a single server (or another small portion of a server), and thus it may not be possible to dedicate the entire server to blocking storage resources, thereby preventing the server from being used for a compute instance.
Disclosure of Invention
In order to solve the above technical problems, the present invention provides a virtualized block storage system and a data storage method, which can be operated in a computing instance, thereby enabling more flexible and efficient use of a limited capacity, and reducing a time delay.
In order to achieve the purpose, the invention adopts the following technical scheme:
a virtualized block storage system comprises a data center local area network and a plurality of branch local area networks; the data center local area network and the branch local area network are communicated through a generalized network;
the data center local area network comprises a data center block storage device interface, and a data center virtual storage array interface and a physical data storage array device which are respectively connected with the data center block storage device interface;
the branch local area network comprises a branch block storage device interface and a branch virtual array interface connected with the branch block storage device interface;
virtualizing a first logic memory in the physical data storage array device, and establishing address mapping between the first logic memory and a branch block storage device interface; the data center virtual storage array interface communicates with a branch virtual array interface through the first logical storage.
Furthermore, the data center local area network also comprises a physical storage network interface connected with the data center block storage device interface;
the data center virtual storage array interface also accesses a physical storage network interface and physical data storage array equipment inside the data center local area network.
Furthermore, the branch virtual array interfaces are communicated with each other through a generalized network.
Further, the branched local area network includes one or more clients; the client includes one or more application servers for providing applications or application functionality to the client.
Furthermore, the branch virtual array interface is an independent computer system or network equipment; or embedded as hardware and/or software in other computer systems or network devices.
Further, the data center local area network further comprises a data center switching device; the data center block storage device interface is connected with the data center switching device; the branch local area network further comprises branch switching equipment; the branch block storage device interface is connected with the branch switching device;
and the data center switching equipment of the data center local area network and the branch switching equipment of the branch local area network are communicated through a generalized network.
The invention also provides a data storage method which is realized based on a virtual block storage system and comprises the following steps:
configuring a branch block storage device interface of a branch local area network and a physical data storage array device for accessing a data center local area network, virtualizing a first logic memory in the physical data storage array device, and establishing address mapping between the first logic memory and the branch block storage device interface;
a memory block is retrieved from a first logical memory in a physical data storage array device, providing block storage access to the client via a branching block storage device interface.
Further, said retrieving a memory block from a first logical memory in a physical data storage array device, providing block storage access to said client via a branching block storage device interface, further comprises: block memory accesses to the guest are prohibited to prevent the guest from accessing the memory block from the first logical memory virtualized from the physical data storage array device.
Further, the storage method further comprises: executing the client through the branched virtual array interface;
the execution client through the branch virtual array interface is as follows: and performing block storage access operation between the branch local area networks through the generalized network.
Further, the storage method further comprises: and executing block storage access operation on the branched local area network through the data center virtual storage array interface.
The effect provided in the summary of the invention is only the effect of the embodiment, not all the effects of the invention, and one of the above technical solutions has the following advantages or beneficial effects:
the invention provides a virtualized block storage system and a data storage method, wherein the system comprises a data center local area network and a plurality of branch local area networks; the data center local area network and the branch local area network are communicated through a generalized network; the data center local area network comprises a data center block storage device interface, and a data center virtual storage array interface and a physical data storage array device which are respectively connected with the data center block storage device interface; the branch local area network comprises a branch block storage device interface and a branch virtual array interface connected with the branch block storage device interface; virtualizing a first logic memory in the physical data storage array device, and establishing address mapping of an interface between the first logic memory and the branch block storage device; the data center virtual storage array interface communicates with the branch virtual array interface through a first logical storage. The invention also provides a data storage method based on the virtualized block storage system. The invention can be run within a computing instance, thereby enabling more flexible and efficient use of limited capacity and reducing time delay.
Because existing branch lan data stores cannot be located in a data center, memory access by clients and application servers is particularly slow because the inserted generalized network is too slow and requires a long latency. The present invention allows for storage of merged branch LAN-specific data stores at a data center LAN connected to the branch LAN via a wide area network, overcoming the bandwidth and latency limitations of the wide area network between the branch LAN and the data center LAN. Because the data storage of a plurality of branch local area networks is combined in the data center local area network, the efficiency, the reliability, the cost benefit and the performance of the data storage are improved. Access to their data stores at the data center local area network may be managed and controlled instead of at a number of separate branch local area networks, improving reliability and performance of data storage, and reducing the personnel required by the branch to provide, maintain, and back up data storage. It also enables a more efficient backup system for its data storage, planning storage growth more efficiently by consolidating their storage expansion for multiple branch lans and reducing excess unused storage.
The present invention bifurcated virtual storage array interface retrieves requested storage blocks from a virtual storage array cache rather than from physical storage devices located in a data center local area network via a generalized network. This storage block prediction reduces the amount of application data and results that must be transferred over long distances, reducing the bandwidth and latency of the generalized network, making the virtual storage array look as if it were a local storage device.
Drawings
FIG. 1 is a block diagram illustrating an exemplary computer system implementing a virtual storage array interface of a virtualized block storage system according to embodiment 1 of the invention;
fig. 2 is a schematic diagram of a virtualized block storage system according to embodiment 1 of the present invention;
fig. 3 is a flowchart of a data storage method according to embodiment 1 of the present invention.
Detailed Description
In order to clearly explain the technical features of the present invention, the following detailed description of the present invention is provided with reference to the accompanying drawings. The following disclosure provides many different embodiments, or examples, for implementing different features of the invention. To simplify the disclosure of the present invention, the components and arrangements of specific examples are described below. Furthermore, the present invention may repeat reference numerals and/or letters in the various examples. This repetition is for the purpose of simplicity and clarity and does not in itself dictate a relationship between the various embodiments and/or configurations discussed. It should be noted that the components illustrated in the figures are not necessarily drawn to scale. Descriptions of well-known components and processing techniques and procedures are omitted so as to not unnecessarily limit the invention.
Example 1
The embodiment 1 of the invention provides a virtualized block storage system, which comprises a data center local area network and a plurality of branch local area networks; the data center local area network and the branch local area network are communicated through a generalized network;
the data center local area network comprises a data center block storage device interface, and a data center virtual storage array interface and a physical data storage array device which are respectively connected with the data center block storage device interface;
the branch local area network comprises a branch block storage device interface and a branch virtual array interface connected with the branch block storage device interface;
the data center virtual storage array interface is in communication with one or more branch virtual array interfaces.
The data center virtual storage array interface also accesses the physical storage network interface and the physical data storage array device within the data center local area network.
The branched virtual array interfaces also communicate with each other through a generalized network.
Fig. 2 is a schematic diagram of a virtualized block storage system according to embodiment 1 of the present invention; the system includes a data center local area network and two branch local area networks, and the scope of the present invention is not limited to the number listed in example 1.
Two branch LANs 101A and 101B, respectively, the branch LAN 101A having its own branch LAN, the branch LAN 101B having its own branch LAN, and the data center LAN having its own branch LAN 200. The two branch local area networks 101A and 101B, respectively, and the data center network 200 are connected by one or more wide area networks 160 (WANs), such as the internet.
The data center local area network comprises a data center block storage device interface 12, and a data center virtual storage array interface 123, a physical storage network interface 124 and a physical data storage array device 125A which are respectively connected with the data center block storage device interface 12; the data center block storage device interface 120 is also coupled to both the data backup device 125B and the data center switching device.
The tributary local area network 101A includes a first tributary block storage device interface 11A, and a first tributary virtual array interface 121A connected to the first tributary block storage device interface 11A;
first tributary block storage device interface 11A is also connected to client 141A and application server 111A, respectively; the first branch virtual array interface 121A is connected to the first virtual storage array cache 122A; client 141A has one or more application servers 111A, and application servers 111A provide applications and application functions to the client system.
Implementing a virtual storage array at a first branch LAN uses a first branch virtual storage array interface 121A, and any branch virtual storage array interface 121A may be a stand-alone computer system or network device, or embedded as hardware and/or software in other computer systems or network devices.
The first branch virtual storage array interface 121A includes a first virtual storage array cache 122A that may optimize virtual storage array data access including data reads and data writes to minimize the impact of WAN bandwidth limitations and latency.
The tributary local area network 101B includes a second tributary block storage device interface 11B, and a second tributary virtual array interface 121B connected to the second tributary block storage device interface 11B;
second tributary block storage device interface 11B is also connected to client 141B and application server 111B, respectively; the second branch virtual array interface 121B is connected to the second virtual storage array cache 122B; client 141B is provided with one or more application servers 111B, application servers 111B providing applications and application functionality to the client system.
Implementing a virtual storage array at a second branch LAN uses a second branch virtual storage array interface 121B, and any branch virtual storage array interface 121B may be a stand-alone computer system or network device, or embedded as hardware and/or software in other computer systems or network devices.
The second branch virtual storage array interface 121B includes a second virtual storage array cache 122B that can optimize virtual storage array data access including data reads and data writes to minimize the effects of WAN bandwidth limitations and latency.
The data center virtual storage array interface communicates with one or more branch virtual array interfaces. That is, data center virtual storage array interface 123 communicates with one or more branch virtual storage interfaces 121 via data center local area network 200, wide area network 160, and their respective branch local area networks 101. Data communication between the breakout virtual storage interface 121 and the data center virtual storage array interface 123 may be in any form and/or protocol for communicating data over wired and wireless data communication networks, including TCP/IP.
Data center virtual storage array interface 123 translates data communications from branch virtual storage array interface 121 into storage accesses of the physical storage array network. To this end, the data center virtual storage array interface 123 accesses the physical storage array network interface 124 and the physical data storage devices 125 in sequence across the storage array network.
The bifurcated virtual array interfaces 121A and 121B of the present invention also communicate therebetween via a generalized network WAN 160.
Fig. 1 is a block diagram illustrating an exemplary computer system implementing a virtual storage array interface of a virtualized block storage system according to embodiment 1 of the present invention. As any branch virtual storage array interface 121A or 121B may be a stand-alone computer system or network device or embedded as hardware and/or software in another computer system or network device. FIG. 1 therefore illustrates an exemplary computer system with a virtual storage array interface.
Computer system 100 includes a Central Processing Unit (CPU)110 for running software applications and optionally an operating system. The central processor 110 may include one or more processing cores. The memory 130 stores applications and data used by the CPU. Memory 150 includes both dynamic and static random access memory. The memory 130 provides non-volatile storage for applications and data, and may include a fixed or removable hard drive, flash memory devices, ROM memory, and CD-ROM, DVD-ROM, Blu-ray, HD-DVD, or other magnetic, optical, or solid state storage devices. CPU110 may execute virtual machine software applications to create one or more virtual processors capable of executing additional software applications and optionally additional operating systems.
User input devices 140 communicate user inputs from one or more users to computer system 100 and may include a keyboard, mouse, joystick, digitizer pad, touchpad, touch screen, still or video camera, and/or microphone. In one embodiment, the user input device may be omitted and the computer system 100 may present a user interface to the user over a network, for example using a web page or a network management protocol and a network management software application.
Existing branch data stores cannot be located in a data center because the inserted WAN is too slow and requires a long latency, making memory access for client systems and application servers particularly slow. The present invention allows for the storage of merged branch local area network specific data stores at a data center local area network connected to the branch local area network via a wide area network. The virtualized block storage system provided by the invention overcomes the bandwidth and latency limitations of the wide area network between the branch local area network and the data center local area network. To this end, embodiments of the invention include a virtual storage array. For branch users, such as branch client systems and branch application servers, the virtual storage array appears as a storage array connected to the local area network of the branch. The virtual storage array may serve the same purpose as a local area network or other data storage device.
Example 2
Based on the virtualized block storage system provided in embodiment 1 of the present invention, embodiment 2 of the present invention further provides a data storage method. The method comprises the following steps:
configuring a branch block storage device interface of a branch local area network and a physical data storage array device for accessing a data center local area network, virtualizing a first logic memory in the physical data storage array device, and establishing address mapping between the first logic memory and the branch block storage device interface;
a memory block is retrieved from a first logical memory in a physical data storage array device, providing block storage access to the client via a branching block storage device interface.
Block memory accesses to the guest are prohibited to prevent the guest from accessing the memory block from the first logical memory virtualized from the physical data storage array device.
Executing the client through the branched virtual array interface; executing the client through the branched virtual array interface as follows: and performing block storage access operation between the branch local area networks through the generalized network.
And executing block storage access operation on the branched local area network through the data center virtual storage array interface.
Fig. 3 is a flowchart of a data storage method according to embodiment 1 of the present invention, where the data storage method is implemented based on two branched local area networks. The scope of the invention of embodiment 2 is not limited to two branched local area networks.
In step S100, the first branch local area network 101A is executed by the first branch virtual array interface 121A, the first branch block storage device interface 11A at the first branch local area network 101A is configured, and the physical data storage array device 125A at the data center local area network is accessed, the first logical storage is virtualized in the physical data storage array device 125A, and an address mapping between the first branch virtual array interface 121A and the first logical storage is established.
The invention improves the data reading performance of the virtual storage array by prefetching the data of the virtual storage array. A Branch LAN or data center LAN virtual storage array interface analyzes read and write accesses to the branched virtual storage array to predict which storage blocks may be accessed in the future. The branch local area network or data center virtual storage array interface then retrieves some or all of these prediction storage blocks and stores them in the branch's virtual storage array cache. If a storage client, such as an application server, file server, or client system, subsequently requests access to one or more cached storage blocks, the bifurcated virtual storage array interface retrieves the requested storage blocks from the virtual storage array cache, rather than retrieving the storage blocks from physical storage devices located in the data center LAN via the WAN. The storage block pre-hides the bandwidth and latency of the WAN from the storage clients so that the virtual storage array appears as if it is a local storage device. The storage client is executed by one or more processors of the computer system.
Wherein the data center network location is connected to the first branch network location via a wide area network and the transmission of the information is sent via a secure virtual network that uses keys to encrypt and decrypt traffic sent via the virtual network.
In step S200, providing block storage access to a client 141A at a first branch LAN location via a first branch block storage device interface 11A by retrieving a storage block from a first logical storage in a physical data storage array device 125A via a wide area network;
in S300, block memory access to client 141A is disabled to prevent client 141A from accessing a memory block from the first logical memory in physical data storage array device 125A.
Among other things, disabling block storage access to client 141A includes suspending a first block storage server virtual machine 101A executing at a first branch LAN location using virtual machine data stored in a first logical storage of a physical data storage array device 125A at a data center LAN location, and restarting the suspended first block storage server virtual machine 101A at a second branch LAN location using virtual machine data stored in the first logical storage in the physical data storage array device 125A at the data center LAN location.
For example, a storage block read request is received from a storage client, such as a client system or application server, which may be received by a branch location virtual data storage array interface. The storage block read request may be received using a storage area network protocol such as iSCSI.
In response to a received memory block read request, a decision is made to determine whether the requested memory block has been previously retrieved and stored in the memory block read cache at the branch location. If so, the requested memory block is retrieved from the memory block read cache and returned to the requesting client. If the system includes a data center virtual storage array interface, a storage block read request is also forwarded back to the data center virtual storage array interface for identifying additional storage blocks that may be requested by the storage client in the future.
After the storage client receives the write request, the client considers its storage block write request to be complete and may continue normal operation. However, the virtual storage array interface will transfer the queued write storage blocks over the WAN to the physical storage array at the data center LAN.
While a storage block write request is queued and waiting to be transmitted to the data center, a storage client may wish to access the storage block for reading or writing. In this case, the virtual storage array interface intercepts the storage block access request. In the case of a storage block read, the virtual storage array interface provides the queued storage block to the storage client. In the case of a storage block write, the virtual storage array interface will update the queued storage block data and send a write acknowledgement to the storage client for the additional storage block access.
Instead, the decision block determines that the virtual storage array cache cannot accept additional storage block write requests, and then performs an immediate transfer of the storage block to a physical storage array at the data center LAN via the WAN. After the transfer is completed, a write acknowledgement is received from the data center virtual storage array interface or the physical data storage array itself. A write acknowledgement is then sent to the storage client, allowing the storage client to resume normal operation.
In another embodiment, the virtual storage array interface may limit storage block read and/or write requests from clients to prevent the virtual storage array cache from being populated under typical usage conditions.
In step S400, the first branch local area network 101B is executed by the second branch virtual array interface 121B, the second branch block storage device interface 11B at the second branch local area network 101B is configured, and the physical data storage array device 125A at the data center local area network is accessed, the first logical storage is virtualized in the physical data storage array device 125A, and an address mapping between the second branch virtual array interface 121B and the first logical storage is established.
Application servers such as database applications or email servers and their associated data stores implemented using virtual storage arrays may be moved together between branches of a virtual storage array system if a client system needs to write or modify a block of storage in the virtual storage array. Because the application server is implemented within the virtual machine, this migration between branches may be seamless from the application server perspective. Moreover, because the virtual storage array concentrates data storage in the data center, not the branch location, no matter which branch virtual storage array interface is used, migration of the virtual machine and the application program need not transfer any virtual machine state and data to the destination branch location before the virtual machine is reactivated. Once the virtual machine is reactivated at the destination branch location, the virtual storage array interface for that branch location only needs the storage blocks that are requested directly by the virtual machine or its application, rather than in its storage block cache, and that are prefetched in anticipation of the virtual machine or application request. The storage block write data is directed directly to the active branch virtual storage array interface.
In step S500, providing block storage access to a client 141B at a second branch LAN location via a second branch block storage device interface 11B by retrieving a storage block from a first logical storage in a physical data storage array device 125A via a wide area network;
the virtual storage array provided by the bifurcated virtual storage interface allows a storage client to access a block of storage by its unique storage address within the virtual storage array. However, because the one or more virtual storage arrays actually store their data in the physical storage arrays, e.g., implemented as a physical storage area network, embodiments of the present invention allow for arbitrary mapping between unique storage addresses of storage blocks in the virtual storage arrays and corresponding unique storage addresses in the one or more physical storage arrays.
In step S600, a block memory access operation is performed between the branched lans through the generalized network, and the client 141A in the first branched lan 101A is executed by the first branched virtual array interface 121A, and the client 141B in the first branched lan 101B is executed by the second branched virtual array interface 121B.
I.e., receiving a first block storage operation to the physical data storage array device 125A from the second block storage server virtual machine 101B; and sending a message to the first block storage server virtual machine 101A to cause the first block storage server virtual machine 101A to perform the first block storage operation, wherein 101A and 101B communicate over a wide-sense network of a carrier.
In step S700, a block storage access operation is performed on the branched local area network through the data center virtual storage array interface.
In the data storage method provided by the invention, the virtual storage arrays store the data thereof in the data center local area network connected with the branch local area network through the wide area network, and a plurality of independent virtual storage arrays from different branches can store the data thereof in the same data center. Each virtual storage array cache may implement storage of predicted virtual storage array network data and virtual storage array write data for its corresponding virtual storage array of the branch local area network. Redundant data within a single branch of virtual storage array data within a physical storage array network of a data center local area network may be compressed or de-duplicated to reduce storage data. If two or more of the branched virtual storage arrays include the same or similar data, compression or data deduplication may be applied across all of these virtual storage arrays, such that only a single copy of the redundant data needs to be stored in the physical storage area network.
The present invention allows for the storage of merged branch local area network specific data stores at a data center local area network connected to the branch local area network via a wide area network. The virtualized block storage system provided by the invention overcomes the bandwidth and latency limitations of the wide area network between the branch local area network and the data center local area network. To this end, embodiments of the invention include a virtual storage array. For branch users, such as branch client systems and branch application servers, the virtual storage array appears as a storage array connected to the local area network of the branch. The virtual storage array may serve the same purpose as a local area network or other data storage device.
Although the embodiments of the present invention have been described with reference to the accompanying drawings, the scope of the present invention is not limited thereto. Various modifications and alterations will occur to those skilled in the art based on the foregoing description. And are neither required nor exhaustive of all embodiments. On the basis of the technical scheme of the invention, various modifications or changes which can be made by a person skilled in the art without creative efforts are still within the protection scope of the invention.

Claims (10)

1. A virtualized block storage system comprising a data center local area network and a plurality of branch local area networks; the data center local area network and the branch local area network are communicated through a generalized network;
the data center local area network comprises a data center block storage device interface, and a data center virtual storage array interface and a physical data storage array device which are respectively connected with the data center block storage device interface;
the branch local area network comprises a branch block storage device interface and a branch virtual array interface connected with the branch block storage device interface;
virtualizing a first logic memory in the physical data storage array device, and establishing address mapping between the first logic memory and a branch block storage device interface; the data center virtual storage array interface communicates with a branch virtual array interface through the first logical storage.
2. The virtualized block storage system of claim 1 wherein said data center local area network further comprises a physical storage network interface coupled to said data center block storage device interface;
the data center virtual storage array interface also accesses a physical storage network interface and physical data storage array equipment inside the data center local area network.
3. A virtualized block storage system as in claim 1 wherein said bifurcated virtual array interfaces also communicate over a generalized network.
4. A virtualized block storage system as in claim 1 wherein said branched local area network comprises one or more clients; the client includes one or more application servers for providing applications or application functionality to the client.
5. A virtualized block storage system as in claim 1 wherein the branched virtual array interface is a stand-alone computer system or a network device; or embedded as hardware and/or software in other computer systems or network devices.
6. The virtualized block storage system of claim 1 wherein said data center local area network further comprises a data center switching device; the data center block storage device interface is connected with the data center switching device; the branch local area network further comprises branch switching equipment; the branch block storage device interface is connected with the branch switching device;
and the data center switching equipment of the data center local area network and the branch switching equipment of the branch local area network are communicated through a generalized network.
7. A data storage method implemented based on the virtualized block storage system of any one of claims 1 to 6, comprising the following steps:
configuring a branch block storage device interface of a branch local area network and a physical data storage array device for accessing a data center local area network, virtualizing a first logic memory in the physical data storage array device, and establishing address mapping between the first logic memory and the branch block storage device interface;
a memory block is retrieved from a first logical memory in a physical data storage array device, providing block storage access to the client via a branching block storage device interface.
8. A data storage method according to claim 7, wherein said retrieving a storage block from a first logical storage in a physical data storage array device, providing block storage access to said client via a branching block storage device interface further comprises: block memory accesses to the guest are prohibited to prevent the guest from accessing the memory block from the first logical memory virtualized from the physical data storage array device.
9. A method of storing data according to claim 7, wherein the method further comprises: executing the client through the branched virtual array interface;
the execution client through the branch virtual array interface is as follows: and performing block storage access operation between the branch local area networks through the generalized network.
10. A method of storing data according to claim 7, wherein the method further comprises: and executing block storage access operation on the branched local area network through the data center virtual storage array interface.
CN202110803730.5A 2021-07-16 2021-07-16 Virtualization block storage system and data storage method Withdrawn CN113687772A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110803730.5A CN113687772A (en) 2021-07-16 2021-07-16 Virtualization block storage system and data storage method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110803730.5A CN113687772A (en) 2021-07-16 2021-07-16 Virtualization block storage system and data storage method

Publications (1)

Publication Number Publication Date
CN113687772A true CN113687772A (en) 2021-11-23

Family

ID=78577268

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110803730.5A Withdrawn CN113687772A (en) 2021-07-16 2021-07-16 Virtualization block storage system and data storage method

Country Status (1)

Country Link
CN (1) CN113687772A (en)

Similar Documents

Publication Publication Date Title
US11662928B1 (en) Snapshot management across cloud provider network extension security boundaries
US11809735B1 (en) Snapshot management for cloud provider network extensions
US8677111B2 (en) Booting devices using virtual storage arrays over wide-area networks
US11461123B1 (en) Dynamic pre-copy and post-copy determination for live migration between cloud regions and edge locations
CN111095225B (en) Method for reading data stored in non-volatile cache using RDMA
US10244069B1 (en) Accelerated data storage synchronization for node fault protection in distributed storage system
US8959173B1 (en) Non-disruptive load-balancing of virtual machines between data centers
US20110276963A1 (en) Virtual Data Storage Devices and Applications Over Wide Area Networks
US20040139167A1 (en) Apparatus and method for a scalable network attach storage system
US20120041970A1 (en) Distributed data cache for on-demand application acceleration
US11474857B1 (en) Accelerated migration of compute instances using offload cards
US11573839B1 (en) Dynamic scheduling for live migration between cloud regions and edge locations
US7818390B2 (en) Method for transferring data between terminal apparatuses in a transparent computation system
JP2011523751A (en) System and method for virtualizing storage for WPAR clients using node port ID virtualization
WO2020247235A1 (en) Managed computing resource placement as a service for dedicated hosts
US12093744B2 (en) System and method for instantiating twin applications
US12137149B2 (en) System and method for migrating groups of containers
US11099952B2 (en) Leveraging server side cache in failover scenario
KR102789371B1 (en) Improved performance of cross-frame real-time updates
WO2015123225A1 (en) Aggregating memory to create a network addressible storage volume for storing virtual machine files
CN112052291A (en) Method and system for accessing distributed block storage system by user mode
CN107577733B (en) A method and system for accelerating data replication
JPWO2016117040A1 (en) Computer system and data migration method in computer system
JP2021513137A (en) Data migration in a tiered storage management system
JP2004318744A (en) Database processing methods that provide high availability

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication
WW01 Invention patent application withdrawn after publication

Application publication date: 20211123