CN110879760B - Unified storage system and method and electronic equipment - Google Patents
Unified storage system and method and electronic equipment Download PDFInfo
- Publication number
- CN110879760B CN110879760B CN201811033879.4A CN201811033879A CN110879760B CN 110879760 B CN110879760 B CN 110879760B CN 201811033879 A CN201811033879 A CN 201811033879A CN 110879760 B CN110879760 B CN 110879760B
- Authority
- CN
- China
- Prior art keywords
- data
- storage
- file
- storage device
- block
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
- G06F11/1464—Management of the backup or restore process for networked environments
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
- G06F3/0656—Data buffering arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Quality & Reliability (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a unified storage system and method and electronic equipment, which comprise two storage devices which are main storage devices and standby storage devices, wherein the two storage devices comprise an NAS storage module and are used for reading/writing file data; the SAN storage module is used for reading/writing the block data; the VFS file system interface is used for controlling the read/write operation of file data; the SCST target subsystem interface is used for controlling the read/write operation of the block data; the cache unit is used for caching the file data and/or the block data according to write operation control, backing up the file data and/or the block data, sending the backup data to the standby storage equipment, and searching and acquiring the requested file data and/or the requested block data according to read operation control if the cache unit is the main storage equipment; and if the backup storage device is the standby storage device, receiving the backup data sent by the main storage device. The invention can realize the uniform storage function and the synchronous backup and management of data without additionally configuring special storage equipment.
Description
Technical Field
The present invention relates to the field of unified storage technologies, and in particular, to a unified storage system and method, and an electronic device.
Background
The unified storage system can realize the storage management of various types of data through a unified management interface, not only supports the NAS storage based on files, but also supports the SAN storage based on block data, can greatly reduce the complexity of the data storage management in enterprises, and has the advantages of easy expansion and lower cost.
Existing implementations of unified storage systems include the following: the first is to configure an independent block storage device and an independent NAS storage head, which can realize a uniform storage function, but the cost is high due to extra cost; the second one is that single-ended equipment realizes the data storage function, does not have the synchronous backup function of data, and in case single-ended equipment trouble, data lose easily, and the reliability is not high. On the basis of single-ended equipment, a dedicated data synchronization card or an IB card can be configured for data backup, and although synchronous backup of data in the single-ended equipment can be realized, extra cost is generated, and management of data storage cannot be realized.
Disclosure of Invention
In view of the above, the present invention provides a unified storage system and method, and an electronic device, which can implement a unified storage function and synchronous backup and management of data.
Based on the above purpose, the present invention provides a unified storage system, which includes two storage devices that are a primary storage device and a backup storage device, where the storage devices include:
the NAS storage module is used for reading/writing file data;
the SAN storage module is used for reading/writing the block data;
the VFS file system interface is used for controlling the read/write operation of file data;
the SCST target subsystem interface is used for controlling the read/write operation of the block data;
the cache unit is used for caching the file data and/or the block data according to the write operation control, backing up the file data and/or the block data, sending the backup data to the standby storage equipment, and searching and acquiring the requested file data and/or the requested block data according to the read operation control if the cache unit is the main storage equipment; and if the data is the standby storage equipment, receiving the backup data sent by the main storage equipment.
Optionally, the cache unit includes:
the data receiving module is used for receiving a data writing request sent by the VFS file system interface and/or the SCST target subsystem interface, wherein the data writing request comprises a file writing data request and a block writing data request;
the data synchronization module is used for caching the received file data and/or block data according to the data writing request if the data synchronization module is the main storage device, backing up the data and then sending the backup data to the standby storage device, and is used for receiving and storing the backup data sent by the main storage device if the data synchronization module is the standby storage device;
and the data storage module is used for transmitting the received file data and/or block data to a storage array unit of the system.
Optionally, the VFS file system interface includes:
and the file data storage control module is used for generating the file data writing request, wherein the file data writing request comprises file data and target equipment information for storing the file data, and the target equipment information comprises control parameters for directly writing the file data into the cache unit.
Optionally, the cache unit further includes:
the data receiving module is used for receiving a data reading request sent by the VFS file system interface and/or the SCST target subsystem interface, wherein the data reading request comprises a file reading data request and a block reading data request;
and the data reading module is used for searching whether the requested data exists in the cache unit or not according to the data reading request, returning the searched data if the requested data exists in the cache unit, and searching the requested data from the storage array unit if the requested data does not exist in the cache unit.
Optionally, the VFS file system interface further includes:
and the file data reading control module is used for generating the file data reading request, and the file data reading request comprises read file data and target equipment information for storing the read file data.
Optionally, the SCST target subsystem interface includes:
and the block data storage control module is used for generating the block data writing request, wherein the block data writing request comprises block data and target equipment information for storing the block data.
Optionally, the SCST target subsystem interface further includes:
and the block data reading control module is used for generating the block data reading request, and the block data reading request comprises block data reading and target equipment information for storing the block data reading.
Optionally, the caching unit caches the file data and/or the block data, and performs a backup process and then sends the backup data to the standby storage device in a synchronous manner.
Optionally, a data synchronization transmission channel is established between the primary storage device and the backup storage device through a gigabit network.
Optionally, the unified storage system further includes:
the HA management module is used for regularly detecting whether the heartbeat signals between the main storage device and the standby storage device are normal or not, and carrying out main-standby switching operation when detecting that one of the main storage device and the standby storage device or a data synchronous transmission channel of the main storage device and the standby storage device HAs a fault.
The embodiment of the invention also provides a unified storage method based on the unified storage system, which comprises the following steps:
performing data writing operation;
directly transmitting the data to a cache unit;
the cache unit receives the data, caches the data, backs up the data and then sends the backed-up data to the standby storage device.
Optionally, the unified storage method further includes:
performing data reading operation;
searching whether the cache unit has the requested data or not;
if yes, directly obtaining the data from the cache unit, and returning the data;
and if the data does not exist, acquiring the data from the storage array unit of the system and returning the data.
The embodiment of the present invention further provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the unified storage method.
As can be seen from the foregoing, the unified storage system, the unified storage method, and the electronic device provided by the present invention include two storage devices that are a primary storage device and a backup storage device, each of which includes an NAS storage module, configured to perform a read/write operation on file data; the SAN storage module is used for reading/writing the block data; the VFS file system interface is used for controlling the read/write operation of file data; the SCST target subsystem interface is used for controlling the read/write operation of the block data; the cache unit is used for caching the file data and/or the block data according to write operation control, backing up the file data and/or the block data, sending the backup data to the standby storage equipment, and searching and acquiring the requested file data and/or the requested block data according to read operation control if the cache unit is the main storage equipment; and if the backup storage device is the standby storage device, receiving the backup data sent by the main storage device. The unified storage system can realize the unified storage function and synchronous backup and management of data without additionally configuring special storage equipment.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic structural diagram of a unified storage system according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of a cache unit according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a data writing flow of the unified storage method according to an embodiment of the present invention;
fig. 4 is a schematic view of a data reading flow of the unified storage method according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to specific embodiments and the accompanying drawings.
It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are used for distinguishing two entities with the same name but different names or different parameters, and it should be noted that "first" and "second" are merely for convenience of description and should not be construed as limitations of the embodiments of the present invention, and they are not described in any more detail in the following embodiments.
Fig. 1 is a schematic structural diagram of a unified storage system according to an embodiment of the present invention. As shown in the figure, the unified storage system provided in the embodiment of the present invention is implemented based on a High Available cluster (HA) architecture, and the system includes a first storage device 10 and a second storage device 20, where the structure of the first storage device 10 is the same as that of the second storage device 20, and in a working process, one of the first storage devices is a main storage device, and the other is a spare storage device.
In the embodiment of the present invention, the first storage device 10 includes;
the NAS storage module is used for reading/writing file data;
the SAN storage module is used for reading/writing the block data;
a VFS file system interface for controlling the read/write operation of the file data;
SCST target subsystem interface, which is used to control the read/write operation of block data;
the cache unit is used for caching and backing up the file data and/or the block data according to the read/write operation control and searching;
and the storage array unit is used for storing file data and/or block data.
The NAS storage module and the SAN storage module are configured in a user space, and a user can read/write file data through the NAS storage module and read/write block data through the SAN storage module. The NAS storage module is connected with the cache unit through a VFS file system interface of the kernel space, and read/write operation and synchronous backup of file data are achieved. The SAN storage module is connected with the cache unit through an SCST target subsystem interface of the kernel space, and the read/write operation and synchronous backup of the block data are realized.
The cache unit of the first storage device 10 and the cache unit of the second storage device 20 are connected through a network to realize high-speed data transmission, and realize synchronous backup of data in the main storage device in the standby storage device.
Fig. 2 is a schematic structural diagram of a cache unit according to an embodiment of the present invention. As shown in the figure, in the embodiment of the present invention, for a write operation, the cache unit includes:
the data receiving module is used for receiving a data writing request sent by a VFS file system interface and/or an SCST target subsystem interface, wherein the data writing request comprises a file writing data request and a block writing data request;
the data synchronization module is used for caching the received data according to the data writing request if the data synchronization module is the main storage device, performing backup and sending the backup data to the standby storage device, and is used for receiving and storing the backup data sent by the main storage device if the data synchronization module is the standby storage device;
and the data storage module is used for transmitting the received data to the storage array unit.
In an embodiment of the present invention, the VFS file system interface includes:
the file data storage control module is used for generating a file data writing request, wherein the file data writing request comprises file data and target device information for storing the file data, and the target device information comprises control parameters for directly writing the file data into the cache unit.
And for the write operation of the file data, the NAS storage module of the user space executes the write operation of the file data, and the NAS storage module sends a request for writing the file data to the cache unit through the VFS file system interface. The file data storage control module of the VFS file system interface generates a file data writing request, the file data writing request comprises target equipment information for storing file data, the target equipment information comprises control parameters (a non-directive mode is used for uniformly modifying and setting a directive mode) for directly writing the file data into a cache unit, the file data to be written is directly written into the cache unit without passing through a cache region of the VFS file system, self-management of the data can be realized in the cache unit, the data does not pass through an uncontrolled kernel memory management unit, all the data are stored and synchronously backed up and managed in the cache unit, and consistency and high-speed access of the data are guaranteed.
On one hand, the file data is backed up through the data synchronization module, and then the backup data is sent to the cache unit of the standby storage device, so that the synchronous backup of the file data is realized; on the other hand, the file data is cached, and the file data can be subsequently stored in the target device through the data storage module according to the target device information in the file data writing request. The backup and the caching process of the file data are synchronously performed, and the writing speed of the data can be improved.
After the file data is stored in the cache unit and the file data sent to the cache unit of the standby storage device is successfully stored, a file data writing success message is sent to the NAS storage module through the VFS file system interface, so that the data consistency between the main storage device and the standby storage device can be ensured, and even if the main storage device fails, the standby storage device can provide a data reading/writing operation function under the condition of ensuring the data consistency with the main storage device.
As shown in fig. 2, for a read operation, in this embodiment of the present invention, the cache unit further includes:
the data receiving module is used for receiving a data reading request sent by the VFS file system interface and/or the SCST target subsystem interface, wherein the data reading request comprises a file reading data request and a block reading data request;
and the data reading module is used for searching whether the read target data exists in the cache unit or not according to the read data request, returning the searched read target data to the user if the read target data exists, and searching the read target data from the target equipment according to the read data request if the read target data does not exist.
In this embodiment of the present invention, the VFS file system interface further includes:
and the file data reading control module is used for generating a file data reading request, wherein the file data reading request comprises reading file data and storing target equipment information of the reading file data.
For the reading operation of the file data, the NAS storage module of the user space executes the reading operation of the file data, and the NAS storage module sends a file data reading request to the cache unit through the VFS file system interface. And a file data reading control module of the VFS file system interface generates a file data reading request, wherein the file data reading request comprises file data reading and target equipment information of the file data reading.
A data receiving module of the cache unit receives a file data reading request and judges whether target equipment belongs to main storage equipment or not according to target equipment information of the read file data;
if the main storage device belongs to the main storage device, firstly searching whether the read file data exists in the cache unit, if so, directly returning the searched read file data, and returning the searched read file data to the user; if the read file data does not exist, the read file data is searched and acquired from the storage array unit, namely the read file data is searched from the target equipment (the read file data request is sent to a general block equipment layer of the main storage equipment, the read file data is waited to be returned) according to the target equipment information and the read file data, and then the searched read file data is returned to a user.
If the read file data does not belong to the main storage device, searching whether the read file data exists in the cache unit, and if so, directly returning the searched read file data; if the read file data does not exist, the read file data request is transmitted to the main storage device through a data synchronous transmission channel between the main storage device and the standby storage device, the main storage device receives the read file data request, the read file data is searched from the target device according to the information of the target device and the read file data, the searched read file data is sent to the standby storage device through the data synchronous transmission channel, when the standby storage device finishes receiving all the read file data, the data reading completion is returned through the VFS file system interface, and the read target data is returned to a user.
In the embodiment of the present invention, the SCST target subsystem interface includes:
and the block data storage control module is used for generating a block data writing request which comprises block data and target device information for storing the block data.
The writing operation process of the block data is similar to that of the file data. For the block data writing operation, the block data writing operation is executed through the SAN storage module of the user space, and the SAN storage module sends a block data writing request to the cache unit through the SCST target subsystem interface. The block data storage control module of the SCST target subsystem interface generates a block data writing request, and the block data to be written is directly written into the cache unit, so that the data can be stored and backed up in the cache unit.
A data receiving module of the cache unit receives a block data writing request, on one hand, the data synchronization module backs up block data, and then the backup data is sent to the cache unit of the backup storage device in a blocking mode (the backup data is returned to a sending end after the receiving end confirms that the data is received by the receiving end so as to ensure that the data is received by the receiving end), so that synchronous backup of the block data is realized; in another aspect, the block data is cached and subsequently stored in a private cache of the target device via the data storage module based on target device information in the write block data request. And after the block data is stored in the cache unit and the block data sent to the cache unit of the standby storage device is successfully stored, sending a successful block data writing message to the SAN storage module through the SCST target subsystem interface.
In this embodiment of the present invention, the SCST target subsystem interface further includes:
and the block data reading control module is used for generating a block data reading request which comprises the block data reading and target equipment information of the block data reading.
The process of reading block data is similar to that of reading file data. For the block data reading operation, the block data reading operation is executed through the SAN storage module of the user space, and the SAN storage module sends a block data reading request to the cache unit through the SCST target subsystem interface. And the block data reading control module of the SCST target subsystem interface generates a block data reading request, wherein the block data reading request comprises block data reading and target equipment information of the block data reading.
A data receiving module of the cache unit receives a block data reading request and judges whether a target device belongs to a main storage device or not according to target device information of the block data reading request;
if the main storage device belongs to the main storage device, searching whether the read block data exists in the cache unit, if so, directly returning the searched read block data, and returning the searched read block data to a user; and if the read block data does not exist, searching and acquiring the read block data from the storage array unit, namely searching the read block data from the target equipment according to the target equipment information and the read block data (sending a block data reading request to a universal block equipment layer of the main storage equipment, waiting for returning the read block data), and then returning the searched read block data to a user.
If the data does not belong to the main storage device, searching whether the read block data exists from the cache unit, and if so, directly returning the searched read block data; if the data synchronization transmission channel does not exist, the data reading block data request is transmitted to the main storage device through the data synchronization transmission channel between the main storage device and the standby storage device, the main storage device receives the data reading block data request, the read block data is searched from the target device according to the target device information and the read block data, the searched read block data is sent to the standby storage device through the data synchronization transmission channel, when the standby storage device receives all the read block data, the completion of data reading is returned through the SCST target subsystem interface, and the read target data is returned to a user.
As shown in fig. 1, in the embodiment of the present invention, the first storage device 10 further includes:
the HA management module (fig. 1 is an HA) is configured to detect whether a heartbeat signal between the primary and the standby storage devices is normal at regular time, and perform a primary/standby switching operation when detecting that one of the primary and the standby storage devices HAs a fault or a data synchronization transmission channel of the primary and the standby storage devices HAs a fault.
The cache unit of the first storage device 10 and the cache unit of the second storage device 20 establish a data synchronization channel through a gigabit network to realize high-speed transmission of data. If the first storage device 10 is a main storage device and the second storage device 20 is a backup storage device, only the main storage device can perform data read/write operations, the HA management modules of the main and backup storage devices periodically detect whether heartbeat signals between the main and backup storage devices are normal, if heartbeat signals between the main and backup storage devices are detected normally, the main and backup storage devices are judged to work normally, if heartbeat signals or heartbeat signals of the main and backup storage devices cannot be detected or are abnormal, the main and backup storage devices are judged to work abnormally, and at this time, switching between the main and backup storage devices can be performed.
The specific method for switching the main storage device and the standby storage device is as follows: firstly, detecting whether a main storage device and/or a standby storage device have faults or not, and if the main storage device and the standby storage device have no faults, detecting whether a data synchronization channel between the main storage device and the standby storage device is abnormal or not;
if the main storage equipment is detected to be in fault, the standby storage equipment is switched to the main storage equipment, the data read-write mode of the switched main storage equipment is changed into a write-through mode (the data existing in the cache unit before is subjected to write-on and disk-off operation, and after the write-on and disk-off operation is completed, the newly written data is directly handed to a universal block equipment layer without passing through the cache unit), the data cache synchronization operation is not carried out any more, so that the single-machine power-down data is not lost, the normal operation of the system is ensured, the data synchronization backup is realized between the main storage equipment and the standby storage equipment, the consistency of the system data can be ensured, and the standby storage equipment is ensured to realize the normal data read/write operation function;
if the standby storage equipment is detected to be in fault, the main storage equipment directly carries out off-line switching operation (data is not transmitted any more through a data synchronization transmission channel between the main storage equipment and the standby storage equipment), and the data read-write mode of the current main storage equipment is also changed into a write-through mode, so that data cache synchronization is not carried out, and the data is not lost after a single machine is in fault;
if a network fault occurs in a data synchronization channel between the main storage device and the standby storage device, the standby storage device fails to avoid the split brain problem, and all data is only subjected to read-write processing of the main storage device.
Fig. 3 is a schematic diagram of a data writing flow of the unified storage method according to the embodiment of the present invention. As shown in the figure, based on the unified storage method implemented by the unified storage system, the data writing process includes:
s10: performing data writing operation;
the data writing operation comprises a file data writing operation and a block data writing operation. Only the master storage device may perform read/write data operations.
S11: directly transmitting the data to a cache unit;
the user executes the data writing operation in the user space, and according to the data type (file data or block data), the data writing operation generates a corresponding data writing request through a VFS file system interface or an SCST target subsystem interface of the kernel space, and according to the data writing request, the data is directly written into the cache unit.
S12: the cache unit receives the data, caches the data, backs up the data and then sends the backed-up data to the standby storage device.
The cache unit caches the received data, backs up the data, sends the backed-up data to the standby storage device, and synchronously caches the data, the backed-up data and the process of sending the backed-up data. And returning a data writing success message after the data caching is successful and the backup data is successfully stored in the standby storage device.
Fig. 4 is a schematic view of a data reading flow of the unified storage method according to an embodiment of the present invention. As shown, the read data process includes:
s20: performing data reading operation;
s21: searching whether the cache unit has the requested data or not; if yes, go to step S22; otherwise, executing S23;
s22: directly obtaining the requested data from the cache unit and returning the data;
s23: and acquiring the requested data from the storage array unit of the system and returning the data.
Based on the above object, an embodiment of an apparatus for executing the unified storage method is further provided in the embodiments of the present invention. The device comprises:
one or more processors, and a memory.
The apparatus for performing the unified storage method may further include: an input device and an output device.
The processor, memory, input device, and output device may be connected by a bus or other means.
The memory, which is a non-volatile computer-readable storage medium, may be used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as program instructions/modules (e.g., the data synchronization module and the data reading module shown in fig. 2) corresponding to the unified storage method in the embodiment of the present invention. The processor executes various functional applications of the server and data processing by running nonvolatile software programs, instructions and modules stored in the memory, that is, the unified storage method of the above method embodiments is realized.
The memory may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of an apparatus performing the unified storage method, and the like. Further, the memory may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, the memory optionally includes memory remotely located from the processor, and these remote memories may be connected to the member user behavior monitoring device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input means may receive input numeric or character information and generate key signal inputs related to user settings and function control of the apparatus performing the unified storage method. The output device may include a display device such as a display screen.
The one or more modules are stored in the memory and, when executed by the one or more processors, perform the unified storage methodology of any of the method embodiments described above. The technical effect of the embodiment of the device for executing the unified storage method is the same as or similar to that of any method embodiment.
An embodiment of the present invention further provides a non-transitory computer storage medium, where the computer storage medium stores computer executable instructions, and the computer executable instructions may execute a processing method for list item operation in any method embodiment described above. Embodiments of the non-transitory computer storage medium may be the same or similar in technical effect to any of the method embodiments described above.
Finally, it should be noted that, as will be understood by those skilled in the art, all or part of the processes in the methods of the above embodiments may be implemented by a computer program that can be stored in a computer-readable storage medium and that, when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like. The technical effect of the embodiment of the computer program is the same as or similar to that of any of the method embodiments described above.
Furthermore, the apparatuses, devices, etc. described in the present disclosure may be various electronic terminal devices, such as a mobile phone, a Personal Digital Assistant (PDA), a tablet computer (PAD), a smart television, etc., and may also be large terminal devices, such as a server, etc., and therefore the scope of protection of the present disclosure should not be limited to a specific type of apparatus, device. The client disclosed by the present disclosure may be applied to any one of the above electronic terminal devices in the form of electronic hardware, computer software, or a combination of both.
Furthermore, the method according to the present disclosure may also be implemented as a computer program executed by a CPU, which may be stored in a computer-readable storage medium. The computer program, when executed by the CPU, performs the above-described functions defined in the method of the present disclosure.
Further, the above method steps and system elements may also be implemented using a controller and a computer readable storage medium for storing a computer program for causing the controller to implement the functions of the above steps or elements.
Further, it should be appreciated that the computer-readable storage media (e.g., memory) described herein can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. By way of example, and not limitation, nonvolatile memory can include Read Only Memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which can act as external cache memory. By way of example and not limitation, RAM is available in a variety of forms such as synchronous RAM (DRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), and Direct Rambus RAM (DRRAM). The storage devices of the disclosed aspects are intended to comprise, without being limited to, these and other suitable types of memory.
Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as software or hardware depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.
The various illustrative logical blocks, modules, and circuits described in connection with the disclosure herein may be implemented or performed with the following components designed to perform the functions described herein: a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination of these components. A general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration.
The steps of a method or algorithm described in connection with the disclosure herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an ASIC. The ASIC may reside in a user terminal. In the alternative, the processor and the storage medium may reside as discrete components in a user terminal.
In one or more exemplary designs, the functions may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer. By way of example, and not limitation, such computer-readable media can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a general-purpose or special-purpose computer, or a general-purpose or special-purpose processor. Also, any connection is properly termed a computer-readable medium. For example, if the software is transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL), or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. Disk and disc, as used herein, includes Compact Disc (CD), laser disc, optical disc, Digital Versatile Disc (DVD), floppy disk, blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.
Disclosed exemplary embodiments should be noted, however, that various changes and modifications could be made herein without departing from the scope of the disclosure as defined by the appended claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. Furthermore, although elements of the disclosure may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated.
It should be understood that, as used herein, the singular forms "a," "an," "the" are intended to include the plural forms as well, unless the context clearly supports the exception. It should also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.
The above-mentioned serial numbers of the embodiments of the present disclosure are merely for description and do not represent the merits of the embodiments.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
Those of ordinary skill in the art will understand that: the discussion of any embodiment above is meant to be exemplary only, and is not intended to intimate that the scope of the disclosure, including the claims, is limited to these examples; within the framework of embodiments of the invention, also combinations between technical features of the above embodiments or different embodiments are possible, and there are many other variations of the different aspects of the embodiments of the invention described above, which are not provided in detail for the sake of brevity. Therefore, any omissions, modifications, substitutions, improvements, and the like that may be made without departing from the spirit and principles of the embodiments of the present invention are intended to be included within the scope of the embodiments of the present invention.
Claims (12)
1. A unified storage system, comprising two storage devices that are primary and backup storage devices, wherein the storage devices comprise:
the NAS storage module is used for executing the read/write operation of file data in a user space by a user, and sends a file data write request and/or a file data read request to the cache unit through a VFS file system interface of a kernel space;
the SAN storage module is used for executing the reading/writing operation of the block data in the user space by a user, and the SAN storage module sends a block writing data request and/or a block reading data request to the cache unit through an SCST target subsystem interface of a kernel space;
the cache unit, if the cache unit is a main storage device, is configured to cache the file data and/or the block data according to the file data writing request and/or the block data writing request, perform backup, send the backup data to a standby storage device, transmit the file data and/or the block data to a storage array unit of a system, and search for whether the requested data exists in the cache unit according to the file data reading request and/or the block data reading request, if the requested data exists, return the searched data, and if the requested data does not exist, search for the requested data from the storage array unit; and if the data is the standby storage equipment, receiving the backup data sent by the main storage equipment.
2. The unified storage system according to claim 1, wherein the VFS file system interface comprises:
and the file data storage control module is used for generating the file data writing request, wherein the file data writing request comprises file data and target equipment information for storing the file data, and the target equipment information comprises control parameters for directly writing the file data into the cache unit.
3. The unified storage system according to claim 2, wherein the VFS file system interface further comprises:
and the file data reading control module is used for generating the file data reading request, and the file data reading request comprises read file data and target equipment information for storing the read file data.
4. The unified storage system according to claim 1, wherein the SCST target subsystem interface comprises:
and the block data storage control module is used for generating the block data writing request, wherein the block data writing request comprises block data and target equipment information for storing the block data.
5. The unified storage system according to claim 4, wherein said SCST target subsystem interface further comprises:
and the block data reading control module is used for generating the block data reading request, and the block data reading request comprises block data reading and target equipment information for storing the block data reading.
6. The unified storage system according to claim 1, wherein the caching unit caches the file data and/or block data and synchronizes the process of backing up and then sending the backed up data to the spare storage device.
7. The unified storage system according to claim 1, wherein the primary and backup storage devices establish a data synchronization transmission channel through a gigabit network.
8. The unified storage system according to claim 1, further comprising:
the HA management module is used for regularly detecting whether the heartbeat signals between the main storage device and the standby storage device are normal or not, and carrying out main-standby switching operation when detecting that one of the main storage device and the standby storage device or a data synchronous transmission channel of the main storage device and the standby storage device HAs a fault.
9. The unified storage system according to claim 8,
the HA management module is used for switching the standby storage device into the main storage device when detecting that the main storage device HAs a fault, and setting a data read-write mode of the switched main storage device into a write-through mode; or, when detecting that the backup storage device fails, the data synchronization transmission channel does not transmit data any more, and sets the data read-write mode of the main storage device to the write-through mode; or when the data synchronous transmission channel fails, the standby storage equipment fails.
10. The unified storage method implemented based on the unified storage system according to any of claims 1 to 9, applied to a main storage device, comprising:
performing data writing operation;
directly transmitting the data to a cache unit;
the cache unit receives the data, caches the data, backs up the data, sends the backed-up data to the standby storage equipment, and transmits the data to the storage array unit of the system.
11. The unified storage method according to claim 10, further comprising:
performing data reading operation;
searching whether the cache unit has the requested data or not;
if yes, directly obtaining the data from the cache unit, and returning the data;
and if the data does not exist, acquiring the data from the storage array unit of the system and returning the data.
12. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the method according to any of claims 10 to 11 when executing the program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811033879.4A CN110879760B (en) | 2018-09-05 | 2018-09-05 | Unified storage system and method and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811033879.4A CN110879760B (en) | 2018-09-05 | 2018-09-05 | Unified storage system and method and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110879760A CN110879760A (en) | 2020-03-13 |
| CN110879760B true CN110879760B (en) | 2022-09-02 |
Family
ID=69727101
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811033879.4A Active CN110879760B (en) | 2018-09-05 | 2018-09-05 | Unified storage system and method and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110879760B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111478947B (en) * | 2020-03-20 | 2023-02-17 | 珠海高凌信息科技股份有限公司 | Method and system for real-time synchronization of main control board and standby control board |
| CN111949661A (en) * | 2020-08-12 | 2020-11-17 | 国网信息通信产业集团有限公司 | Access method and device for power distribution and utilization data |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1648842A (en) * | 2004-01-29 | 2005-08-03 | 株式会社日立制作所 | Storage systems having a plurality of interfaces |
| CN1838128A (en) * | 2005-03-24 | 2006-09-27 | 株式会社日立制作所 | Control technology for storage system |
| CN104050248A (en) * | 2014-06-05 | 2014-09-17 | 北京捷成世纪科技股份有限公司 | File storage system and storage method |
| CN105653406A (en) * | 2015-12-31 | 2016-06-08 | 华为技术有限公司 | Method for managing distributed storage system and distributed storage system |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7873700B2 (en) * | 2002-08-09 | 2011-01-18 | Netapp, Inc. | Multi-protocol storage appliance that provides integrated support for file and block access protocols |
| AU2012200446B2 (en) * | 2005-06-24 | 2012-05-31 | Catalogic Software, Inc. | System and method for high performance enterprise data protection |
| US8370302B2 (en) * | 2009-06-02 | 2013-02-05 | Hitachi, Ltd. | Method and apparatus for block based volume backup |
| CN102088490B (en) * | 2011-01-19 | 2013-06-12 | 华为技术有限公司 | Data storage method, device and system |
-
2018
- 2018-09-05 CN CN201811033879.4A patent/CN110879760B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1648842A (en) * | 2004-01-29 | 2005-08-03 | 株式会社日立制作所 | Storage systems having a plurality of interfaces |
| CN1838128A (en) * | 2005-03-24 | 2006-09-27 | 株式会社日立制作所 | Control technology for storage system |
| CN104050248A (en) * | 2014-06-05 | 2014-09-17 | 北京捷成世纪科技股份有限公司 | File storage system and storage method |
| CN105653406A (en) * | 2015-12-31 | 2016-06-08 | 华为技术有限公司 | Method for managing distributed storage system and distributed storage system |
Non-Patent Citations (2)
| Title |
|---|
| SAN与NAS融合的存储备份系统的设计与应用;胡春宇;《中国优秀博硕士学位论文全文数据库(硕士)信息科技辑》;20090415;第2009年卷(第4期);I138-33 * |
| Snins: A Storage Network Integrating NAS and SAN;De-Zhi Han;《2005 International Conference on Machine Learning and Cybernetics》;20051107;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110879760A (en) | 2020-03-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6404907B2 (en) | Efficient read replica | |
| US11307776B2 (en) | Method for accessing distributed storage system, related apparatus, and related system | |
| EP3179359B1 (en) | Data sending method, data receiving method, and storage device | |
| US11907561B2 (en) | Data backup method and apparatus | |
| CN105159795A (en) | Data synchronization method, apparatus and system | |
| KR101983208B1 (en) | Data management method, node and system for database cluster | |
| CN109739435B (en) | File storage and updating method and device | |
| AU2013403132A1 (en) | Data storage method, data storage apparatus, and storage device | |
| CN102708150A (en) | Method, device and system for asynchronously copying data | |
| WO2020224410A1 (en) | Application version switching method and apparatus, electronic device and storage medium | |
| US20210326211A1 (en) | Data backup method, apparatus, and system | |
| CN110879760B (en) | Unified storage system and method and electronic equipment | |
| CN111352943A (en) | Method and device for realizing data consistency, server and terminal | |
| CN108352995B (en) | SMB service fault processing method and storage device | |
| CN110442601B (en) | Openstack mirror image data parallel acceleration method and device | |
| CN113157487A (en) | Data recovery method and apparatus thereof | |
| JP2020525921A (en) | Auxiliary storage device that provides independent backup and restore functions and equipment to which the auxiliary storage device is applied | |
| KR102567900B1 (en) | Method and Apparatus for Ensuring Continuous Device Operational Stability in Cloud Degraded Mode | |
| US11669516B2 (en) | Fault tolerance for transaction mirroring | |
| CN113391759B (en) | Communication method and equipment | |
| JP2017208113A (en) | Data storage method, data storage apparatus, and storage device | |
| CN111078467A (en) | Method and device for realizing remote copy consistency | |
| KR102665749B1 (en) | Method and apparatus for ensuring continued device operational reliability in cloud-degraded mode | |
| CN114676166B (en) | Data processing method and device | |
| CN111414127B (en) | Computing cluster system, data acquisition method thereof and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |