CN111352916B - Data storage method, system and storage medium based on NAS storage system - Google Patents
Data storage method, system and storage medium based on NAS storage system Download PDFInfo
- Publication number
- CN111352916B CN111352916B CN202010113508.8A CN202010113508A CN111352916B CN 111352916 B CN111352916 B CN 111352916B CN 202010113508 A CN202010113508 A CN 202010113508A CN 111352916 B CN111352916 B CN 111352916B
- Authority
- CN
- China
- Prior art keywords
- data
- file
- stored
- public cloud
- gateway
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 55
- 238000013500 data storage Methods 0.000 title claims abstract description 25
- 230000005012 migration Effects 0.000 claims description 18
- 238000013508 migration Methods 0.000 claims description 18
- 230000008569 process Effects 0.000 claims description 12
- 238000004590 computer program Methods 0.000 claims 1
- 230000000694 effects Effects 0.000 abstract description 10
- 230000002159 abnormal effect Effects 0.000 abstract description 9
- 230000006870 function Effects 0.000 description 14
- 238000012545 processing Methods 0.000 description 13
- 238000010586 diagram Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000005192 partition Methods 0.000 description 2
- 230000008439 repair process Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000000630 rising effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
- G06F16/1824—Distributed file systems implemented using Network-attached Storage [NAS] architecture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a data storage method, a system and a storage medium based on an NAS storage system, wherein the NAS storage system comprises a cluster file subsystem and a plurality of file gateways, and the method comprises the steps of distributing data to be stored to the file gateways corresponding to the cluster file subsystem; storing the data to be stored to public cloud through each file gateway; the NAS storage system is a cluster architecture, and each file gateway is mapped to one physical node in the cluster architecture. The method and the device can effectively reduce the probability of abnormal work of the file gateway, effectively improve the stability of the system architecture and improve the storage effect of data.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a data storage method, system and storage medium based on a NAS storage system.
Background
Currently, public clouds provide object storage services that can be accessed through the internet, for example, an object storage service of the oricloud and an object storage service of the amazon cloud, so that a file gateway product is adopted in the related art to solve the problem that the object storage service interfaces with a traditional access mode of a network attached storage (Network Attached Storage, NAS) file, and in practical application, the local file access of a client is communicated with the object storage service of the public cloud through the file gateway product.
In this way, if network communication fails or service provided by public cloud fails, the file gateway works abnormally, the stability of the system architecture is poor, and the storage effect of data is affected; in the mode, the data is usually stored in the public cloud, no backup data exists, if the public cloud access fails, the customer service is interrupted, the user experience is affected, and the risk resistance of the system architecture is low; if a plurality of data are stored in public cloud by adopting a discrete file gateway, because the data are stored by manual operation, the data are stored in inconsistent mode, business errors can be caused, the data storage efficiency is low, the reading and writing of the data are affected, and the cost is high.
Disclosure of Invention
The present invention aims to solve at least one of the technical problems in the related art to some extent.
Therefore, the invention aims to provide a data storage method, a system and a storage medium based on an NAS storage system, which can effectively reduce the probability of abnormal work of a file gateway, effectively improve the stability of a system architecture and improve the storage effect of data.
To achieve the above object, an embodiment of the present invention provides a data storage method based on a NAS storage system, where the NAS storage system includes a cluster file subsystem and a plurality of file gateways, the method includes: distributing data to be stored to a file gateway corresponding to the cluster file subsystem; storing the data to be stored to public cloud through each file gateway; the NAS storage system is a cluster architecture, and each file gateway is mapped to one physical node in the cluster architecture.
According to the data storage method based on the NAS storage system, which is provided by the embodiment of the first aspect of the invention, the data to be stored is distributed to the file gateways corresponding to the cluster file subsystems, and the data to be stored is stored to the public cloud through the file gateways, wherein the NAS storage system is a cluster architecture, and the file gateways are mapped to one physical node in the cluster architecture, so that the probability of abnormal work of the file gateways can be effectively reduced, the stability of the system architecture is effectively improved, and the storage effect of the data is improved.
In order to achieve the above objective, an embodiment of the present invention provides a NAS storage system, where the NAS storage system includes a cluster file subsystem and a plurality of file gateways, where the cluster file subsystem distributes data to be stored to corresponding file gateways; and the cluster file subsystem stores the data to be stored to a public cloud through each file gateway, wherein the NAS storage system is a cluster architecture, and each file gateway is mapped to one physical node in the cluster architecture.
According to the NAS storage system provided by the embodiment of the second aspect of the invention, the data to be stored is distributed to the file gateways corresponding to the cluster file subsystems, and the data to be stored is stored to the public cloud through the file gateways, wherein the NAS storage system is a cluster architecture, and the file gateways are mapped to one physical node in the cluster architecture, so that the probability of abnormal work of the file gateways can be effectively reduced, the stability of the system architecture is effectively improved, and the storage effect of the data is improved.
To achieve the above object, a non-transitory computer readable storage medium according to an embodiment of a third aspect of the present invention, when executed by a processor, causes a terminal to perform a data storage method based on a NAS storage system, where the NAS storage system includes a cluster file subsystem and a plurality of file gateways, the method comprising: according to the data storage method based on the NAS storage system provided by the embodiment of the first aspect of the invention.
According to the non-transitory computer readable storage medium provided by the embodiment of the third aspect of the invention, the data to be stored is distributed to the file gateways corresponding to the cluster file subsystems, and the data to be stored is stored to the public cloud through each file gateway, wherein the NAS storage system is a cluster architecture, each file gateway is mapped to one physical node in the cluster architecture, so that the probability of abnormal work of the file gateway can be effectively reduced, the stability of the system architecture is effectively improved, and the storage effect of the data is improved.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The foregoing and/or additional aspects and advantages of the invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings, in which:
FIG. 1 is a flow chart of a data storage method based on a NAS storage system according to one embodiment of the present invention;
FIG. 2 is a schematic diagram of a NAS storage system according to an embodiment of the present invention;
FIG. 3 is a flow chart of a data storage method based on a NAS storage system according to another embodiment of the present invention;
FIG. 4 is a schematic diagram illustrating a NAS storage system according to one embodiment of the present invention;
FIG. 5 is a schematic diagram of a NAS storage system according to another embodiment of the present invention.
Detailed Description
Embodiments of the present invention are described in detail below, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to like or similar elements or elements having like or similar functions throughout. The embodiments described below by referring to the drawings are illustrative only and are not to be construed as limiting the invention. On the contrary, the embodiments of the invention include all alternatives, modifications and equivalents as may be included within the spirit and scope of the appended claims.
In order to solve the problem that network communication in the related art is faulty or service provided by public cloud is faulty, namely abnormal work of a file gateway is caused, the stability of a system architecture is poor, and the storage effect of data is affected; in the mode, the data is usually stored in the public cloud, no backup data exists, if the public cloud access fails, the customer service is interrupted, the user experience is affected, and the risk resistance of the system architecture is low; if a plurality of data are stored in public cloud by adopting a discrete file gateway, because the data are stored by manual operation, the data are stored in an inconsistent way, which can lead to business errors, the data storage efficiency is low, the reading and writing of the data are affected, and the cost is high.
Fig. 1 is a flowchart of a data storage method based on a NAS storage system according to an embodiment of the present invention.
The NAS storage system in this embodiment includes a cluster file subsystem and a plurality of file gateways.
Referring to fig. 1, the method includes:
s101: and distributing the data to be stored to a file gateway corresponding to the cluster file subsystem.
The cluster file subsystem is specifically an extensible network file system, and may be, for example, a distributed network file system, and is not limited to this.
The cluster file subsystem in the embodiment of the invention is particularly used for receiving data to be stored sent by applications of mass clients and distributing the data to be stored to the corresponding file gateway according to some built-in data distribution rules, thereby effectively assisting in realizing 'one-copy writing, multiple-copy cloud rising', and improving the reliability of the data.
In a specific execution process, the current processing data amount of each file gateway may be determined, and a ratio value between the current processing data amounts of each file gateway may be determined, so that, in combination with the ratio value between the current processing data amounts of each file gateway, data to be stored may be adaptively allocated to a corresponding file gateway, or a current data processing capability index of each file gateway may be determined, so that data to be stored may be adaptively allocated to a corresponding file gateway according to the data processing capability index, which is not limited.
In the embodiment of the invention, the data to be stored is distributed to the corresponding file gateway to generate the backup data of the data to be stored, and the data to be stored and the backup data are distributed to the corresponding file gateway, so that multiple copies of backup data are formed for the data to be stored.
S102: and storing the data to be stored to the public cloud through each file gateway.
In practical application, the file gateway is equivalent to a middleware between the public cloud object storage service and the application server capable of providing the data to be stored, the data interaction between the object storage service and the application server can be realized through the file gateway, the application server uploads the data to be stored to the public cloud object storage service through the file gateway, or the application server accesses the data from the public cloud object storage service through the file gateway, and the application server is generally connected with the file gateway through a shared file interface provided by the file gateway.
In a specific implementation process, a cluster file subsystem is configured for a NAS storage system, the cluster file subsystem receives data to be stored sent by an application of a mass client, distributes the data to be stored to a corresponding file gateway according to a built-in data distribution rule, the file gateway provides a pre-configured interface to the outside, and the data to be stored is stored to a public cloud through each file gateway by calling the pre-configured interface, wherein each file gateway is mapped to a physical node in a cluster architecture, so that the configuration of the file gateway and the public cloud architecture form in the NAS storage system into the cluster architecture is realized, the service availability of the file gateway can be effectively improved, and service unavailability of the file gateway can be caused by service failure of the public cloud.
In this embodiment, the NAS storage system includes a cluster file subsystem and a plurality of file gateways, and the data to be stored is distributed to the file gateways corresponding to the cluster file subsystem, and is stored to a public cloud through each file gateway, where the NAS storage system is a cluster architecture, and each file gateway is mapped to a physical node in the cluster architecture, so that the probability of abnormal work of the file gateway can be effectively reduced, the stability of the system architecture is effectively improved, and the storage effect of the data is improved.
Referring to fig. 2, fig. 2 is a schematic diagram of an architecture of a NAS storage system according to an embodiment of the present invention, including: the cluster file subsystem 21 and the plurality of file gateways 22, wherein each file gateway 22 corresponds to a public cloud 23 and a file sharing subsystem 24, the file sharing subsystem 24 obtains data to be stored uploaded by various sources, the data to be stored is transmitted to the cluster file subsystem 21, the cluster file subsystem 21 executes the steps of the method in the embodiment shown in fig. 1 for the data to be stored, and the file gateways 22 provide a preconfigured interface to the outside.
FIG. 3 is a flow chart illustrating a data storage method based on a NAS storage system according to another embodiment of the present invention.
The present embodiment proposes a specific application example for the architecture of the NAS storage system in fig. 2 described above.
Referring to fig. 3, the method includes:
s301: and obtaining data to be stored uploaded by various sources, and transmitting the data to be stored to the cluster file subsystem.
The multiple sources may be multiple different types of application programs, or multiple application programs of the same type, and these application programs may be installed in the same electronic device, or may be installed in different electronic devices, which is not limited.
In a specific implementation process, the file sharing subsystem may obtain data to be stored uploaded by multiple sources through a preset protocol, where the preset protocol may be, for example, a general network file system (Common Internet File System, CIFS) protocol, or may also be a network file system (Network File System, NFS) protocol.
The file sharing subsystem is used for acquiring the data to be stored uploaded by various sources and transmitting the data to be stored to the cluster file subsystem, so that file sharing can be effectively realized, the application function of the NAS storage system is expanded, and the applicability of the NAS storage system is improved.
S302: and distributing the data to be stored to a file gateway corresponding to the cluster file subsystem.
The cluster file subsystem is specifically an extensible network file system, and may be, for example, a distributed network file system, and is not limited to this.
The cluster file subsystem in the embodiment of the invention is particularly used for receiving data to be stored sent by the application of the mass client and distributing the data to be stored to the corresponding file gateway according to some built-in data distribution rules.
In a specific execution process, the current processing data amount of each file gateway may be determined, and a ratio value between the current processing data amounts of each file gateway may be determined, so that, in combination with the ratio value between the current processing data amounts of each file gateway, data to be stored may be adaptively allocated to a corresponding file gateway, or a current data processing capability index of each file gateway may be determined, so that data to be stored may be adaptively allocated to a corresponding file gateway according to the data processing capability index, which is not limited.
In the embodiment of the invention, the data to be stored is distributed to the corresponding file gateway to generate the backup data of the data to be stored, and the data to be stored and the backup data are distributed to the corresponding file gateway, so that multiple copies of backup data are formed for the data to be stored.
S303: and storing the data to be stored to the public cloud through each file gateway by calling a preconfigured interface.
Wherein the preconfigured interfaces include a first interface supporting hard-connectivity and a second interface supporting extended attributes.
Where hard-wired refers to one or more file names of a file, the hard-wired function enables multiple file names that are not or under the same directory to be modified while the same file can be modified, wherein after one modification, all files with which it has a hard-wired are modified together.
In this embodiment, the preconfigured interface includes a first interface supporting hard connection and a second interface supporting an extended attribute, which may enable the clustered file subsystem to define a target storage format by calling the first interface and the second interface, and store the data to be stored to the public cloud in the target storage format via each file gateway.
Thus, object storage services of a plurality of public clouds are clustered into a clustered file system that can be accessed by users in a local network file sharing manner.
Based on the implementation manner, the architecture of the NAS storage system can effectively support the storage manner of 'copy' or 'striping partition' of all data to be stored of the NAS storage system, so that the implementation can be flexibly deployed according to different requirements of users for high reliability, high concurrency and the like, and when the cluster file subsystem adopts the distributed network file system of the glumerfs, the data self-repairing function of the distributed network file system of the glumerfs can be utilized, the data consistency checking and repairing of cloud data are realized, and the remote copying function of the distributed network file system of the glumerfs is utilized, so that the data migration on the cloud is realized.
In a specific execution process, the cluster file subsystem is further used for receiving a migration instruction, wherein the migration instruction is used for migrating stored data in the source public cloud to the target public cloud; and the cluster file subsystem migrates the stored data from the source public cloud to the target public cloud according to the migration instruction.
The method steps can be realized by adopting the copy data restoration function of the NAS, so that the whole data migration process does not need manual intervention, the self-recovery can be realized after the process is abnormally interrupted, the breakpoint continuous transmission is realized, and the copy data restoration function of the NAS can ensure the consistency of the source and the destination of the migrated data, namely, the integrity of the data migration on the cloud.
As an example, assuming that the original NAS storage system includes two file gateways, corresponding to the ali cloud and the Tech cloud, and two sets of directory files are placed on the ali cloud and the Tech cloud in a two-copy manner, it is assumed that a user needs to migrate stored data on the ali cloud (i.e., the source public cloud) to amazon or any other public cloud (the migrated public cloud may be referred to as a target public cloud), according to a migration instruction, a data migration operation may be performed by the cluster file subsystem in the present invention, that is, the migrated gateway corresponding to the source public cloud in the original cluster is replaced by the file gateway of the target public cloud, and then, after the repair task is performed, a copy data repair function of the NAS is started, and after the stored data in the source public cloud is newly created on the newly added target public cloud through the file gateway of the newly added target public cloud, thereby automatically implementing the whole data migration process. In this embodiment, the file sharing subsystem obtains the data to be stored uploaded by multiple sources, and transmits the data to be stored to the clustered file subsystem, so that file sharing can be effectively realized, application functions of the NAS storage system are expanded, and applicability of the NAS storage system is improved. The framework of the NAS storage system can effectively support the storage mode of 'copy' or 'striping partition' of all data to be stored of the NAS storage system, so that the implementation can be flexibly deployed according to different requirements of users for high reliability, high concurrency and the like, and when the cluster file subsystem adopts the distributed network file system of the glumerfs, the data self-repairing function of the distributed network file system of the glumerfs can be utilized to realize the data consistency checking and repairing of the cloud data, and the remote copying function of the distributed network file system of the glumerfs is utilized to realize the data migration on the cloud.
FIG. 4 is a schematic diagram of a NAS storage system according to one embodiment of the present invention.
Referring to FIG. 4, the NAS storage system 400 comprises:
a cluster file subsystem 401 and a plurality of file gateways 402, wherein,
the cluster file subsystem 401 distributes data to be stored to the corresponding file gateway 402;
the cluster file subsystem 401 stores data to be stored to the public cloud 403 through each file gateway 402, wherein the NAS storage system is a cluster architecture, and each file gateway is mapped to one physical node in the cluster architecture.
Optionally, in some embodiments, referring to fig. 5, the nas storage system 400 further comprises:
and each file gateway corresponds to one public cloud 403, wherein the cluster file subsystem 401 stores the data to be stored into the corresponding public cloud 403 through each file gateway 402.
Optionally, in some embodiments, referring to fig. 5, the nas storage system further comprises;
a file sharing subsystem 404 that, among other things,
the file sharing subsystem 404 acquires data to be stored uploaded by various sources, and transmits the data to be stored to the clustered file subsystem 401.
Optionally, in some embodiments, the method comprises, among other things,
the cluster file subsystem 401 generates backup data of the data to be stored, and distributes the data to be stored and the backup data to the corresponding file gateway 402.
Optionally, in some embodiments, the file gateway 402 provides a pre-configured interface to the outside, wherein,
the cluster file subsystem 401 stores the data to be stored to the public cloud 403 via each file gateway 402 by calling a preconfigured interface.
Optionally, in some embodiments, the preconfigured interface includes a first interface supporting a hard connection and a second interface supporting an extended attribute.
Optionally, in some embodiments, the method comprises, among other things,
the cluster file subsystem 401 defines a target storage format by calling the first interface and the second interface, and stores data to be stored in the target storage format to the public cloud 403 via each file gateway 402.
Alternatively, in some embodiments, the first and second processing steps,
the cluster file subsystem 401 is further configured to receive a migration instruction;
the cluster file subsystem 401 migrates the stored data from the source public cloud to the target public cloud according to the migration instruction.
It should be noted that, the explanation of the embodiment of the data storage method based on the NAS storage system in the foregoing embodiments of fig. 1 to 3 is also applicable to the NAS storage system 400 of this embodiment, and the implementation principle is similar, and will not be repeated here.
In this embodiment, the NAS storage system includes a cluster file subsystem and a plurality of file gateways, and the data to be stored is distributed to the file gateways corresponding to the cluster file subsystem, and is stored to a public cloud through each file gateway, where the NAS storage system is a cluster architecture, and each file gateway is mapped to a physical node in the cluster architecture, so that the probability of abnormal work of the file gateway can be effectively reduced, the stability of the system architecture is effectively improved, and the storage effect of the data is improved.
To achieve the above embodiments, the present invention also proposes a non-transitory computer-readable storage medium, which when executed by a processor of a terminal, enables the terminal to perform a data storage method based on a NAS storage system, the NAS storage system including a cluster file subsystem and a plurality of file gateways, the method comprising:
distributing data to be stored to a file gateway corresponding to a cluster file subsystem;
storing the data to be stored to public cloud through each file gateway;
the NAS storage system is a cluster architecture, and each file gateway is mapped to one physical node in the cluster architecture.
The non-transitory computer readable storage medium in this embodiment distributes data to be stored to the file gateways corresponding to the clustered file subsystems, and stores the data to be stored to public cloud through each file gateway, where the NAS storage system is a clustered architecture, and each file gateway is mapped to one physical node in the clustered architecture, so that the probability of abnormal operation of the file gateway can be effectively reduced, the stability of the system architecture is effectively improved, and the storage effect of the data is improved.
It should be noted that in the description of the present invention, the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. Furthermore, in the description of the present invention, unless otherwise indicated, the meaning of "a plurality" is two or more.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and further implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present invention.
It is to be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, the various steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, may be implemented using any one or combination of the following techniques, as is well known in the art: discrete logic circuits having logic gates for implementing logic functions on data signals, application specific integrated circuits having suitable combinational logic gates, programmable Gate Arrays (PGAs), field Programmable Gate Arrays (FPGAs), and the like.
Those of ordinary skill in the art will appreciate that all or a portion of the steps carried out in the method of the above-described embodiments may be implemented by a program to instruct related hardware, where the program may be stored in a computer readable storage medium, and where the program, when executed, includes one or a combination of the steps of the method embodiments.
In addition, each functional unit in the embodiments of the present invention may be integrated in one processing module, or each unit may exist alone physically, or two or more units may be integrated in one module. The integrated modules may be implemented in hardware or in software functional modules. The integrated modules may also be stored in a computer readable storage medium if implemented in the form of software functional modules and sold or used as a stand-alone product.
The above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, or the like.
In the description of the present specification, a description referring to terms "one embodiment," "some embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiments or examples. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
While embodiments of the present invention have been shown and described above, it will be understood that the above embodiments are illustrative and not to be construed as limiting the invention, and that variations, modifications, alternatives and variations may be made to the above embodiments by one of ordinary skill in the art within the scope of the invention.
Claims (9)
1. A data storage method based on a NAS storage system, wherein the NAS storage system includes a cluster file subsystem and a plurality of file gateways, the method comprising:
distributing data to be stored to a file gateway corresponding to the cluster file subsystem;
storing the data to be stored to public cloud through each file gateway;
the NAS storage system is a cluster architecture, and each file gateway is mapped to one physical node in the cluster architecture;
receiving a migration instruction;
migrating the stored data from a source public cloud to a target public cloud according to the migration instruction; wherein, include: and replacing the migrated gateway corresponding to the source public cloud in the original cluster with the file gateway of the target public cloud, starting the copy data restoration function of the NAS storage system, so that the stored data in the source public cloud is subjected to new generation of data file copies on the newly added target public cloud through the newly added file gateway of the target public cloud, and realizing the data migration process.
2. The NAS storage system-based data storage method according to claim 1, wherein each of the file gateways corresponds to a public cloud; the storing the data to be stored to a public cloud via each file gateway includes: and storing the data to be stored into a corresponding public cloud through each file gateway.
3. The NAS storage system-based data storage method of claim 1, said NAS storage system further comprising a file sharing subsystem, wherein said method further comprises:
acquiring data to be stored uploaded by various sources;
and transmitting the data to be stored to the cluster file subsystem.
4. The NAS storage system-based data storage method of claim 1, wherein the distributing the data to be stored to the corresponding file gateway comprises:
generating backup data of the data to be stored;
and distributing the data to be stored and the backup data to the corresponding file gateway.
5. The NAS storage system-based data storage method of claim 1, wherein the file gateway provides a preconfigured interface to the outside, the method further comprising:
and storing the data to be stored to public cloud through each file gateway by calling the preconfigured interface.
6. The NAS storage system-based data storage method of claim 5, wherein the preconfigured interface comprises a first interface supporting a hard connection and a second interface supporting an extended attribute.
7. The NAS storage system-based data storage method of claim 6, wherein the method comprises:
defining a target storage format by calling the first interface and the second interface;
and storing the data to be stored to public cloud in the target storage format through each file gateway.
8. A NAS storage system comprising a clustered file subsystem and a plurality of file gateways, wherein,
the cluster file subsystem distributes data to be stored to the corresponding file gateway;
the cluster file subsystem stores the data to be stored to a public cloud through each file gateway, wherein the NAS storage system is a cluster architecture, and each file gateway is mapped to one physical node in the cluster architecture;
the cluster file subsystem is also used for receiving a migration instruction;
migrating the stored data from a source public cloud to a target public cloud according to the migration instruction; wherein, include: and replacing the migrated gateway corresponding to the source public cloud in the original cluster with the file gateway of the target public cloud, starting the copy data restoration function of the NAS storage system, so that the stored data in the source public cloud is subjected to new generation of data file copies on the newly added target public cloud through the newly added file gateway of the target public cloud, and realizing the data migration process.
9. A non-transitory computer readable storage medium having stored thereon a computer program, which when executed by a processor implements a NAS storage system-based data storage method according to any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010113508.8A CN111352916B (en) | 2020-02-24 | 2020-02-24 | Data storage method, system and storage medium based on NAS storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010113508.8A CN111352916B (en) | 2020-02-24 | 2020-02-24 | Data storage method, system and storage medium based on NAS storage system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111352916A CN111352916A (en) | 2020-06-30 |
| CN111352916B true CN111352916B (en) | 2023-11-03 |
Family
ID=71195762
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010113508.8A Active CN111352916B (en) | 2020-02-24 | 2020-02-24 | Data storage method, system and storage medium based on NAS storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111352916B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117041321B (en) * | 2023-09-28 | 2023-12-26 | 宁波银行股份有限公司 | Service processing system and method |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101365001A (en) * | 2007-07-31 | 2009-02-11 | 霍尼韦尔国际公司 | Apparatus and method supporting a redundancy-managing interface between wireless and wired networks |
| CN102571904A (en) * | 2011-10-11 | 2012-07-11 | 浪潮电子信息产业股份有限公司 | Construction method of NAS cluster system based on modularization design |
| CN105094897A (en) * | 2015-07-02 | 2015-11-25 | 华为技术有限公司 | Virtual machine starting method, cloud access equipment and cloud computing center |
| US9639555B1 (en) * | 2013-06-21 | 2017-05-02 | EMC IP Holding Company LLC | Object storage server based gateway to network file system cluster |
| CN109561120A (en) * | 2017-09-26 | 2019-04-02 | 杭州海康威视系统技术有限公司 | Small documents backup method, systems and management server |
| CN109756484A (en) * | 2018-12-12 | 2019-05-14 | 杭州数梦工场科技有限公司 | Control method, control device, gateway and the medium of gateway based on object storage |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7516133B2 (en) * | 2003-10-17 | 2009-04-07 | Hitachi, Ltd. | Method and apparatus for file replication with a common format |
| DK3257231T3 (en) * | 2015-02-09 | 2019-04-08 | Koninklijke Kpn Nv | DISTRIBUTED GATEWAYS |
| US11057466B2 (en) * | 2015-12-31 | 2021-07-06 | Dell Products L.P. | Method and system for generating out-of-band notifications of client activity in a network attached storage (NAS) device |
| GB2575293B (en) * | 2018-07-04 | 2020-09-16 | Graphcore Ltd | Data Through Gateway |
-
2020
- 2020-02-24 CN CN202010113508.8A patent/CN111352916B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101365001A (en) * | 2007-07-31 | 2009-02-11 | 霍尼韦尔国际公司 | Apparatus and method supporting a redundancy-managing interface between wireless and wired networks |
| CN102571904A (en) * | 2011-10-11 | 2012-07-11 | 浪潮电子信息产业股份有限公司 | Construction method of NAS cluster system based on modularization design |
| US9639555B1 (en) * | 2013-06-21 | 2017-05-02 | EMC IP Holding Company LLC | Object storage server based gateway to network file system cluster |
| CN105094897A (en) * | 2015-07-02 | 2015-11-25 | 华为技术有限公司 | Virtual machine starting method, cloud access equipment and cloud computing center |
| CN109561120A (en) * | 2017-09-26 | 2019-04-02 | 杭州海康威视系统技术有限公司 | Small documents backup method, systems and management server |
| CN109756484A (en) * | 2018-12-12 | 2019-05-14 | 杭州数梦工场科技有限公司 | Control method, control device, gateway and the medium of gateway based on object storage |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111352916A (en) | 2020-06-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11016749B1 (en) | Architecture for incremental deployment | |
| US10169163B2 (en) | Managing backup operations from a client system to a primary server and secondary server | |
| CN107734026B (en) | Method, device and equipment for designing network additional storage cluster | |
| US9311328B2 (en) | Reference volume for initial synchronization of a replicated volume group | |
| US9031906B2 (en) | Method of managing data in asymmetric cluster file system | |
| US9262323B1 (en) | Replication in distributed caching cluster | |
| US20150229715A1 (en) | Cluster management | |
| CN111078121A (en) | Data migration method, system and related components of distributed storage system | |
| US9229740B1 (en) | Cache-assisted upload proxy | |
| US8984162B1 (en) | Optimizing performance for routing operations | |
| JP5868986B2 (en) | Recovery by item | |
| CN110825698B (en) | Metadata management method and related device | |
| CN110825704B (en) | Data reading method, data writing method and server | |
| US11593496B2 (en) | Decentralized data protection system for multi-cloud computing environment | |
| CN114385561A (en) | File management method and device and HDFS system | |
| AU2019438434A1 (en) | Document storage and management | |
| CN111225003B (en) | NFS node configuration method and device | |
| CN111352916B (en) | Data storage method, system and storage medium based on NAS storage system | |
| CN111752892B (en) | Distributed file system and implementation method, management system, equipment and medium thereof | |
| US9015371B1 (en) | Method to discover multiple paths to disk devices cluster wide | |
| US11334456B1 (en) | Space efficient data protection | |
| EP4379543A1 (en) | Cloud desktop data migration method, service node, management node, server, electronic device, and computer-readable storage medium | |
| CN109992447B (en) | Data copying method, device and storage medium | |
| US10880388B1 (en) | Automatic redirection in scale-out cluster environments that perform distributed deduplication | |
| CN113419901A (en) | Data disaster recovery method and device and server |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |