CN107590024B - Data storage method and data storage system - Google Patents
Data storage method and data storage system Download PDFInfo
- Publication number
- CN107590024B CN107590024B CN201710681070.1A CN201710681070A CN107590024B CN 107590024 B CN107590024 B CN 107590024B CN 201710681070 A CN201710681070 A CN 201710681070A CN 107590024 B CN107590024 B CN 107590024B
- Authority
- CN
- China
- Prior art keywords
- data
- backup
- volume
- storage
- mirror image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000013500 data storage Methods 0.000 title claims abstract description 54
- 238000000034 method Methods 0.000 title claims abstract description 42
- 238000003860 storage Methods 0.000 claims abstract description 181
- 238000004519 manufacturing process Methods 0.000 claims abstract description 83
- 238000013507 mapping Methods 0.000 claims abstract description 23
- 238000005516 engineering process Methods 0.000 claims description 8
- 230000001360 synchronised effect Effects 0.000 description 7
- 230000005540 biological transmission Effects 0.000 description 4
- VBAHFEPKESUPDE-UHFFFAOYSA-N 2-methoxyamphetamine Chemical compound COC1=CC=CC=C1CC(C)N VBAHFEPKESUPDE-UHFFFAOYSA-N 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000002360 preparation method Methods 0.000 description 2
- 238000011084 recovery Methods 0.000 description 2
- 238000007726 management method Methods 0.000 description 1
- 230000010076 replication Effects 0.000 description 1
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application discloses a data storage method and a data storage system, wherein the method comprises the following steps: when a data backup instruction is received, backing up data stored in the mirror image volume to a backup memory, storing the data stored in the production storage server to the data change volume, and establishing mapping between the data in the data change volume and the data in the mirror image volume; and synchronizing the data in the data change volume to the mirror volume according to the mapping when receiving a data backup completion signal. By adopting the production storage system and the production storage method provided by the embodiment, the backup data is sent to the backup memory by the mirror image volume of the mirror image storage server, the production business volume of the production storage server does not need to be occupied, and the influence of the read-write operation of the normal production business data is avoided.
Description
Technical Field
The present application relates to the field of server storage technologies, and in particular, to a data storage method and a data storage system.
Background
In an enterprise-level data storage system, to prevent data loss due to an operation error or a system failure, data stored in a production storage server needs to be periodically transmitted to a backup storage via a network.
At present, L AN-Free architecture and Server-Free architecture based on Storage Area Network (SAN) are adopted in AN enterprise data Storage system, in the data Storage system adopting L AN-Free architecture, backup data are sent to a backup memory through the SAN network, compared with the traditional L AN architecture, the backup data do not need to pass through a TCP/IP stack of a production Storage Server, the consumption of CPU resources and memory resources of the production Storage Server is reduced, the possibility of blockage of the L AN network is reduced, in the data Storage scheme adopting the Server-Free architecture, the data Storage scheme is further upgraded in AN L AN-Free architecture, the data stored in a service Storage volume in the production Storage Server is directly transmitted to the backup memory through the control of protocols such as NDMP, and the backup data do not need to be cached in the production Storage Server in the transmission process, so the consumption of the CPU resources and the memory resources of the production Storage Server is further reduced.
However, when backing up data, the data storage system based on the Server-Free architecture still needs to occupy the production business volume resources of the production storage Server; on the premise that mass data needs to be processed and the uninterrupted operation time of the service is longer and longer, the production storage server production service volume resources are occupied by the production service for a long time, and the time window for data backup is smaller and smaller. Under the actual condition, the production service volume resources in the production storage server cannot complete the transmission of the backup data under the time window; in order to realize backup storage of data, the data storage system only sacrifices production service time and reserves time for data backup.
Disclosure of Invention
The application provides a data storage method and a data storage system, which aim to solve the problem that normal business data operation is influenced because a business storage volume of a production storage server needs to be occupied for data backup.
The embodiment of the invention provides a data storage method, which is applied to a data storage system;
the data storage system comprises a production storage server, a mirror image storage server and a backup storage;
the mirror image storage server comprises a mirror image volume and a data change volume which are positioned in different bottom layer storage hardware; the method comprises the following steps:
s101: judging whether a data backup instruction is received or not; if yes, executing S103; if not, executing S102;
s102: storing the data stored in the production storage server to the mirror volume in a mirror mode;
s103: backing up data stored in the mirror volume to the backup storage; storing the data stored in the production storage server to the data change volume, and establishing mapping between the data in the data change volume and the data in the mirror volume; executing S104;
s104: judging whether a data backup completion signal is received or not; if yes, executing S105; if not, continuing to execute S103;
s105: and synchronizing the data in the data change volume to the mirror volume according to the mapping.
Optionally, the method further includes: and generating and storing metadata of backup data while backing up the data stored in the mirror volume to the backup storage.
Optionally, the production storage server and the mirror storage server, and the mirror storage server and the backup storage all transmit data through an SAN network.
Optionally, the mirror image storage Server and the backup storage adopt a Server-Free method to transmit backup data.
Optionally, a BitMap technology is used to establish a mapping between the data change volume and the data in the mirror volume.
An embodiment of the present invention provides a data storage system, including: the system comprises a production storage server, a mirror image storage server and a backup storage;
the mirror image storage server comprises a mirror image volume and a data change volume which are positioned in different bottom layer storage hardware; when a data backup instruction is not received, the mirror image storage server stores the data stored in the production storage server to the mirror image volume in a mirror image mode;
when a data backup instruction is received, the mirror image storage server stores the data stored in the production storage server into the data change volume, establishes mapping between the data in the data change volume and the data in the mirror image volume, backs up the data stored in the mirror image volume to the backup memory, and synchronizes the data in the data change volume to the mirror image volume according to the mapping after the backup is completed.
Optionally, the method further includes generating and storing metadata of the backup data while backing up the data in the mirror volume to the backup storage.
Optionally, the production storage server and the mirror storage server, and the mirror storage server and the backup storage all transmit data through an SAN network.
Optionally, the mirror image storage Server and the backup storage adopt a Server-Free method to transmit backup data.
Optionally, the mirror storage server establishes mapping between the data change volume and the data in the mirror volume by using a BitMap technology.
By adopting the production storage system and the production storage method provided by the embodiment, the backup data is sent to the backup memory by the mirror image volume of the mirror image storage server, the production business volume of the production storage server does not need to be occupied, and the influence of the read-write operation of the normal production business data is avoided. When the backup data is sent to the backup memory by the mirror image storage server, the service data written into the production storage volume is stored into the data change volume, and the data change volume is written into the mirror image volume after the data backup is completed, so that the data in the mirror image volume is the same as the data in the production service volume, and the data backed up into the backup memory is ensured to be the data of the production service volume in the production storage server.
Drawings
In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without any creative effort.
FIG. 1 is a schematic diagram illustrating a usage scenario of a data storage method provided by an embodiment;
FIG. 2 is a flow diagram of a data storage method provided by an embodiment;
the system comprises 11-a production storage server, 12-a mirror image storage server, 13-a backup storage, 14-a backup server, 15-L AN switches, 16-SAN switches and 17-a service server.
Detailed Description
The embodiment of the invention provides a data storage method and a data storage system, which can avoid the influence on the production storage of a production storage server 11 caused by occupying a service storage volume of the production storage server 11 during data backup.
In order to make those skilled in the art better understand the technical solution of the present invention, the technical solution in the embodiment of the present invention will be clearly and completely described below with reference to the drawings in the embodiment of the present invention, and it is obvious that the described embodiment is only a part of the embodiment of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a schematic view of a usage scenario of a data storage method provided by an embodiment. As shown in fig. 1, the data storage system applied by the data storage method provided by the embodiment of the present invention includes a production storage server 11, a mirror storage server 12, and a backup storage 13.
The production storage server 11 is in communication connection with the service server 17 through AN L AN network (i.e. a L AN switch 15 shown in the figure), receives service data sent by the service data server, stores the service data, and reads the service data in its disk array according to a request of the service data and sends the service data to the service server 17.
In this embodiment, a large amount of data exchange is required among the production storage server 11, the mirror storage server 12, and the backup storage 13, and the three preferably use a SAN network for communication.
In this embodiment, the mirror storage server 12 includes a mirror volume and a data change volume located in different underlying storage hardware, for example, the mirror volume and the data change volume may be different disks in a disk array (RAID), or may be different disks in a storage pool. Of course, it should be noted that the mirror storage server 12 in the present embodiment is not limited to one server, and may be multiple services in actual use; in practice, the mirror volume and the data change volume may be located in different mirror storage servers 12.
In addition, the data storage system provided by the present embodiment further includes a backup server 14. The backup server 14 is provided independently of the production storage server 11, the mirror storage server 12, and the backup storage 13. Backup control software is installed in the backup server 14, and backup client software or a backup interface is installed in the mirror image storage server 12 and the backup storage 13.
Fig. 2 is a flowchart of a data storage method according to an embodiment. As shown in fig. 2, the data storage method provided by this embodiment includes the following steps.
S101: judging whether a data backup instruction is received or not; if yes, executing S103; if not, executing S102.
In this embodiment, the data backup operation is controlled by the backup server 14. The backup server 14 may start the backup operation according to a predetermined rule and a user instruction, and send a backup instruction to the corresponding backup client software to start the corresponding server to perform the backup operation.
S102: and mirroring the data stored in the production storage server 11 to the mirror volume.
In the production case, the production storage server 11 stores the service data transmitted by the service data and simultaneously transmits the stored data to the mirror storage server 12.
In this embodiment, the production storage server 11 maps its own production service volume to the service server 17 through one group of host interfaces, and establishes a synchronous replication relationship with the mirror volume in the mirror storage server 12 through an SAN network using another group of host interfaces; in the case that the mirror storage server 12 is not communicated with the backup storage 13 to realize data backup, the mirror volume synchronous storage area of the mirror storage server 12 stores the service data stored in the production storage server 11.
S103: backing up the data stored in the mirror image volume to a backup memory, storing the data stored in the production storage server to a data change volume, and establishing mapping between the data in the data change volume and the data in the mirror image volume; s104 is then executed.
When the backup server 14 sends a data backup instruction and the backup client software in the mirror storage server 12 and the backup storage 13 receives the data backup instruction, the corresponding backup client software drives the corresponding server to perform preparation operation before backup, and performs data backup after preparation is completed.
In this embodiment, the backup data is sent from the mirror volume of the mirror storage server 12, and is transmitted to the backup storage 13 through the SAN network, so as to implement the backup operation. While data backup is performed, the production storage server 11 still performs normal production operations, performs data read-write operations in its own production service volume, and sends the data written in the production service volume to the mirror image storage server 12 through the SAN network.
At this time, since the mirror volume in the mirror storage server 12 is performing a data backup operation, the service data transmitted from the production storage server 11 cannot be written into the mirror volume. As a temporary data storage method, the mirror storage server 12 writes the service data transmitted from the production storage server 11 into the data change volume. In order to ensure that the data written into the data change volume and the data in the mirror volume have an association relationship, the mirror storage server 12 further establishes a mapping between the data in the data change volume and the mirror volume data according to the service data sent by the production storage server 11.
S104: judging whether a data backup completion signal is received or not; if yes, executing S105; if not, the process continues to execute S103.
S105: according to the mapping, synchronizing the data in the data change volume to the mirror volume, and executing S102.
And when the data to be backed up in the data change volume is completely sent, the data change volume sends a data backup completion signal to the mirror image storage server 12. After receiving the data backup completion signal, the mirror storage server 12 synchronizes the service data stored in the data change volume to the mirror volume according to the mapping relationship; at the same time, the mirror storage server 12 writes the data sent from the production storage server 11 to the mirror storage volume.
In the data storage method, the same data as the production business volume of the production storage server 11 is backed up and stored in the mirror volume of the mirror storage server 12 by using a storage synchronous remote copy technology, and the data change volume is used as a data temporary storage volume. When data backup is performed, backup data is transferred from the mirror volume to the backup storage 13 without occupying a production storage volume of the production storage server 11; therefore, the production server can carry out production service operation, and the influence of backup operation on normal production in the prior art is avoided.
Of course, the mirror storage server 12 in this embodiment may also be used as a redundant production storage device to temporarily take over the work of the production storage server 11 when the production storage server 11 is down.
In order to ensure that the location of the corresponding backup data in the backup memory 13 can be quickly determined during data recovery, the backup software generates and stores the metadata of the backup data simultaneously during the aforementioned backup operation. The metadata is preferentially stored in the backup storage 13 in consideration of the backup management of data of the entire data storage system managed by the backup storage 13 as a whole.
As described above, the data storage method provided in this embodiment is applied to AN enterprise-level data storage system, and in order to ensure data transmission efficiency, the production storage server 11, the mirror image storage server 12, and the backup storage 13 communicate via AN SAN network, so as to avoid the problem that L AN network needs to pass through a TCP/IP stack, and occupies too much server CPU resources and memory resources.
In order to further reduce the consumption of CPU and memory resources when the mirror image storage Server 12 and the backup memory 13 are transmitted in the data backup process, the backup data is transmitted between the mirror image storage Server 12 and the backup memory 13 by adopting a Server-Free method; therefore, the mirror storage server 12 and the backup storage 13 should have corresponding control software installed thereon, and the backup server 14 performs data transmission control by using SCSI-3 expansion instructions or NDMP protocols, so as to implement data backup and data recovery between different servers.
In addition, in this embodiment, a Bitmap technology is used to establish the mapping between the data in the data change volume and the data in the mirror volume; of course, in other embodiments, other mapping methods may be used to implement the data association between the two.
Besides providing the foregoing data storage method, an embodiment of the present invention further provides a data storage system. Similar to the foregoing method, the data storage system includes a production storage server 11, a mirror storage server 12, and a backup storage; the mirror storage server 12 includes mirror volumes and data change volumes located in different underlying storage hardware.
When the data backup instruction is not received, the mirror storage server 12 receives the synchronous service data sent from the production storage server 11 and stores the synchronous service data in the mirror volume. When receiving a data backup instruction, the mirror storage server 12 stores the received synchronous service data in the data change volume, and establishes a mapping relationship between the data in the data change volume and the data in the mirror volume; meanwhile, the data in the mirror volume is sent to the backup memory 13 for backup.
After the data backup is completed, the mirror storage server 12 synchronizes the data in the data change volume to the mirror volume according to the mapping relationship, and directly stores the received synchronized service data to the mirror volume.
Further, the data storage system provided by the present embodiment further includes a metadata generation unit. The metadata generation unit is configured to generate and store metadata of the backup data while the data of the mirror volume is backed up to the backup memory 13. In this embodiment, the metadata generation unit may be disposed in the mirror storage server 12, or may be disposed in the backup storage 13; the formed metadata is stored within the backup server.
Corresponding to the foregoing method, in this embodiment: data are transmitted between the production storage server 11 and the mirror image storage server 12 and between the mirror image storage server 12 and the backup storage 13 through an SAN network; backup data is transmitted between the mirror image storage Server 12 and the backup storage 13 by adopting a Server-Free method; the mirror storage server 12 uses the BitMap technology to establish a mapping between the data change volume and the data in the mirror volume.
The data storage method and the data storage system in the embodiment of the present invention are described in detail above. The principle and the implementation manner of the present invention are explained in this section by using specific embodiments, and the above description of the embodiments is only used to help understanding the core idea of the present invention, and all other embodiments obtained by those skilled in the art without creative efforts will fall within the protection scope of the present invention without departing from the principle of the present invention.
Claims (10)
1. A data storage method is applied to a data storage system; the method is characterized in that:
the data storage system comprises a production storage server, a mirror image storage server and a backup storage;
the mirror image storage server comprises a mirror image volume and a data change volume which are positioned in different bottom layer storage hardware; the method comprises the following steps:
s101: judging whether a data backup instruction is received or not; if yes, executing S103; if not, executing S102;
s102: storing the data stored in the production storage server to the mirror volume in a mirror mode;
s103: backing up data stored in the mirror volume to the backup storage; storing the data stored in the production storage server to the data change volume, and establishing mapping between the data in the data change volume and the data in the mirror volume; executing S104;
s104: judging whether a data backup completion signal is received or not; if yes, executing S105; if not, continuing to execute S103;
s105: and synchronizing the data in the data change volume to the mirror volume according to the mapping.
2. The data storage method of claim 1, wherein:
and generating and storing metadata of backup data while backing up the data stored in the mirror volume to the backup storage.
3. The data storage method according to claim 1 or 2, wherein:
the production storage server and the mirror image storage server, and the mirror image storage server and the backup storage device transmit data through an SAN network.
4. The data storage method of claim 3, wherein:
and the mirror image storage Server and the backup memory transmit backup data by adopting a Server-Free method.
5. The data storage method according to claim 1 or 2, wherein:
and establishing the mapping of the data in the data change volume and the mirror volume by adopting a BitMap technology.
6. A data storage system, comprising: the system comprises a production storage server, a mirror image storage server and a backup storage;
the mirror image storage server comprises a mirror image volume and a data change volume which are positioned in different bottom layer storage hardware;
when a data backup instruction is not received, the mirror image storage server stores the data stored in the production storage server to the mirror image volume in a mirror image mode;
when a data backup instruction is received, the mirror image storage server stores the data stored in the production storage server into the data change volume, establishes mapping between the data in the data change volume and the data in the mirror image volume, backs up the data stored in the mirror image volume to the backup memory, and synchronizes the data in the data change volume to the mirror image volume according to the mapping after the backup is completed.
7. The data storage system of claim 6, further comprising:
and generating and storing metadata of the backup data while backing up the data in the mirror volume to the backup storage.
8. The data storage system of claim 6 or 7, wherein:
the production storage server and the mirror image storage server, and the mirror image storage server and the backup storage device transmit data through an SAN network.
9. The data storage system of claim 7, wherein:
and backup data is transmitted between the mirror image storage Server and the backup storage by adopting a Server-Free method.
10. The data storage system of claim 6 or 7, wherein:
and the mirror image storage server adopts a BitMap technology to establish the mapping between the data change volume and the data in the mirror image volume.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710681070.1A CN107590024B (en) | 2017-08-10 | 2017-08-10 | Data storage method and data storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710681070.1A CN107590024B (en) | 2017-08-10 | 2017-08-10 | Data storage method and data storage system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107590024A CN107590024A (en) | 2018-01-16 |
| CN107590024B true CN107590024B (en) | 2020-08-07 |
Family
ID=61042204
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710681070.1A Active CN107590024B (en) | 2017-08-10 | 2017-08-10 | Data storage method and data storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107590024B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113554335B (en) * | 2021-08-02 | 2022-05-10 | 南京邮电大学 | Production planning method based on big data |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102402562A (en) * | 2010-09-14 | 2012-04-04 | 中兴通讯股份有限公司 | Database remote disaster recovery method and system |
| CN103970585A (en) * | 2013-01-31 | 2014-08-06 | 杭州华三通信技术有限公司 | Method and device for creating virtual machine |
| CN104081329A (en) * | 2013-01-25 | 2014-10-01 | 株式会社东芝 | Backup storage system that backs up data, and backup storage device and method |
| CN106095622A (en) * | 2016-06-22 | 2016-11-09 | 上海爱数信息技术股份有限公司 | Data back up method and device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7174352B2 (en) * | 1993-06-03 | 2007-02-06 | Network Appliance, Inc. | File system image transfer |
-
2017
- 2017-08-10 CN CN201710681070.1A patent/CN107590024B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102402562A (en) * | 2010-09-14 | 2012-04-04 | 中兴通讯股份有限公司 | Database remote disaster recovery method and system |
| CN104081329A (en) * | 2013-01-25 | 2014-10-01 | 株式会社东芝 | Backup storage system that backs up data, and backup storage device and method |
| CN103970585A (en) * | 2013-01-31 | 2014-08-06 | 杭州华三通信技术有限公司 | Method and device for creating virtual machine |
| CN106095622A (en) * | 2016-06-22 | 2016-11-09 | 上海爱数信息技术股份有限公司 | Data back up method and device |
Non-Patent Citations (1)
| Title |
|---|
| "基于备份、复制和镜像的数据库高可用技术的研究";朱立谷;《计算机应用研究》;20020428(第04期);第41-43页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107590024A (en) | 2018-01-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP1204923B1 (en) | Remote data copy using a prospective suspend command | |
| JP4870816B2 (en) | Apparatus, system, and method for improved synchronous data mirror swap | |
| US7594137B2 (en) | Storage system and data restoration method thereof | |
| US8726066B1 (en) | Journal based replication with enhance failover | |
| US9135120B1 (en) | Consistency group moving | |
| US9965306B1 (en) | Snapshot replication | |
| US9037818B1 (en) | Active replication switch | |
| US8850144B1 (en) | Active replication switch | |
| US9658929B1 (en) | Asynchronous splitting | |
| US10185583B1 (en) | Leveraging snapshots | |
| US9659074B1 (en) | VFA statistics | |
| US9619255B1 (en) | Remote live motion | |
| US9619264B1 (en) | AntiAfinity | |
| US8074037B2 (en) | Storage service device with dual controller and backup method thereof | |
| JP2006338064A (en) | Disaster recovery method and system | |
| JP2009009333A (en) | Control method for asynchronous remote copy system and asynchronous remote copy system | |
| KR20110086690A (en) | Performing a data write on a storage device | |
| US7069400B2 (en) | Data processing system | |
| WO2017041616A1 (en) | Data reading and writing method and device, double active storage system and realization method thereof | |
| JP5466650B2 (en) | Apparatus and method for managing storage copy service system | |
| WO2024103594A1 (en) | Container disaster recovery method, system, apparatus and device, and computer-readable storage medium | |
| CN109739685B (en) | Master-slave hot backup data synchronization method and storage medium | |
| CN102622286B (en) | A kind of raid-array bitmap backup method and system | |
| CN111984474B (en) | Method, system and equipment for recovering double-control cluster fault | |
| CN105988901A (en) | Data copying method and storage system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |