CN112269690B - Data backup method and device - Google Patents
Data backup method and device Download PDFInfo
- Publication number
- CN112269690B CN112269690B CN202011291350.XA CN202011291350A CN112269690B CN 112269690 B CN112269690 B CN 112269690B CN 202011291350 A CN202011291350 A CN 202011291350A CN 112269690 B CN112269690 B CN 112269690B
- Authority
- CN
- China
- Prior art keywords
- data
- memory
- target data
- target
- backup
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 69
- 238000004891 communication Methods 0.000 claims abstract description 31
- 230000008569 process Effects 0.000 claims description 24
- 238000004590 computer program Methods 0.000 claims description 14
- 238000013500 data storage Methods 0.000 abstract description 6
- 238000012423 maintenance Methods 0.000 description 29
- 238000007726 management method Methods 0.000 description 12
- 238000012545 processing Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 9
- 238000003745 diagnosis Methods 0.000 description 8
- 230000004927 fusion Effects 0.000 description 7
- 238000012544 monitoring process Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 238000012986 modification Methods 0.000 description 5
- 230000008859 change Effects 0.000 description 4
- 238000010276 construction Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000013523 data management Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000036541 health Effects 0.000 description 3
- 238000007689 inspection Methods 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 239000000470 constituent Substances 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 238000011084 recovery Methods 0.000 description 2
- 239000002699 waste material Substances 0.000 description 2
- 230000004931 aggregating effect Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000012550 audit Methods 0.000 description 1
- 230000004888 barrier function Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000006378 damage Effects 0.000 description 1
- 238000007499 fusion processing Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000013439 planning Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000013515 script Methods 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
- G06F11/1464—Management of the backup or restore process for networked environments
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention provides a data backup method and device, wherein the method is applied to a proprietary cloud platform and comprises the following steps: firstly, establishing a communication link between a first memory and a second memory; the first memory and the second memory are connected with the same cloud server; then, when one or more target services selected by the user are determined, determining target data associated with the one or more target services in the first memory; dividing the target data into a plurality of data packets according to attribute information of the target data; then, transmitting the data packets to a second memory through a communication link so as to carry out full backup on target data; in addition, when the target data is updated, the updated target data is backed up to the second memory in an incremental mode. The cloud server data storage safety is improved, and the target data is backed up after being divided into a plurality of data packets, so that the integrity of the backed-up target data is ensured.
Description
Technical Field
The present invention relates to the field of data backup technologies, and in particular, to a data backup method and apparatus.
Background
Cloud platforms refer to services based on hardware resources and software resources, providing computing, networking, and storage capabilities. Cloud platforms can be divided into three classes: the system comprises a storage type cloud platform mainly used for data storage, a computing type cloud platform mainly used for data processing and a comprehensive type cloud platform taking both computing and storage processing into consideration.
The cloud platform responds to the demands of the user by distributing the data requests to the cloud server, so that corresponding services are provided for the user, and the cloud server stores data such as user data, log data and the like in a memory in the process of processing the data requests, but when the memory fails and the stored data is lost, the cloud server can not normally provide services for the user and further the user experience is affected.
Disclosure of Invention
In view of the foregoing, a method and apparatus, a server, a storage medium for providing a data backup that overcomes or at least partially solves the foregoing are provided, including:
A method of data backup applied to a proprietary cloud platform, the method comprising:
establishing a communication link between a first memory and a second memory; the first memory and the second memory are connected with the same cloud server;
determining one or more target services selected by a user, and determining target data associated with the one or more target services in the first memory;
dividing the target data into a plurality of data packets according to the attribute information of the target data;
transmitting the plurality of data packets to the second memory via the communication link to perform full back-up of the target data;
And when the target data is updated, the updated target data is backed up to the second memory in an incremental mode.
Optionally, when the target data is updated, the incremental backup of the updated target data to the second memory includes:
Determining difference data when the target data is updated;
and sending the difference data to the second memory to perform incremental backup on the updated target data to the second memory.
Optionally, the method further comprises: in the process of full backup, when backup interruption is detected, determining one or more target data packets which are not successfully backed up;
and sending the one or more target data packets to the second memory when the backup restoration is detected.
Optionally, the method further comprises: and when the first memory fails, setting the second memory as the main memory of the cloud server.
Optionally, the method further comprises: and after the full-scale backup is finished, carrying out integrity check on the target data.
Optionally, the target service is a service provided for a regional portal platform.
Optionally, the attribute information includes any one or more of the following:
Data type, data amount, data importance level.
An apparatus for data backup applied to a proprietary cloud platform, the apparatus comprising:
The link establishment module is used for establishing a communication link between the first memory and the second memory; the first memory and the second memory are connected with the same cloud server;
A target data determining module, configured to determine one or more target services selected by a user, and determine target data associated with the one or more target services in the first memory;
The data dividing module is used for dividing the target data into a plurality of data packets according to the attribute information of the target data;
the data sending module is used for sending the data packets to the second memory through the communication link so as to carry out full backup on the target data;
And the updating backup module is used for backing up the updated target data to the second memory in an incremental way when the target data is updated.
A server, a processor, a memory and a computer program stored on the memory and capable of running on the processor, which when executed by the processor implements a method of data backup as described above.
A computer readable storage medium having stored thereon a computer program which when executed by a processor implements a method of data backup as described above.
The embodiment of the invention has the following advantages:
In the embodiment of the invention, a communication link between a first memory and a second memory is established; the first memory and the second memory are connected with the same cloud server; then, when one or more target services selected by the user are determined, determining target data associated with the one or more target services in the first memory; dividing the target data into a plurality of data packets according to attribute information of the target data; then, transmitting the data packets to a second memory through a communication link so as to carry out full backup on target data; in addition, when the target data is updated, the updated target data is backed up to the second memory in an incremental mode. The cloud server data storage safety is improved, the target data is backed up after being divided into a plurality of data packets, the loss of the target data caused by interruption of the backup process is avoided, and the integrity of the backed up target data is ensured.
Drawings
In order to more clearly illustrate the technical solutions of the present invention, the drawings that are needed in the description of the present invention will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort to a person skilled in the art.
Fig. 1 is a schematic diagram of an overall architecture of a proprietary cloud platform according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a method for backing up data according to an embodiment of the present invention;
FIG. 3 is a flowchart illustrating steps of another method for data backup according to an embodiment of the present invention;
Fig. 4 is a schematic structural diagram of a data backup device according to an embodiment of the present invention.
Detailed Description
In order that the above-recited objects, features and advantages of the present invention will become more readily apparent, a more particular description of the invention will be rendered by reference to the appended drawings and appended detailed description. It will be apparent that the described embodiments are some, but not all, embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
And the proprietary cloud platform adopts the unified operation and maintenance service management platform to manage related resources in the proprietary cloud platform. The proprietary cloud platform takes calculation, network, storage and the like as basic constituent elements, and meanwhile, the constituent elements in the proprietary cloud platform can be selected and predefined according to system requirements. The proprietary cloud platform is actually based on the existing hardware module, combines with virtualization, software definition and a distributed architecture, and realizes modularized seamless transverse expansion by aggregating a plurality of sets of standardized general hardware through a network, so as to construct a cloud platform environment which is completely driven by software.
The operation and maintenance system in the proprietary cloud platform realizes operation and maintenance management of unified and automatic deployment, upgrading and changing, configuration management on physical equipment, an operating system, computation, a network, storage, a database, middleware, business application and the like in the cloud computing environment. Monitoring alarm and automatic analysis and diagnosis processing in the aspects of fault, performance, configuration and the like are provided, the running state and quality of the cloud platform are evaluated through analysis and processing, the continuous and stable running of cloud computing service application is ensured, service and support are provided for a service flow, and a perfect operation and maintenance service management platform is constructed.
The data center physical resource management in the proprietary cloud platform can be provided for a proprietary cloud platform planning tool and an automatic deployment operation and maintenance service, various resources of the proprietary cloud platform can be managed and scheduled in a centralized mode, physical computing resources, virtual computing resources, network resources and storage resources are covered, and various virtualization technologies can be adapted and managed. Through the unified operation and maintenance management interface, the special cloud platform can be comprehensively and efficiently managed and operated.
The proprietary cloud platform may also provide proprietary cloud platform operation/maintenance/diagnostic system services. The service relies on topology display, cloud platform resource aggregate topology display, network topology display, monitoring configuration, network health, health inspection of infrastructure, pre-inspection, fault pre-inspection and diagnosis; these services in turn rely on end state data, log data, and monitoring data. Meanwhile, the NTP (Network Time Protocol ) of the machine room also ensures that the time on each node is synchronous, so that the collected log and monitoring data can be effective data, and the effectiveness of operation, maintenance and diagnosis is ensured.
The operation and maintenance white screen in the proprietary cloud platform is except for the autonomous operation and maintenance portal (portal site) of the cloud product through the diagnostic system of the proprietary cloud platform, and the operation and maintenance need to be logged on the equipment nodes (physical servers, virtual machines, containers, network nodes and network equipment) under specific conditions. Meanwhile, in order to reduce operation errors caused by manual login of the service node, almost all operation tools, operation scripts and operation commands in operation and maintenance work are integrated in the proprietary cloud platform operation and maintenance/diagnosis system, and remote login and operation and maintenance operation can be performed on the target node in the operation and maintenance portal provided by the cloud platform operation and maintenance/diagnosis system.
In the proprietary cloud platform, the operation and maintenance files are used as storage of operation and maintenance data, and comprise terminal data, diagnosis prescriptions (fault solutions), log data, monitoring data and operation and maintenance flow data. As the data source for comparison between diagnosis basis and fault judgment, the more abundant the data, the higher the diagnosis accuracy, and the higher the accuracy of health pre-examination and trend judgment.
The operation and maintenance security is guaranteed from the perspective of three rights separation, a system administrator owns operation and maintenance operation rights of a platform, a security administrator owns rights of creation, change and destruction of operation and maintenance account numbers and roles, a security auditor owns audit rights of all operation and maintenance operation logs of a proprietary cloud platform, and the operation and maintenance rights are subdivided, so that each operation and maintenance person is guaranteed to be used for minimum applicable rights, and risks caused by overlarge rights are avoided. The product operation and maintenance management and control is converged in a proprietary cloud platform operation and maintenance system, and an SSO (SINGLE SIGN On ) system is accessed, so that the unified convergence of the product operation and maintenance management and control authority is ensured. And the system supports multiple double-factor services, verifies the account IP and the authority information when the operation and maintenance system logs in, and ensures the authentication safety of the proprietary cloud platform.
In the construction of smart cities, advanced technologies such as cloud computing, big data, internet of things, mobile interconnection and the like are introduced, a cross-domain multi-dimensional big data public service cloud platform with unified standards, unified inlets, unified acquisition, unified management, unified services and unified data is built, so that the cross-department, cross-domain and cross-domain data fusion capability is realized, the intra-domain data concentration, the external domain data sharing exchange and the domain boundary flexible expansion according to rules are realized, the ecological cycle of digital economy is formed, the data sharing in various fields of urban management, social folks, resource environments and economic industry is promoted, the administrative efficiency, the urban management capability and the resident life quality are promoted, the industry fusion development is promoted, and the industrial transformation upgrading and the innovative business mode is promoted.
By constructing a cross-domain multidimensional big data cloud platform, a data barrier can be broken, data concentration is realized, and the big data development difficulty is broken. Based on the cloud platform construction, the data center platform and the data sharing service system construction are further carried out aiming at the cloud platform.
Aiming at the construction of a data center (namely a unified data platform), a data resource platform, a data sharing platform and the like are introduced and matched with corresponding data specifications, so that a unified data management system for opening up business cooperation mechanisms and video areas of all levels, business systems of all levels and intelligent applications in all fields can be constructed, an open, interconnected and shared data sharing platform can be formed, and meanwhile, the system can be provided with data cloud, data management, data exploration, full-link monitoring and the like.
As shown in fig. 1, the proprietary cloud platform is deployed with an area application portal, an open service gateway, a unified data platform, an area internet of things sensing system and other structures, where the open service gateway includes a converged service sharing center and a converged data innovation center, and the following details of each part of the proprietary cloud platform are described:
Zone application portal
In the regional application portal, the regional application portal mainly comprises plates for traffic, environmental protection, travel, industry and commerce, medical treatment, education, regional economy, employment, cross-domain authentication and the like, and a user can enter each plate through the regional application portal and can acquire information corresponding to each plate formed by processed data.
(II) converged service sharing center and converged data innovation center
The converged service sharing center can merge the data of each region according to the service classification to create different data sharing centers, for example: personal information center, credit information center, legal information center, financial service center, travel service center, comprehensive treatment service center, space-time service center, internet of things service center, etc.
The fusion data innovation center can realize the innovation application of fusion data through a data fusion system and an AI algorithm system. The fusion service sharing center and the fusion data innovation center can be used for presenting the processed data to a user through the regional application portal after the data are subjected to fusion processing.
(III) unified data platform
The unified data platform can comprise a data resource platform and a data sharing platform, wherein the data resource platform can comprise a plurality of components, such as data cloud, intelligent data bins, intelligent tags, data exploration, AIMaster, data DNA, panoramic monitoring and data asset, so that services can be provided for upper-layer industry application and business scenes, the problems of data standardization, data quality and the like in the field of data management are solved, and interaction modes such as dragging and the like are adopted, so that the realization of business logic and business functions is simplified, and the usability of the data platform is improved.
(IV) regional Internet of things sensing system
The regional Internet of things sensing system is composed of related sensing equipment such as pressure, humidity, cameras, light sources, infrared sensing, temperature and the like and equipment data.
(V) other Structure
In addition, the data can be processed through a super computing cluster, a regional cloud computing platform and OpenStack FI Ware clusters (an open-source cloud computing management platform item is a combination of a series of software open-source items).
Referring to fig. 2, a flowchart illustrating steps of a method for data backup according to an embodiment of the present invention may be applied to a proprietary cloud platform, and may specifically include the following steps:
Step 201, establishing a communication link between a first memory and a second memory; the first memory and the second memory are connected with the same cloud server;
the cloud server may refer to a cloud server that provides a server to a user in a proprietary cloud platform.
In practical application, a plurality of cloud servers may be pre-deployed in a proprietary cloud platform, and different cloud servers may provide different services to users, for example: a cloud server providing computing services, a cloud server providing data storage services, a cloud server providing online backup services, a cloud server providing hosted services, a cloud server providing payment services, and the like.
After the cloud server is deployed, a memory corresponding to the cloud server can be continuously deployed in the proprietary cloud platform, and the memory can be used for storing application program data required by the cloud server, log data generated in a data request processing process, user data and the like. In the embodiment of the invention, in order to avoid the influence of the cloud server on providing services for users due to the data loss in the memory, the first memory and the second memory can be deployed in the proprietary cloud platform in advance, the first memory and the second memory can be connected with the same cloud server, the first memory can be directly used for storing the data of the cloud server, and the second memory can be used for backing up the data stored in the first memory.
After the first memory and the second memory are deployed, a communication link between the first memory and the second memory can be established, the communication link can be used for sending data to the second memory through the communication link after the data corresponding to the cloud server is stored in the first memory so as to backup the data, or after the data of the first memory is lost, the data in the second memory can be sent to the first memory through the link so as to restore the data.
Step 202, determining one or more target services selected by a user, and determining target data associated with the one or more target services in the first memory;
In an embodiment of the present invention, the target service is a service provided for a regional portal platform.
In practical applications, the proprietary cloud platform may provide services for regional application portals, for example: traffic, environmental protection, travel, business, medical, educational, regional economy, employment, cross-domain authentication, and the like. Therefore, when the server of the proprietary cloud platform is required to be used, a data request can be sent to the proprietary cloud platform first, so that the proprietary cloud platform can provide corresponding services for users in response to the data request.
Specifically, when a user needs to use a service in the proprietary cloud platform, one or more target services may be selected in the regional portal platform, for example: the data request aiming at the target service can be generated in the regional portal platform and then sent to the proprietary cloud platform, and the proprietary cloud platform can send the target service requested by the data request to the corresponding cloud server according to the target service requested by the data request after receiving the data request, so that the proprietary cloud platform can respond to the data request and provide the corresponding target service for a user.
In practical application, the cloud server may store the data included in the data request in the first memory on one hand, and may store the log data, the application data, and the like in the first memory for subsequent use in a process of processing the data request.
After storing the data in the first memory, the data in the first memory may be backed up to the second memory in order to avoid losing the data due to a failure of the first memory.
Specifically, after determining the one or more target services selected by the user, the target data associated with the one or more target services may be determined in the data stored in the first memory, and then backed up to the second memory according to the following steps 203 to 205.
Step 203, dividing the target data into a plurality of data packets according to the attribute information of the target data;
in an embodiment of the present invention, the attribute information includes any one or more of the following: data type, data amount, data importance level.
In practical application, in order to avoid the interruption of the backup process and the loss of the whole target data, the proprietary cloud platform may divide the target data into a plurality of data packets according to the attribute information of the target data, and then backup the plurality of data packets respectively.
As an example, the attribute information may refer to a data type, and then the proprietary cloud platform may divide the target data into a plurality of data packets according to the data type, for example: when the data type of the target data is the image type, the target data may be divided into a plurality of data packets according to the pixel points.
As another example, the attribute information may refer to the data amount, and then the proprietary cloud platform may divide the target data into a plurality of data packets according to the size of the data amount, for example: when the data size of the target data is large, the target data can be divided into a plurality of data packets with the same data block size according to the preset data block size.
As yet another example, the attribute information may refer to a data importance level, and then the proprietary cloud platform may divide the target data into a plurality of data packets according to the data importance level, for example: when the data importance level of the target data is higher, the target data can be divided into a larger number of data packets; when the importance levels of the target data meet, the target data may be divided into a smaller number of data packets.
Step 204, sending the plurality of data packets to the second memory through the communication link to perform full backup on the target data;
After dividing the target data into a plurality of data packets, the proprietary cloud platform can send the data packets from the first memory to the second memory for backup through a pre-established communication link between the first memory and the second memory.
Specifically, the plurality of data packets may be sent to the second memory in parallel for backup, or the plurality of data packets may be sent to the second memory in series for backup.
As an example, the full-scale backup may be performed on the target data first, where the full-scale backup may refer to one full-scale backup performed on all data, but the time required for the full-scale backup is longer, and the resources consumed in the backup process are larger, so that the full-scale backup may be used only when the target data is backed up for the first time, and after the target data is updated, the incremental backup may be performed on the target data according to the method of step 205.
In an embodiment of the present invention, the method may further include the following steps:
In the process of full backup, when backup interruption is detected, determining one or more target data packets which are not successfully backed up; and sending the one or more target data packets to the second memory when the backup restoration is detected.
In practical application, because the communication link may have problems of fluctuation, failure, etc., in order to ensure that all data packets of the target data can be completely backed up to the second memory in the full backup process, when the backup interruption is detected, one or more target data packets which are not backed up successfully may be determined first, and when the backup is restored, one or more target data packets which are not backed up successfully are backed up again.
Specifically, when the target data is divided into a plurality of data packets, a backup data packet list can be established, and after a certain data packet in the plurality of data packets is successfully backed up to the second memory, the data packet can be deleted from the backup data packet list, so that when the interruption of the process of full backup is detected, one or more target data packets which are not successfully backed up can be determined through the remaining data packets in the backup data packet list, so that the target data packets can be backed up later, the loss of the data packets caused by the interruption of the backup process is avoided, and the integrity of the backed up target data is improved.
As an example, after detecting the backup recovery, the one or more target data packets that are not backed up may be sent to the second memory again to continue the backup of the one or more target data packets that are not backed up.
In an embodiment of the present invention, the method may further include the following steps:
And after the full-scale backup is finished, carrying out integrity check on the target data.
In practical applications, the integrity of data may refer to the accuracy and reliability of data, which is proposed to prevent the existence of data that does not conform to the semantic rule in the memory and prevent invalid operations or error information caused by the input and output of error information, and the integrity of data may be divided into four types: entity integrity, domain integrity, reference integrity, user-defined integrity, and thus, to ensure the integrity of the target data, various means may be employed such as: foreign keys, constraints, rules, triggers, etc. to ensure the integrity of the target data.
As an example, the target data backed up in the second memory may also be compared with the target data in the first memory, so as to determine whether the target data backed up in the second memory is complete.
And step 205, when the target data is updated, backing up the updated target data to the second memory in an incremental mode.
In practical applications, the target data stored in the first memory may change due to addition or modification, so in order to ensure that the target data backed up in the second memory is consistent with the target data stored in the first memory, the target data in the second memory may be updated and backed up when the target data in the first memory is updated.
Specifically, the updated target data in the first memory may be fully backed up to the second memory again, but this method is only applicable when the data size of the target data is small, and when the data size of the target data is already large, if the updated target data is fully backed up, the resource waste in the backup process may be caused, and the backup time is too long, so only the target data of the updated portion may be incrementally backed up, and the incremental backup may refer to that after one full backup or the last incremental backup, only the data that is increased or modified in comparison with the previous backup needs to be backed up in each subsequent backup, and because only the data that is increased or modified is backed up, the data size of the data that is required to be backed up is not large and there is no repeated backup data, thereby reducing the backup time and reducing the resource waste in the backup process.
As an example, when the target data in the first memory is updated, it may be determined that the data of the updated portion occurs in the target data, and then the data of the updated portion is backed up to the second memory in an incremental manner.
In an embodiment of the present invention, the method may further include the following steps: and when the first memory fails, setting the second memory as the main memory of the cloud server.
In practical applications, if the first storage fails, the stored target data cannot be provided to the cloud server, which may further cause that the cloud server cannot normally provide services to the user, so in order to avoid the problem that the cloud server cannot provide the server due to the failure of the first storage, the second storage may be used as the main storage of the cloud server when the first storage fails.
Specifically, the first memory can be used as a main memory of the cloud server to provide target data for the cloud server in a normal use process, and the second memory can be used as a backup memory of the cloud server, so that on one hand, the first memory can be used for backing up the target data in the first memory, and on the other hand, when the first memory fails, the second memory can be used as the main memory of the cloud server because the second memory is backed up with the same target data as the first memory, so as to provide the target data for the cloud server, and further, the problem that the cloud server cannot work normally when the first memory fails and the experience of a user is affected is avoided.
In the embodiment of the invention, a communication link between a first memory and a second memory is established; the first memory and the second memory are connected with the same cloud server; then, when one or more target services selected by the user are determined, determining target data associated with the one or more target services in the first memory; dividing the target data into a plurality of data packets according to attribute information of the target data; then, transmitting the data packets to a second memory through a communication link so as to carry out full backup on target data; in addition, when the target data is updated, the updated target data is backed up to the second memory in an incremental mode. The cloud server data storage safety is improved, the target data is backed up after being divided into a plurality of data packets, the loss of the target data caused by interruption of the backup process is avoided, and the integrity of the backed up target data is ensured.
Referring to fig. 3, a flowchart illustrating steps of another method for data backup according to an embodiment of the present invention may be applied to a proprietary cloud platform, and may specifically include the following steps:
step 301, establishing a communication link between a first memory and a second memory;
In practical application, a plurality of cloud servers can be deployed in advance in a proprietary cloud platform, and different cloud servers can provide different services for users.
After the cloud server is deployed, a memory corresponding to the cloud server can be continuously deployed in the proprietary cloud platform, in order to avoid the influence on the cloud server to provide services for users due to the loss of data in the memory, a first memory and a second memory can be deployed in the proprietary cloud platform in advance, the first memory and the second memory can be connected with the same cloud server, the first memory can be directly used for storing the data of the cloud server, and the second memory can be used for backing up the data stored in the first memory.
After the first memory and the second memory are deployed, a communication link between the first memory and the second memory can be established, the communication link can be used for sending data to the second memory through the communication link after the data corresponding to the cloud server is stored in the first memory so as to backup the data, or after the data of the first memory is lost, the data in the second memory can be sent to the first memory through the link so as to restore the data.
Step 302, determining one or more target services selected by a user, and determining target data associated with the one or more target services in the first memory;
in practical application, the cloud server may store the data included in the data request in the first memory on one hand, and may store the log data, the application data, and the like in the first memory for subsequent use in a process of processing the data request.
After storing the data in the first memory, the data in the first memory may be backed up to the second memory in order to avoid losing the data due to a failure of the first memory.
Specifically, after determining the one or more target services selected by the user, the target data associated with the one or more target services may be determined in the data stored in the first memory, and then backed up to the second memory according to steps 303-306 as follows.
Step 303, dividing the target data into a plurality of data packets according to the attribute information of the target data;
In practical application, in order to avoid the interruption of the backup process and the loss of the whole target data, the proprietary cloud platform may divide the target data into a plurality of data packets according to the attribute information of the target data, and then backup the plurality of data packets respectively, where the attribute information may include any one or more of the following: data type, data amount, data importance level, etc.
Step 304, transmitting the plurality of data packets to the second memory through the communication link, so as to perform full backup on the target data;
After dividing the target data into a plurality of data packets, the proprietary cloud platform can send the data packets from the first memory to the second memory for backup through a pre-established communication link between the first memory and the second memory.
Specifically, the plurality of data packets may be sent to the second memory in parallel for backup, or the plurality of data packets may be sent to the second memory in series for backup.
Step 305, determining difference data when the target data is updated;
In practical applications, the target data stored in the first memory may change due to addition or modification, so in order to ensure that the target data backed up in the second memory is consistent with the target data stored in the first memory, the target data in the second memory may be updated and backed up when the target data in the first memory is updated.
Specifically, when it is determined that the target data is updated, the difference data may be determined first, where the difference data may refer to data that is stored in the first memory, has a change such as an increase or a modification, compared to the target data backed up in the second memory, and is used as the difference data.
And step 306, sending the difference data to the second memory to backup the updated target data to the second memory in an incremental manner.
After the difference data is determined, the proprietary cloud platform can send the difference data to the second memory for backup, so that the updated target data in the first memory is backed up to the second memory in an incremental mode.
In an embodiment of the present invention, the proprietary cloud platform may also forward the backed-up target data from the second memory to the first memory after the first memory loses the target data due to the failure, so as to recover the target data in the first memory.
It should be noted that, for simplicity of description, the method embodiments are shown as a series of acts, but it should be understood by those skilled in the art that the embodiments are not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred embodiments, and that the acts are not necessarily required by the embodiments of the invention.
Referring to fig. 4, a schematic structural diagram of a device for data backup according to an embodiment of the present invention is shown, where the device may be applied to a proprietary cloud platform, and may specifically include the following modules:
A link establishment module 401, configured to establish a communication link between the first memory and the second memory; the first memory and the second memory are connected with the same cloud server;
A target data determining module 402, configured to determine one or more target services selected by a user, and determine target data associated with the one or more target services in the first memory;
A data dividing module 403, configured to divide the target data into a plurality of data packets according to attribute information of the target data;
A data sending module 404, configured to send the plurality of data packets to the second memory through the communication link, so as to perform full-scale backup on the target data;
And the update backup module 405 is configured to, when the target data is updated, backup the updated target data to the second memory in an incremental manner.
In an embodiment of the present invention, the update backup module 405 includes:
the difference data determining submodule is used for determining difference data when the target data is updated;
And the incremental backup sub-module is used for sending the difference data to the second memory so as to backup the updated target data to the second memory in an incremental way.
In an embodiment of the invention, the apparatus further comprises:
The backup data packet determining module is used for determining one or more target data packets which are not backed up successfully when backup interruption is detected in the process of full backup;
and the backup module of the non-backup data packet is used for sending the one or more target data packets to the second memory when the backup recovery is detected.
In an embodiment of the invention, the apparatus further comprises:
And the fault setting module is used for setting the second memory as the main memory of the cloud server when the first memory fails.
In an embodiment of the invention, the apparatus further comprises:
And the integrity checking module is used for carrying out integrity checking on the target data after the full backup is completed.
In an embodiment of the present invention, the target service is a service provided for a regional portal platform.
In an embodiment of the present invention, the attribute information includes any one or more of the following:
Data type, data amount, data importance level.
In the embodiment of the invention, a communication link between a first memory and a second memory is established; the first memory and the second memory are connected with the same cloud server; then, when one or more target services selected by the user are determined, determining target data associated with the one or more target services in the first memory; dividing the target data into a plurality of data packets according to attribute information of the target data; then, transmitting the data packets to a second memory through a communication link so as to carry out full backup on target data; in addition, when the target data is updated, the updated target data is backed up to the second memory in an incremental mode. The cloud server data storage safety is improved, the target data is backed up after being divided into a plurality of data packets, the loss of the target data caused by interruption of the backup process is avoided, and the integrity of the backed up target data is ensured.
An embodiment of the present invention further provides a server, which may include a processor, a memory, and a computer program stored on the memory and capable of running on the processor, where the computer program is executed by the processor to implement a method for backing up data as described above.
An embodiment of the present invention further provides a computer readable storage medium, on which a computer program is stored, which when executed by a processor implements a method for backing up data as above.
For the device embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments for relevant points.
In this specification, each embodiment is described in a progressive manner, and each embodiment is mainly described by differences from other embodiments, and identical and similar parts between the embodiments are all enough to be referred to each other.
It will be apparent to those skilled in the art that embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the invention may take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal device, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiment and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or terminal device that comprises the element.
The foregoing has described in detail a method and apparatus for data backup, and specific examples have been presented herein to illustrate the principles and embodiments of the present invention, the above examples being provided only to assist in understanding the method and core ideas of the present invention; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in accordance with the ideas of the present invention, the present description should not be construed as limiting the present invention in view of the above.
Claims (10)
1. A method for backing up data, the method being applied to a proprietary cloud platform, the proprietary cloud platform having an area portal platform therein, the method comprising:
establishing a communication link between a first memory and a second memory; the first memory and the second memory are connected with the same cloud server;
determining one or more target services selected by a user in a regional portal platform, and determining target data associated with the one or more target services in the first memory;
Dividing the target data into a plurality of data packets according to the attribute information of the target data; wherein after dividing the target data into a plurality of data packets, further comprising:
establishing a backup data packet list to determine whether the target data is successfully backed up;
transmitting the plurality of data packets to the second memory via the communication link to perform full back-up of the target data;
And when the target data is updated, the updated target data is backed up to the second memory in an incremental mode.
2. The method of claim 1, wherein the incrementally backing up the updated target data to the second memory when the target data is updated comprises:
Determining difference data when the target data is updated;
and sending the difference data to the second memory to perform incremental backup on the updated target data to the second memory.
3. The method according to claim 1 or 2, further comprising:
in the process of full backup, when backup interruption is detected, determining one or more target data packets which are not successfully backed up;
and sending the one or more target data packets to the second memory when the backup restoration is detected.
4. A method according to claim 3, further comprising:
and when the first memory fails, setting the second memory as the main memory of the cloud server.
5. The method as recited in claim 1, further comprising:
And after the full-scale backup is finished, carrying out integrity check on the target data.
6. The method of claim 1, wherein the target service is a service provided for a regional portal platform.
7. The method of claim 1, wherein the attribute information comprises any one or more of:
Data type, data amount, data importance level.
8. A device for backing up data, the device being applied to a proprietary cloud platform, the proprietary cloud platform having an area portal platform therein, the device comprising:
The link establishment module is used for establishing a communication link between the first memory and the second memory; the first memory and the second memory are connected with the same cloud server;
The target data determining module is used for determining one or more target services selected by a user in the regional portal platform and determining target data associated with the one or more target services in the first memory;
the data dividing module is used for dividing the target data into a plurality of data packets according to the attribute information of the target data; wherein after dividing the target data into a plurality of data packets, further comprising: establishing a backup data packet list to determine whether the target data is successfully backed up;
the data sending module is used for sending the data packets to the second memory through the communication link so as to carry out full backup on the target data;
And the updating backup module is used for backing up the updated target data to the second memory in an incremental way when the target data is updated.
9. A server comprising a processor, a memory and a computer program stored on the memory and capable of running on the processor, which when executed by the processor implements a method of data backup as claimed in any one of claims 1 to 7.
10. A computer readable storage medium, wherein a computer program is stored on the computer readable storage medium, which when executed by a processor, implements a method of data backup according to any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011291350.XA CN112269690B (en) | 2020-11-17 | 2020-11-17 | Data backup method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011291350.XA CN112269690B (en) | 2020-11-17 | 2020-11-17 | Data backup method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112269690A CN112269690A (en) | 2021-01-26 |
| CN112269690B true CN112269690B (en) | 2024-05-24 |
Family
ID=74339246
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011291350.XA Active CN112269690B (en) | 2020-11-17 | 2020-11-17 | Data backup method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112269690B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113590883A (en) * | 2021-08-10 | 2021-11-02 | 上海杉互健康科技有限公司 | Method, system, device and storage medium for mapping medical information and database |
| CN115941421B (en) * | 2023-02-21 | 2023-05-12 | 国家海洋技术中心 | Data screening method, system, equipment and medium for double-backup observation data center |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102546242A (en) * | 2011-12-23 | 2012-07-04 | 广东步步高电子工业有限公司 | Cloud server based data backup and system recovery method and system utilizing same |
| CN103226483A (en) * | 2013-03-25 | 2013-07-31 | 成都瑞科电气有限公司 | DHBS (dual hot-backup system) and method thereof based on SOA (service-oriented architecture) and cloud storage |
| CN103345435A (en) * | 2013-06-28 | 2013-10-09 | 环境保护部华南环境科学研究所 | Data backup and restoration method and destination sever system for backup |
| CN106648976A (en) * | 2016-11-26 | 2017-05-10 | 广东欧珀移动通信有限公司 | Data back-up method and device |
| CN107113324A (en) * | 2015-11-28 | 2017-08-29 | 华为技术有限公司 | Data backup device and method, system |
| CN108897638A (en) * | 2018-05-31 | 2018-11-27 | 康键信息技术（深圳）有限公司 | Data back up method, device, computer equipment and storage medium |
| CN108958967A (en) * | 2017-05-17 | 2018-12-07 | 腾讯科技（深圳）有限公司 | A kind of method and server of data processing |
| CN109271283A (en) * | 2018-09-06 | 2019-01-25 | 北京云测信息技术有限公司 | A kind of data back up method based on block chain |
| CN109597717A (en) * | 2018-12-07 | 2019-04-09 | 北京金山云网络技术有限公司 | A kind of data backup, restoration methods, device, electronic equipment and storage medium |
| CN109815057A (en) * | 2019-01-25 | 2019-05-28 | 维沃移动通信有限公司 | A kind of data back up method and mobile terminal |
| CN110515770A (en) * | 2019-08-16 | 2019-11-29 | 苏州浪潮智能科技有限公司 | A kind of cloud backup method of data, device, equipment and storage medium |
| CN111198784A (en) * | 2018-11-16 | 2020-05-26 | 杭州海康威视系统技术有限公司 | Data storage method and device |
| CN111737043A (en) * | 2019-03-25 | 2020-10-02 | 阿里巴巴集团控股有限公司 | Database disaster tolerance method, device, server and storage medium |
-
2020
- 2020-11-17 CN CN202011291350.XA patent/CN112269690B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102546242A (en) * | 2011-12-23 | 2012-07-04 | 广东步步高电子工业有限公司 | Cloud server based data backup and system recovery method and system utilizing same |
| CN103226483A (en) * | 2013-03-25 | 2013-07-31 | 成都瑞科电气有限公司 | DHBS (dual hot-backup system) and method thereof based on SOA (service-oriented architecture) and cloud storage |
| CN103345435A (en) * | 2013-06-28 | 2013-10-09 | 环境保护部华南环境科学研究所 | Data backup and restoration method and destination sever system for backup |
| CN107113324A (en) * | 2015-11-28 | 2017-08-29 | 华为技术有限公司 | Data backup device and method, system |
| CN106648976A (en) * | 2016-11-26 | 2017-05-10 | 广东欧珀移动通信有限公司 | Data back-up method and device |
| CN108958967A (en) * | 2017-05-17 | 2018-12-07 | 腾讯科技（深圳）有限公司 | A kind of method and server of data processing |
| CN108897638A (en) * | 2018-05-31 | 2018-11-27 | 康键信息技术（深圳）有限公司 | Data back up method, device, computer equipment and storage medium |
| CN109271283A (en) * | 2018-09-06 | 2019-01-25 | 北京云测信息技术有限公司 | A kind of data back up method based on block chain |
| CN111198784A (en) * | 2018-11-16 | 2020-05-26 | 杭州海康威视系统技术有限公司 | Data storage method and device |
| CN109597717A (en) * | 2018-12-07 | 2019-04-09 | 北京金山云网络技术有限公司 | A kind of data backup, restoration methods, device, electronic equipment and storage medium |
| CN109815057A (en) * | 2019-01-25 | 2019-05-28 | 维沃移动通信有限公司 | A kind of data back up method and mobile terminal |
| CN111737043A (en) * | 2019-03-25 | 2020-10-02 | 阿里巴巴集团控股有限公司 | Database disaster tolerance method, device, server and storage medium |
| CN110515770A (en) * | 2019-08-16 | 2019-11-29 | 苏州浪潮智能科技有限公司 | A kind of cloud backup method of data, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112269690A (en) | 2021-01-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104734878B (en) | The method and system of software definition networking disaster recovery | |
| CN112600891B (en) | Information physical fusion-based edge cloud cooperative system and working method | |
| CN109361532B (en) | High availability system and method for network data analysis and computer readable storage medium | |
| Kamburugamuve et al. | Survey of distributed stream processing for large stream sources | |
| TWI704788B (en) | Physical security system having multiple server nodes configured to implement a conditionally triggered rule | |
| KR102013004B1 (en) | Dynamic load balancing in a scalable environment | |
| JP5102901B2 (en) | Method and system for maintaining data integrity between multiple data servers across a data center | |
| CN101652999B (en) | System and method for managing live video data | |
| US7757116B2 (en) | Method and system for coordinated multiple cluster failover | |
| CN106603281A (en) | Configuration file management method and system | |
| CN204859222U (en) | With two high available systems that live of city data center | |
| CN108809972A (en) | A kind of Internet of Things Comprehensive Experiment and application development platform and framework based on the ecosystem of increasing income | |
| US10129373B2 (en) | Recovery of a network infrastructure to facilitate business continuity | |
| CN112269690B (en) | Data backup method and device | |
| Fu et al. | Real-time data infrastructure at uber | |
| CN105843182A (en) | Power dispatching accident handling scheme preparing system and power dispatching accident handling scheme preparing method based on OMS | |
| CN112291264B (en) | Security control method, device, server and storage medium | |
| CN101777020A (en) | Fault tolerance method and system used for distributed program | |
| CN105074660B (en) | Dispose data path correlation plug-in unit | |
| CN112256498A (en) | Fault processing method and device | |
| CN110971464A (en) | Operation and maintenance automatic system suitable for disaster recovery center | |
| CN112383632A (en) | Load balancing method and device | |
| CN115812298A (en) | Block chain management of supply failure | |
| CN110532312A (en) | A kind of industry interconnection cloud platform system based on big data | |
| CN112256490A (en) | Data processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |