CN117354321A

CN117354321A - Service data mirroring method and device, storage medium and electronic device

Info

Publication number: CN117354321A
Application number: CN202210753842.9A
Authority: CN
Inventors: 柳丹
Original assignee: ZTE Corp
Current assignee: ZTE Corp
Priority date: 2022-06-29
Filing date: 2022-06-29
Publication date: 2024-01-05

Abstract

The application discloses a method and a device for mirroring service data, a storage medium and an electronic device, wherein the method comprises the steps of obtaining a target mirroring request, wherein the target mirroring request is used for requesting to mirror the service data on target equipment; responding to the target mirror image request, and determining a service to be mirrored in a group of services according to a service registration information list of the group of services, wherein the service registration information list is used for indicating whether each service in the group of services allows service data mirroring or not; the service data of the service to be mirrored is mirrored to obtain a data mirroring result of the service data of the service to be mirrored, and the technical problem that the mirroring method of the service data in the related technology has long time consumption of data mirroring caused by large data volume of the service data to be mirrored is solved.

Description

Service data mirroring method and device, storage medium and electronic device

Technical Field

The present invention relates to the field of communications, and in particular, to a method and apparatus for mirroring service data, a storage medium, and an electronic apparatus.

Background

In the related art, in the process of mirror image processing on the current network data, a full-table export technology is generally adopted, that is, all service configuration data (i.e., the current network data) of the network device is exported in a whole, and planning simulation is performed on part of services after storage is completed.

However, in the process of performing planning simulation, future development evaluation (a form of planning simulation) is generally performed only for one or more services, so that other unused data are synchronously exported, which results in waste of database resources, and when the scale of the network node is large, the overall exporting speed of all service configuration data of the network device is slow, and the performance is low.

Therefore, the mirroring method of the service data in the related art has the technical problem that the time consumption of data mirroring is long due to the large data volume of the service data required to be mirrored.

Disclosure of Invention

The embodiment of the application provides a service data mirroring method and device, a storage medium and an electronic device, which at least solve the technical problem that the data mirroring time is long because the data volume of the service data to be mirrored is large in the service data mirroring method in the related technology.

According to an aspect of an embodiment of the present application, there is provided a method for mirroring service data, including: obtaining a target mirror image request, wherein the target mirror image request is used for requesting mirror image processing of service data on target equipment; responding to the target mirror image request, and determining a service to be mirrored in a group of services according to a service registration information list of the group of services, wherein the service registration information list is used for indicating whether each service in the group of services allows service data mirroring or not; and carrying out mirror image processing on the service data of the service to be mirrored to obtain a data mirror image result of the service data of the service to be mirrored.

According to another aspect of the embodiments of the present application, there is also provided a mirroring apparatus for service data, including: the system comprises an acquisition unit, a target mirror image request and a processing unit, wherein the acquisition unit is used for acquiring a target mirror image request, and the target mirror image request is used for requesting mirror image processing of service data on target equipment; a determining unit, configured to determine, in response to the target mirroring request, a service to be mirrored in a set of services according to a service registration information list of the set of services, where the service registration information list is configured to indicate whether each service in the set of services allows for service data mirroring; the mirror image unit is used for carrying out mirror image processing on the service data of the service to be mirrored to obtain a data mirror image result of the service data of the service to be mirrored.

In an exemplary embodiment, the mirroring unit includes: the starting module is used for starting a plurality of mirror subtasks corresponding to the target businesses one by one under the condition that the business to be mirrored comprises the target businesses; the first mirror image module is used for carrying out mirror image processing on the service data of the target service corresponding to each mirror image subtask through each mirror image subtask in the mirror image subtasks to obtain a data mirror image result of the service data of the target services.

In an exemplary embodiment, the apparatus further comprises: the first sending unit is used for sending a mirror image starting notification message to the service module of the service to be mirrored by calling a starting interface of the service module of the service to be mirrored before the service data of the service to be mirrored is mirrored to obtain a data mirroring result of the service data of the service to be mirrored; the mirror unit includes: the second mirror image module is used for responding to the received notification message returned by the service module of the service to be mirrored and permitting to start mirror image, and carrying out mirror image processing on the service data of the service to be mirrored to obtain a data mirror image result of the service data of the service to be mirrored.

In an exemplary embodiment, the apparatus further comprises: the receiving unit is used for receiving a notification message of waiting for opening the mirror image returned by the service module of the service to be mirrored after the service module of the service to be mirrored is sent with a mirror image starting notification message by calling a starting interface of the service module of the service to be mirrored, wherein the notification message of waiting for opening the mirror image carries waiting time; the mirror unit includes: and the third mirroring module is used for mirroring the service data of the service to be mirrored in response to the notification message which is received in the waiting time and returned by the service module of the service to be mirrored and is used for permitting to start mirroring, so as to obtain a data mirroring result of the service data of the service to be mirrored.

In an exemplary embodiment, the apparatus further comprises: the second sending unit is configured to send a notification message of completion of mirroring to the service module of the service to be mirrored after the service data of the service to be mirrored is mirrored to obtain a data mirroring result of the service data of the service to be mirrored, where the notification message of completion of mirroring is used to instruct the service module of the service to be mirrored to allow other service operations to be executed.

In an exemplary embodiment, the mirroring unit includes: the first generation module is used for generating a first temporary database; the determining module is used for determining a data mirror image mode of the service data of the service to be mirrored to obtain a target mirror image mode; the acquisition module is used for acquiring the service data of the service to be mirrored from a target data table according to the target mirroring mode, wherein the target data table is a data table which is used for storing the service data of the service to be mirrored in a service database corresponding to the service to be mirrored; the first importing module is used for importing the service data of the service to be mirrored into the first temporary database; and the first transfer module is used for transferring the first temporary database into an image file to obtain the data image result.

In one exemplary embodiment, the acquisition module includes: the first execution sub-module is used for acquiring a target table structure script dumped by a table structure of the target data table and a target table data script dumped by service data of the service to be mirrored by accessing a service database corresponding to the service to be mirrored under the condition that the target mirroring mode is a first mirroring mode; the first import module includes: and the second execution sub-module is used for recovering the target table structure script into a first temporary table in the first temporary database and recovering the target table data script into table data in the first temporary table.

In one exemplary embodiment, the acquisition module includes: the third execution sub-module is used for executing a database generation language corresponding to the service module of the service to be mirrored to obtain a reconstructed target table structure under the condition that the target mirror mode is a second mirror mode; a calling sub-module, configured to call a data export interface of the service module of the service to be mirrored to obtain a target data packet in a preset format, where the target data packet carries service data of the service to be mirrored; the first import module includes: and the fourth execution sub-module is used for analyzing the target data message to obtain the service data of the service to be mirrored, and importing the service data of the service to be mirrored into the first temporary database according to the target table structure.

In an exemplary embodiment, the mirroring unit includes: the second generation module is used for generating a second temporary database; the searching module is used for searching a target data table and a target history table by accessing a service database corresponding to the service to be mirrored when the target mirroring request is used for requesting to mirror the service data before the target history moment, wherein the target data table is a data table for storing the service data of the service to be mirrored, and the target history table is a data table for storing data operation records executed on the target data table according to time sequence; the execution module is used for mirroring the target data table into a second temporary table and inquiring data operation records of which the operation time is positioned after the target history time in the target history table to obtain a group of data operation records; the rollback module is used for reversely rolling back the business data in the second temporary table to the target historical moment according to the sequence from the near to the far of the operation time and the group of data operation records to obtain a third temporary table; a second import module, configured to import data in the third temporary table into the second temporary database; and the second dumping module is used for dumping the second temporary database into an image file to obtain the data image result.

In an exemplary embodiment, the apparatus further comprises: and the registration unit is used for calling a service registration interface through the service module of the service to be mirrored to execute registration operation on the service to be mirrored to obtain service registration information of the service to be mirrored.

In an exemplary embodiment, the apparatus further comprises: and the anti-registration unit is used for executing anti-registration operation on the service to be mirrored through the service module call service anti-registration interface of the service to be mirrored after executing registration operation on the service to be mirrored through the service module call service registration interface of the service to be mirrored so as to delete the service registration information of the service to be mirrored.

In an exemplary embodiment, the apparatus further comprises: and the disabling unit is used for performing disabling operation on the service to be mirrored through the service module calling disabling interface of the service to be mirrored after the service registration interface is called by the service module to be mirrored to perform registration operation on the service to be mirrored, so as to prohibit service data mirroring on the service module of the service to be mirrored.

According to yet another aspect of the embodiments of the present application, there is also provided a computer readable storage medium having a computer program stored therein, wherein the computer program is configured to perform the mirroring method of service data as described above when run.

According to still another aspect of the embodiments of the present application, there is further provided an electronic device including a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor executes the mirroring method of service data described above through the computer program.

In the embodiment of the application, a mode of determining a service to be subjected to data mirroring based on service registration information is adopted, and a target mirroring request is obtained, wherein the target mirroring request is used for requesting to mirror service data on target equipment; responding to the target mirror image request, and determining a service to be mirrored in a group of services according to a service registration information list of the group of services, wherein the service registration information list is used for indicating whether each service in the group of services allows service data mirroring or not; the method comprises the steps of carrying out mirror image processing on service data of a service to be mirrored to obtain a data mirror image result of the service data of the service to be mirrored, determining the service to be mirrored of the service data based on service registration information after receiving a mirror image request for mirror image processing of the service data, and carrying out data mirror image on the service data of the service to be mirrored only instead of mirror image on all the service data in target equipment, so that the purpose of reducing the data volume of the service data required to be mirrored can be achieved, the technical effects of reducing the time consumption of the data mirror image and improving the data mirror image efficiency are achieved, and the technical problem of long time consumption of the data mirror image caused by large data volume of the service data required to be mirrored in a mirror image method of the service data in the related art is solved.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required to be used in the description of the embodiments or the prior art will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.

FIG. 1 is a schematic diagram of a hardware environment of an alternative method of mirroring business data according to an embodiment of the present application;

FIG. 2 is a flow diagram of an alternative method of mirroring business data according to an embodiment of the present application;

FIG. 3 is a block diagram of an alternative data mirroring process according to an embodiment of the present application;

FIG. 4 is a flow chart of an alternative data export according to an embodiment of the present application;

FIG. 5 is a flow chart of another alternative data export according to an embodiment of the present application;

FIG. 6 is an exemplary diagram of an alternative Free mode Json message according to an embodiment of the present application

FIG. 7 is a diagram of an alternative source table versus history table according to an embodiment of the present application;

FIG. 8 is a flow chart of an alternative method of mirroring business data according to an embodiment of the present application;

FIG. 9 is a flow chart of another alternative method of mirroring business data according to an embodiment of the present application;

FIG. 10 is a block diagram of an alternative business data mirroring apparatus according to an embodiment of the present application;

fig. 11 is a block diagram of an alternative electronic device according to an embodiment of the present application.

Detailed Description

In order to make the present application solution better understood by those skilled in the art, the following description will be made in detail and with reference to the accompanying drawings in the embodiments of the present application, it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, shall fall within the scope of the present application.

It should be noted that the terms "first," "second," and the like in the description and claims of the present application and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that embodiments of the present application described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

According to one aspect of the embodiments of the present application, a method for mirroring service data is provided. Alternatively, in the present embodiment, the mirroring method of service data described above may be applied to a hardware environment formed by the terminal 102 and the server 104 as shown in fig. 1. As shown in fig. 1, the server 104 is connected to the terminal 102 through a network, and may be used to provide services (such as application services, etc.) to the terminal or to clients installed on the terminal, and a database may be provided on the server or independent of the server, for providing data storage services to the server 104.

The network may include, but is not limited to, at least one of: wired network, wireless network. The wired network may include, but is not limited to, at least one of: a wide area network, a metropolitan area network, a local area network, and the wireless network may include, but is not limited to, at least one of: WIFI (Wireless Fidelity ), bluetooth. The terminal 102 may be, but is not limited to, a terminal device such as a smart phone, a smart tablet, and a smart computer.

The mirroring method of the service data in the embodiment of the present application may be performed by the server 104, may be performed by the terminal 102, or may be performed by both the server 104 and the terminal 102. Taking the server 104 as an example to perform the method for mirroring service data in this embodiment, fig. 2 is a schematic flow chart of an alternative method for mirroring service data according to an embodiment of the present application, as shown in fig. 2, the flow of the method may include the following steps:

Step S202, a target mirror image request is obtained, wherein the target mirror image request is used for requesting mirror image processing of service data on target equipment.

The method for mirroring service Data in this embodiment may be applied to a scenario in which Data Mirror (Data Mirror refers to copy and dump of Data) is performed on service Data on a network device, and may be applied to any network system that needs Data mirroring processing, where the network device may be an internet or a device in the internet of things, and the scenario in which Data Mirror is performed may be a Data simulation in the field of network planning, or may be other scenarios in which Data Mirror is performed on service Data on a network device, where this embodiment is not limited. In some examples of the present embodiment, a network layout is described as an example.

At present, when a network planning tool performs mirror image processing on current network data, a full-table export technology is generally adopted: and (3) integrally exporting all service configuration data of the network equipment, and carrying out planning simulation on part of services after the storage is completed. The mirror image mode of the service data has the following defects: the network planning generally carries out future development evaluation aiming at one or more services, and the export of other service configuration data carries a large amount of irrelevant data, so that the waste of database resources is caused; when the network node scale is larger, the whole export speed of the current network data is low, the performance is low, and the instantaneity cannot be ensured.

In order to at least partially solve the above problems, the service data may be mirrored according to the service registration information, that is, only the service registration information is indicated to allow the service that performs the data mirroring, instead of performing the data mirroring for all services, so as to achieve the purpose of reducing the data amount of the required mirroring, reduce the waste of database resources, increase the data export speed, further improve the data export performance, and ensure the instantaneity of the data export.

In this embodiment, for a target device (which may be a network device), the server may obtain a target image request, where the target image request is used to request to image service data on the target device. Alternatively, the target image request may be an image request generated according to a detected trigger operation after the target device or other device detects the trigger operation of the target object. For example, a target object (representing a target user) may generate a create mirror request (i.e., a target mirror request) by triggering a create live data mirror operation, and may specify a mirror name and description in the process of generating the create mirror request. In this case, the target image request carries the image name and the image description information of the image to be generated.

If there is a mirror image entry which is the same as the mirror image name in the mirror image warehouse (i.e. the warehouse for storing the mirror image business data), the indication information of the failure of the creation of the mirror image is returned to the target object, and the subsequent steps are terminated, otherwise, the mirror image information of the mirror image ID (Identity document, identity identifier), the mirror image name, the mirror image description, the creator, the creation time and the mirror image type waiting to generate the mirror image is stored in the mirror image information master table, wherein the mirror image ID can be a character string which is randomly generated, and the mirror image IDs of different mirror image files are different.

Optionally, the service data on the target device may be current network data of a current network service on the target device, and in a process of executing the current network service of the target device, the service data corresponding to the current network service may be recorded. The target object may be an object that establishes a connection relationship with the target device, for example, may be an object having a data mirroring authority to mirror data of service data on the target device, which is not limited in this embodiment.

Step S204, responding to the target mirror image request, determining the service to be mirror image in a group of service according to a service registration information list of the group of service, wherein the service registration information list is used for indicating whether each service in the group of service allows the service data mirror image.

In this embodiment, after the target mirror image request is obtained, the service to be mirrored in the set of services may be determined according to the service registration (Business Register, which refers to service module information registration that needs to be mirrored) information list of the set of services in response to the target mirror image request. The service registration information list is used for indicating whether each service in a group of services allows the service data mirroring, and may contain a plurality of service registration information, and each service registration information is used for indicating whether the corresponding service allows the service data mirroring.

For example, the service registration information list contains service registration information of each of the services A, B, C, D on the network device, and based on the service registration information, it is determined that the service a and the service C are services for which the service data mirroring is permitted (for example, whether the data mirroring operation information is enabled to be yes), and the service B and the service D are services for which the service data mirroring is not permitted (for example, whether the data mirroring operation information is enabled to be no), the service a and the service C may be determined as services to be mirrored.

Optionally, the service registration information may include at least one of: micro service information, mirror service list, mirror mode (supporting Direct mode and Free mode), database table name or creating table script. Before determining the service to be mirrored in the set of services according to the service registration information list of the set of services, each service in the set of services may be registered and the service registration information of each service may be sent to the server,

Optionally, the determining the service to be mirrored in the set of services according to the service registration information list of the set of services may be: determining the enabling state of the data mirroring operation of each service according to the service registration information of each service in the service registration information list and the group of services; and determining the service to be mirrored in the group of services according to the enabling state of the data mirroring operation of each service.

Step S206, mirror processing is carried out on the service data of the service to be mirrored to obtain a data mirror result of the service data of the service to be mirrored.

In this embodiment, after determining the service to be mirrored in the set of service data, the service data of the service to be mirrored may be mirrored, so as to obtain a data mirroring result of the service data of the service to be mirrored. Optionally, the process of mirroring the service data of the service to be mirrored to obtain the data mirroring result of the service data of the service to be mirrored may be: when the service to be mirrored is a plurality of services, mirroring operation is carried out on each service in the plurality of services to be mirrored simultaneously, and mirroring results of the plurality of services to be mirrored are obtained; or, mirror image operation is sequentially performed on each service to be mirrored in the multiple services to be mirrored, so as to obtain mirror image results of the multiple services to be mirrored, which is not limited in this embodiment.

After obtaining the service result of the service to be mirrored, the service result may be sent to the target object. Optionally, when the service result of the service to be mirrored shows that the service to be mirrored fails, the service to be mirrored may be subjected to data mirroring again until the service result of the service to be mirrored shows that the service to be mirrored is successful, or the target object may be directly notified that the service to be mirrored fails.

Optionally, before the service data of the service to be mirrored is mirrored to obtain a data mirroring result of the service data of the service to be mirrored, a time corresponding to the service data of the service to be mirrored may be determined, where the service data of the service to be mirrored may be service data of the service to be mirrored before a current time, that is, a real-time Mirror (may refer to a service data Mirror of an existing network environment) of the service to be mirrored, or may be service data of the service to be mirrored before a certain historical time, that is, a History Mirror of the data (may refer to a service data Mirror of a certain historical time), or may be service data of other times.

Optionally, in the process of performing mirror image processing on the service data of the service to be mirrored to obtain a data mirror image result of the service data of the service to be mirrored, a mirror image mode of performing data mirror image on the service data of the service to be mirrored can be determined first, and then the mirror image processing is performed on the service data of the service to be mirrored by adopting a mirror image mode corresponding to the mirror image mode to obtain the data mirror image result of the service data of the service to be mirrored. For example, when the mirror mode corresponding to the service data of the service to be mirrored is a Direct mode (Direct mode), the mirror mode corresponding to the Direct mode may be adopted to mirror the service data of the service to be mirrored; or when the mirroring mode corresponding to the service data of the service to be mirrored is a Free mode (Free mode), the mirroring mode corresponding to the Free mode may be adopted to mirror the service data of the service to be mirrored.

202-206, obtaining a target mirror image request, wherein the target mirror image request is used for requesting mirror image processing of service data on target equipment; responding to the target mirror image request, and determining a service to be mirrored in a group of services according to a service registration information list of the group of services, wherein the service registration information list is used for indicating whether each service in the group of services allows service data mirroring or not; the service data of the service to be mirrored is mirrored to obtain a data mirroring result of the service data of the service to be mirrored, so that the technical problem of long time consumption of data mirroring caused by large data volume of the service data required to be mirrored in the mirroring method of the service data in the related art is solved, the time consumption of the data mirroring is reduced, and the efficiency of the data mirroring is improved.

In an exemplary embodiment, mirroring service data of a service to be mirrored to obtain a data mirroring result of the service data of the service to be mirrored includes:

s11, under the condition that the service to be mirrored comprises a plurality of target services, starting a plurality of mirror subtasks corresponding to the plurality of target services one by one;

s12, carrying out mirror image processing on service data of the target service corresponding to each mirror image subtask through each mirror image subtask in the mirror image subtasks to obtain a data mirror image result of the service data of the target services.

In this embodiment, after determining the service to be mirrored from a set of services, the service data of the service to be mirrored may be mirrored, so as to obtain a data mirroring result of the service data of the service to be mirrored. Optionally, in the case that the service to be mirrored includes a plurality of target services, in order to improve the efficiency of data mirroring, a plurality of mirror subtasks corresponding to the plurality of target services one to one may be started, and the service data of the target service corresponding to each mirror subtask is mirrored through each mirror subtask in the plurality of mirror subtasks, so as to obtain a data mirroring result of the service data of the plurality of target services.

Alternatively, the process of starting a plurality of mirror subtasks corresponding to a plurality of target services one to one may be: registration information of a service to be mirrored (i.e., the service registration information) is input to a mirror generator so as to start a creation task, and then the mirror generator starts a plurality of mirror subtasks corresponding to a plurality of target services one by one according to the received registration information and other parameter entering information.

It should be noted that, for the frame diagram of the data mirroring process shown in fig. 3, the mirror generator supports to start the mirror creation task, push the progress information of mirror creation to the service module, and access the service database to obtain the source data; the service module is used for service life cycle management, and comprises: operations such as creation, modification, deletion, start, stop, pause, resume, query, etc. may be performed through a front-end interface, or may be performed through an API (Application Programming Interface ) interface call, and data changes caused by these operations may be stored in a service database. At the same time, the service module can also indicate to the data image processing module which data needs to be exported when the service data images, the export mode (Direct mode, free mode), and whether the data image operation is enabled.

Here, the service database may provide source data for generating an engineering database, and the engineering database is a simulation database generated by the data mirroring processing module after exporting data from the service database according to service registration information. After the simulation database is generated, the planning simulation engineering system performs planning and simulation operations based on the database. The planning simulation engineering system can be used for triggering data mirroring, and after the engineering database is generated, corresponding planning simulation operation is carried out on the data in the engineering database.

For the above data mirroring processing module, the data mirroring processing module may include a mirror generator, and may further include at least one of:

the mirror image warehouse management module can support the user to specify information such as mirror image names, descriptions, mirror image modes (real-time or historical), historical time points and the like so as to create a mirror image; meanwhile, the function of inquiring and deleting the data mirror image can be provided; when the image is created, the creation of the rename image is not supported, and when the image is deleted, the image in use is forbidden to be deleted.

The service registration enabling module can support the service module to register and enable the data mirror image processing module so as to acquire the relevant configuration of the service module data mirror image.

For example, the image generator may be invoked, initiating a creation task. In the step, firstly, a registration information list of each service module is queried, the registration information list and the mirror image ID are taken as an input parameter and are input into a mirror image generator so as to start a creation task, and then the mirror image generator is used for concurrently starting a mirror image generation subtask by taking the service module as a unit after receiving the input parameter.

Optionally, in the process of mirroring the service data of the target service, if the target service is in a state operated by a certain use object, a data mirroring error is easy to occur, so before each mirroring subtask mirrors the service data of the target service corresponding to each mirroring subtask, each mirroring subtask may send a notification to a service module of the target service corresponding to each mirroring subtask, so as to notify the service module of making mirroring preparation, thereby improving the success rate of mirroring the service data of the service to be mirrored.

For example, the mirror image generation subtask can call a starting interface realized by the service module and inform the service module that mirror image preparation is performed, so that service conflict is avoided; if the service module is ready, the data to be mirrored may be mirrored, and if the service module is not ready, the mirror generator (or a mirror generation subtask started by the mirror generator) may be informed of the waiting time.

According to the embodiment, when the service to be mirrored comprises a plurality of services, the service data of the plurality of services are mirrored through the plurality of mirror subtasks corresponding to the plurality of services one by one, so that the speed of carrying out data mirroring on the service to be mirrored can be improved, and the time consumption of carrying out data mirroring on the service to be mirrored is reduced.

In an exemplary embodiment, before mirroring the service data of the service to be mirrored to obtain a data mirroring result of the service data of the service to be mirrored, the method further includes:

s21, sending a mirror image starting notification message to the service module of the service to be mirrored by calling a starting interface of the service module of the service to be mirrored.

In this embodiment, before the service data of the service to be mirrored is mirrored, a mirror start notification message may be sent to the service module of the service to be mirrored by calling a start interface with the service module of the service to be mirrored, where the start notification message is used to notify that the service module of the service to be mirrored is ready for mirroring.

Alternatively, after sending the mirror start notification message to the service module of the service to be mirrored, the service module of the service to be mirrored may send a feedback message to the mirror generator. For example, when a service module of a service to be mirrored is ready, a notification message that immediately starts service reporting of the mirror may be sent to the mirror generator; when the service module of the service to be mirrored is not ready, a notification message carrying the waiting for the mirror to be started, which requires waiting time, can be sent to the mirror generator.

Correspondingly, the mirror image processing is carried out on the service data of the service to be mirrored to obtain a data mirror image result of the service data of the service to be mirrored, which comprises the following steps:

s22, responding to the received notification message of permitting to start the mirror image returned by the service module of the service to be mirrored, and mirroring the service data of the service to be mirrored to obtain a data mirroring result of the service data of the service to be mirrored.

In this embodiment, after sending the mirror image start notification message to the service module of the service to be mirrored, if the received notification message for permitting to start the mirror image returned by the service module of the service to be mirrored, the service data of the service to be mirrored may be mirrored in response to the notification message for permitting to start the mirror image, so as to obtain a data mirroring result of the service data of the service to be mirrored.

Optionally, when the notification message returned by the service module of the service to be mirrored is not received within the preset time threshold, the starting interface of the service module of the service to be mirrored can be recalled, and the mirror starting notification message is sent to the service module of the service to be mirrored.

According to the embodiment, the service module is called to send the mirror image starting notification message to the service module, and after receiving the notification message returned by the service module and permitting to start the mirror image, the service data of the service to be mirrored is mirrored, so that the success rate of data mirroring can be improved.

In an exemplary embodiment, after sending the mirror start notification message to the service module of the service to be mirrored by calling the start interface with the service module of the service to be mirrored, the method further includes:

s31, receiving a notification message of waiting for opening the mirror image returned by the service module of the service to be mirrored, wherein the notification message of waiting for opening the mirror image carries waiting time.

In this embodiment, after sending the mirror image start notification message to the service module of the service to be mirrored, the notification message (notification message) of the mirror image to be started, which is returned by the service module of the service to be mirrored, may be received, where the notification message of the mirror image to be started carries a waiting time. For example, when a service module of a service to be mirrored is being invoked and is expected to take 3 minutes to use, a notification message waiting to turn on the mirror may be sent to the mirror generator, and the notification message waiting to turn on the mirror carries a waiting time (i.e., 3 minutes, or a slightly longer time than 3 minutes).

Optionally, the mirror generator may receive a notification message of waiting for opening the mirror returned by the service module of the service to be mirrored, and wait for other notification messages sent by the service module of the service to be mirrored in the waiting time according to the notification message of waiting for opening the mirror. For example, when the notification message waiting for opening the mirror image carries a waiting time of 3 minutes, the mirror image generator may wait for 3 minutes and perform corresponding processing according to the subsequently received notification message.

s32, responding to the notification message returned by the service module of the service to be mirrored and permitting to start mirroring, and mirroring the service data of the service to be mirrored to obtain the data mirroring result of the service data of the service to be mirrored.

Optionally, after the service module of the service to be mirrored is ready, a notification message (notification message, also called mirror start notification message) for permitting the mirror to be started may be sent to the mirror generator, and the mirror generator performs mirror processing on the service data of the service to be mirrored after receiving the notification message for permitting the mirror to be started. For example, the mirror generator waits for a notification that the mirror can be started to be reported by a service module that cannot start the mirror immediately. If the service module is ready, image management (image generator in the data image processing module) can be reported, permitting the opening of the image. If the service module of the service to be mirrored does not receive the report after the waiting time is out, the whole mirror image creation fails and the subsequent steps are terminated.

According to the embodiment, the received notification message of waiting for opening the mirror image returned by the service module of the service to be mirrored is responded, the subsequent notification is waited for being received, the notification of permitting the mirror image is received within a certain time, and then the data mirror image is carried out, so that the success rate of the data mirror image can be improved.

In an exemplary embodiment, after performing mirroring on the service data of the service to be mirrored to obtain a data mirroring result of the service data of the service to be mirrored, the method further includes:

s41, sending a notification message of mirror completion to the service module of the service to be mirrored, wherein the notification message of mirror completion is used for indicating that the service module of the service to be mirrored is allowed to execute other service operations.

In this embodiment, after obtaining the data mirroring result of the service data of the service to be mirrored, a notification message of mirroring completion may be sent to the service module of the service to be mirrored, so as to instruct the service module of the service to be mirrored to allow the service module of the service to be mirrored to execute other service operations. Here, the permission to execute the other service module may be an identification indication that the data mirroring has been completed based on the service data of the service to be mirrored.

Alternatively, since there is a possibility of being stolen in the process of sending the notification message of the completion of the mirroring to the service module of the service to be mirrored, the notification message may be sent to the service module of the service to be mirrored after being encrypted.

For example, after the data mirroring is performed on the service data of the service a and the service C, the mirror generator may send a notification message of the mirror completion to the service module of the service a and the service C, notify the service module that the data mirroring is completed, and may perform other service operations.

By the embodiment, after the data mirroring result of the service data of the service to be mirrored is obtained, the service module can be informed of sending the notification message of mirroring completion, so that the service module can conveniently execute other service operations in time, and the timeliness of executing the service operations is improved.

s51, generating a first temporary database;

s52, determining a data mirror image mode of service data of the service to be mirrored to obtain a target mirror image mode;

s53, obtaining service data of the service to be mirrored from a target data table according to a target mirroring mode, wherein the target data table is a data table for storing the service data of the service to be mirrored in a service database corresponding to the service to be mirrored;

S54, importing service data of the service to be mirrored into a first temporary database;

s55, dumping the first temporary database into an image file to obtain a data image result.

In this embodiment, after determining the service to be mirrored, the service data of the service to be mirrored may be mirrored. Alternatively, the first temporary database may be first generated, and then service data of the service to be mirrored may be mirrored in the first temporary database.

Alternatively, the process of mirroring the service data of the service to be mirrored in the first temporary database may be: firstly, determining a data mirror image mode of service data of a service to be mirrored to obtain a target mirror image mode; obtaining service data of the service to be mirrored from a target data table according to the target mirroring mode, and importing the service data of the service to be mirrored into a first temporary database; and finally, dumping the first temporary database into an image file to obtain a data image result, wherein the target data table is a data table for storing service data of the service to be imaged in the service database corresponding to the service to be imaged.

The process of determining the data mirror mode of the service data of the service to be mirrored and obtaining the target mirror mode may be: the registration information corresponding to the service to be mirrored is searched in a service registration information list of a group of services, and the data mirror mode included in the registration information is determined as a target mirror mode, or other modes for determining the target mirror mode are also possible.

For example, the mirror modes of the specification table may be summarized, real-time data of the specification table may be obtained according to different mode processes, a temporary database may be generated, and the data may be imported. The designated table is a data table storing service data of the service to be mirrored.

Optionally, the process of dumping the first temporary database into the mirror image file to obtain the data mirror image result may be: and dumping the first temporary database into a file, storing the file into a mirror image information detailed record table, and updating fields such as end time, state and the like in a mirror image information master table. After the data mirroring result is obtained, the first temporary database may be deleted in order to reduce consumption of storage resources. In addition, the user may be notified that the data mirroring process is completed.

According to the embodiment, according to the data mirroring mode of different service data, the temporary database is generated from the service data of the acquired appointed table and the data is imported, so that the rationality and success rate of data mirroring can be improved.

In an exemplary embodiment, according to a target mirror mode, acquiring service data of a service to be mirrored from a target data table includes:

s61, when the target mirror mode is the first mirror mode, a target table structure script dumped by a table structure of a target data table and a target table data script dumped by service data of the service to be mirror are obtained by accessing a service database corresponding to the service to be mirror.

In this embodiment, if the target mirroring mode is the first mirroring mode, the target table structure script in which the table structure of the target data table is dumped and the target table data script in which the service data of the service to be mirrored is dumped may be obtained by accessing the service database corresponding to the service to be mirrored. The first mirror mode here may be Direct mode.

For example, as shown in fig. 4, the data export flow of Direct mode may include the following steps:

step S402, a temporary database is newly built.

When the mirror mode specified by the data table in the registration information is the Direct mode, a temporary database can be newly built.

Step S404, the structure and data of the service database dump specification table are accessed.

The service database may be accessed using the service database information in the service module return message. And then sequentially using the dump command to extract the structure of the appointed table and the real-time data of the appointed table into a table structure script and a table data script.

Correspondingly, importing the service data of the service to be mirrored into a first temporary database, including:

s62, recovering the target table structure script into a first temporary table in the first temporary database, and recovering the target table data script into table data in the first temporary table.

After the target table structure script dumped by the table structure of the target data table and the target table data script dumped by the service data of the service to be mirrored are acquired, the service data of the service to be mirrored can be imported into the first temporary database. Alternatively, the target table structure script may be restored to the first temporary table in the first temporary database, and the target table data script may be restored to the table data in the first temporary table.

For example, as shown in fig. 4, the data export process of the Direct mode may further include the following steps:

in step S406, the restore specifies a table structure.

The table structure script may be reconstructed into a temporary table in the temporary database using a restore command.

In step S408, the restore specifies the data of the table.

Using the restore command, the table data script can be restored to the temporary table.

Here, direct mode support directly exports the business table of appointed into the emulation table, direct mode easy realization, performance are good, the resource occupation is little.

According to the embodiment, when the data mirroring mode of the service data of the service to be mirrored is the Direct mode, the structure of the designated table and the service data in the designated table are extracted into the table structure script and the table data script by using the dump command, the table structure script is rebuilt into the temporary table by using the restore command in the temporary database, and the table data script is restored into the temporary table, so that the accuracy of data mirroring can be improved.

s71, executing a database generation language corresponding to a service module of a service to be mirrored to obtain a reconstructed target table structure under the condition that the target mirror mode is a second mirror mode;

s72, calling a data export interface of a service module of the service to be mirrored to obtain a target data message in a preset format, wherein the target data message carries service data of the service to be mirrored;

in this embodiment, if the target mirror mode is the second mirror mode, a database generation language corresponding to the service module of the service to be mirrored may be executed to obtain a reconstructed target table structure; and calling a data export interface of a service module of the service to be mirrored to obtain a target data message in a preset format, wherein the target data message carries service data of the service to be mirrored.

For example, as shown in fig. 5, the Free mode data export process may include the following steps:

step S502, a temporary database is newly built, and DDL sentences are executed.

When the mirror mode designated by the data table in the registration information is Free mode, a temporary database can be newly built, DDL (Data Definition Language ) sentences provided when the service module is registered are executed, and the designated table structure is reconstructed.

Step S504, calling a service interface to obtain a data JSON message of a designated table.

And calling a data export interface realized by the service module to obtain a real-time data JSON (lightweight data exchange format) message of the designated table.

s73, analyzing the target data message to obtain service data of the service to be mirrored, and importing the service data of the service to be mirrored into the first temporary database according to the target table structure.

After determining the target data message and the target table structure, the service data of the service to be mirrored may be imported into the first temporary database. Optionally, the target data packet may be parsed to obtain service data of the service to be mirrored, and the service data of the service to be mirrored is imported into the first temporary database according to the target table structure.

and step S506, analyzing the real-time data JSON message and importing the data into a temporary database.

Here, free mode supports exporting the JSON format data provided by the service to the emulation table, JSON message format referring to fig. 6, where columns provide the names and types of database table fields, current types only support string \int\long\float \double five, data provide the values of table fields, each pair { } represents a row of data, supports null, needs to correspond to fields one by one. The Free mode is relatively flexible, but has low speed and high resource expense, and is suitable for complex scenes which cannot be solved by the Direct mode.

Through the embodiment, when the data mirroring mode of the service data of the service to be mirrored is Free mode, firstly executing a database generation language corresponding to the service module to obtain a reconstructed table structure; calling a data export interface of the service module to obtain a data message in a preset format; and analyzing the data message to obtain service data, and finally importing the service data into a temporary database according to a table structure, so that the accuracy of data mirroring can be improved.

s81, generating a second temporary database;

s82, under the condition that the target mirror image request is used for requesting mirror image of service data before the target historical moment, a target data table and a target historical table are searched by accessing a service database corresponding to a service to be mirror image, wherein the target data table is a data table for storing the service data of the service to be mirror image, and the target historical table is a data table for storing data operation records executed on the target data table according to time sequence;

s83, mirroring the target data table into a second temporary table, and inquiring the data operation records of which the operation time is positioned behind the target history time in the target history table to obtain a group of data operation records;

S84, reversing the business data in the second temporary table to the target historical moment according to a group of data operation records according to the sequence from near to far of the operation time, and obtaining a third temporary table;

s85, importing the data in the third temporary table into a second temporary database;

s86, dumping the second temporary database into an image file to obtain a data image result.

In this embodiment, in addition to the mirror image processing (i.e., the mirror image of the live data) of the current network service, the mirror image processing (i.e., the mirror image of the historical data) of the current network service may also be performed on the data at a certain historical time. Correspondingly, the target mirror image request can be used for requesting to mirror business data before the target historical moment, and the target mirror image request can carry a designated historical time point, namely the target historical moment.

After determining the service to be mirrored, a second temporary database may be generated in a similar manner to the foregoing embodiment, and the service data of the service to be mirrored may be mirrored in the second temporary database, so as to recover the service data before the target history time. Alternatively, the process of mirroring the service data of the service to be mirrored in the second temporary database may be: and searching a target data table and a target history table by accessing a service database corresponding to the service to be mirrored, and recovering service data before the target history moment in the second temporary database according to the target data table and the target history table. The target data table is a data table for storing service data of a service to be mirrored, and the target history table is a data table for storing data operation records executed on the target data table in time sequence.

It should be noted that, when the service database creates a source table (i.e., a data table storing service data, for example, a target data table), a history table is created accordingly, where the history table and the source table are related by a trigger (trigger), see fig. 7, where the table on the left side of fig. 7 is the source table, and the table on the right side of fig. 7 is the history table (i.e., a data operation record for the source table is stored, for example, the target history table). A trigger is a method of ensuring data integrity, whose execution is triggered by an event. When the source table is subjected to insert, delete, update and other operations, trigger execution is activated, the data operation of one source table is automatically inserted into the history table, and the history table can record information such as data change time, change type, data key-value before change, data key-value after change and the like.

When the service module is started, a database script is automatically called to create a service database, a source table and a corresponding history table, and a trigger mechanism is created in the source table so as to ensure that the change condition of subsequent service data can be recorded in the corresponding history table. For the service to be mirrored, when a service module of the service to be mirrored is started, a database script is called to create a service database, a target data table and a corresponding target history table.

Optionally, the manner of recovering the service data before the target history time in the second temporary database according to the target data table and the target history table may be: mirroring the target data table into a second temporary table, and inquiring a data operation record of which the operation time is positioned behind the target history time in the target history table to obtain a group of data operation records; and then reversing the business data in the second temporary table to the target historical moment according to a group of data operation records in the sequence from near to far according to the operation time, so as to obtain a third temporary table, wherein the data in the third temporary table is the business data before the target historical moment.

For example, the service database information in the service module return message can be used to access the service database, the appointed table is mirrored into the temporary table first, the data operation record of the source table after the time point in the history table is queried according to the appointed history time point, and the temporary table data is returned to the history time according to the sequence from the near to the far of the operation time.

Alternatively, after the third temporary table is obtained, the data in the third temporary table may be imported into the second temporary database; and dumping the second temporary database into an image file to obtain a data image result. The process of dumping the second temporary database into the mirror image file to obtain the data mirror image result is similar to the process of dumping the first temporary database into the mirror image file to obtain the data mirror image result, which is not described in detail in this embodiment.

It should be noted that, the third temporary table may be a data table in the service database, and the manner of importing the data in the third temporary table into the second temporary database may be similar to the manner of importing the target data table into the first temporary database, which is already described and will not be repeated herein.

Alternatively, after importing the data in the third temporary table into the second temporary database, the third temporary table in the service database may be deleted; after the temporary databases (for example, the first temporary database and the second temporary database) are dumped into mirror image files to obtain a data mirror image result, the obtained mirror image files can be stored into a mirror image warehouse, and the temporary databases are deleted, so that the consumption of storage resources is reduced; in addition, the service module can be informed of the completion of data mirroring, and other service operations can be performed.

According to the embodiment, the service database is accessed to find the appointed table and the history table of the appointed table, the appointed table is mirrored into the temporary table, and then the temporary table data is returned to the history time, so that the accuracy and the flexibility of data mirroring can be improved.

In an exemplary embodiment, the above method further comprises:

S91, calling a service registration interface to execute registration operation on the service to be mirrored through a service module of the service to be mirrored, and obtaining service registration information of the service to be mirrored.

In this embodiment, the service registration interface may be called by the service module of the service to be mirrored to perform a registration operation on the service to be mirrored, so as to obtain service registration information of the service to be mirrored. For example, the service module may be started, and the data mirror processing module API interface is called to complete the registration operation during the starting process. If the mirror mode contains Free mode, exportSourceDataMicroService, mirrorSchema, mirrorTableName, mirrorDDL needs to be provided, and if Direct mode uses stored procedure functions, also needs to be provided in mirrorFunctions.

According to the embodiment, the service module calls the service registration interface to perform service module registration enabling to obtain the service registration information of the service to be mirrored, so that the process of obtaining the service registration information of the service to be mirrored can be simplified, and the time consumption for mirroring the service data of the service to be mirrored is reduced.

In an exemplary embodiment, after the service registration interface is called by the service module of the service to be mirrored to perform the registration operation on the service to be mirrored, the method further includes:

S101, calling a service anti-registration interface through a service module of the service to be mirrored to execute anti-registration operation on the service to be mirrored so as to delete service registration information of the service to be mirrored.

In this embodiment, after the service registration interface is called by the service module of the service to be mirrored to perform the registration operation on the service to be mirrored, the service registration information of the service to be mirrored may be deleted. Optionally, the service module of the service to be mirrored may call the service anti-registration interface to perform an anti-registration operation on the service to be mirrored, so as to delete the service registration information of the service to be mirrored.

For example, after registering a service module for a service to be mirrored, the registration information may be deleted by calling an anti-registration interface on the service module.

By the embodiment, the deleting process of the service registration information can be simplified by calling the service anti-registration interface to delete the registration information, and the convenience of service data mirror image control is improved.

s111, executing disabling operation to the service to be mirrored through the service module invoking disabling interface to disable the service module to be mirrored from carrying out service data mirroring.

In this embodiment, after the service registration interface is called by the service module of the service to be mirrored to perform the registration operation on the service to be mirrored, the service module of the service to be mirrored may be prohibited from mirroring the service data. Optionally, the disabling operation may be executed on the service to be mirrored through the service module call disabling interface of the service to be mirrored, so as to prohibit the service module of the service to be mirrored from mirroring service data.

For example, a service module is typically default to an enabled state after registration is completed, i.e., the data mirroring processing module may mirror data for the service module. If the service module needs to pause the data image, the disabling interface can be called to disable; the enable interface may also be invoked for recovery later.

According to the embodiment, the disabling operation is executed on the service to be mirrored through the disabling interface, so that the disabling process of the service module can be simplified, and the convenience of service data mirroring control is improved.

The following explains the mirroring method of service data in the embodiment of the present application in conjunction with an alternative example. In this alternative example, the target image mode is Direct mode or Free mode.

In order to avoid the export of irrelevant service data volume during data mirroring, improve the data export performance and avoid the waste of storage resources, the present alternative example provides a mirroring scheme supporting real-time data and historical data, which can be applied to a frame diagram of data mirroring shown in fig. 3, and perform mirroring of service data according to service registration information, and a user can decide which current network service registers and starts data mirroring according to actual needs. In addition, the real-time data of the current network service can be subjected to mirror image processing, and the data of the current network service at a certain historical moment can be subjected to mirror image processing. The scheme can be embedded into a planning simulation system, an operation inlet is provided by the system, and the operation can be completed through calling an API interface.

As shown in connection with fig. 8, for live data mirroring, the live data mirroring process flow in the service data mirroring method in this alternative example may include the following steps:

step S802, a user creation mirror image request is acquired, and a request parameter comprises a mirror image name and a description.

Step S804, call the mirror image generator, start the creation task, and input the registration information and the mirror image ID (random generation) of each service module.

In this step, a registration information list of each service module is queried, and the registration information list and the mirror image ID are used as the input parameters to be input into the mirror image generator so as to start the creation task.

In step S806, the image generator concurrently starts the image generation subtask of the registered service module.

In step S808, each subtask calls "start apiURL" in the registration information, and notifies the service module that the image preparation is ready.

In the step, a subtask calls a starting interface realized by a service module to inform the service module of preparing a mirror image; if the service module is ready, step S810 is skipped and step S812 is performed; if the traffic module is not ready, the mirror generator needs to be informed of the waiting time.

In step S810, the service module feeds back the start-up information, permitting the image generator to start creation.

In this step, the mirror image generator waits for the notification reported by the service module in step S808, if the notification reported by the service is not received after waiting for timeout, the entire mirror image creation fails, and the subsequent steps are terminated.

Step S812, respectively summarizing tables designated as Direct mode and Free mode in the registration information, acquiring real-time data of the tables according to different mode processing procedures, and importing the data to generate a temporary database.

Step S814, notifies the service module that the mirroring is completed.

In step S816, the temporary database dump is stored in the mirror repository and deleted.

In the step, the temporary database is dumped into a file, the file is stored into a mirror image information detailed record table, the temporary database is deleted, and meanwhile, fields such as the ending time, the state and the like in a mirror image information master table are updated, and the user is informed of the completion of the data mirror image processing.

As shown in connection with fig. 9, for the history data mirroring, the history data mirroring process flow in the service data mirroring method in this alternative example may include the following steps:

in step S902, a user creation image request is obtained, where the request parameters include an image name and a description.

Here, the user triggers a create history data image operation, specifying an image name, description, and history time point. The information carried by the create mirror request may include a historical point in time.

Step S904, call the mirror image generator, start the creation task, and enter the registration information and mirror image ID (random generation) of each business module.

Step S906, the image generator concurrently starts an image generation subtask of the registered service module.

In step S908, each subtask calls "start apiURL" in the registration information, notifying the service module that the image is ready.

In step S910, the service module feeds back the start-up information, and permits the image generator to start the creation.

The execution of step S908 and step S910 is similar to the execution of step S808 and step S810, and will not be described here.

Step S912, accessing the service database, finding the appointed table and the history table of the appointed table, mirroring the appointed table into a temporary table, and returning the temporary table data to the history time.

Step S914, the tables designated as Direct mode and Free mode in the registration information are summarized respectively, and then data are acquired from the temporary table according to different mode processing procedures, and are imported to generate a temporary database.

Step S916, notifying the service module that the mirror image is completed, deleting the temporary table in the service database, accessing the service database, and deleting the temporary table generated in step S912.

And step S918, the temporary database dump is stored into a mirror image warehouse to delete the temporary database.

By the optional example, when the current network data mirroring is processed, the real-time data mirroring and the historical data mirroring are supported, the multimode mirroring table data is supported, the mirroring processing of the real-time data and the historical data can be rapidly and stably completed, the system performance is effectively improved, and the resource waste is reduced.

It should be noted that, for simplicity of description, the foregoing method embodiments are all expressed as a series of action combinations, but it should be understood by those skilled in the art that the present application is not limited by the order of actions described, as some steps may be performed in other order or simultaneously in accordance with the present application. Further, those skilled in the art will also appreciate that the embodiments described in the specification are all preferred embodiments, and that the acts and modules referred to are not necessarily required in the present application.

From the description of the above embodiments, it will be clear to a person skilled in the art that the method according to the above embodiments may be implemented by means of software plus the necessary general hardware platform, but of course also by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (such as ROM (Read-Only Memory)/RAM (Random Access Memory ), magnetic disk, optical disc), including instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method described in the embodiments of the present application.

According to another aspect of the embodiments of the present application, there is also provided a service data mirroring apparatus for implementing the foregoing service data mirroring method. Fig. 10 is a block diagram of an alternative service data mirroring apparatus according to an embodiment of the present application, and as shown in fig. 10, the apparatus may include:

an obtaining unit 1002, configured to obtain a target mirror request, where the target mirror request is used to request mirror processing on service data on a target device;

a determining unit 1004, coupled to the obtaining unit 1002, configured to determine, in response to the target mirroring request, a service to be mirrored in a set of services according to a service registration information list of the set of services, where the service registration information list is used to indicate whether each service in the set of services allows mirroring of service data;

the mirroring unit 1006 is connected to the determining unit 1004, and is configured to mirror the service data of the service to be mirrored to obtain a data mirroring result of the service data of the service to be mirrored.

It should be noted that the acquisition unit 1002 in this embodiment may be used to perform the above-described step S202, the determination unit 1004 in this embodiment may be used to perform the above-described step S204, and the mirroring unit 1006 in this embodiment may be used to perform the above-described step S206.

The method comprises the steps of obtaining a target mirror image request through the module, wherein the target mirror image request is used for requesting mirror image processing of service data on target equipment; responding to the target mirror image request, and determining a service to be mirrored in a group of services according to a service registration information list of the group of services, wherein the service registration information list is used for indicating whether each service in the group of services allows service data mirroring or not; the service data of the service to be mirrored is mirrored to obtain a data mirroring result of the service data of the service to be mirrored, so that the technical problem of long time consumption of data mirroring caused by large data volume of the service data required to be mirrored in the mirroring method of the service data in the related art is solved, the time consumption of the data mirroring is reduced, and the efficiency of the data mirroring is improved.

In one exemplary embodiment, the mirroring unit includes:

the starting module is used for starting a plurality of mirror subtasks corresponding to the target businesses one by one under the condition that the business to be mirrored comprises the target businesses;

the first mirror image module is used for carrying out mirror image processing on the service data of the target service corresponding to each mirror image subtask through each mirror image subtask in the mirror image subtasks to obtain a data mirror image result of the service data of the target services.

In one exemplary embodiment of the present invention,

the device further comprises: the first sending unit is used for sending a mirror image starting notification message to the service module of the service to be mirrored by calling a starting interface of the service module of the service to be mirrored before the service data of the service to be mirrored is mirrored to obtain a data mirroring result of the service data of the service to be mirrored;

the mirror image unit includes: the second mirror image module is used for responding to the received notification message which is returned by the service module of the service to be mirrored and is used for permitting the mirror image to be started, and mirroring the service data of the service to be mirrored to obtain the data mirror image result of the service data of the service to be mirrored.

In one exemplary embodiment of the present invention,

the device further comprises: the receiving unit is used for receiving a notification message of waiting for opening the mirror image returned by the service module of the service to be mirrored after sending the mirror image starting notification message to the service module of the service to be mirrored by calling a starting interface of the service module of the service to be mirrored, wherein the notification message of waiting for opening the mirror image carries waiting time;

the mirror image unit includes: and the third mirroring module is used for mirroring the service data of the service to be mirrored in response to the notification message which is returned by the service module of the service to be mirrored and is received within the waiting time and is used for permitting the mirror to be opened, so as to obtain the data mirroring result of the service data of the service to be mirrored.

In an exemplary embodiment, the above apparatus further includes:

the second sending unit is used for sending a notification message of mirror completion to the service module of the service to be mirrored after mirror processing is carried out on the service data of the service to be mirrored to obtain a data mirror result of the service data of the service to be mirrored, wherein the notification message of mirror completion is used for indicating that the service module of the service to be mirrored is allowed to execute other service operations.

In one exemplary embodiment, the mirroring unit includes:

the first generation module is used for generating a first temporary database;

the determining module is used for determining a data mirror image mode of service data of the service to be mirrored to obtain a target mirror image mode;

the system comprises an acquisition module, a mirror image processing module and a mirror image processing module, wherein the acquisition module is used for acquiring service data of a service to be mirrored from a target data table according to a target mirror image mode, wherein the target data table is a data table for storing the service data of the service to be mirrored in a service database corresponding to the service to be mirrored;

the first importing module is used for importing service data of the service to be mirrored into a first temporary database;

the first transfer module is used for transferring the first temporary database into an image file to obtain a data image result.

In one exemplary embodiment of the present invention,

the acquisition module comprises: the first execution sub-module is used for acquiring a target table structure script dumped by a table structure of a target data table and a target table data script dumped by service data of the service to be mirrored by accessing a service database corresponding to the service to be mirrored under the condition that the target mirroring mode is a first mirroring mode;

the first import module includes: and the second execution sub-module is used for recovering the target table structure script into a first temporary table in the first temporary database and recovering the target table data script into table data in the first temporary table.

In one exemplary embodiment of the present invention,

the acquisition module comprises: the third execution sub-module is used for executing a database generation language corresponding to the service module of the service to be mirrored to obtain a reconstructed target table structure under the condition that the target mirror mode is the second mirror mode; the calling sub-module is used for calling a data export interface of a service module of the service to be mirrored to obtain a target data message in a preset format, wherein the target data message carries service data of the service to be mirrored;

the first import module includes: and the fourth execution sub-module is used for analyzing the target data message to obtain service data of the service to be mirrored, and importing the service data of the service to be mirrored into the first temporary database according to the target table structure.

In one exemplary embodiment, the mirroring unit includes:

the second generation module is used for generating a second temporary database;

the searching module is used for searching a target data table and a target history table by accessing a service database corresponding to a service to be mirrored when the target mirroring request is used for requesting to mirror service data before a target history time, wherein the target data table is a data table for storing the service data of the service to be mirrored, and the target history table is a data table for storing data operation records executed on the target data table according to a time sequence;

the execution module is used for mirroring the target data table into a second temporary table, inquiring the data operation records of which the operation time is positioned behind the target history time in the target history table, and obtaining a group of data operation records;

the rollback module is used for reversely rolling back the business data in the second temporary table to the target historical moment according to a group of data operation records according to the sequence from near to far of the operation time to obtain a third temporary table;

the second importing module is used for importing the data in the third temporary table into a second temporary database;

and the second dumping module is used for dumping the second temporary database into an image file to obtain a data image result.

In an exemplary embodiment, the above apparatus further includes:

and the registration unit is used for calling the service registration interface through the service module of the service to be mirrored to execute registration operation on the service to be mirrored to obtain service registration information of the service to be mirrored.

In an exemplary embodiment, the above apparatus further includes:

and the anti-registration unit is used for calling the service registration interface through the service module of the service to be mirrored to execute the registration operation on the service to be mirrored through the service module of the service to be mirrored to execute the anti-registration operation on the service to be mirrored so as to delete the service registration information of the service to be mirrored.

In an exemplary embodiment, the above apparatus further includes:

the disabling unit is used for executing the disabling operation on the service to be mirrored through the service module of the service to be mirrored after the service registration interface is called by the service module of the service to be mirrored to execute the registration operation on the service to be mirrored through the service module of the service to be mirrored.

It should be noted that the above modules are the same as examples and application scenarios implemented by the corresponding steps, but are not limited to what is disclosed in the above embodiments. It should be noted that the above modules may be implemented in software or in hardware as part of the apparatus shown in fig. 1, where the hardware environment includes a network environment.

According to yet another aspect of embodiments of the present application, there is also provided a storage medium. Alternatively, in this embodiment, the storage medium may be used to execute a program code of the mirroring method of service data according to any one of the foregoing embodiments of the present application.

Alternatively, in this embodiment, the storage medium may be located on at least one network device of the plurality of network devices in the network shown in the above embodiment.

Alternatively, in the present embodiment, the storage medium is configured to store program code for performing the steps of:

s1, acquiring a target mirror image request, wherein the target mirror image request is used for requesting mirror image processing of service data on target equipment;

s2, responding to a target mirror image request, and determining a service to be mirrored in a group of services according to a service registration information list of the group of services, wherein the service registration information list is used for indicating whether each service in the group of services allows service data mirroring or not;

s3, mirror image processing is carried out on the service data of the service to be mirrored, and a data mirror image result of the service data of the service to be mirrored is obtained.

Alternatively, specific examples in the present embodiment may refer to examples described in the above embodiments, which are not described in detail in the present embodiment.

Alternatively, in the present embodiment, the storage medium may include, but is not limited to: various media capable of storing program codes, such as a U disk, ROM, RAM, a mobile hard disk, a magnetic disk or an optical disk.

According to still another aspect of the embodiments of the present application, there is further provided an electronic device for implementing the mirroring method of service data, where the electronic device may be a server, a terminal, or a combination thereof.

Fig. 11 is a block diagram of an alternative electronic device, according to an embodiment of the present application, including a processor 1102, a communication interface 1104, a memory 1106 and a communication bus 1108, as shown in fig. 11, wherein the processor 1102, the communication interface 1104 and the memory 1106 communicate with each other via the communication bus 1108, wherein,

a memory 1106 for storing a computer program;

the processor 1102 is configured to execute the computer program stored in the memory 1106, and implement the following steps:

Alternatively, the communication bus may be a PCI (Peripheral Component Interconnect, peripheral component interconnect standard) bus, or an EISA (Extended Industry Standard Architecture ) bus, or the like. The communication bus may be classified as an address bus, a data bus, a control bus, or the like. For ease of illustration, only one thick line is shown in FIG. 11, but not only one bus or one type of bus. The communication interface is used for communication between the electronic device and other equipment.

The memory may include RAM or may include non-volatile memory (non-volatile memory), such as at least one disk memory. Optionally, the memory may also be at least one memory device located remotely from the aforementioned processor.

As an example, the memory 1106 may include, but is not limited to, an acquisition unit 1002, a determination unit 1004, and a mirroring unit 1006 in a mirroring apparatus including the service data. In addition, other module units in the mirroring device of the service data may be included, but are not limited to, and are not described in detail in this example.

The processor may be a general purpose processor and may include, but is not limited to: CPU (Central Processing Unit ), NP (Network Processor, network processor), etc.; but also DSP (Digital Signal Processing, digital signal processor), ASIC (Application Specific Integrated Circuit ), FPGA (Field-Programmable Gate Array, field programmable gate array) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components.

Alternatively, specific examples in this embodiment may refer to examples described in the foregoing embodiments, and this embodiment is not described herein.

It will be understood by those skilled in the art that the structure shown in fig. 11 is only schematic, and the device implementing the mirroring method of the service data may be a terminal device, and the terminal device may be a smart phone (such as an Android mobile phone, an iOS mobile phone, etc.), a tablet computer, a palmtop computer, a mobile internet device (Mobile Internet Devices, MID), a PAD, etc. Fig. 11 is not limited to the structure of the electronic device. For example, the electronic device may also include more or fewer components (e.g., network interfaces, display devices, etc.) than shown in FIG. 11, or have a different configuration than shown in FIG. 11.

Those of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be implemented by a program for instructing a terminal device to execute in association with hardware, the program may be stored in a computer readable storage medium, and the storage medium may include: flash disk, ROM, RAM, magnetic or optical disk, etc.

The foregoing embodiment numbers of the present application are merely for describing, and do not represent advantages or disadvantages of the embodiments.

The integrated units in the above embodiments may be stored in the above-described computer-readable storage medium if implemented in the form of software functional units and sold or used as separate products. Based on such understanding, the technical solution of the present application may be embodied in essence or a part contributing to the prior art or all or part of the technical solution in the form of a software product stored in a storage medium, including several instructions to cause one or more computer devices (which may be personal computers, servers or network devices, etc.) to perform all or part of the steps of the methods described in the various embodiments of the present application.

In the foregoing embodiments of the present application, the descriptions of the embodiments are emphasized, and for a portion of this disclosure that is not described in detail in this embodiment, reference is made to the related descriptions of other embodiments.

In several embodiments provided in the present application, it should be understood that the disclosed client may be implemented in other manners. The above-described embodiments of the apparatus are merely exemplary, and the division of the units, such as the division of the units, is merely a logical function division, and may be implemented in another manner, for example, multiple units or components may be combined or may be integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some interfaces, units or modules, or may be in electrical or other forms.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution provided in the present embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or at least two units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The foregoing is merely a preferred embodiment of the present application and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present application and are intended to be comprehended within the scope of the present application.

Claims

1. A method for mirroring service data, comprising:

obtaining a target mirror image request, wherein the target mirror image request is used for requesting mirror image processing of service data on target equipment;

responding to the target mirror image request, and determining a service to be mirrored in a group of services according to a service registration information list of the group of services, wherein the service registration information list is used for indicating whether each service in the group of services allows service data mirroring or not;

and carrying out mirror image processing on the service data of the service to be mirrored to obtain a data mirror image result of the service data of the service to be mirrored.

2. The method of claim 1, wherein the mirroring the service data of the service to be mirrored to obtain a data mirroring result of the service data of the service to be mirrored comprises:

Under the condition that the service to be mirrored comprises a plurality of target services, a plurality of mirror subtasks corresponding to the plurality of target services one by one are started;

and carrying out mirror image processing on service data of the target service corresponding to each mirror image subtask through each mirror image subtask in the mirror image subtasks to obtain a data mirror image result of the service data of the target services.

3. The method of claim 1, wherein the step of determining the position of the substrate comprises,

before the service data of the service to be mirrored is mirrored to obtain a data mirroring result of the service data of the service to be mirrored, the method further includes: sending a mirror image starting notification message to the service module of the service to be mirrored by calling a starting interface of the service module of the service to be mirrored;

the mirror image processing is performed on the service data of the service to be mirrored to obtain a data mirror image result of the service data of the service to be mirrored, including: and responding to the received notification message returned by the service module of the service to be mirrored, and carrying out mirroring on the service data of the service to be mirrored to obtain a data mirroring result of the service data of the service to be mirrored.

4. The method of claim 3, wherein the step of,

after the service module of the service to be mirrored sends the mirror image start notification message to the service module of the service to be mirrored by calling the start interface of the service module of the service to be mirrored, the method further comprises: receiving a notification message of waiting for opening the mirror image returned by the service module of the service to be mirrored, wherein the notification message of waiting for opening the mirror image carries waiting time;

the mirror image processing is performed on the service data of the service to be mirrored to obtain a data mirror image result of the service data of the service to be mirrored, including: and responding to the notification message returned by the service module of the service to be mirrored and permitting to start mirroring received within the waiting time, mirroring the service data of the service to be mirrored, and obtaining a data mirroring result of the service data of the service to be mirrored.

5. The method according to claim 3, wherein after the mirroring the service data of the service to be mirrored to obtain a data mirroring result of the service data of the service to be mirrored, the method further comprises:

and sending a notification message of mirror completion to the service module of the service to be mirrored, wherein the notification message of mirror completion is used for indicating that the service module of the service to be mirrored is allowed to execute other service operations.

6. The method of claim 1, wherein the mirroring the service data of the service to be mirrored to obtain a data mirroring result of the service data of the service to be mirrored comprises:

generating a first temporary database;

determining a data mirror image mode of service data of the service to be mirrored to obtain a target mirror image mode;

acquiring service data of the service to be mirrored from a target data table according to the target mirroring mode, wherein the target data table is a data table which is used for storing the service data of the service to be mirrored in a service database corresponding to the service to be mirrored;

importing the service data of the service to be mirrored into the first temporary database;

and dumping the first temporary database into an image file to obtain the data image result.

7. The method of claim 6, wherein the step of providing the first layer comprises,

the obtaining the service data of the service to be mirrored from the target data table according to the target mirroring mode comprises the following steps: under the condition that the target mirror mode is a first mirror mode, acquiring a target table structure script dumped by a table structure of the target data table and a target table data script dumped by service data of the service to be mirrored by accessing a service database corresponding to the service to be mirrored;

The importing the service data of the service to be mirrored into the first temporary database includes: restoring the target table structure script to a first temporary table in the first temporary database, and restoring the target table data script to table data in the first temporary table.

8. The method of claim 6, wherein the step of providing the first layer comprises,

the obtaining the service data of the service to be mirrored from the target data table according to the target mirroring mode comprises the following steps: executing a database generation language corresponding to the service module of the service to be mirrored to obtain a reconstructed target table structure under the condition that the target mirror mode is a second mirror mode; invoking a data export interface of a service module of the service to be mirrored to obtain a target data message in a preset format, wherein the target data message carries service data of the service to be mirrored;

the importing the service data of the service to be mirrored into the first temporary database includes: analyzing the target data message to obtain the service data of the service to be mirrored, and importing the service data of the service to be mirrored into the first temporary database according to the target table structure.

9. The method of claim 1, wherein the mirroring the service data of the service to be mirrored to obtain a data mirroring result of the service data of the service to be mirrored comprises:

generating a second temporary database;

under the condition that the target mirroring request is used for requesting to mirror business data before a target historical moment, a target data table and a target historical table are searched by accessing a business database corresponding to the business to be mirrored, wherein the target data table is a data table for storing the business data of the business to be mirrored, and the target historical table is a data table for storing data operation records executed on the target data table according to time sequence;

mirroring the target data table into a second temporary table, and inquiring a data operation record of which the operation time is positioned after the target history time in the target history table to obtain a group of data operation records;

according to the sequence from near to far of the operation time, reversely returning the business data in the second temporary table to the target historical moment according to the group of data operation records to obtain a third temporary table;

Importing the data in the third temporary table into the second temporary database;

and dumping the second temporary database into an image file to obtain the data image result.

10. The method according to any one of claims 1 to 9, further comprising:

and calling a service registration interface through the service module of the service to be mirrored to execute registration operation on the service to be mirrored to obtain service registration information of the service to be mirrored.

11. The method of claim 10, wherein after the performing a registration operation on the service to be mirrored by the service module invoking a service registration interface for the service to be mirrored, the method further comprises:

and calling a service anti-registration interface through the service module of the service to be mirrored to execute anti-registration operation on the service to be mirrored so as to delete the service registration information of the service to be mirrored.

12. The method of claim 10, wherein after the performing a registration operation on the service to be mirrored by the service module invoking a service registration interface for the service to be mirrored, the method further comprises:

executing disabling operation on the service to be mirrored through the service module calling disabling interface of the service to be mirrored so as to prohibit service data mirroring on the service module of the service to be mirrored.

13. A service data mirroring apparatus, comprising:

the system comprises an acquisition unit, a target mirror image request and a processing unit, wherein the acquisition unit is used for acquiring a target mirror image request, and the target mirror image request is used for requesting mirror image processing of service data on target equipment;

a determining unit, configured to determine, in response to the target mirroring request, a service to be mirrored in a set of services according to a service registration information list of the set of services, where the service registration information list is configured to indicate whether each service in the set of services allows for service data mirroring;

the mirror image unit is used for carrying out mirror image processing on the service data of the service to be mirrored to obtain a data mirror image result of the service data of the service to be mirrored.

14. A computer readable storage medium, characterized in that the computer readable storage medium comprises a stored program, wherein the program when run performs the method of any one of claims 1 to 12.

15. An electronic device comprising a memory and a processor, wherein the memory has stored therein a computer program, the processor being arranged to perform the method of any of claims 1 to 12 by means of the computer program.