CN117421789A

CN117421789A - Data processing method, device, storage medium and equipment

Info

Publication number: CN117421789A
Application number: CN202311411968.9A
Authority: CN
Inventors: 刘永伟; 顾亮; 郭旭; 孔斌
Original assignee: Industrial and Commercial Bank of China Ltd ICBC
Current assignee: Industrial and Commercial Bank of China Ltd ICBC
Priority date: 2023-10-27
Filing date: 2023-10-27
Publication date: 2024-01-19

Abstract

The present disclosure provides a data processing method, apparatus, storage medium, and device, which can be applied to the field of big data, the field of database, and the field of financial technology. The method comprises the following steps: generating a service subscription message according to the update type of the first target data to be updated, wherein the service subscription message is suitable for acquiring a service interface related to the update type from the second service end; sending a service subscription message to a registry, the registry being configured to determine a target service interface from among the candidate service interfaces and to generate a service notification message, the candidate service interfaces being associated with an update type; generating a first data update request according to a service notification message from a registry; and sending a first data updating request to a second server, wherein the second server is suitable for generating a first data updating task corresponding to the target service interface according to the first data updating request, and the first data updating task is used for updating service data related to the second server according to the first target data.

Description

Data processing method, device, storage medium and equipment

Technical Field

The present disclosure relates to the field of big data, the field of databases, and the field of financial science and technology, and in particular, to a data processing method, apparatus, storage medium, and device.

Background

With the rapid development of technology, more and more enterprises meet the increasing business demands by constructing business service systems. With the continuous expansion of service scale and the requirement of meeting related service transaction rules in the service transaction process, the service system is required to meet the service transaction requirement by accessing the service data stored in the database of other service systems. The process of accessing other databases to obtain relevant business data can affect the operation efficiency of the business service system and even the success rate of business transaction.

Disclosure of Invention

In view of the foregoing, the present disclosure provides a data processing method, apparatus, storage medium, and device.

According to a first aspect of the present disclosure, there is provided a data processing method, applied to a first service end, including:

generating a service subscription message according to the update type of the first target data to be updated, wherein the service subscription message is suitable for acquiring a service interface related to the update type from a second service end;

sending a service subscription message to a registry, wherein the registry is configured to determine a target service interface from candidate service interfaces registered by the second service end, and generate a service notification message according to the target service interface, and the candidate service interface is related to the update type;

Generating a first data update request according to a service notification message from the registry; and

and sending the first data updating request to the second server, wherein the second server is suitable for generating a first data updating task corresponding to the target service interface according to the first data updating request, and the first data updating task is used for updating service data related to the second server according to the first target data.

According to an embodiment of the present disclosure, generating the first data update request according to the service notification message from the registry includes:

analyzing the service notification message to obtain a target service interface address corresponding to the target service interface;

and generating the first data updating request according to the target service interface address, the data updating task identifier corresponding to the updating type and the first target data.

According to an embodiment of the disclosure, the data processing method is applied to the first service end, and further includes:

determining second target data with the query frequency greater than or equal to a preset frequency threshold value from the initial data according to the query frequencies respectively related to the initial data, wherein the initial data is stored in a first database corresponding to the first service end;

And sending the second target data to the distributed message platform, wherein the second server is configured to acquire the second target data from the distributed message platform and synchronize the second target data to a second database related to the second server.

determining third target data with the query frequency smaller than a preset frequency threshold value from the initial data according to the query frequencies respectively related to the initial data, wherein the initial data are stored in a first database corresponding to the first service end;

updating the initial batch data table according to the third target data to obtain an updated batch data table; and

and sending the batch data table to a distributed message platform, wherein the second server is configured to acquire the batch data table from the distributed message platform and synchronize the batch data table to a second database related to the second server.

According to an embodiment of the present disclosure, the update type includes at least one of:

new type, delete type, replace type.

A second aspect of the present disclosure provides a data processing method, applied to a second server, including:

analyzing a first data updating request from a first service end to obtain first target data to be updated and a data updating task identifier, wherein the first data updating request is obtained through a target service interface;

generating a first data updating task corresponding to the target service interface according to the first target data and the data updating task identifier; and

and executing the first data updating task to obtain updated target service data, wherein the first data updating task is used for updating the service data related to the second server according to the first target data.

According to an embodiment of the disclosure, a data processing method is applied to a second server, wherein generating a first data update task corresponding to the target service interface according to the first target data and the data update task identifier includes:

determining a data update task attribute associated with a data attribute of the first target data, wherein the data update task attribute characterizes a task execution policy of the first data update task;

Determining task configuration information corresponding to the data updating task attribute from a plurality of candidate task configuration information; and

and generating the first data updating task according to the task configuration information and the first target data.

According to an embodiment of the present disclosure, the task execution policies include a plurality of task execution policies, and the plurality of task execution policies include a target task execution policy with a latest update time;

wherein, executing the first data update task includes:

and executing the first data updating task in a gray scale container related to the second server under the condition that the data updating task attribute represents the target task execution strategy, wherein the first data updating task is used for updating initial service data in the gray scale container according to the first target data to obtain the updated target service data.

According to an embodiment of the disclosure, the data processing method is applied to the second server and further includes:

generating a service registration message according to a candidate service attribute corresponding to the candidate service interface, wherein the candidate service attribute comprises a candidate service interface address; and

and sending the service registration message to the registry.

acquiring second target data from the distributed message platform under the condition that the distributed message platform acquires the second target data from the first server; and

and synchronizing the second target data to a second database related to the second server.

receiving a batch data table from the first server from the distributed message platform; and

and synchronizing the batch data table to a second database related to the second server.

A third aspect of the present disclosure provides a data processing method, applied to a service system, where the service system includes a first service end, a second service end, and a registry, where the data processing method includes:

the first server generates a service subscription message according to the update type of the first target data to be updated, wherein the service subscription message is suitable for acquiring a service interface related to the update type from the second server;

The first server side sends a service subscription message to a registration center;

the registry determines a target service interface from the candidate service interfaces registered by the second service end according to the service subscription message;

the registry generates a service notification message according to the target service interface, wherein the candidate service interface is related to the update type;

the first server generates a first data update request according to a service notification message from the registry;

the first server sends the first data updating request to the second server;

the second server side analyzes a first data updating request from the first server side to obtain first target data to be updated and a data updating task identifier, wherein the first data updating request is obtained through a target service interface;

the second server generates a first data updating task corresponding to the target service interface according to the first target data and the data updating task identifier; and

and the second server executes the first data updating task to obtain updated target service data, wherein the first data updating task is used for updating the service data related to the second server according to the first target data.

A fourth aspect of the present disclosure provides a data processing apparatus, applied to a first service end, including:

the service subscription message generation module is used for generating a service subscription message according to the update type of the first target data to be updated, wherein the service subscription message is suitable for acquiring a service interface related to the update type from the second service end;

a service subscription message sending module, configured to send a service subscription message to a registry, where the registry is configured to determine a target service interface from candidate service interfaces registered by the second service end, and generate a service notification message according to the target service interface, where the candidate service interface is related to the update type;

a first data update request generation module, configured to generate a first data update request according to a service notification message from the registry; and

the first data updating request sending module is configured to send the first data updating request to the second server, where the second server is adapted to generate, according to the first data updating request, a first data updating task corresponding to the target service interface, where the first data updating task is configured to update, according to the first target data, service data related to the second server.

A fourth aspect of the present disclosure provides a data processing apparatus, applied to a second service end, including:

the analysis module is used for analyzing a first data updating request from a first service end, wherein the first data updating request is obtained through a target service interface;

the first data updating task generating module is used for generating a first data updating task corresponding to the target service interface according to the first target data and the data updating task identifier; and

and the first data updating task execution module is used for executing the first data updating task, wherein the first data updating task is used for updating service data related to the second server according to the first target data.

A fifth aspect of the present disclosure provides a business service system, comprising a first service side, a second service side and a registry,

the first server is configured to generate a service subscription message according to the update type of the first target data to be updated, wherein the service subscription message is suitable for acquiring a service interface related to the update type from the second server;

the first server is configured to send a service subscription message to a registry;

The registry is configured to determine a target service interface from the candidate service interfaces registered by the second service end according to the service subscription message;

the registry being configured to generate a service notification message in accordance with the target service interface, the candidate service interface being associated with the update type;

the first server is configured to generate a first data update request according to a service notification message from the registry;

the first server is configured to send the first data update request to the second server;

the second service end is configured to analyze a first data updating request from the first service end to obtain first target data to be updated and a data updating task identifier, wherein the first data updating request is obtained through a target service interface;

the second server is configured to generate a first data update task corresponding to the target service interface according to the first target data and the data update task identifier; and

the second server is configured to execute the first data updating task to obtain updated target service data, where the first data updating task is used to update service data related to the second server according to the first target data.

A sixth aspect of the present disclosure provides an electronic device, comprising: one or more processors; and a memory for storing one or more programs, wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to perform the method described above.

A seventh aspect of the present disclosure also provides a computer-readable storage medium having stored thereon executable instructions that, when executed by a processor, cause the processor to perform the above-described method.

An eighth aspect of the present disclosure also provides a computer program product comprising a computer program which, when executed by a processor, implements the above method.

According to the data processing method, the device, the storage medium and the equipment provided by the disclosure, the first service end generates the service subscription message according to the update type of the first target data, determines the target service interface from the candidate service interfaces related to the update type through the registration center, and can realize screening of the target service interface according to the load condition corresponding to the candidate service interface of the second service end, so that the first service end can generate the first data update request according to the target service interface corresponding to the service notification message, and therefore, the service data related to the second service end can be updated by using the first target data by sending the first data update request to the second service end, the problem that data interaction cannot be performed because the databases of the first service end and the second service end do not support a communication connection function is avoided, meanwhile, the technical problem that data query efficiency is low due to data interaction between the databases of the first service end and the second service end through the DBLINK function is avoided, and further the technical effects of improving the data update efficiency and improving the running stability of the service system are achieved.

Drawings

The foregoing and other objects, features and advantages of the disclosure will be more apparent from the following description of embodiments of the disclosure with reference to the accompanying drawings, in which:

FIG. 1A schematically illustrates an architectural diagram of data interactions between business systems according to a comparative example of the present disclosure;

FIG. 1B schematically illustrates an exemplary system architecture of a data processing method and apparatus according to an embodiment of the present disclosure;

fig. 2 schematically illustrates a flowchart of a data processing method applied to a first server according to an embodiment of the disclosure;

FIG. 3 schematically illustrates an application scenario diagram of a data processing method according to an embodiment of the present disclosure;

FIG. 4 schematically illustrates an application scenario diagram of a data processing method according to another embodiment of the present disclosure;

FIG. 5 schematically illustrates an application scenario diagram of a data processing method according to a further embodiment of the present disclosure;

fig. 6A schematically illustrates a flowchart of a data processing method applied to a second server according to an embodiment of the disclosure;

FIG. 6B schematically illustrates an application scenario diagram of a data processing method according to a further embodiment of the present disclosure;

fig. 7 schematically illustrates a flowchart of a data processing method applied to a business service system according to an embodiment of the present disclosure;

FIG. 8 schematically illustrates a block diagram of a data processing apparatus applied to a first server according to an embodiment of the present disclosure;

FIG. 9 schematically illustrates a block diagram of a data processing apparatus applied to a second server according to an embodiment of the present disclosure;

fig. 10 schematically illustrates a block diagram of an electronic device adapted to implement a data processing method according to an embodiment of the disclosure.

Detailed Description

Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be understood that the description is only exemplary and is not intended to limit the scope of the present disclosure. In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the present disclosure. It may be evident, however, that one or more embodiments may be practiced without these specific details. In addition, in the following description, descriptions of well-known structures and techniques are omitted so as not to unnecessarily obscure the concepts of the present disclosure.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The terms "comprises," "comprising," and/or the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.

All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. It should be noted that the terms used herein should be construed to have meanings consistent with the context of the present specification and should not be construed in an idealized or overly formal manner.

Where expressions like at least one of "A, B and C, etc. are used, the expressions should generally be interpreted in accordance with the meaning as commonly understood by those skilled in the art (e.g.," a system having at least one of A, B and C "shall include, but not be limited to, a system having a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.).

In the technical scheme of the invention, the related user information (including but not limited to user personal information, user image information, user equipment information, such as position information and the like) and data (including but not limited to data for analysis, stored data, displayed data and the like) are information and data authorized by a user or fully authorized by all parties, and the processing of the related data such as collection, storage, use, processing, transmission, provision, disclosure, application and the like are all conducted according to the related laws and regulations and standards of related countries and regions, necessary security measures are adopted, no prejudice to the public welfare is provided, and corresponding operation inlets are provided for the user to select authorization or rejection.

The inventor finds that in an actual business transaction scenario, databases of other business service systems are generally required to be accessed through a DBLINK (Database Link), so as to obtain necessary business data required by business transaction. The inventor finds that the DBLINK function can generate a database information coupling condition to influence the operation efficiency of the service system, and the partial type of database does not support the DBLINK function, so that service data access among different service systems is difficult to realize, and the operation efficiency of the service system is influenced.

Fig. 1A schematically illustrates an architectural diagram of data interactions between business systems according to a comparative example of the present disclosure.

As shown in fig. 1A, a first database may be associated with service system a and a second database may be associated with service system B. The first database and the second database may be communicatively coupled via a database link (DBLINK). Therefore, the service system a can directly access the second database through the DBLINK to realize the query of the corresponding service data from the second database. Correspondingly, the service system B can also directly access the first database through the DBLINK to realize the inquiry of the corresponding service data from the first database.

The embodiment of the disclosure provides a data processing method applicable to a first server, which comprises the following steps: generating a service subscription message according to the update type of the first target data to be updated, wherein the service subscription message is suitable for acquiring a service interface related to the update type from the second service end; sending a service subscription message to a registration center, wherein the registration center is configured to determine a target service interface from candidate service interfaces registered by a second service end, and generate a service notification message according to the target service interface, and the candidate service interface is related to an update type; generating a first data update request according to a service notification message from a registry; and sending a first data updating request to a second server, wherein the second server is suitable for generating a first data updating task corresponding to the target service interface according to the first data updating request, and the first data updating task is used for updating service data related to the second server according to the first target data.

According to the embodiment of the disclosure, the first service end generates the service subscription message according to the update type of the first target data, determines the target service interface from the candidate service interfaces related to the update type through the registration center, and can realize screening of the target service interface according to the load condition corresponding to the candidate service interface of the second service end, so that the first service end can generate the first data update request according to the target service interface corresponding to the service notification message, and therefore the service data related to the second service end can be updated by utilizing the first target data by sending the first data update request to the second service end, the problem that data interaction cannot be performed because the respective databases of the first service end and the second service end do not support the communication connection function is avoided, and the data update efficiency is improved.

The embodiment of the disclosure also provides a data processing method applicable to the second server, which comprises the following steps: analyzing a first data updating request from a first service end to obtain first target data to be updated and a data updating task identifier, wherein the first data updating request is obtained through a target service interface; generating a first data updating task corresponding to the target service interface according to the first target data and the data updating task identifier; and executing a first data updating task to obtain updated target service data, wherein the first data updating task is used for updating the service data related to the second server according to the first target data.

FIG. 1B schematically illustrates an exemplary system architecture of data processing methods and apparatus according to embodiments of the present disclosure. It should be noted that fig. 1 is only an example of a system architecture to which embodiments of the present disclosure may be applied to assist those skilled in the art in understanding the technical content of the present disclosure, but does not mean that embodiments of the present disclosure may not be used in other devices, systems, environments, or scenarios.

As shown in fig. 1B, the application scenario 100 according to this embodiment may include terminal devices 101, 102, 103, a network 104, a first server 105, a second server 106, and a registry server 107. The network 104 is a medium used to provide communication links between the terminal devices 101, 102, 103 and the server 105, and between the first server 105, the second server 106, and the registry server 107. The network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.

The user may interact with the server 105 via the network 104 using the terminal devices 101, 102, 103 to receive or send messages or the like. Various communication client applications, such as shopping class applications, web browser applications, search class applications, instant messaging tools, mailbox clients, social platform software, etc. (by way of example only) may be installed on the terminal devices 101, 102, 103.

The terminal devices 101, 102, 103 may be a variety of electronic devices having a display screen and supporting web browsing, including but not limited to smartphones, tablets, laptop and desktop computers, and the like.

The first server 105, the second server 106, and the registry server 107 may be servers providing various services, such as a background management server (by way of example only) providing support for websites browsed by users using terminal devices. The background management server may analyze and process the received data such as the user request, and feed back the processing result (e.g., the web page, information, or data obtained or generated according to the user request) to the terminal device.

It should be noted that, the data processing method applied to the first server provided in the embodiments of the present disclosure may be generally executed by the first server 105. Accordingly, the data processing apparatus applied to the first server provided in the embodiments of the present disclosure may be generally disposed in the first server 1 05. The data processing method applied to the first server provided by the embodiments of the present disclosure may also be performed by a server or a server cluster that is different from the first server 105 and is capable of communicating with the terminal devices 101, 102, 103 and/or the first server 105. Accordingly, the data processing apparatus applied to the first server provided in the embodiments of the present disclosure may also be provided in a server or a server cluster that is different from the first server 105 and is capable of communicating with the terminal devices 101, 102, 103 and/or the first server 105.

It should be appreciated that the data processing method applied to the second server provided in the embodiments of the present disclosure may be generally performed by the second server 106. Accordingly, the data processing apparatus applied to the second server provided in the embodiments of the present disclosure may be generally disposed in the second server 105.

It should be understood that the number of terminal devices, networks and servers in fig. 1B is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.

The data processing method of the disclosed embodiment will be described in detail below with reference to fig. 2 to 6B based on the scenario described in fig. 1B.

Fig. 2 schematically illustrates a flowchart of a data processing method applied to a first server according to an embodiment of the disclosure.

As shown in fig. 2, the data processing method applied to the first server may include operations S210 to S240.

In operation S210, a service subscription message is generated according to the update type of the first target data to be updated.

According to an embodiment of the present disclosure, the service subscription message is adapted to obtain a service interface related to the update type from the second service side.

According to an embodiment of the present disclosure, the first server may be a data producer, the second server may be a data consumer, the first target data may be data that needs to be updated to the second server,

It should be noted that the first target data may be any type of service data, for example, may be service data such as historical transaction information, customer account name user name, password, log record, update task status, deletion protocol, transaction data, and the like.

Operation S220, a service subscription message is sent to the registry.

According to an embodiment of the present disclosure, the registry is configured to determine a target service interface from among candidate service interfaces registered by the second server, and generate a service notification message according to the target service interface, the candidate service interface being related to the update type.

In operation S230, a first data update request is generated according to a service notification message from the registry.

In operation S240, a first data update request is sent to the second server.

According to the embodiment of the disclosure, the registry may be configured to invoke the service resource from the second service end, where the second service end may register the address, port, and other interface parameters of the data update service resource to the registry by providing candidate service interfaces to the registry, and the registry may select a target service interface suitable for providing the data update service by detecting the load condition of the candidate service resource corresponding to each candidate service interface.

According to the embodiment of the disclosure, the registry may generate the service notification message according to the interface parameter of the target service interface, and the first service end may obtain the interface parameter corresponding to the target service interface by analyzing the service notification message, and generate the first data update request according to the interface parameter corresponding to the target service interface.

It should be appreciated that the first data update request may be sent to the second server.

According to the embodiment of the disclosure, the second server is adapted to generate a first data update task corresponding to the target service interface according to the first data update request, where the first data update task is used to update service data related to the second server according to the first target data.

According to the embodiment of the disclosure, the first target data is updated to the second service end, so that the first service end and the second service end can simultaneously inquire the first target data from respective corresponding databases, and the second service end can conveniently provide business services according to the first target data.

According to the embodiment of the disclosure, the registry can enable the first service end to call the second service end target service interface through dynamic proxy, load balancing, network resource calling and other mechanisms between the first service end and the second service end, so that the first target data is synchronized to the second service end, the calculation load pressure caused by the second service end due to the first target data obtained by synchronization can be reduced, the operation stability of the second service end is ensured, and the execution smoothness of the business service resources of the second service end is further improved.

It should be noted that the registry may be disposed in a distributed service center different from the first service end and the second service end, where the distributed service platform may provide a supporting capability of a distributed service base environment, and provide remote communication, service registration discovery, and monitoring management functions under a distributed architecture.

Or, the registry may be further disposed in a server cluster corresponding to the first service end or the second service end, and a specific setting manner of the registry is not limited in the embodiments of the present disclosure.

According to an embodiment of the present disclosure, the update type includes at least one of: new type, delete type, replace type.

According to an embodiment of the present disclosure, generating a first data update request from a service notification message from a registry includes: analyzing the service notification message to obtain a target service interface address corresponding to the target service interface; and generating a first data updating request according to the target service interface address, the data updating task identifier corresponding to the updating type and the first target data.

According to embodiments of the present disclosure, the target service interface address may include a network address, a port address, etc. corresponding to the target service resource. The first data updating request can be sent to the second server through the target service interface address, the second server can generate a first data updating task corresponding to the updating type through the data updating task identifier, and the database corresponding to the second server can be updated according to the first target data by executing the first data updating task.

For example, the first data updating task may be a generated transaction approval data insertion task, so that the second server side may insert the transaction approval data into a database corresponding to the second server side by executing the first data updating task, so that the second server side provides subsequent business services through the inserted transaction approval data.

It should be understood that the first data update task may further include a deletion task, a replacement task, and the like, and the first data update task may be determined according to the update type and the data task update identifier, so that the first data update task is executed according to the first target data, so as to implement data interaction and data synchronization between the first database corresponding to the first server and the database corresponding to the second server.

Fig. 3 schematically illustrates an application scenario diagram of a data processing method according to an embodiment of the present disclosure.

As shown in fig. 3, the second service end may register candidate service interfaces with the registry, for example, register an interface address of a server that needs to execute a service, so as to generate a candidate service interface sequence table, the first service end may send a service subscription message to the registry, and the registry may determine a target service interface according to respective corresponding load conditions of the candidate service interfaces in the candidate service interface sequence table when receiving the service subscription message sent by the first service end, and send a service notification message containing information about the relevant interface of the target service interface to the first service end, where the first service end may call a service resource corresponding to the target service interface by sending a first data update request to the second service end, so as to generate a first data update task, and implement update of the second service end to obtain first target data. The monitoring center can count the data interaction frequency of the first service end and the second service end respectively, so that the condition of repeated interaction of unified first target data is avoided, and occupied network bandwidth is saved.

It should be noted that, the distributed service platform for providing the distributed data interaction service for the data access between the first service end and the second service end can implement the functions of service monitoring, data tracing, interactive data current limiting, emergency fusing and the like for the data access through the access monitoring center.

According to an embodiment of the present disclosure, the data processing method applied to the first server further includes: determining second target data with the query frequency greater than or equal to a preset frequency threshold value from the initial data according to the query frequencies respectively related to the initial data, wherein the initial data is stored in a first database corresponding to a first service end; and sending the second target data to the distributed message platform, wherein the second server is configured to acquire the second target data from the distributed message platform and synchronize the second target data to a second database associated with the second server.

According to an embodiment of the present disclosure, the second target data may include data that is produced by the first server and that may be frequently queried by the second server, such as a user name of a business transaction user, a rights token, and the like. The distributed message platform may include an asynchronous message queue such as Kafka, and the first service end may serve as a message production end to send the produced second target data to the asynchronous message queue in the distributed message platform. The second server may pull the second target data from the asynchronous message queue under the condition that it detects that new second target data is generated in the asynchronous message queue, and store the second target data in a corresponding database fragmentation area in the second database based on a data attribute (e.g., a data classification attribute, a data class attribute) of the second target data, so as to realize data synchronous update between the first database and the second database.

According to the embodiment of the disclosure, the first server synchronizes the second target data with the second server through the distributed service platform, so that the data which is frequently queried by the second server can be timely updated to the second database, meanwhile, the problems of data packet loss, frequent calling of a working thread and the like caused by synchronizing the data through a communication request between the first server and the second server are avoided, the timeliness and the integrity of data synchronization are ensured, and the calculation cost is reduced.

Fig. 4 schematically illustrates an application scenario diagram of a data processing method according to another embodiment of the present disclosure.

As shown in fig. 4, the application scenario may include a first service side, a second service side, and a distributed message platform. The first service may apply for a TOPIC (TOPIC) a_topic on the distributed message platform, where the TOPIC a_topic may include partition 1 and partition 2. The first server may send the second target data corresponding to the partition 1, and synchronously write the changed second target data into the a_topic, so that the second server consumes the second target data from the partition 1 of the distributed message platform. Accordingly, the first server may send the second target data corresponding to the partition 2, so that the second server consumes the second target data from the partition 2 of the distributed message platform.

The distributed message platform can detect various possible abnormal conditions (such as thread blocking, task accumulation, server downtime and the like) in real time in the message production and message consumption processes, and the first service end and the second service end can detect the conditions of service transaction availability, transaction processing correctness, task accumulation and the like in real time through accessing the distributed message platform, alarm the detected abnormal problems, and timely inform related operation and maintenance personnel of intervention processing in a short message, mail and the like. Meanwhile, the first service end can also generate a exported batch file daily to serve as a spam measure for abnormal conditions, so that consistency of access data is fully ensured.

According to an embodiment of the present disclosure, the data processing method applied to the first server further includes: according to the query frequencies respectively related to the initial data, determining third target data with the query frequency smaller than a preset frequency threshold value from the initial data, wherein the initial data is stored in a first database corresponding to a first service end; updating the initial batch data table according to the third target data to obtain an updated batch data table; and sending the batch data table to the distributed message platform, wherein the second server is configured to obtain the batch data table from the distributed message platform and synchronize the batch data table to a second database associated with the second server.

According to an embodiment of the present disclosure, the third target data with the query frequency smaller than the preset frequency threshold may be data with low query timeliness requirements related to the business service resource of the second service end, such as historical transaction data and the like.

According to the embodiment of the disclosure, the data produced in the previous time period in the initial batch data table can be updated according to the third target data produced in the current time period by the first service end, and the updated batch data table is obtained. The second server side can pull the batch data table from the distributed message platform at preset data updating time, and store the updated batch data table into the second database, so that batch data synchronization between the first database and the second database is realized.

Fig. 5 schematically illustrates an application scenario diagram of a data processing method according to a further embodiment of the present disclosure.

As shown in fig. 5, the application scenario may include a first service terminal 501, a second service terminal 502, and a distributed message platform 500. The first service terminal 501 and the second service terminal 502 may respectively provide business services through respective associated server clusters, the first service terminal 501 may be associated with a first database server, and the second service terminal 502 may be associated with a second database server. The distributed messaging platform 500 may include a distributed application coordination service software cluster 510 (Zookeeper cluster) for detecting a data synchronization process in a batch data (third target data) synchronization process between the first server 501 and the second server 502. Distributed message platform 500 may also include a bulk data management server 521, a master bulk data controller 531, a backup bulk data controller 532, a master database server 541, and backup database servers 551 and 552.

Synchronization of third target data (i.e., bulk data) may be achieved between the first server 501 and the second server 502 by accessing the distributed application coordination service software cluster 510. For example, the first service terminal 501 may create a batch export job of APPLICATION A TABLE table, and the first service terminal 501 may generate a batch file according to the third target data meeting the batch data synchronization condition in APPLICATION A TABLE table. The first service end can download batch files to the second service end 502 through the distributed application coordination service software cluster 510 at the late 22 points daily; the second server 502 may create a new APPLICATION A TABLE table batch import job to load batch files received from the first server 501 into a second database (e.g., gaussDB database) associated with the second server 502. In this way, DBLINK decoupling between the databases of the first service terminal 501 and the second service terminal 502 can be achieved.

Distributed message platform 500 may implement detection and scheduling functions through client 503. The batch data detection information detected by the Zookeeper cluster may be obtained, for example, by communicatively connecting the client 503 to the batch data management server 521.

In one embodiment of the present disclosure, the first service end may build a service providing group using a mobile internet financial open platform providing framework and a GaussDB database, register a service to a registry of the distributed service platform, obtain a message of a service provider from the registry, and mainly obtain a server IP address list and port information of the second service end. Wherein the financial services open platform may provide a universal base mobile end component and services. The GaussDB database can have the characteristics of complex transaction mixed loading capacity, distributed transaction support, mass data storage and the like.

According to the embodiment of the disclosure, the first service end subscribes the service provided by the second service end to the registry of the distributed service platform, and the capabilities of full-link service monitoring, tracking, current limiting, fusing and the like can be implemented through the data synchronous monitoring function of the distributed service platform, so that powerful guarantee is provided for the operation and maintenance of the distributed service. The application monitoring system of the distributed service platform can also collect application information, intensively display events and running conditions of each application system, and monitor the application systems. The data synchronization monitoring function of the distributed service platform can provide one-stop visual integration analysis capability, integrate and provide centralized display of professional systems such as indexes, logs, links and the like, has IT architecture perception, and can drill faults step by step and rapidly attribution. The method has the advantages of realizing diagnosis and detection of the node, even the function in the running process, reducing the difficulty of fault analysis and improving the attribution and positioning efficiency of complex problems.

Fig. 6A schematically illustrates a flowchart of a data processing method applied to a second server according to an embodiment of the disclosure.

As shown in fig. 6A, the information processing method applied to the server may include the following operations S610 to S630.

In operation S610, the first data update request from the first service end is parsed to obtain the first target data to be updated and the data update task identifier.

According to an embodiment of the present disclosure, the first data update request is obtained through the target service interface.

In operation S620, a first data update task corresponding to the target service interface is generated according to the first target data and the data update task identifier.

In operation S630, the first data update task is executed to obtain updated target service data.

According to the embodiment of the disclosure, the first data updating task is used for updating service data related to the second server according to the first target data.

It should be noted that, in the embodiment of the present disclosure, technical terms related to the data processing method applied to the second server include, but are not limited to, the first target data and the target service interface, and technical terms similar to or corresponding to those in the data processing method applied to the first server include, but are not limited to, the first target data and the target service interface have similar or corresponding technical properties, and the embodiments of the present disclosure will not be repeated here.

According to an embodiment of the present disclosure, further comprising: generating a service registration message according to a candidate service attribute corresponding to the candidate service interface, wherein the candidate service attribute comprises a candidate service interface address; and sending a service registration message to the registry.

According to an embodiment example of the present disclosure, generating, according to the first target data and the data update task identifier, a first data update task corresponding to the target service interface includes: determining a data update task attribute associated with a data attribute of the first target data, wherein the data update task attribute characterizes a task execution policy of the first data update task; determining task configuration information corresponding to the data updating task attribute from the plurality of candidate task configuration information; and generating a first data updating task according to the task configuration information and the first target data.

According to an embodiment of the present disclosure, the task execution policy may indicate an execution rule for an update operation of the first target data, for example, when the first target data includes approval data, i.e., the data attribute of the first target data may include an approval data attribute, by determining that the approval data associated with the approval data attribute updates the task attribute, the task execution policy may be determined to insert the approval data into a database shard area in the second database.

According to an embodiment of the present disclosure, the task configuration information may be a configuration template corresponding to a task execution policy, and generating the first data update task may be achieved by filling the configuration template according to the first target data.

According to the embodiment of the disclosure, the task execution policies comprise a plurality of task execution policies, and the plurality of task execution policies comprise target task execution policies with latest update time; wherein performing the first data update task comprises: and under the condition that the data updating task attribute represents the target task execution strategy, executing a first data updating task in a gray scale container related to the second server, wherein the first data updating task is used for updating initial service data in the gray scale container according to the first target data to obtain updated target service data.

According to embodiments of the present disclosure, a task execution policy may have a task version identification, which may be associated with a creation time of the task execution policy. The target task execution policy may be associated with the target task version identifier closest to the current time, i.e. the target task execution policy may be updated recently. By executing the first data updating task according to the target task execution strategy in the gray scale container related to the second server, the target task execution strategy which is updated recently can be operated in the gray scale environment, so that the execution environment is distinguished from the task execution strategy which runs stably, the execution logic detection for the target task execution strategy is facilitated, the execution logic error of the target task execution strategy is found and modified in time, or the service operation effect of the target task execution strategy is fed back in time.

Fig. 6B schematically illustrates an application scenario diagram of a data processing method according to a further embodiment of the present disclosure.

As shown in fig. 6B, the application scenario may include a first service end, a second service end, and a distributed service platform, where the distributed service platform may be provided with a registry, and the second service end may send a request to the registry, so as to register a candidate service interface of the second service end to the registry. The first service side may instruct the registry to select the target service interface according to the respective load states of the candidate service interfaces by sending a service subscription message to the registry. Meanwhile, the registry may generate a service notification message based on the related information corresponding to the target service interface and transmit the service notification message to the first service side. The first service end may generate a first data update request including first target data to be updated, a target service interface address, and a data update task identifier. The first service end can send the first data update request to the distributed service platform, and the distributed service platform can perform gray scale marking on the first data update request according to the data update task identifier. The second service end routing layer of the second service end can execute the first data updating task according to the gray scale identification of the first data updating request and the target task executing strategy, so that the first target data is released in the gray scale container, and the service executing efficiency which is too low and is caused by the defect of the executing strategy of the target task executing strategy can be effectively reduced.

Accordingly, in the case that the first data update request is not marked with the gray scale identifier, the second server routing layer may execute the first data update task according to the task execution policy created earlier relative to the target task execution policy, so as to implement publishing of the first target data in the normal container.

According to the embodiment of the disclosure, the distributed service platform can also perform data synchronization monitoring such as full-link service monitoring, tracking, current limiting, fusing and the like on the data synchronization between the first service end and the second service end.

According to embodiments of the present disclosure, the first data update request may also be gray scale marked by a service system other than the distributed service platform.

According to an embodiment of the present disclosure, the data processing method applied to the second server further includes: under the condition that the distributed message platform acquires second target data from the first service end, acquiring the second target data from the distributed message platform; and synchronizing the second target data to a second database associated with the second server.

According to an embodiment of the present disclosure, the data processing method applied to the second server further includes: receiving a batch data table sent from a first service end from a distributed message platform; and synchronizing the batch data table to a second database associated with the second server.

Fig. 7 schematically shows a flowchart of a data processing method applied to a business service system according to an embodiment of the present disclosure.

As shown in fig. 7, the data processing method applied to the business service system may include the following operations S710 to S780.

In operation S710, the first server generates a service subscription message according to the update type of the first target data to be updated.

In operation S720, the first service end sends a service subscription message to the registry.

In operation S730, the registry determines a target service interface from the candidate service interfaces registered by the second server according to the service subscription message.

In operation S740, the registry generates a service notification message according to the target service interface.

According to an embodiment of the present disclosure, the candidate service interface is associated with an update type.

In operation S750, the first server generates a first data update request according to the service notification message from the registry.

In operation S760, the first server sends a first data update request to the second server.

In operation S770, the second server parses the first data update request from the first server to obtain the first target data to be updated and the data update task identifier.

According to an embodiment of the present disclosure, the first data update request is obtained through a target service interface.

In operation S780, the second server generates a first data update task corresponding to the target service interface according to the first target data and the data update task identifier.

In operation S790, the second server executes the first data update task to obtain updated target service data.

Fig. 8 schematically illustrates a block diagram of a data processing apparatus applied to a first server according to an embodiment of the present disclosure.

As shown in fig. 8, an information processing apparatus 800 provided by an embodiment of the present disclosure includes: a service subscription message generation module 810, a service subscription message transmission module 820, a first data update request generation module 830, and a first data update request transmission module 840.

The service subscription message generating module 810 is configured to generate a service subscription message according to an update type of the first target data to be updated, where the service subscription message is adapted to obtain a service interface related to the update type from the second service end.

The service subscription message sending module 820 is configured to send a service subscription message to a registry, where the registry is configured to determine a target service interface from the candidate service interfaces registered by the second service end, and generate a service notification message according to the target service interface, where the candidate service interface is related to the update type.

The first data update request generation module 830 is configured to generate a first data update request according to a service notification message from a registry.

The first data update request sending module 840 is configured to send a first data update request to the second server.

According to an embodiment of the present disclosure, the first data update request generation module includes: the target service interface address obtaining unit and the first data update request generating unit.

And the target service interface address obtaining unit is used for analyzing the service notification message to obtain the target service interface address corresponding to the target service interface.

And the first data update request generation unit is used for generating a first data update request according to the target service interface address, the data update task identifier corresponding to the update type and the first target data.

According to an embodiment of the present disclosure, a data processing apparatus module includes: a second target data obtaining unit and a second target data transmitting unit.

The second target data obtaining unit is used for determining second target data with the query frequency greater than or equal to a preset frequency threshold value from the initial data according to the query frequencies respectively related to the initial data, and the initial data is stored in the first database corresponding to the first service end.

And the second target data sending unit is used for sending second target data to the distributed message platform, wherein the second server side is configured to acquire the second target data from the distributed message platform and synchronize the second target data into a second database related to the second server side.

According to an embodiment of the present disclosure, the data processing apparatus module further includes: the system comprises a third target data obtaining unit, a batch data table updating unit and a batch data table sending unit.

And the third target data obtaining unit is used for determining third target data with the query frequency smaller than a preset frequency threshold value from the initial data according to the query frequencies respectively related to the initial data, wherein the initial data is stored in a first database corresponding to the first service end.

And the batch data table updating unit is used for updating the initial batch data table according to the third target data to obtain an updated batch data table.

And the batch data table sending unit is used for sending the batch data table to the distributed message platform, wherein the second server side is configured to acquire the batch data table from the distributed message platform and synchronize the batch data table into a second database related to the second server side.

Fig. 9 schematically illustrates a block diagram of a data processing apparatus applied to a second server according to an embodiment of the present disclosure.

As shown in fig. 9, an information processing apparatus 900 provided by an embodiment of the present disclosure includes: the system comprises an analysis module 910, a first data update task generation module 920 and a first data update task execution module 930.

The parsing module 910 is configured to parse a first data update request from a first service side, where the first data update request is obtained through a target service interface.

The first data update task generating module 920 is configured to generate a first data update task corresponding to the target service interface according to the first target data and the data update task identifier.

And a first data update task execution module 930, configured to execute a first data update task, where the first data update task is configured to update service data related to the second server according to the first target data.

According to an embodiment of the present disclosure, the first data update task generation module includes: a data update task attribute determination unit, a task configuration information determination unit, and a first data update task generation unit.

And the data updating task attribute determining unit is used for determining the data updating task attribute associated with the data attribute of the first target data, wherein the data updating task attribute represents a task execution strategy of the first data updating task.

And a task configuration information determining unit configured to determine task configuration information corresponding to the data update task attribute from the plurality of candidate task configuration information.

And the first data updating task generating unit is used for generating a first data updating task according to the task configuration information and the first target data.

According to an embodiment of the present disclosure, the first data update task generating unit includes a target traffic data update subunit.

And the target service data updating subunit is used for executing a first data updating task in the gray scale container related to the second service end under the condition that the attribute of the data updating task represents the target task execution strategy, and the first data updating task is used for updating the initial service data in the gray scale container according to the first target data to obtain updated target service data.

According to an embodiment of the present disclosure, a data processing apparatus module includes: a service registration message generating unit and a service registration message transmitting unit.

A service registration message generating unit for generating a service registration message according to candidate service attributes corresponding to the candidate service interfaces, wherein the candidate service attributes comprise candidate service interface addresses

And the service registration message sending unit is used for sending the service registration message to the registration center.

According to an embodiment of the present disclosure, a data processing apparatus module includes: a second target data acquisition unit and a second data synchronization unit.

The second target data acquisition unit is used for acquiring the second target data from the distributed message platform under the condition that the distributed message platform acquires the second target data from the first service end.

And the second data synchronization unit is used for synchronizing the second target data to a second database related to the second server.

According to an embodiment of the present disclosure, a data processing apparatus module includes: a batch data table receiving unit and a batch data table synchronizing unit.

And the batch data table receiving unit is used for receiving the batch data table sent by the first service end from the distributed message platform.

And the batch data table synchronization unit is used for synchronizing the batch data table to a second database related to the second server.

According to an embodiment of the present disclosure, a business service system includes a first service side, a second service side, and a registry.

The first server is configured to generate a service subscription message according to the update type of the first target data to be updated, and the service subscription message is suitable for acquiring a service interface related to the update type from the second server.

The first server is configured to send a service subscription message to the registry.

The registry is configured to determine a target service interface from the candidate service interfaces registered by the second server according to the service subscription message.

The registry is configured to generate a service notification message based on the target service interface, the candidate service interface being associated with the update type.

The first server is configured to generate a first data update request based on a service notification message from the registry.

The first server is configured to send a first data update request to the second server.

The second server is configured to parse a first data update request from the first server to obtain first target data to be updated and a data update task identifier, where the first data update request is obtained through a target service interface.

The second server is configured to generate a first data update task corresponding to the target service interface according to the first target data and the data update task identifier.

The second server is configured to execute a first data updating task to obtain updated target service data, wherein the first data updating task is used for updating service data related to the second server according to the first target data.

Fig. 10 schematically illustrates a block diagram of an electronic device adapted to implement a data processing method according to an embodiment of the disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed in this text.

As shown in fig. 10, an electronic device 1000 according to an embodiment of the present disclosure includes a processor 1001 that can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 1002 or a program loaded from a storage section 1008 into a Random Access Memory (RAM) 1003. The processor 1001 may include, for example, a general purpose microprocessor (e.g., a CPU), an instruction set processor and/or an associated chipset and/or a special purpose microprocessor (e.g., an Application Specific Integrated Circuit (ASIC)), or the like. The processor 1001 may also include on-board memory for caching purposes. The processor 1001 may include a single processing unit or multiple processing units for performing different actions of the method flows according to embodiments of the present disclosure.

In the RAM 1003, various programs and data necessary for the operation of the electronic apparatus 1000 are stored. The processor 1001, the ROM 1002, and the RAM 1003 are connected to each other by a bus 1004. The processor 1001 performs various operations of the method flow according to the embodiment of the present disclosure by executing programs in the ROM 1002 and/or the RAM 1003. Note that the program may be stored in one or more memories other than the ROM 1002 and the RAM 1003. The processor 1001 may also perform various operations of the method flow according to the embodiments of the present disclosure by executing programs stored in the one or more memories.

According to an embodiment of the disclosure, the electronic device 1000 may also include an input/output (I/O) interface 1005, the input/output (I/O) interface 1005 also being connected to the bus 1004. The electronic device 1000 may also include one or more of the following components connected to the I/O interface 1005: an input section 1006 including a keyboard, a mouse, and the like; an output portion 1007 including a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), etc., and a speaker, etc.; a storage portion 1008 including a hard disk or the like; and a communication section 1009 including a network interface card such as a LAN card, a modem, or the like. The communication section 1009 performs communication processing via a network such as the internet. The drive 1010 is also connected to the I/O interface 1005 as needed. A removable medium 1011, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like, is installed as needed in the drive 1010, so that a computer program read out therefrom is installed as needed in the storage section 1008.

The present disclosure also provides a computer-readable storage medium that may be embodied in the apparatus/device/system described in the above embodiments; or may exist alone without being assembled into the apparatus/device/system. The computer-readable storage medium carries one or more programs which, when executed, implement methods in accordance with embodiments of the present disclosure.

According to embodiments of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, which may include, for example, but is not limited to: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this disclosure, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. For example, according to embodiments of the present disclosure, the computer-readable storage medium may include ROM 1002 and/or RAM 1003 and/or one or more memories other than ROM 1002 and RAM 1003 described above.

Embodiments of the present disclosure also include a computer program product comprising a computer program containing program code for performing the methods shown in the flowcharts. The program code, when executed in a computer system, causes the computer system to perform the methods provided by embodiments of the present disclosure.

The above-described functions defined in the system/apparatus of the embodiments of the present disclosure are performed when the computer program is executed by the processor 1001. The systems, apparatus, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the disclosure.

In one embodiment, the computer program may be based on a tangible storage medium such as an optical storage device, a magnetic storage device, or the like. In another embodiment, the computer program may also be transmitted in the form of signals on a network medium, distributed, and downloaded and installed via the communication section 1009, and/or installed from the removable medium 1011. The computer program may include program code that may be transmitted using any appropriate network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the foregoing.

In such an embodiment, the computer program may be downloaded and installed from a network via the communication portion 1009, and/or installed from the removable medium 1011. The above-described functions defined in the system of the embodiments of the present disclosure are performed when the computer program is executed by the processor 1001. The systems, devices, apparatus, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the disclosure.

According to embodiments of the present disclosure, program code for performing computer programs provided by embodiments of the present disclosure may be written in any combination of one or more programming languages, and in particular, such computer programs may be implemented in high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. Programming languages include, but are not limited to, such as Java, c++, python, "C" or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of remote computing devices, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., connected via the Internet using an Internet service provider).

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

Those skilled in the art will appreciate that the features recited in the various embodiments of the disclosure and/or in the claims may be provided in a variety of combinations and/or combinations, even if such combinations or combinations are not explicitly recited in the disclosure. In particular, the features recited in the various embodiments of the present disclosure and/or the claims may be variously combined and/or combined without departing from the spirit and teachings of the present disclosure. All such combinations and/or combinations fall within the scope of the present disclosure.

The embodiments of the present disclosure are described above. However, these examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although the embodiments are described above separately, this does not mean that the measures in the embodiments cannot be used advantageously in combination. The scope of the disclosure is defined by the appended claims and equivalents thereof. Various alternatives and modifications can be made by those skilled in the art without departing from the scope of the disclosure, and such alternatives and modifications are intended to fall within the scope of the disclosure.

Claims

1. A data processing method is applied to a first service end and comprises the following steps:

sending a service subscription message to a registry, wherein the registry is configured to determine a target service interface from candidate service interfaces registered by the second server, and generate a service notification message according to the target service interface, and the candidate service interface is related to the update type;

2. The method of claim 1, wherein generating a first data update request from a service notification message from the registry comprises:

3. The method of claim 1, further comprising:

And sending the second target data to a distributed message platform, wherein the second server is configured to acquire the second target data from the distributed message platform and synchronize the second target data into a second database related to the second server.

4. The method of claim 1, further comprising:

5. The method of any of claims 1 to 4, the update type comprising at least one of:

new type, delete type, replace type.

6. The data processing method is applied to a second server and comprises the following steps:

7. The method of claim 6, wherein generating a first data update task corresponding to the target service interface based on the first target data and the data update task identification comprises:

8. The method of claim 7, wherein the task execution policies include a plurality of the task execution policies including a target task execution policy with a latest update time;

wherein executing the first data update task comprises:

and under the condition that the data updating task attribute represents the target task execution strategy, executing the first data updating task in a gray scale container related to the second server, wherein the first data updating task is used for updating initial service data in the gray scale container according to the first target data to obtain the updated target service data.

9. The method of claim 6, further comprising:

and sending the service registration message to the registration center.

10. The method of claim 6, further comprising:

under the condition that the distributed message platform acquires second target data from the first server side, acquiring the second target data from the distributed message platform; and

11. The method of claim 6, further comprising:

receiving a batch data table sent by the first server from a distributed message platform; and

12. The data processing method is applied to a business service system, wherein the business service system comprises a first service end, a second service end and a registration center, and the data processing method comprises the following steps:

The first server generates a first data updating request according to a service notification message from the registry;

the first server side sends the first data updating request to the second server side;

the second server executes the first data updating task to obtain updated target service data, wherein the first data updating task is used for updating service data related to the second server according to the first target data.

13. A data processing apparatus, applied to a first service end, comprising:

the service subscription message generation module is used for generating a service subscription message according to the update type of the first target data to be updated, and the service subscription message is suitable for acquiring a service interface related to the update type from the second service end;

the first data updating request sending module is used for sending the first data updating request to the second server, wherein the second server is suitable for generating a first data updating task corresponding to the target service interface according to the first data updating request, and the first data updating task is used for updating service data related to the second server according to the first target data.

14. A data processing apparatus, applied to a second server, comprising:

the system comprises a first service end, a second service end, a parsing module and a first data updating module, wherein the first service end is used for receiving a first data updating request from the first service end;

15. The business service system comprises a first service end, a second service end and a registration center;

the first server side is configured to generate a service subscription message according to the update type of the first target data to be updated, wherein the service subscription message is suitable for acquiring a service interface related to the update type from the second server side;

the registry is configured to determine a target service interface from the candidate service interfaces registered by the second server according to the service subscription message;

the registry is configured to generate a service notification message from the target service interface, the candidate service interface being associated with the update type;

the second server is configured to execute the first data updating task to obtain updated target service data, wherein the first data updating task is used for updating service data related to the second server according to the first target data.

16. An electronic device, comprising:

one or more processors;

storage means for storing one or more programs,

wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to perform the method of any of claims 1-12.

17. A computer readable storage medium having stored thereon executable instructions which, when executed by a processor, cause the processor to perform the method according to any of claims 1 to 12.

18. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1 to 12.