WO2020253634A1

WO2020253634A1 - Data processing method, system and device

Info

Publication number: WO2020253634A1
Application number: PCT/CN2020/095935
Authority: WO
Inventors: 王顺云
Original assignee: 深圳前海微众银行股份有限公司
Priority date: 2019-06-21
Filing date: 2020-06-12
Publication date: 2020-12-24
Also published as: CN110289999A; CN110289999B

Abstract

The embodiments of the present invention disclose a data processing method, system and device, relating to the field of financial technology (Fintech). Said method comprises: after receiving an identifier of a first client device and data to be processed which are sent by the first client device, querying a preset correlation table to obtain a target service group corresponding to the identifier of the first client device, and using a master server in the target service group to process the data to be processed. In the embodiments of the present invention, by providing at least one service group and a master server and a slave server included in each service group, the master server in each service group can exist in real time, i.e. at least one service group can be in an available state at all times. In this way, by executing a data processing process related to the first client device using the master server in the service group corresponding to the first client device, high availability for processing data of the client device can be ensured.

Description

Data processing method, system and device

Cross references to related applications

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office, the application number is 201910542091.4, and the application name is "a data processing method, system and device" on June 21, 2019, the entire content of which is incorporated herein by reference Applying.

Technical field

The present invention relates to the technical field of financial technology (Fintech), and in particular to a data processing method, system and device.

Background technique

With the development of computer technology, more and more technologies are applied in the financial field. The traditional financial industry is gradually transforming to Fintech. However, due to the security and real-time requirements of the financial industry, Fintech has also proposed technology higher requirement. The financial technology field generates a large amount of data every day, such as loan business system and customer loan data, insurance business system and customer marketing data, management business system liquidation data, etc.; different business systems correspond to different data, resulting in Different business systems have different requirements for data processing. Therefore, how to process the data of different business systems is very important for the normal development of the financial technology field.

In an existing implementation, a dedicated server corresponding to each business system can be set in the financial technology field, so that multiple dedicated servers can be used to process data of different business systems respectively. For example, the dedicated server corresponding to the loan business system can be the loan server. If the loan server receives the data sent by the loan business system, it can use the resources in the loan server (such as hard disk, disk, central processing unit, network, etc.) Data is processed. However, in this implementation method, each business system corresponds to a dedicated server. If the resources on a dedicated server are damaged, it usually requires professionals to maintain the dedicated server (such as repairing the dedicated server, or setting up a new dedicated server). server). In this way, the business system needs to wait for the completion of the maintenance process before continuing to execute the data processing process. It can be seen that the use of the above implementation may cause the data processing process of the business system to be blocked, and thus cannot achieve high data processing availability.

In summary, there is an urgent need for a data processing method to solve the technical problem of low availability of data processing caused by using a dedicated server corresponding to each business system to process data.

Summary of the invention

The embodiments of the present invention provide a data processing method, system, and device to solve the technical problem of low data processing availability caused by using a dedicated server corresponding to each business system to process data.

In the first aspect, an embodiment of the present invention provides a data processing method, which is applied to a data processing system, the data processing system includes at least one service group, and each service group in the at least one service group includes a master Server and one or more slave servers; the method includes:

Receive a data request message sent by a first client device, where the data request message includes the identification of the first client device and the data to be processed; further, query a preset correspondence table to obtain the first client The target service group corresponding to the device identifier, and the main server in the target service group is used to process the data to be processed; wherein the preset correspondence table stores one or more client device identifiers and all Describe the correspondence of at least one service group.

In the above design, by setting at least one service group and the master server and one or more slave servers included in each service group, it can be ensured that the master server in each service group exists in real time (for example, if a service at the current moment If the main server of the group is damaged, a new main server can be assigned to the service group), so that at least one service group can be available at all times; in this way, by assigning the corresponding service group to the first client device, the first client device can be The main server in the service group corresponding to a client device executes the data processing process related to the first client device to ensure high availability of the data processing process.

In a possible design, if the master server in the target service group fails, the first slave server is selected from one or more slave servers in the target service group, and the first slave server is used. The server processes the to-be-processed data.

In the above design, if the main server in a certain service group is damaged, a new main server can be selected from other servers included in the service group, so that the new main server can be used to process the data to be processed. When the main server is damaged, a new main server is automatically selected, which eliminates the need for manual maintenance, which is simple to operate, easy to implement, and can reduce maintenance costs; on the other hand, by using the new main server to process the pending data, users do not need to input data again The data processing result can be obtained by requesting the message, so that the user experience is better.

In a possible design, the preset correspondence table further includes the IP address of the main server in each service group; the using the main server in the target service group to process the data to be processed includes: According to the IP address of the main server in the target service group included in the preset correspondence table, the data to be processed is sent to the main server in the target service group, so that the The main server processes the data to be processed.

In the above design, the IP address of the client device, the service group, and the IP address of the main server in the service group are added to the preset correspondence table, so that querying the preset correspondence table can determine the host that processes the data to be processed. Servers without having to analyze each server in each service group, which can improve the efficiency of data processing.

In a possible design, if the service group corresponding to the identifier of the first client device does not exist in the preset correspondence table, then according to the performance of the at least one service group from the at least one service group The first service group is selected from the group, and the main server in the first service group is used to process the data to be processed; the performance of each service group in the at least one service group is determined by the performance of each service group in the at least one service group Determined by the disk capacity of the master server and one or more slave servers.

In the above design, by selecting the service group with the best current performance in at least one service group as the service group corresponding to the new client device, not only can the efficiency of processing the data of the client device be improved, but also at least one service can be guaranteed The load balance of the group improves the data processing capacity of the data processing system.

In a possible design, after the first service group is selected from the at least one service group according to the performance of the at least one service group, the first service group may be generated in the preset correspondence table. The corresponding relationship between the identifier of the client device and the first service group.

In the above design, after assigning the target service group to the new client device, the corresponding relationship between the new client device and the target service group can be updated to the preset correspondence table, thereby improving the real-time performance of the preset correspondence table. Furthermore, the accuracy of data processing based on the preset correspondence table is improved.

In a possible design, before using the main server in the target service group to process the to-be-processed data, it may also be determined that the first client device is legal.

In the above design, by verifying the legality of the client device before processing the data of the client device, it is possible to avoid processing the data of other client devices, and to ensure the orderliness and processing of the data of different client devices. safety.

In a second aspect, the data processing system provided by an embodiment of the present invention includes one or more client devices, a proxy server, and at least one service group, and each service group in the at least one service group includes at least one host Server and one or more slave servers;

The client device is configured to generate a data request message according to a user's trigger operation, and send the data request message to the proxy server; the data request message includes the identification of the client device and the data to be processed ；

The proxy server is configured to, after receiving the data request message sent by the client device, query a preset correspondence table to determine the target service group corresponding to the identifier of the client device, and send the to-be-processed data For the main server in the target service group; the preset correspondence table stores the correspondence between the identification of the one or more client devices and the at least one service group;

The main server in the target service group is configured to process the data to be processed after receiving the data to be processed sent by the proxy server.

In a third aspect, an embodiment of the present invention provides a data processing device, the device is applied to a data processing system, the data processing system includes at least one service group, and each service group in the at least one service group includes a master Server and one or more slave servers; the device includes:

A transceiver module, configured to receive a data request message sent by a first client device, where the data request message includes the identifier of the first client device and the data to be processed;

The query module is configured to query a preset correspondence table to obtain the target service group corresponding to the identifier of the first client device; the preset correspondence table stores one or more client device identifiers and the Correspondence of at least one service group;

The processing module is configured to use the main server in the target service group to process the data to be processed.

In a fourth aspect, a computer-readable storage medium provided by an embodiment of the present invention includes instructions, which when run on a computer, cause the computer to execute the method described in any of the first aspect.

In the fifth aspect, a computer program product provided by an embodiment of the present invention, when it runs on a computer, causes the computer to execute the method described in any of the first aspect.

In a sixth aspect, an embodiment of the present invention provides a computer device, including:

At least one memory for storing program instructions;

At least one processor is configured to call program instructions stored in the memory, and execute any method as described in the first aspect according to the obtained program.

These or other implementations of the present invention will be more concise and understandable in the description of the following embodiments.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present invention, the following will briefly introduce the drawings needed in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings may be obtained from these drawings without creative labor.

FIG. 1 is a schematic structural diagram corresponding to a data processing method provided by an embodiment of the present invention;

2 is a schematic diagram of the architecture of a data processing system provided by an embodiment of the present invention;

FIG. 3 is a schematic flowchart corresponding to a data processing method provided by an embodiment of the present invention;

4 is a schematic structural diagram of a data processing device provided by an embodiment of the present invention;

Fig. 5 is a schematic structural diagram of a computer device provided by an embodiment of the present invention.

Detailed ways

In order to make the objectives, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all of them. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

Fintech refers to a new innovative technology brought to the financial field after the integration of information technology into the financial field. The financial system can be improved by using advanced information technology to assist in financial operations, transaction execution and financial system improvements. Processing efficiency, business scale, and can reduce costs and financial risks. Generally speaking, the field of financial technology usually involves a large amount of data, such as loan data of the credit business system, card sales data of the sales business system, transfer data of the payment business system, etc. How to use technology to mine a large amount of data It has always been the goal pursued by the financial technology field to extract the characteristics required by the financial field.

Since the solution of setting up a dedicated server for each business system cannot guarantee the high availability of data processing, in order to ensure the high availability of data processing, in a possible implementation, multiple dedicated servers can be set up for the same business system ( Two or more). In this way, if a dedicated server is damaged, other dedicated servers can be used to process the data of the business system to ensure the continuity of processing the data in the business system.

Taking the setting of two dedicated servers for the same business system as an example, Figure 1 is a schematic diagram of the system architecture corresponding to this implementation method. As shown in Figure 1, the system can be provided with a client device 110, a load balancing server 120, and a dedicated server. A server 131, a dedicated server 132, and a network attached storage (Network Attached Storage, NAS) server 140. Among them, the load balancing server 120 can be connected to the client device 110, the dedicated server 131, and the dedicated server 132 respectively, and the NAS server 140 can be connected to the dedicated server 131 and the dedicated server 132 respectively; there can be many ways to realize the connection, for example, through The connection is realized in a wired manner, or the connection may also be realized in a wireless manner, which is not specifically limited.

In the embodiment of the present invention, the NAS server 140 may be composed of multiple hard disks, and the NAS server 140 may store multiple data related to the client device 110, such as text data, audio data, and video data. Correspondingly, the dedicated server 131 and/or the dedicated server 132 may store the identity information of the client device 110, where the identity information of the client device 110 may include the user name of the client device 100, the password corresponding to the user name, etc. In this way, the dedicated server 131 and/or the dedicated server 132 can access the NAS server 140 through the identity information of the client device 110, so as to realize the processing of the data of the client device 110. In an example, the dedicated server 131 and the dedicated server 132 may share the identity information of the client device 110 by transmitting data streams. For example, the dedicated server 131 and the dedicated server 132 may be respectively provided with a synchronization tool (such as a sersync tool), if the dedicated server 131 detects that the identity information of the client device 110 at a certain moment is updated from the first identity information to the second identity Information, the difference data in the second identity information that is different from the first identity information can be transmitted to the dedicated server 132 through the sersync tool; in this way, the dedicated server 132 can update the internally stored identity of the client device 110 according to the received difference data Information, so as to realize the data sharing process between the dedicated server 131 and the dedicated server 132.

In specific implementation, the client device 110 may generate a data request message according to the user's trigger instruction, and then send the data request message to the load balancing server 120; accordingly, the load balancing server 120 may receive the data processing request according to the dedicated server 131 And the load situation of the dedicated server 132 (such as memory and/or hard disk occupancy rate, number of CPU cores, etc.). Select a target dedicated server (such as dedicated server 132) from dedicated server 131 and dedicated server 132, and then The data processing request is sent to the dedicated server 132; in some cases, if the dedicated server 132 fails, the load balancing server 120 can send the data processing request to the dedicated server 131; further, if the data processing request is to modify file a, After receiving the data processing request, the dedicated server 132 (or dedicated server 131) can verify the identity of the client device 110 in advance. If it is determined that the identity of the client device 110 is legal, it can obtain the NAS that matches the client device 100. File a in the server 140, and modify the file a.

According to the above content, in this implementation, in addition to multiple dedicated servers, it is also necessary to set up a NAS server 140 independent of multiple dedicated servers, although this implementation can be used when a dedicated server fails. Other dedicated servers process data, but if the NAS server 140 fails (such as a certain hard disk that constitutes the NAS server 140 is damaged, network failure, insufficient memory, etc.), any dedicated server cannot process the data, resulting in data Processing is not available; that is, the above implementation process still cannot achieve high data availability.

In addition, the above implementation also has the following problems:

(1) Since the independent NAS server 140 is set up, the cost of the system is high.

(2) The process of synchronizing data streams between the dedicated server 131 and the dedicated server 132 uses the same network as the process of processing data based on the NAS server 140, which causes the process of synchronizing data streams to occupy a large network space, which may cause the data processing process The network in is blocked, and the efficiency of data processing is low.

(3) The dedicated server 131 and the dedicated server 132 access the same NAS device, which results in the inability to dynamically allocate data corresponding to different dedicated servers according to actual business scenarios, resulting in poor scalability of data processing.

Based on this, the embodiments of the present invention provide a data processing system to achieve high availability of data processing, improve the efficiency and scalability of data processing, and reduce costs.

2 is a schematic diagram of the architecture of a data processing system provided by an embodiment of the present invention. As shown in FIG. 2, the system may include one or more client devices (such as the client device 211 and the client device shown in FIG. 212 and client device 213), proxy server 220, storage server group 230, and at least one service group (for example, service group 241, service group 242, and service group 243 as shown in FIG. 2). Wherein, the proxy server 220 can be connected to at least one client device, the storage server group 230, and at least one service group respectively. Each service group of the at least one service group can be connected to the storage server group 230, and the connection can be realized by wired connection. , Or it can be a wireless connection, which is not specifically limited.

In the embodiment of the present invention, multiple servers may be set in each service group, and any two servers among the multiple servers may realize data sharing, for example, data sharing may be realized through the RAFT protocol. Taking the service group 241 as an example, the service group 241 can be provided with servers 2411 to 2413. Accordingly, the service group 241 can select a master server from the servers 2411 to 2413 in various ways, for example, according to the RAFT protocol. The main server is selected from the servers 2411 to 2413, or the main server can be set by a person skilled in the art based on experience, which is not specifically limited. In an example, the service group 241 may select the server with the best performance (such as the server 2411) from the servers 2411 to 2413 as the master server. In this way, the server 1412 and the server 2413 may serve as two slave servers managed by the master server 2411. Among them, the performance of the server can be determined by any one or more of the available capacity of the disk in the server, the amount of memory occupied, the number of cores of the central processing unit (CPU), and the network traffic, which is not specifically limited. .

It should be noted that the service group in Figure 2 is only an exemplary simple description, and the number of servers in the service group listed is only for the convenience of explaining the solution, and does not constitute a limitation on the solution. In the specific implementation , The number of servers in the service group can be greater than 3, for example, it can be 5 or more. In an example, in order to ensure the accuracy of RAFT protocol election, the number of servers in each service group may be set to an odd number.

In a possible implementation manner, one or more storage servers may also be provided in the storage server cluster 230, such as storage server 231 to storage server 233, and any two storage servers among storage server 231 to storage server 233 can be implemented. data sharing. Correspondingly, the storage server cluster 230 can also select a primary storage server (such as the storage server 231) from the storage server 231 to the storage server 233 in the above manner. In this way, the storage server 232 and the storage server 233 can be managed by the primary storage server 231 The two slave storage servers.

In specific implementation, after any service group in the service group 241 to the service group 243 determines the master server, the identification of the client device corresponding to the service group, the information of the master server, and the information of the slave server can be reported to the master storage server 231 . For example, taking the service group 241 as an example, after determining the master server 2411, the slave server 2412, and the slave server 2413, the master server 2411 may assign the identification of the service group 241 to which it belongs and the identification of the client device corresponding to the service group 241 , The currently available disk capacity, Internet Protocol Address (IP), port number, server number and other information are sent to the main storage server 231, and the slave server 2412 and the slave server 2413 can respectively send the information of the service group 241 to which they belong The identification and the currently available disk capacity are sent to the main storage server 231. In this way, the primary storage server 231 can establish a preset correspondence table according to the identification of the client device corresponding to the service group 241 to the service group 243, the information of the primary server, and the information of the secondary server, and can pass the preset correspondence table through the RAFT protocol Shared to the slave storage server 232 and the slave storage server 233, therefore, the master storage server 231, the slave storage server 232, and the slave storage server 233 may respectively store the same preset correspondence table.

Table 1 is a schematic table of a preset correspondence table provided by an embodiment of the present invention.

Table 1: Schematic of a preset correspondence table

As shown in Table 1, the preset correspondence table can include the identification of each service group, the identification of the client device corresponding to each service group, the identification of the master server and the slave server included in each service group, and the available disks. Information such as capacity and IP address of the main server. Taking the service group 241 as an example, based on the content shown in Table 1, the client device corresponding to the service group 241 may be the client device 212, the master server in the service group 241 may be the master server 2411, and the slave server may be the slave server 2412 And the slave server 2413; the disk capacity available in the master server 2411 is 500M, the disk capacity available in the slave server 2412 is 300M, and the disk capacity available in the slave server 2413 is 200M; the IP address of the master server 2411 can be http:// 2411.com.

Take the service group 241 as an example. In a possible implementation, if the main server 2411 in the service group 241 fails (such as disk damage, insufficient disk space, insufficient memory, network failure, hardware equipment damage, software operation failure, etc.) ), the service group 241 can re-elect a new master server (such as the server 2413) from the slave server 2412 and the slave server 2413 according to the RAFT protocol. Further, the new main server 2413 can report its IP address and the failure information of the old main server 2411 to the main storage server 231. In this way, the main storage server 231 can report the IP address of the new main server 2413 and the main server 2411's The fault information updates the preset correspondence table.

In an example, the main storage server 231 may mark the new main server 2412 as the main server 2412, and may mark the state of the old main server 2411 as an unavailable state, and then generate and push the alarm corresponding to the old main server 2411 Information to operation and maintenance personnel. In another example, the master storage server 231 can mark the new master server 2412 as the master server 2412, and can mark the old master server 2411 as the slave server 2411. The method shown in Table 1 can be The preset correspondence table is updated as shown in Table 2.

Table 2: An illustration of an updated preset correspondence table

Understandably, after the primary storage server 231 updates the preset correspondence table, it may also share the updated preset correspondence table to the secondary storage server 232 and the secondary storage server 233 through the RAFT protocol, so that the primary storage server 231, The slave storage server 232 and the slave storage server 233 may respectively store the same preset correspondence table.

In the embodiment of the present invention, if the main server in the service group fails, the service group can elect a new main server from other servers. In this way, the new main server can be used to process the data request message of the client device; In other words, the main server can be automatically selected by the service group to automatically recover from failures, thereby making the data processing process highly available.

Based on the system architecture shown in Fig. 2, Fig. 3 is a schematic flow diagram corresponding to the data processing method provided by an embodiment of the present invention, and the method includes:

Step 301: The first client device sends a data request message to the proxy server.

In the embodiment of the present invention, the client devices 211 to 213 may be client devices corresponding to different business systems. For example, the client device 211 is a client device corresponding to a loan business system, and the client device 212 is an insurance business system. The corresponding client device, client device 213 is the client device corresponding to the sales business system; in this way, the loan business system can process the loan data generated during the execution of the loan business system through the client device 211, and insurance business The system can process insurance data generated during the execution of the business by the insurance business system through the client device 212, and the sales business system can process the sales data generated during the execution of the business by the sales business system through the client device 213.

The data processing method in the embodiment of the present invention is described below by taking loan business system processing loan data as an example. It is understandable that other business systems processing their respective data can also be implemented with reference to this method, which is not specifically limited.

In one example, a (World Wide Web, web) browser may be provided in the client device 211, and the user in the loan business system may obtain the resource management interface by entering a preset link in the web browser; among them, the resource management interface There can be multiple function icons, such as "modify resource" function icon, "delete resource" function icon, and "get resource" function icon. Taking the deletion of loan data a as an example, if the client device 211 detects that the user triggers the "resource deletion" function icon, it can prompt the user to enter the identification of the resource to be deleted in the resource management interface, and then when it detects that the user has entered the loan data a After the identification, a data request message is generated according to the identification of the loan data a, and the data request message may include the identification of the client device 211 and the identification of the loan data a.

Further, the client device 211 may send the data request message to the proxy server 200, wherein there may be multiple ways to send the data request message to the proxy server 200, for example, the data request message may be sent through wired devices such as optical fiber and network cable. Or, the data request message can be sent through wireless devices such as sound wave or Bluetooth, which is not specifically limited.

Step 302: The proxy server queries a preset correspondence table, and determines a target service group corresponding to the first client device.

As shown in FIG. 2, in an example, after determining the primary storage server 231, the secondary storage server 232, and the secondary storage server 233 in the storage service group 230, the information (such as the IP address) of the primary storage server 231 can be sent to the proxy server 220; in this way, the proxy server 220 can communicate with the main storage server 231 according to the IP address of the main storage server 231, obtain the preset correspondence table stored in the main storage server 231, and store the preset correspondence table in the preset storage In the space, for example, stored in the disk or hard disk of the proxy server 220.

In the embodiment of the present invention, the proxy server 220 may obtain the preset correspondence table in multiple ways. In a possible implementation manner, the proxy server 220 may update the preset correspondence stored in the preset storage space according to a preset period. The relationship table, for example, the proxy server 220 may send a request message to the main storage server 231 every 5 minutes. Accordingly, after receiving the request message, the main storage server 231 may send the preset correspondence table to the proxy server 220; The server 220 may update the preset correspondence table stored in the preset storage space every 5 minutes. In another possible implementation manner, the proxy server 220 may update the preset correspondence table stored in the preset storage space in real time according to the instructions of the main storage server 231. For example, if the main storage server 2411 is damaged, the main storage server 231 updates the preset correspondence table, then the main storage server 231 can actively send the updated preset correspondence table to the proxy server 220; in this way, the proxy server 220 can use the preset correspondence table received in real time to update the preset The preset correspondence table stored in the storage space.

In specific implementation, if the proxy server 220 receives the data request message sent by the client device 211, it can obtain the preset correspondence table stored in the preset storage space, and then can query the preset correspondence table according to the identifier of the client device 211 If there is a target service group corresponding to the client device 211 in the preset correspondence table, the result of the query may be that the query is successful; if the service group corresponding to the client device 211 does not exist in the preset correspondence table, the result of the query It can be that the query failed. The following describes the process of the proxy server 220 determining the main server corresponding to the client device from these two scenarios.

Situation One

In scenario 1, the target service group corresponding to the client device exists in the preset correspondence table.

Based on the preset correspondence table shown in Table 1, if the client device is the client device 211, the proxy server 220 may determine that the service group corresponding to the client device 211 is the service group 241.

Situation two

In the second scenario, there is no service group corresponding to the client device in the preset correspondence table.

Based on the preset correspondence table shown in Table 1, if the client device is the client device 214, the proxy server 220 may determine that the service group corresponding to the client device 214 does not exist in the preset correspondence table; thus, the proxy server 220 The target service group can be selected from the service group 241-server 243 according to the performance of the service group 241-server 243, and the main server in the target service group can be used as the main server corresponding to the client device 211. The performance of the service group 241 to the server 243 may be determined by the total disk capacity of the servers included in the service group 241 to the server 243.

For example, based on the preset correspondence table shown in Table 1, the total available space of the servers 2411-2413 included in the service group 241 is 1000M, and the total available space of the servers 2421-2423 included in the service group 242 is 600M. The total available space of the servers 2431 to 2433 included in the service group 243 is 1400M; it can be seen that the performance of the service group 241 to the server 243 can be from high to low as: service group 243>service group 241>server 242. Since the service group with the best performance is the service group 243, the proxy server 220 may use the main server 2432 in the service group 243 as the main server corresponding to the client device 211.

In the embodiment of the present invention, by selecting the service group with the best current performance in at least one service group as the service group corresponding to the new client device, not only can the efficiency of processing the data of the client device be improved, but also at least one The load balance of the service group improves the data processing capacity of the data processing system.

In step 303, the proxy server 220 sends the data processing request to the main server in the target service group.

In specific implementation, if the target service group corresponding to the client device is the service group 241, since the main server in the service group 241 is the main server 2411, the proxy server 220 can obtain the IP of the main server 2411 from the preset correspondence table Address (ie http://2411.com), and then the identification of the loan data a can be forwarded to the main server 2411 according to the IP address of the main server 2411. Specifically, the proxy server 220 may generate a message according to the IP address of the proxy server 220, the IP address http://2411.com of the main server 2411, and the identifier of the loan data a, and the sender address of the message may be the proxy server 220 The IP address of the recipient may be http://2411.com, and the content of the message may include the identifier of the loan data a, or may also include other information, such as the identifier of the client device 211.

Step 304: The main server in the target service group processes the data to be processed.

In specific implementation, if the main server 2411 receives the data processing request, it can query the disk of the main server 2411 to determine the location of the loan data a, and can delete the loan data a from the disk. In an example, the main server 2411 may send a response message of successful data processing to the proxy server 220 after successfully deleting the loan data a, so that the proxy server 220 forwards the response message of successful data processing to the client device 211. In this way, The client device 211 may display the information that the loan data a is successfully deleted to the user of the loan business system on the web interface.

In a possible implementation manner, after receiving the data processing request, the main server 2411 may also authenticate the client device 211 before deleting the loan data a from the disk. Specifically, the client device 211 may send the first authorization information to the main server 2411 in advance, and accordingly, the data request message sent by the client device 211 to the proxy server 220 may include the second authentication information of the client device 211 Therefore, the message sent by the proxy server 220 to the main server 2411 may also include the second authentication information of the client device 211. In this way, after the main server 2411 receives the data processing request, it can use the first authentication information of the client device 211 and the second authentication information of the client device 211 to verify the legitimacy of the client device 211. If 211 is legal, the loan data a can be deleted from the disk. If it is determined that the client device 211 is illegal, it can send a data processing failure response message to the proxy server 220 so that the proxy server 220 can forward the data processing failure response message To the client device 211, in this way, the client device 211 can display the failure to delete the loan data a to the user of the loan business system on the web interface.

In specific implementation, if the first authentication information and the second authentication information of the client device 211 are the user name and password, the main server 2411 can determine that the client device 211 is the same as the second authentication information. Legal. If the first authentication information of the client device 211 is a private key and the second authentication information of the client device 211 is a public key, then the main server 2411 can be used when the first authentication information matches the second authentication information It is determined that the client device 211 is legitimate. It should be noted that the first authentication information and the second authentication information of the client device 211 may also be other information, such as barcode information, which is not specifically limited.

In the embodiment of the present invention, by verifying the legality of the client device before processing the data of the client device, it is possible to avoid processing the data of other client devices and to ensure the orderliness of the data processing of different client devices And security.

In the above-mentioned embodiment of the present invention, a data request message sent by a first client device is received, and the data request message includes the identification of the first client device and the data to be processed; further, query a preset correspondence table , Obtain the target service group corresponding to the identifier of the first client device, and use the main server in the target service group to process the to-be-processed data; the preset correspondence table stores one or more clients The corresponding relationship between the identifier of the terminal device and the at least one service group. In the embodiment of the present invention, by setting at least one service group and the master server and one or more slave servers included in each service group, it can be ensured that the master server in each service group exists in real time (for example, if the current If the main server of the service group is damaged, a new main server can be assigned to the service group, so that at least one service group can be available at all times; in this way, by assigning the corresponding service group to the first client device, The main server in the service group corresponding to the first client device executes the data processing process related to the first client device to ensure high availability of the data processing process; and, by setting a preset correspondence table, it is based on the preset correspondence The table can determine the main server that processes the data to be processed, and there is no need to analyze each server in the service group, which can improve the efficiency of data processing.

In view of the foregoing method flow, an embodiment of the present invention also provides a data processing device, and the specific content of the device can be implemented with reference to the foregoing method.

4 is a schematic structural diagram of a data processing device provided by an embodiment of the present invention. The device is applied to a data processing system. The data processing system includes at least one service group, and each service group in the at least one service group It includes a master server and one or more slave servers; the device includes:

The transceiver module 401 is configured to receive a data request message sent by a first client device, where the data request message includes the identification of the first client device and the data to be processed;

The query module 402 is configured to query a preset correspondence table to obtain the target service group corresponding to the identifier of the first client device; the preset correspondence table stores one or more client device identities and all State the correspondence of at least one service group;

The processing module 403 is configured to use the main server in the target service group to process the data to be processed.

Optionally, the processing module 403 is further configured to:

If the master server in the target service group fails, a first slave server is selected from one or more slave servers in the target service group, and the first slave server is used to process the data to be processed.

Optionally, the preset correspondence table further includes the IP address of the main server in each service group;

The processing module 403 is specifically configured to: according to the IP address of the main server in the target service group included in the preset correspondence table, send the to-be-processed data to the main server in the target service group, So that the main server in the target service group processes the to-be-processed data.

Optionally, the device processing module 403 is further configured to:

If there is no service group corresponding to the identifier of the first client device in the preset correspondence table, selecting the first service group from the at least one service group according to the performance of the at least one service group, And use the master server in the first service group to process the to-be-processed data; the performance of each service group in the at least one service group is determined by the master server and one or more slave servers in the at least one service group The disk capacity of the server is determined.

Optionally, the processing module 403 is further configured to:

The corresponding relationship between the identifier of the first client device and the first service group is generated in the preset correspondence table.

Optionally, the processing module 403 is further configured to:

It is determined that the first client device is legal.

Referring to FIG. 5, based on the same technical concept, an embodiment of the present invention also provides a computer device for executing a method of a data processing system in any embodiment of the present invention, and may include a memory 1001 and a processor 1002.

The memory 1001 is used to store a computer program executed by the processor 1002. The memory 1001 may mainly include a program storage area and a data storage area. The program storage area may store an operating system, an application program required for at least one function, and the like; the data storage area may store data created according to the use of a computer device. The processor 1002 may be a central processing unit (central processing unit, CPU), or a digital processing unit or the like. The embodiment of the present invention does not limit the specific connection medium between the foregoing memory 1001 and the processor 1002. In the embodiment of the present invention, in FIG. 5, the memory 1001 and the processor 1002 are connected through a bus 1003, and the bus 1003 is represented by a thick line in FIG. Limited. The bus 1003 can be divided into an address bus, a data bus, a control bus, and the like. For ease of presentation, only one thick line is used in FIG. 5 to represent, but it does not mean that there is only one bus or one type of bus.

The memory 1001 may be a volatile memory (volatile memory), such as a random-access memory (random-access memory, RAM); the memory 1001 may also be a non-volatile memory (non-volatile memory), such as a read-only memory, flash memory Flash memory, hard disk drive (HDD) or solid-state drive (SSD), or memory 1001 can be used to carry or store desired program codes in the form of instructions or data structures and can be used by Any other medium accessed by the computer, but not limited to this. The memory 1001 may be a combination of the above-mentioned memories.

The processor 1002 is configured to execute the blockchain-based data verification method provided by the embodiment of the present invention when calling the computer program stored in the memory 1001.

An embodiment of the present invention also provides a computer storage medium that stores computer executable instructions required to execute the foregoing processor, and contains a program used to execute the foregoing processor.

Those skilled in the art should understand that the embodiments of the present invention may be provided as methods or computer program products. Therefore, the present invention may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

The present invention is described with reference to flowcharts and/or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and/or block in the flowchart and/or block diagram, and the combination of processes and/or blocks in the flowchart and/or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing equipment to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing equipment are generated It is a device that realizes the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.

These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device. The device implements the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.

These computer program instructions can also be loaded on a computer or other programmable data processing equipment, so that a series of operation steps are executed on the computer or other programmable equipment to produce computer-implemented processing, so as to execute on the computer or other programmable equipment. The instructions provide steps for implementing functions specified in a flow or multiple flows in the flowchart and/or a block or multiple blocks in the block diagram.

Although the preferred embodiments of the present invention have been described, those skilled in the art can make additional changes and modifications to these embodiments once they learn the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the present invention.

Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. In this way, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalent technologies, the present invention is also intended to include these modifications and variations.

Claims

A data processing method, characterized in that the method is applied to a data processing system, the data processing system includes at least one service group, and each service group in the at least one service group includes a main server and one or more From the server; the method includes:

Receiving a data request message sent by a first client device, where the data request message includes the identifier of the first client device and the data to be processed;

Query the preset correspondence table to obtain the target service group corresponding to the identification of the first client device; the preset correspondence table stores the identification of one or more client devices and the identification of the at least one service group Correspondence;

Use the master server in the target service group to process the to-be-processed data.
The method of claim 1, wherein the method further comprises:

If the master server in the target service group fails, a first slave server is selected from one or more slave servers in the target service group, and the first slave server is used to process the data to be processed.
The method according to claim 2, wherein the preset correspondence table further includes the Internet Protocol address IP of the main server in each service group; the main server in the target service group is used to process all State the data to be processed, including:

According to the IP of the main server in the target service group included in the preset correspondence table, send the to-be-processed data to the main server in the target service group, so that the main server in the target service group The server processes the to-be-processed data.
The method of claim 1, wherein the method further comprises:

If there is no service group corresponding to the identifier of the first client device in the preset correspondence table, selecting the first service group from the at least one service group according to the performance of the at least one service group, And use the main server in the first service group to process the data to be processed; the performance of each service group in the at least one service group is determined by the disk capacity of the main server in each service group and one or Determined by the disk capacity of multiple slave servers.
The method according to claim 4, wherein after the selecting the first service group from the at least one service group according to the performance of the at least one service group, the method further comprises:

The corresponding relationship between the identifier of the first client device and the first service group is generated in the preset correspondence table.
The method according to any one of claims 1 to 5, characterized in that, before using the main server in the target service group to process the data to be processed, the method further comprises:

It is determined that the first client device is legal.
A data processing system, characterized in that the data processing system includes one or more client devices, proxy servers and at least one service group, and each service group in the at least one service group includes at least one main server and One or more slave servers;

The client device is configured to generate a data request message according to a user's trigger operation, and send the data request message to the proxy server; the data request message includes the identification of the client device and the data to be processed ；

The proxy server is configured to, after receiving the data request message sent by the client device, query a preset correspondence table to determine the target service group corresponding to the identifier of the client device, and send the to-be-processed data For the main server in the target service group; the preset correspondence table stores the correspondence between the identification of the one or more client devices and the at least one service group;

The main server in the target service group is configured to process the data to be processed after receiving the data to be processed sent by the proxy server.
The system according to claim 7, wherein the system further comprises a storage server;

The storage server is configured to: receive the information reported by the master server and one or more slave servers in each service group, and generate the preset correspondence table according to the information;

The proxy server is further configured to: obtain the preset correspondence table from the storage server.
The system according to claim 8, wherein the preset correspondence table further includes the IP of the main server in each service group;

When the master server in the target service group fails, the target service group selects a first slave server with a performance greater than a first preset performance from one or more slave servers in the target service group, and combines all Sending the IP of the first slave server to the storage server;

The storage server is further configured to: after receiving the IP of the first slave server, use the IP of the first slave server to update the IP of the master server in the target service group in the preset correspondence table.
A data processing device, characterized in that the device is applied to a data processing system, the data processing system includes at least one service group, and each service group in the at least one service group includes a main server and one or more From the server; the device includes:

A transceiver module, configured to receive a data request message sent by a first client device, where the data request message includes the identifier of the first client device and the data to be processed;

The query module is configured to query a preset correspondence table to obtain the target service group corresponding to the identifier of the first client device; the preset correspondence table stores one or more client device identifiers and the Correspondence of at least one service group;

The processing module is configured to use the main server in the target service group to process the data to be processed.
The device according to claim 10, wherein the processing module is further configured to:

If the master server in the target service group fails, a first slave server is selected from one or more slave servers in the target service group, and the first slave server is used to process the data to be processed.
The apparatus according to claim 11, wherein the preset correspondence table further includes the IP of the main server in each service group;

The processing module is specifically configured to: according to the IP of the main server in the target service group included in the preset correspondence table, send the to-be-processed data to the main server in the target service group, so that The main server in the target service group processes the to-be-processed data.
The device according to claim 10, wherein the device processing module is further configured to:

If there is no service group corresponding to the identifier of the first client device in the preset correspondence table, selecting the first service group from the at least one service group according to the performance of the at least one service group, And use the main server in the first service group to process the data to be processed; the performance of each service group in the at least one service group is determined by the disk capacity of the main server in each service group and one or Determined by the disk capacity of multiple slave servers.
The device according to claim 13, wherein the processing module is further configured to:

The corresponding relationship between the identifier of the first client device and the first service group is generated in the preset correspondence table.
The device according to any one of claims 10 to 14, wherein the processing module is further configured to:

It is determined that the first client device is legal.
A computer-readable storage medium, which is characterized by comprising instructions, which when run on a computer, causes the computer to execute the method according to any one of claims 1 to 6.
A computer program product, which is characterized in that when it runs on a computer, the computer executes the method according to any one of claims 1 to 6.
A computer device, characterized in that it comprises:

At least one memory for storing program instructions;

At least one processor is configured to call program instructions stored in the memory, and execute the method according to any one of claims 1 to 6 according to the obtained program.