CN114793194A - Service data processing method and device and computer readable storage medium - Google Patents
Service data processing method and device and computer readable storage medium Download PDFInfo
- Publication number
- CN114793194A CN114793194A CN202210233783.2A CN202210233783A CN114793194A CN 114793194 A CN114793194 A CN 114793194A CN 202210233783 A CN202210233783 A CN 202210233783A CN 114793194 A CN114793194 A CN 114793194A
- Authority
- CN
- China
- Prior art keywords
- service
- target
- node
- nodes
- task
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title description 5
- 238000000034 method Methods 0.000 claims abstract description 67
- 238000012545 processing Methods 0.000 claims abstract description 44
- 230000008569 process Effects 0.000 claims abstract description 25
- 238000004590 computer program Methods 0.000 claims description 12
- 238000012423 maintenance Methods 0.000 abstract description 18
- 238000005516 engineering process Methods 0.000 abstract description 6
- 239000006185 dispersion Substances 0.000 abstract description 5
- 238000007726 management method Methods 0.000 description 33
- 238000010586 diagram Methods 0.000 description 8
- 230000000694 effects Effects 0.000 description 5
- 238000012550 audit Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 1
- 210000005036 nerve Anatomy 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0876—Aspects of the degree of configuration automation
- H04L41/0886—Fully automatic configuration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
- H04L41/0813—Configuration setting characterised by the conditions triggering a change of settings
- H04L41/082—Configuration setting characterised by the conditions triggering a change of settings the condition being updates or upgrades of network functionality
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Automation & Control Theory (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a method and a device for processing service data and a computer readable storage medium. Wherein, the method comprises the following steps: receiving a target service request, wherein the target service request is a request acquired through a target service system; generating a target service task based on the target service request; after heartbeat data of a plurality of nodes in a target service system are received, determining a target node in the plurality of nodes based on the heartbeat data; and sending the target service task to the target node so as to process the target service task by using the target node. The invention solves the technical problem of higher maintenance difficulty caused by over dispersion of distributed system nodes in the related technology.
Description
Technical Field
The invention relates to the field of task batch processing, in particular to a method and a device for processing service data and a computer-readable storage medium.
Background
The distributed access system has numerous and dispersed nodes, and brings great difficulty to operation and maintenance requirements such as data information maintenance and node upgrade of a management system, parameters, nodes, routes and services. For a distributed access system, the traditional management mode adopts manual operation on modules for collecting information, configuring service, upgrading the system and the like, for example, the traditional management mode maintains data in corresponding documents according to data types, and the system are interacted in a document mode; changing data information of a system node, and manually logging in the node to maintain the data information; in the aspect of service configuration, developers manually configure services for the associated system to call through interface documents; when the system is upgraded, an operator directly carries out operations such as version package replacement, service restart and the like on all nodes to be upgraded according to the operation document to complete the upgrading process
However, the above distributed management systems are all operated manually by people, and have the following disadvantages: 1) adopting document maintenance data, and requiring an operator to frequently update the document and fill in revision records; when the method is interacted with an associated system, data inconsistency is easily caused due to the version problem, so that the communication cost is increased, and the working efficiency is reduced. 2) The developer manually configures the service according to the interface document, and the problems of field loss, format error, file omission, high error rate and the like are easy to occur. 3) The configuration information of the system nodes is maintained by manually logging in the nodes, the operation process is complicated, and the professional requirement is high. 4) In the traditional upgrading mode, each node to be upgraded needs to be logged in, an upgrade package is manually replaced, and the service is restarted; if the configuration file is modified, the file in each node needs to be modified and stored repeatedly; if version rollback is required, the operations are repeated.
In view of the above problems, no effective solution has been proposed.
Disclosure of Invention
The embodiment of the invention provides a method and a device for processing service data and a computer readable storage medium, which are used for at least solving the technical problem of high maintenance difficulty caused by over-dispersion of distributed system nodes in the related technology.
According to an aspect of the embodiments of the present invention, a method for processing service data is provided, including: receiving a target service request, wherein the target service request is a request acquired through a target service system; generating a target business task based on the target business request; after heartbeat data of a plurality of nodes in the target service system is received, determining a target node in the plurality of nodes based on the heartbeat data; and sending the target service task to the target node so as to process the target service task by using the target node.
Optionally, before receiving the target service request, the method further includes: acquiring service system information of a plurality of service systems including the target service system, wherein the service system information at least comprises: system information, parameter information, node information, routing information, and service information of each service system in the plurality of service systems; and maintaining the service system information according to a preset dimension.
Optionally, maintaining the service system information according to a predetermined dimension at least includes: maintaining the routing information according to the node information of each service system; and maintaining the service information of each service system according to the service dimension.
Optionally, before receiving heartbeat data of a plurality of nodes in the target service system, the method further includes: acquiring IP information of a plurality of nodes in each service system; and generating node names for the plurality of nodes in each service system based on the IP information, wherein the node names are used for identifying sending nodes of the heartbeat data.
Optionally, determining a target node of the plurality of nodes based on the heartbeat data comprises: analyzing the heartbeat data to obtain a node name of the heartbeat data; determining the target node from the plurality of nodes based on a node name of the heartbeat data.
Optionally, the method further comprises: and after the target node is determined to finish the target service task, updating the task state of the target service task.
Optionally, the method further comprises: obtaining system upgrade data of a plurality of service systems including the target service system; generating a system upgrade policy based on the system upgrade data, wherein the system upgrade policy at least comprises: upgrading time, the number of upgraded nodes in each batch and the upgrading interval time in each batch; and upgrading the plurality of service systems based on the upgrading strategy.
Optionally, upgrading the plurality of service systems based on the upgrade policy includes: generating an upgrade task based on the upgrade policy; and sending the upgrading task to the plurality of service systems according to heartbeat connection, wherein the plurality of service systems execute upgrading operation based on the current state of the nodes of the service systems and the upgrading task after receiving the upgrading task.
According to another aspect of the embodiments of the present invention, there is provided a device for processing service data, including: the system comprises a receiving module, a sending module and a receiving module, wherein the receiving module is used for receiving a target service request, and the target service request is a request acquired through a target service system; the first generation module is used for generating a target business task based on the target business request; the determining module is used for determining a target node in a plurality of nodes based on heartbeat data after the heartbeat data of the plurality of nodes in the target service system is received; and the sending module is used for sending the target service task to the target node so as to process the target service task by using the target node.
Optionally, the apparatus further comprises: a first obtaining module, configured to obtain service system information of a plurality of service systems including a target service system before receiving a target service request, where the service system information at least includes: system information, parameter information, node information, routing information, and service information of each service system in the plurality of service systems; and the maintenance module is used for maintaining the service system information according to a preset dimension.
Optionally, the maintenance module includes at least: a first maintenance unit, configured to maintain the routing information according to node information of each service system; and the second maintenance unit is used for maintaining the service information of each service system according to the service dimension.
Optionally, the apparatus further comprises: an obtaining unit, configured to obtain IP information of multiple nodes in each service system before receiving heartbeat data of the multiple nodes in the target service system; a first generating unit, configured to generate node names for the plurality of nodes in each service system based on the IP information, where the node names are used to identify sending nodes of the heartbeat data.
Optionally, the determining module includes: the analysis unit is used for analyzing the heartbeat data to obtain the node name of the heartbeat data; a determining unit, configured to determine the target node from the plurality of nodes based on a node name of the heartbeat data.
Optionally, the apparatus further comprises: and the updating module is used for updating the task state of the target service task after the target node is determined to finish the processing of the target service task.
Optionally, the apparatus further comprises: the second acquisition module is used for acquiring system upgrading data of a plurality of service systems including the target service system; a second generating module, configured to generate a system upgrade policy based on the system upgrade data, where the system upgrade policy at least includes: upgrading time, the number of upgraded nodes in each batch and the upgrading interval time in each batch; and the upgrading module is used for upgrading the plurality of service systems based on the upgrading strategy.
Optionally, the upgrade module includes: the second generating unit is used for generating an upgrading task based on the upgrading strategy; and the sending unit is used for sending the upgrading tasks to the plurality of service systems according to heartbeat connection, wherein the plurality of service systems execute upgrading operation based on the current state of the nodes of the plurality of service systems and the upgrading tasks after receiving the upgrading tasks.
According to another aspect of the embodiments of the present invention, there is also provided a computer-readable storage medium, where the computer-readable storage medium includes a stored computer program, and when the computer program is executed by a processor, the computer-readable storage medium controls a device to execute any one of the foregoing service data processing methods.
According to another aspect of the embodiment of the present invention, a processor is further provided, where the processor is configured to execute a computer program, where the computer program executes the method for processing the service data in any one of the foregoing embodiments.
In the embodiment of the invention, a target service request is received, wherein the target service request is a request acquired through a target service system; generating a target service task based on the target service request; after heartbeat data of a plurality of nodes in a target service system are received, determining a target node in the plurality of nodes based on the heartbeat data; and sending the target service task to the target node so as to process the target service task by using the target node. By the service data processing method provided by the embodiment of the invention, the purpose of determining the target node in the plurality of nodes to process the target service task after receiving the target service request is achieved, so that the technical effect of improving the task processing efficiency is realized, and the technical problem of high maintenance difficulty caused by over dispersion of distributed system nodes in the related technology is solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
fig. 1 is a flowchart of a method for processing service data according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a heartbeat data acquisition method according to an embodiment of the invention;
FIG. 3 is a schematic diagram of an automated upgrade of a system node according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of centrally managing distributed nodes, according to an embodiment of the present invention;
fig. 5 is a schematic diagram of a service data processing apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without making any creative effort based on the embodiments in the present invention, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Moreover, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example 1
In accordance with an embodiment of the present invention, there is provided a method embodiment of a method for processing business data, it should be noted that the steps illustrated in the flowchart of the attached drawings can be executed in a computer system, such as a set of computer executable instructions, and although a logical order is illustrated in the flowchart, in some cases, the steps illustrated or described can be executed in an order different from that shown.
Fig. 1 is a flowchart of a method for processing service data according to an embodiment of the present invention, as shown in fig. 1, the method includes the following steps:
step S102, receiving a target service request, wherein the target service request is a request acquired through a target service system.
Optionally, in the above step, a target service request sent by the target service system is received first.
It should be noted that the target business system, i.e. the transaction system of the bank, includes but is not limited to: ATM, cell-phone bank system, counter system.
And step S104, generating a target service task based on the target service request.
Optionally, in the foregoing step, the target service request is analyzed, so as to generate the target service task according to a requirement.
Step S106, after receiving the heartbeat data of a plurality of nodes in the target service system, determining the target node in the plurality of nodes based on the heartbeat data.
Optionally, in the above step, the node sends a heartbeat to the management and control platform once every minute, and keeps heartbeat connection with the management and control platform. It should be noted that the heartbeat data heartbeat is a message, determines whether a node is alive, is a self-defined command word that notifies the opposite side of the self state at regular time between the client and the server, and is sent at a certain time interval, which is similar to a heartbeat.
And step S108, sending the target service task to the target node so as to process the target service task by using the target node.
As can be seen from the above, in the embodiment of the present invention, a target service request may be received first, where the target service request is a request obtained through a target service system; a target business task may then be generated based on the target business request; then, after receiving heartbeat data of a plurality of nodes in the target service system, determining a target node in the plurality of nodes based on the heartbeat data; and finally, the target service task can be sent to the target node so as to process the target service task by using the target node. By the service data processing method provided by the embodiment of the invention, the purpose of determining the target node in the nodes to process the target service task after receiving the target service request is achieved, so that the technical effect of improving the task processing efficiency is realized, and the technical problem of high maintenance difficulty caused by over dispersion of distributed system nodes in the related technology is solved.
As an optional embodiment, before receiving the target service request, the method for processing service data further includes: acquiring service system information of a plurality of service systems including a target service system, wherein the service system information at least comprises: system information, parameter information, node information, routing information, and service information of each service system in a plurality of service systems; and maintaining the business system information according to the preset dimension.
It should be noted that the management and control platform is a module that maintains and monitors the service granularity attribute, ensures complete and successful operation of the central nerve, and belongs to a financial service system.
In the above optional embodiment, the management and control platform maintains system information, parameter information, and node information of the provider and the consumer respectively according to the system dimension; maintaining routing information according to the node dimension; and respectively maintaining the service information of the consumer and the service information of the provider according to the service dimension, and storing the data into a database by the control platform.
It should be noted that the nodes (for example, the cloud corresponds to a plurality of virtual machines, 1 node, 5 nodes) are clusters, and are used for providing services to other virtual machines when one of the virtual machines fails, and waiting for a transaction request.
As an optional embodiment, the service system information is maintained according to a predetermined dimension, and the method for processing the service data at least includes: maintaining routing information according to the node information of each service system; and maintaining the service information of each business system according to the service dimension.
In the above optional embodiments, the method for maintaining the service system information based on the predetermined dimension includes, but is not limited to: maintaining routing information based on the node information for each traffic system; service information for each business system is maintained based on the service dimensions.
As an optional embodiment, before receiving heartbeat data of a plurality of nodes in the target service system, the method for processing service data further includes: acquiring IP information of a plurality of nodes in each service system; and generating node names for the plurality of nodes in each service system based on the IP information, wherein the node names are used for identifying sending nodes of the heartbeat data.
In the above alternative embodiment, the IP information of the plurality of nodes in each service system may be first obtained, then node names may be generated for the plurality of nodes in each service system based on the IP information, and the sending node of the heartbeat data may be identified by using the node names.
As an alternative embodiment, determining a target node of the plurality of nodes based on the heartbeat data includes: analyzing the heartbeat data to obtain a node name of the heartbeat data; a target node is determined from the plurality of nodes based on the node name of the heartbeat data.
Fig. 2 is a schematic diagram of a heartbeat data acquisition method according to an embodiment of the present invention, and as shown in fig. 2, a task id is first generated from a management and control platform and stored in a system cache, then the generated task id is stored in a database, and an initial task state is generated, then the management and control platform acquires heartbeat data of a system node (a cycle is 1 minute), the data is brought back to the system node after the acquisition is successful, the system node returns a result after the processing is successful, the management and control platform deletes the task id after the node processing is determined to be successful, and finally the management and control platform updates the task state.
As an optional embodiment, the method for processing service data further includes: and after the target node is determined to complete the target service task, updating the task state of the target service task.
In the above optional embodiment, after it is determined that the target node completes the target service task, the task state of the target service task is updated, so that the task processing is continued next.
As an optional embodiment, the method for processing service data further includes: acquiring system upgrading data of a plurality of service systems including a target service system; generating a system upgrade policy based on the system upgrade data, wherein the system upgrade policy at least comprises: upgrading time, the number of nodes upgraded in each batch and the upgrading interval time in each batch; and upgrading the plurality of service systems based on the upgrading strategy.
Fig. 3 is a schematic diagram of an automatic upgrade of a system node according to an embodiment of the present invention, and as shown in fig. 3, the following details of the automatic upgrade of the system node are described with reference to fig. 3:
firstly, an upgrade package of a node is uploaded to a control server through a control platform interface to be decompressed, and service file information in the upgrade package is reversely analyzed to a database to be stored. Upgrade personnel formulate the upgrading strategy through the management and control platform, carry out the customization according to the system classification and set up, include: the upgrading time of the nodes of the consumer system and the provider system, the number of the nodes upgraded in each batch and the interval time of the upgrading in each batch. And the management and control platform generates an upgrading task for each system node, and all the system nodes correspond to the upgrading packages of the nodes.
In addition, the management and control platform uploads the upgrade package to the distributed file management system and registers information returned by the distributed file management system. And the management and control platform generates a version upgrading task and waits for a node heartbeat obtaining task. And after the access point acquires the task, returning a result of receiving the task to the management and control platform for registration, and automatically triggering the timing task to carry out upgrading operation after waiting for the specified upgrading time. And the nodes are connected through the distributed file system address stored in the control platform and acquire the file.
Further, in the embodiment of the present invention, after the node is upgraded, the upgraded result is returned to the management and control platform for registration. And after all the system nodes are upgraded, the management and control platform generates stop instructions for part of the system nodes in batches, performs stop operation after the heartbeat obtains the stop task, and generates start instructions for the batch of the nodes after the stop is completed. The other nodes work the same way.
It should be noted that, in the above steps, the node upgrade does not upgrade all nodes, and in order to ensure the service, a part of nodes are upgraded first; the transaction is put into a normal processing flow, wherein part of nodes are nodes currently executing the service request, and in order to ensure that the service corresponding to the service request is processed normally, a stop instruction is generated first and is not upgraded first; and after the nodes process the services, finishing the upgrading task based on the starting instruction.
And finally, the node returns the restart operation result to the control platform for storage, and the states of the management process and the service process of the system node are updated in real time.
As an optional embodiment, upgrading a plurality of service systems based on an upgrade policy includes: generating an upgrading task based on an upgrading strategy; and sending the upgrading task to a plurality of service systems according to the heartbeat connection, wherein after the plurality of service systems receive the upgrading task, the plurality of service systems execute upgrading operation based on the current state of the nodes of the plurality of service systems and the upgrading task.
Fig. 4 is a schematic diagram of centralized management of a decentralized node according to an embodiment of the present invention, and as shown in fig. 4, the following detailed steps of centralized management of the decentralized node are described in detail: firstly, respectively maintaining system information, parameter information and node information of a provider and a consumer according to system dimensions by a management and control platform; maintaining routing information according to the node dimension; and respectively maintaining the consumer service information and the provider service information according to the service dimensionality. And the management and control platform stores the data into a database. Secondly, the nodes and the control platform are interacted in an HTTP + JSON mode, and the nodes are connected with the control platform to acquire information such as parameters, nodes and routes in the process of starting management. And the control platform uniformly generates a unique node name for the node IP of each system according to rules. The node sends heartbeat to the control platform once every minute, and the heartbeat connection with the control platform is kept. And then, after the management and control platform modifies the data, generating a task through an interface button, storing the task in a database table, and putting the task id into a cache. Secondly, the node heartbeats to a control platform, the control platform inquires whether a key name exists in the cache or not according to the node name of the heartbeat band, and if the key name does not exist, normal response is carried out; and if so, acquiring the 1 st task id of the node, inquiring task information according to the task id database and bringing back the heartbeat. And then, after the node processes the task, returning the processing result to the control platform, and the control platform registers the operation result and updates the task state. Finally, the service information of the management and control platform mainly realizes the function of managing the financial service directory so as to provide personnel at different levels, and further provides service registration application, service registration audit, service interface configuration, service interface audit, service consumption application, service consumption audit and the like through the inquiry and retrieval of different dimensionalities.
As can be seen from the above, the embodiment of the present invention can implement centralized maintenance of data information, including information such as systems, parameters, nodes, routes, and services. After the data information is modified, the nodes are obtained and take effect in real time through a task form, a required service file can be generated by one key according to the input service information, the service information can be maintained from multiple dimensions, the service management is convenient, the automatic upgrading can be realized, an upgrading strategy can be customized, and the whole upgrading process of the operating system nodes of the management and control platform is realized, and the method provided by the embodiment of the invention also has the following advantages:
1) the data information is maintained in a unified mode, complexity of documents is eliminated, maintenance cost is low, working efficiency is improved, and service management is facilitated.
2) The system and the node data information are maintained through the management and control platform, and after the data information is operated, the system and the node can be directly obtained and can be used for generating effect. The system and the node are maintained more quickly and conveniently.
3) The service interface is generated by one key, so that the human resource cost is saved, and errors caused by manual configuration are reduced.
4) The upgrading is automated, the upgrading operation process is simplified, the upgrading complexity is reduced, and the upgrading efficiency is improved.
Example 2
According to another aspect of the embodiment of the present invention, there is further provided a device for processing service data, and fig. 5 is a schematic diagram of the device for processing service data according to the embodiment of the present invention, as shown in fig. 5, including: a receiving module 51, a first generating module 53, a determining module 55 and a transmitting module 57. The following describes a processing apparatus for the service data.
A receiving module 51, configured to receive a target service request, where the target service request is a request acquired by a target service system;
a first generating module 53, configured to generate a target service task based on the target service request;
a determining module 55, configured to determine, after receiving heartbeat data of a plurality of nodes in the target service system, a target node in the plurality of nodes based on the heartbeat data;
and a sending module 57, configured to send the target service task to the target node, so as to process the target service task by using the target node.
It should be noted here that the receiving module 51, the first generating module 53, the determining module 55 and the sending module 57 correspond to steps S102 to S108 in embodiment 1, and the modules are the same as the corresponding steps in the implementation example and application scenario, but are not limited to the disclosure in embodiment 1. It should be noted that the modules described above as part of an apparatus may be implemented in a computer system such as a set of computer-executable instructions.
As can be seen from the above, in the embodiment of the present invention, first, a target service request may be received by using the receiving module 51, where the target service request is a request obtained through a target service system; the target business task may then be generated based on the target business request by means of the first generation module 53; the determining module 55 may then determine, after receiving the heartbeat data of the plurality of nodes in the target business system, a target node of the plurality of nodes based on the heartbeat data; finally, the target service task may be sent to the target node by means of the sending module 57, so as to process the target service task by using the target node. By the service data processing device provided by the embodiment of the invention, the purpose of determining the target node in the plurality of nodes to process the target service task after receiving the target service request is achieved, so that the technical effect of improving the task processing efficiency is realized, and the technical problem of high maintenance difficulty caused by over dispersion of distributed system nodes in the related technology is solved.
Optionally, the apparatus for processing service data further includes: a first obtaining module, configured to obtain service system information of a plurality of service systems including a target service system before receiving a target service request, where the service system information at least includes: system information, parameter information, node information, routing information, and service information of each service system in a plurality of service systems; and the maintenance module is used for maintaining the service system information according to the preset dimensionality.
Optionally, a maintenance module comprising at least: the first maintenance unit is used for maintaining the routing information according to the node information of each service system; and the second maintenance unit is used for maintaining the service information of each service system according to the service dimension.
Optionally, the device for processing service data further includes: the system comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring IP information of a plurality of nodes in each service system before receiving heartbeat data of the plurality of nodes in a target service system; and the first generating unit is used for generating node names for a plurality of nodes in each service system based on the IP information, wherein the node names are used for identifying sending nodes of the heartbeat data.
Optionally, the determining module includes: the analysis unit is used for analyzing the heartbeat data to obtain the node name of the heartbeat data; a determining unit, configured to determine a target node from the plurality of nodes based on a node name of the heartbeat data.
Optionally, the device for processing service data further includes: and the updating module is used for updating the task state of the target service task after the target node is determined to process and complete the target service task.
Optionally, the device for processing service data further includes: the second acquisition module is used for acquiring system upgrading data of a plurality of service systems including the target service system; a second generating module, configured to generate a system upgrade policy based on the system upgrade data, where the system upgrade policy at least includes: upgrading time, the number of upgraded nodes in each batch and the upgrading interval time in each batch; and the upgrading module is used for upgrading the plurality of service systems based on the upgrading strategy.
Optionally, the upgrade module includes: the second generating unit is used for generating an upgrading task based on the upgrading strategy; and the sending unit is used for sending the upgrading task to the plurality of service systems according to the heartbeat connection, wherein the plurality of service systems execute upgrading operation based on the current state of the nodes of the plurality of service systems and the upgrading task after receiving the upgrading task.
Example 3
According to another aspect of the embodiments of the present invention, there is also provided a computer-readable storage medium, which includes a stored computer program, wherein when the computer program is executed by a processor, the computer-readable storage medium controls an apparatus to execute the method for processing service data of any one of the foregoing.
Example 4
According to another aspect of the embodiment of the present invention, there is further provided a processor, where the processor is configured to execute a computer program, where the computer program executes the method for processing the service data in any one of the foregoing embodiments.
The above-mentioned serial numbers of the embodiments of the present invention are only for description, and do not represent the advantages and disadvantages of the embodiments.
In the above embodiments of the present invention, the description of each embodiment has its own emphasis, and reference may be made to the related description of other embodiments for parts that are not described in detail in a certain embodiment.
In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units may be a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed coupling or direct coupling or communication connection between each other may be an indirect coupling or communication connection through some interfaces, units or modules, and may be electrical or in other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention, which is substantially or partly contributed by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and amendments can be made without departing from the principle of the present invention, and these modifications and amendments should also be considered as the protection scope of the present invention.
Claims (11)
1. A method for processing service data is characterized by comprising the following steps:
receiving a target service request, wherein the target service request is a request acquired through a target service system;
generating a target business task based on the target business request;
after heartbeat data of a plurality of nodes in the target service system is received, determining a target node in the plurality of nodes based on the heartbeat data;
and sending the target service task to the target node so as to process the target service task by using the target node.
2. The method of claim 1, wherein prior to receiving the target service request, the method further comprises:
acquiring service system information of a plurality of service systems including the target service system, wherein the service system information at least comprises: system information, parameter information, node information, routing information, and service information of each service system in the plurality of service systems;
and maintaining the service system information according to a preset dimension.
3. The method of claim 2, wherein maintaining the business system information according to predetermined dimensions comprises at least:
maintaining the routing information according to the node information of each service system;
and maintaining the service information of each service system according to the service dimension.
4. The method of claim 2, wherein prior to receiving heartbeat data for a plurality of nodes in the target business system, the method further comprises:
acquiring IP information of a plurality of nodes in each service system;
and generating node names for the plurality of nodes in each service system based on the IP information, wherein the node names are used for identifying sending nodes of the heartbeat data.
5. The method of claim 4, wherein determining a target node of the plurality of nodes based on the heartbeat data comprises:
analyzing the heartbeat data to obtain a node name of the heartbeat data;
determining the target node from the plurality of nodes based on a node name of the heartbeat data.
6. The method according to any one of claims 1 to 5, further comprising:
and after the target node is determined to finish the target service task, updating the task state of the target service task.
7. The method according to any one of claims 1 to 5, further comprising:
obtaining system upgrade data of a plurality of service systems including the target service system;
generating a system upgrade policy based on the system upgrade data, wherein the system upgrade policy at least comprises: upgrading time, the number of upgraded nodes in each batch and the upgrading interval time in each batch;
and upgrading the plurality of service systems based on the upgrading strategy.
8. The method of claim 7, wherein upgrading the plurality of business systems based on the upgrade policy comprises:
generating an upgrade task based on the upgrade policy;
and sending the upgrading task to the plurality of service systems according to heartbeat connection, wherein the plurality of service systems execute upgrading operation based on the current state of the nodes of the service systems and the upgrading task after receiving the upgrading task.
9. A device for processing service data, comprising:
the system comprises a receiving module, a processing module and a processing module, wherein the receiving module is used for receiving a target service request, and the target service request is obtained through a target service system;
the first generation module is used for generating a target business task based on the target business request;
the determining module is used for determining a target node in a plurality of nodes based on heartbeat data after the heartbeat data of the plurality of nodes in the target service system is received;
and the sending module is used for sending the target service task to the target node so as to utilize the target node to process the target service task.
10. A computer-readable storage medium, comprising a stored computer program, wherein when the computer program is executed by a processor, the computer-readable storage medium is controlled by a device to perform the method for processing service data according to any one of claims 1 to 8.
11. A processor, characterized in that the processor is configured to run a computer program, wherein the computer program performs the method for processing service data according to any one of the preceding claims 1 to 8 when running.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210233783.2A CN114793194A (en) | 2022-03-09 | 2022-03-09 | Service data processing method and device and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210233783.2A CN114793194A (en) | 2022-03-09 | 2022-03-09 | Service data processing method and device and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114793194A true CN114793194A (en) | 2022-07-26 |
Family
ID=82460265
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210233783.2A Pending CN114793194A (en) | 2022-03-09 | 2022-03-09 | Service data processing method and device and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114793194A (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110442766A (en) * | 2019-07-11 | 2019-11-12 | 新华三大数据技术有限公司 | Webpage data acquiring method, device, equipment and storage medium |
| CN112162865A (en) * | 2020-11-03 | 2021-01-01 | 中国工商银行股份有限公司 | Server scheduling method and device and server |
-
2022
- 2022-03-09 CN CN202210233783.2A patent/CN114793194A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110442766A (en) * | 2019-07-11 | 2019-11-12 | 新华三大数据技术有限公司 | Webpage data acquiring method, device, equipment and storage medium |
| CN112162865A (en) * | 2020-11-03 | 2021-01-01 | 中国工商银行股份有限公司 | Server scheduling method and device and server |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10171383B2 (en) | Methods and systems for portably deploying applications on one or more cloud systems | |
| US10122798B2 (en) | System and process for managing network communications | |
| CN108427581A (en) | System micro services method and terminal device | |
| CN112118565A (en) | Multi-tenant service gray level publishing method and device, computer equipment and storage medium | |
| CN110546606A (en) | Tenant upgrade analysis | |
| CN107229520A (en) | Data center operating system | |
| US20120117425A1 (en) | Method and apparatus for obtaining feedback from a device for recommendations | |
| CN109889381A (en) | Automatic configuration management method and device based on fort machine | |
| EP1978672A1 (en) | Method for implementing management software, hardware with pre-configured software and implementing method thereof | |
| CN109582335B (en) | Method, device and equipment for on-line upgrading of non-interrupt storage cluster nodes | |
| CN108243012B (en) | Charging application processing system, method and device in OCS (online charging System) | |
| CN104508625A (en) | Abstraction models for monitoring of cloud resources | |
| CN108681777A (en) | A kind of method and apparatus of the machine learning program operation based on distributed system | |
| CN115812298A (en) | Block chain management of supply failure | |
| US20200358648A1 (en) | Continuous monitoring of network devices during maintenance | |
| CN104462166A (en) | Report generation method and system | |
| EP4050850A1 (en) | Service upgrading method, device and system | |
| CN112905306A (en) | Multi-cluster container management method and device, electronic equipment and storage medium | |
| CN114793194A (en) | Service data processing method and device and computer readable storage medium | |
| CN109408104A (en) | A kind of method and device for obtaining game and integrating information | |
| CN115309457A (en) | Application instance restarting method and device, electronic equipment and readable storage medium | |
| CN114553859A (en) | BMC configuration management method and device, electronic equipment and storage medium | |
| US8422357B1 (en) | System, method, and computer program product for updating an inventory of network devices based on an unscheduled event | |
| CN114020368A (en) | Information processing method and device based on state machine and storage medium | |
| CN114489754A (en) | Configurable service management method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |