CN111352719B - Transaction bookkeeping service data processing method, device and system - Google Patents
Transaction bookkeeping service data processing method, device and system Download PDFInfo
- Publication number
- CN111352719B CN111352719B CN202010241030.7A CN202010241030A CN111352719B CN 111352719 B CN111352719 B CN 111352719B CN 202010241030 A CN202010241030 A CN 202010241030A CN 111352719 B CN111352719 B CN 111352719B
- Authority
- CN
- China
- Prior art keywords
- service
- bookkeeping
- transaction
- services
- micro
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/48—Program initiating; Program switching, e.g. by interrupt
- G06F9/4806—Task transfer initiation or dispatching
- G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
- G06F9/4881—Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
- G06F9/5038—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/04—Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
Abstract
The embodiment of the application provides a transaction bookkeeping service data processing method, a device and a system, wherein the method comprises the following steps: receiving a transaction bookkeeping service call request; generating corresponding service scheduling information according to a request source of the transaction bookkeeping service calling request and sending the service scheduling information to a service execution node so that the service execution node generates a corresponding service execution queue according to service scheduling information configuration and calls a corresponding bookkeeping micro service according to the service execution queue to execute transaction bookkeeping processing; the application can effectively improve the processing efficiency and the accuracy of transaction bookkeeping under a high concurrence scene.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a method, an apparatus, and a system for processing transaction bookkeeping service data.
Background
With the rapid development of financial markets, the global financial market volume of transactions has increased by orders of magnitude, and traditional single-node application system capabilities have not been able to cope with the rapid response demands of transaction bookkeeping in high concurrency scenarios. In the prior art, the capability of the system for processing massive transactions can be improved by modifying the transaction bookkeeping module into a distributed service mode. However, because of the characteristics of the financial market transaction, the processing process of the transaction bookkeeping needs to ensure strong consistency preferentially, the processing of the key module has requirements on the transaction processing sequence, the submitting and rollback of the transaction also need to realize synchronous processing, and meanwhile, the processing flow of the transaction bookkeeping itself is longer and needs to be split into a plurality of sub-services for processing, and the requirement has a problem of difficult connection with the traditional RPC calling mode.
The inventors have found that when bookkeeping services are invoked at high concurrency. Because of the large number of sub-services of the bookkeeping service, to ensure the final consistency of the sub-services, preemption of partial hot spot resources is inevitable, so that service response capability is reduced, and the updating sequence of partial transaction information is abnormal.
In summary, there is no reasonable solution for distributed calling in a scenario where transaction bookkeeping is strong and consistent, so how to provide a new solution to solve the above technical problems is a technical problem to be solved in the art.
Disclosure of Invention
Aiming at the problems in the prior art, the application provides a transaction bookkeeping service data processing method, a device and a system, which can effectively improve the processing efficiency and the accuracy of transaction bookkeeping under a high concurrence scene.
In order to solve at least one of the problems, the application provides the following technical scheme:
in a first aspect, the present application provides a transaction bookkeeping service data processing method, comprising:
receiving a transaction bookkeeping service call request;
and generating corresponding service scheduling information according to a request source of the transaction bookkeeping service calling request and sending the service scheduling information to a service execution node so that the service execution node generates a corresponding service execution queue according to service scheduling information configuration and calls a corresponding bookkeeping micro service according to the service execution queue to execute transaction bookkeeping processing.
Further, the generating corresponding service scheduling information according to the request source of the transaction bookkeeping service call request includes:
performing authority verification on a request source of the transaction bookkeeping service call request;
if the right verification result is passed, determining a corresponding access mode and service flow according to the specific type of the request source of the transaction bookkeeping service call request.
In a second aspect, the present application provides a transaction bookkeeping service data processing method, comprising:
receiving service scheduling information sent by a service observation node, wherein the service scheduling information is generated by the service observation node according to a request source of a received transaction bookkeeping service call request;
and generating a corresponding service execution queue according to the service scheduling information configuration, and calling a corresponding bookkeeping micro service according to the service execution queue to execute transaction bookkeeping processing.
Further, the generating a corresponding service execution queue according to the service scheduling information configuration includes:
performing feature classification on all to-be-scheduled bookkeeping microservices in the service scheduling information to obtain a microservice without association influence, a microservice with insensitive calling order and a microservice with sensitive calling order;
The micro service without the associated influence is brought into an asynchronous service execution queue and independent transaction control is carried out;
the calling order insensitive micro-service is brought into a dynamic service execution queue and service resources are uniformly distributed;
and the calling order sensitive micro-service is brought into an important service execution queue, and service resource use conditions of the important service execution queue are monitored in real time.
In a third aspect, the present application provides a transaction bookkeeping service data processing apparatus comprising:
a service call receiving module for receiving a transaction bookkeeping service call request;
and the service scheduling control module is used for generating corresponding service scheduling information according to a request source of the transaction bookkeeping service calling request and sending the service scheduling information to a service execution node so that the service execution node generates a corresponding service execution queue according to the service scheduling information configuration and calls a corresponding bookkeeping micro service according to the service execution queue to execute transaction bookkeeping processing.
Further, the service scheduling control module includes:
the permission control unit is used for verifying the permission of a request source of the transaction bookkeeping service calling request;
and the access and flow control unit is used for determining a corresponding access mode and service flow according to the specific type of the request source of the transaction bookkeeping service call request if the result of the permission verification is passed.
In a fourth aspect, the present application provides a transaction bookkeeping service data processing apparatus comprising:
the scheduling information receiving module is used for receiving service scheduling information sent by a service observation node, wherein the service scheduling information is generated by the service observation node according to a request source of a received transaction bookkeeping service call request;
and the transaction queue processing module is used for generating a corresponding service execution queue according to the service scheduling information configuration and calling a corresponding bookkeeping micro service according to the service execution queue to execute transaction bookkeeping processing.
Further, the transaction queue processing module includes:
the service feature classification unit is used for classifying features of all to-be-scheduled bookkeeping micro-services in the service scheduling information to obtain non-association-influence micro-services, calling order insensitive micro-services and calling order sensitive micro-services;
the asynchronous service execution unit is used for bringing the non-relevant influence micro-service into an asynchronous service execution queue and performing independent transaction control;
the dynamic service execution unit is used for bringing the call order insensitive micro-service into a dynamic service execution queue and uniformly distributing service resources;
And the key service execution unit is used for bringing the calling order sensitive micro-service into a key service execution queue and monitoring service resource use conditions of the key service execution queue in real time.
In a fifth aspect, the present application provides a transaction bookkeeping service data processing system comprising:
a service call receiving module for receiving a transaction bookkeeping service call request;
the service scheduling control module is used for generating corresponding service scheduling information according to the request source of the transaction bookkeeping service call request and sending the corresponding service scheduling information to the service execution node;
the scheduling information receiving module is used for receiving service scheduling information sent by the service observation node;
and the transaction queue processing module is used for generating a corresponding service execution queue according to the service scheduling information configuration and calling a corresponding bookkeeping micro service according to the service execution queue to execute transaction bookkeeping processing.
In a sixth aspect, the present application provides an electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the transaction bookkeeping service data processing method when the program is executed.
In a seventh aspect, the present application provides a computer readable storage medium having stored thereon a computer program which when executed by a processor performs the steps of the transaction bookkeeping service data processing method.
According to the technical scheme, the application provides a transaction bookkeeping service data processing method, device and system, which are used for uniformly receiving a transaction bookkeeping call request by adding observer nodes, performing access control, authority control and flow control, and transmitting service scheduling information to a service execution node; the service execution node executes processing tasks of transaction bookkeeping through multi-service and flexible transaction and dynamic service execution configuration, types of services are divided, reasonable scheduling sequence and rollback strategy are provided, service call is decoupled on the premise that final consistency of transactions is guaranteed, and therefore transaction bookkeeping task backlog of the same source and hot spot access of key processing services are prevented, and processing efficiency of transaction bookkeeping in a high concurrency scene is guaranteed to the greatest extent.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a flow chart illustrating a method for processing transaction bookkeeping service data according to an embodiment of the present application;
fig. 2 is a second flowchart of a transaction bookkeeping service data processing method according to an embodiment of the present application;
fig. 3 is a third flowchart of a transaction book-keeping service data processing method according to an embodiment of the present application;
fig. 4 is a flowchart of a transaction book-keeping service data processing method according to an embodiment of the present application;
fig. 5 is a block diagram of one of the transaction bookkeeping service data processing devices in the embodiment of the present application;
fig. 6 is a diagram showing a second construction of a transaction bookkeeping service data processing apparatus according to an embodiment of the present application;
fig. 7 is a third block diagram of a transaction bookkeeping service data processing device according to an embodiment of the present application;
fig. 8 is a diagram showing a structure of a transaction bookkeeping service data processing apparatus in the embodiment of the present application;
fig. 9 is a block diagram of a transaction bookkeeping service data processing system in accordance with an embodiment of the present application;
fig. 10 is a flowchart illustrating a transaction bookkeeping service data processing method according to an embodiment of the present application;
fig. 11 is a schematic structural diagram of an electronic device in an embodiment of the application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
Consider the prior art when bookkeeping services are invoked at high concurrency. Because of the fact that sub-services of the bookkeeping service are more, preemption of partial hot spot resources is likely to exist in order to guarantee final consistency of the sub-services, so that service response capacity is reduced, and the updating sequence of partial transaction information is also abnormal. The service execution node executes processing tasks of transaction bookkeeping through multi-service and flexible transaction and dynamic service execution configuration, types of services are divided, reasonable scheduling sequence and rollback strategy are provided, service call is decoupled on the premise that final consistency of transactions is guaranteed, and therefore transaction bookkeeping task backlog of the same source and hot spot access of key processing services are prevented, and processing efficiency of transaction bookkeeping in a high concurrency scene is guaranteed to the greatest extent.
In order to effectively improve the processing efficiency and accuracy of transaction bookkeeping in a high concurrency scenario, the present application provides an embodiment of a transaction bookkeeping service data processing method, in which an execution body is a service observation node or a service observation device, referring to fig. 1, the transaction bookkeeping service data processing method specifically includes the following contents:
Step S1001: a transaction bookkeeping service call request is received.
Step S1002: and generating corresponding service scheduling information according to a request source of the transaction bookkeeping service calling request and sending the service scheduling information to a service execution node so that the service execution node generates a corresponding service execution queue according to service scheduling information configuration and calls a corresponding bookkeeping micro service according to the service execution queue to execute transaction bookkeeping processing.
Optionally, the service observation node is configured to receive the externally sent bookkeeping service call request in a unified manner, perform access control, permission control and flow control on the service to be invoked according to the call source, and perform corresponding access control, permission control and flow control on the bookkeeping requests of different access sources, for example, perform one-layer call filtering when the service is accessed, and push the filtered service scheduling message to the service execution node.
Optionally, after the service execution node persistence the service execution task queue through the database according to the service scheduling message pushed by the service observation node, the service execution node may call the service to perform transaction bookkeeping processing according to the dynamically adjustable configuration service execution queue.
As can be seen from the above description, the transaction bookkeeping service data processing method provided by the embodiment of the present application can uniformly receive a transaction bookkeeping call request by adding an observer node, perform access control, authority control and flow control, and send service scheduling information to a service execution node; the service execution node executes processing tasks of transaction bookkeeping through multi-service and flexible transaction and dynamic service execution configuration, types of services are divided, reasonable scheduling sequence and rollback strategy are provided, service call is decoupled on the premise that final consistency of transactions is guaranteed, and therefore transaction bookkeeping task backlog of the same source and hot spot access of key processing services are prevented, and processing efficiency of transaction bookkeeping in a high concurrency scene is guaranteed to the greatest extent.
In order to uniformly receive the transaction bookkeeping call request, and perform access control, authority control and flow control, in an embodiment of the transaction bookkeeping service data processing method of the present application, referring to fig. 2, the above step S1002 may further specifically include the following:
step S2001: and performing authority verification on the request source of the transaction bookkeeping service call request.
Step S2002: if the right verification result is passed, determining a corresponding access mode and service flow according to the specific type of the request source of the transaction bookkeeping service call request.
Alternatively, the requests may be filtered by means of a profile, and different access control means may be added according to different bookkeeping service request sources.
Optionally, the authority of the service caller can be checked by means of a configuration file, so that unauthorized access or incorrect call can be prevented.
Optionally, the service traffic may be dynamically adjusted according to factors such as the source of the service request, the signature, etc.
In order to effectively improve the processing efficiency and accuracy of transaction bookkeeping in a high concurrency scenario, the present application provides an embodiment of a transaction bookkeeping service data processing method, in which an execution body is a service execution node or a service execution device, referring to fig. 3, the transaction bookkeeping service data processing method specifically includes the following contents:
step S3001: and receiving service scheduling information sent by a service observation node, wherein the service scheduling information is generated by the service observation node according to a request source of a received transaction bookkeeping service call request.
Step S3002: and generating a corresponding service execution queue according to the service scheduling information configuration, and calling a corresponding bookkeeping micro service according to the service execution queue to execute transaction bookkeeping processing.
Optionally, after receiving the service call message from the service observation node and persistence the service execution task queue through the database, the service is called to perform transaction bookkeeping processing according to the dynamically adjustable configuration service execution queue.
In order to perform the processing tasks of transaction bookkeeping by multi-service and flexible transaction and dynamic service execution configuration, the services are classified into types, and a reasonable scheduling order and rollback policy are provided, and in an embodiment of the transaction bookkeeping service data processing method of the present application, referring to fig. 4, the above step S3002 may further specifically include the following:
step S4001: and classifying the features of all the bookkeeping microservices to be scheduled in the service scheduling information to obtain the unassociated microservices, the calling order insensitive microservices and the calling order sensitive microservices.
Step S4002: and incorporating the unassociated micro-service into an asynchronous service execution queue and performing independent transaction control.
Step S4003: and incorporating the calling order insensitive micro-services into a dynamic service execution queue and uniformly distributing service resources.
Step S4004: and the calling order sensitive micro-service is brought into an important service execution queue, and service resource use conditions of the important service execution queue are monitored in real time.
The optional dynamic adjustment service execution task queue can be subdivided into three types of tasks: the service which can be rolled back at any time and has no associated influence can be incorporated into an asynchronous processing queue for independent transaction control, and if the whole bookkeeping service needs to be rolled back, a service executor can execute the rolling back of the asynchronous service through a rolling back interface provided by the asynchronous service in the execution ending stage; the service insensitive to the scheduling sequence is incorporated into the dynamic service queue to be uniformly allocated, so that uniform allocation of service resources under a high concurrency scene is realized; services sensitive to the calling sequence (the service requiring the first or last call) realize resource tilting as high-priority services by acquiring service queue conditions in real time. After all the services are executed, unified transaction submission or rollback processing is performed.
In addition, the present application may also provide a micro-service cluster for performing transaction bookkeeping processing, mainly comprising the following micro-services: transaction detail update (order insensitive), transaction position update (order sensitive), transaction cash flow update (order sensitive), credit line update (order sensitive), national risk check (order insensitive), risk limit check (order insensitive), associated transaction update (rollback at any time and without associated influence), transaction assistance information update (rollback at any time and without associated influence), and the like.
In order to effectively improve the processing efficiency and accuracy of transaction bookkeeping in a high concurrency scenario, the present application provides an embodiment of a transaction bookkeeping service data processing device for implementing all or part of the contents of the transaction bookkeeping service data processing method, which may be specifically a service observation device or a service observation node, referring to fig. 5, where the transaction bookkeeping service data processing device specifically includes the following contents:
the service call receiving module 10 is configured to receive a transaction bookkeeping service call request.
The service scheduling control module 20 is configured to generate corresponding service scheduling information according to a request source of the transaction bookkeeping service call request, and send the service scheduling information to a service execution node, so that the service execution node generates a corresponding service execution queue according to the service scheduling information configuration, and call a corresponding bookkeeping micro service according to the service execution queue to execute transaction bookkeeping processing.
As can be seen from the above description, the transaction bookkeeping service data processing apparatus provided by the embodiments of the present application is capable of uniformly receiving a transaction bookkeeping call request by adding an observer node, performing access control, authority control and flow control, and transmitting service scheduling information to a service execution node; the service execution node executes processing tasks of transaction bookkeeping through multi-service and flexible transaction and dynamic service execution configuration, types of services are divided, reasonable scheduling sequence and rollback strategy are provided, service call is decoupled on the premise that final consistency of transactions is guaranteed, and therefore transaction bookkeeping task backlog of the same source and hot spot access of key processing services are prevented, and processing efficiency of transaction bookkeeping in a high concurrency scene is guaranteed to the greatest extent.
In order to uniformly receive transaction bookkeeping call requests for access control, authority control and flow control, in one embodiment of the transaction bookkeeping service data processing apparatus of the present application, referring to fig. 6, the service dispatch control module 20 includes:
and the right control unit 21 is used for checking the right of the request source of the transaction bookkeeping service call request.
And the access and flow control unit 22 is configured to determine a corresponding access manner and service flow according to a specific type of a request source of the transaction bookkeeping service call request if the result of the permission verification is passed.
In order to effectively improve the processing efficiency and accuracy of transaction bookkeeping in a high concurrency scenario, the present application provides an embodiment of a transaction bookkeeping service data processing device for implementing all or part of the contents of the transaction bookkeeping service data processing method, which may be specifically a service execution device or a service execution node, referring to fig. 7, where the transaction bookkeeping service data processing device specifically includes the following contents:
the scheduling information receiving module 30 is configured to receive service scheduling information sent by a service observation node, where the service scheduling information is generated by the service observation node according to a request source of a received transaction bookkeeping service call request.
The transaction queue processing module 40 is configured to generate a corresponding service execution queue according to the service scheduling information configuration, and call a corresponding bookkeeping micro-service according to the service execution queue to perform transaction bookkeeping processing.
In order to be able to perform the processing tasks of transaction bookkeeping by multi-service and flexible transaction as well as dynamic service execution configuration, the services are typed, providing a reasonable scheduling order and rollback policy, in an embodiment of the transaction bookkeeping service data processing apparatus of the present application, see fig. 8, the transaction queue processing module 40 comprises:
and the service feature classification unit 41 is configured to perform feature classification on all to-be-scheduled bookkeeping microservices in the service scheduling information, so as to obtain an unassociated microservice, a calling order insensitive microservice and a calling order sensitive microservice.
An asynchronous service execution unit 42, configured to incorporate the micro service without influence into an asynchronous service execution queue and perform independent transaction control.
The dynamic service execution unit 43 is configured to incorporate the call order insensitive micro service into a dynamic service execution queue and uniformly allocate service resources.
And the key service execution unit 44 is configured to incorporate the calling order sensitive micro service into a key service execution queue and monitor service resource usage of the key service execution queue in real time.
In order to effectively improve the processing efficiency and accuracy of transaction bookkeeping in a high concurrency scenario, the present application provides an embodiment of a transaction bookkeeping service data processing system, referring to fig. 9, the system specifically includes:
the service call receiving module 10 is configured to receive a transaction bookkeeping service call request.
The service scheduling control module 20 is configured to generate corresponding service scheduling information according to a request source of the transaction bookkeeping service call request, and send the service scheduling information to a service execution node.
The scheduling information receiving module 30 is configured to receive service scheduling information sent by the service observation node.
The transaction queue processing module 40 is configured to generate a corresponding service execution queue according to the service scheduling information configuration, and call a corresponding bookkeeping micro-service according to the service execution queue to perform transaction bookkeeping processing.
To further illustrate the present solution, the present application further provides a specific application example of the method for implementing the data processing method for the transaction bookkeeping service by using the data processing device for the transaction bookkeeping service, referring to fig. 10, which specifically includes the following contents:
step S101: the application system starts to start.
Step S102: the system starts up to the service framework layer and starts up the distributed service framework.
Step S103: externally, transaction bookkeeping calls are initiated.
Step S104: rights and flow control are performed on external calls.
Step S105: if the rights and flow control are not passed, a refusal call is returned.
Step S106: if the authority and the flow control pass, notifying a service executor to perform service scheduling.
Step S107: after receiving the message, the service executor starts to execute service dispatch.
Step S108: the service executor reads the service configuration and dynamically generates three service dispatch queues according to the service configuration.
Step S109: the asynchronous queue can be processed automatically and concurrently, the processing is executed automatically, and the subsequent rollback can be performed additionally.
Step S110: the order-dependent queue needs to be executed serially, and the queue can dynamically tilt resources under the condition of multiple concurrent calls.
Step S111: the order-dependent queues may perform processing in parallel, with the processing order being adjusted based on dynamic allocation of resource conditions.
Step S112: whether to roll back is determined according to the service processing results of the dependent order and the independent order.
Step S113: if the transaction does not need to rollback, then the transaction commit is performed.
Step S114: if the transaction requires rollback, then the transaction rollback is performed.
Step S115: and returning a service scheduling result.
Also provided is a particular embodiment of a transaction bookkeeping service data processing system, comprising: service observer means, service executor means, bookkeeping micro-service cluster means.
Wherein the service observer device is connected with the service executor device; the service executor device is connected to a bookkeeping micro-service cluster device.
Specifically, the service observer device: the service observer receives the call of the external bookkeeping service, performs access control, authority control and flow control on the service according to call sources, performs corresponding access control, authority control and flow control on bookkeeping requests of different access sources, performs one-layer call filtering when the service is accessed, and pushes the filtered service scheduling message to the service executor.
Specifically, the service executor device: and after receiving the service calling message from the service observer device and persistence of the service execution task queue through the database, calling the service to carry out transaction bookkeeping processing according to the dynamically adjustable configuration service execution queue. In the dynamic adjustment service execution task queue, three types of tasks are subdivided: the service which can be rolled back at any time and has no associated influence can be incorporated into an asynchronous processing queue for independent transaction control, and if the whole bookkeeping service needs to be rolled back, a service executor can execute the rolling back of the asynchronous service through a rolling back interface provided by the asynchronous service in the execution ending stage; the service insensitive to the scheduling sequence is incorporated into the dynamic service queue to be uniformly allocated, so that uniform allocation of service resources under a high concurrency scene is realized; services sensitive to the calling sequence (the service requiring the first or last call) realize resource tilting as high-priority services by acquiring service queue conditions in real time. After all the services are executed, unified transaction submission or rollback processing is performed.
Specifically, the bookkeeping micro service cluster device: the micro-service cluster for carrying out transaction bookkeeping processing mainly comprises the following micro-services: transaction detail update (order insensitive), transaction position update (order sensitive), transaction cash flow update (order sensitive), credit line update (order sensitive), national risk check (order insensitive), risk limit check (order insensitive), associated transaction update (rollback at any time and without associated influence), transaction assistance information update (rollback at any time and without associated influence), and the like.
From the above, the present application can at least achieve the following technical effects:
1. the final consistency of the transaction is ensured so that the business logic can be self-consistent.
2. The unified transaction bookkeeping service entrance is exposed to the outside, and dynamic authority and flow management are supported, so that the key bookkeeping request can be effectively supported.
3. The method fully utilizes the high concurrency and expandability characteristics of the distributed service, greatly improves the processing efficiency of transaction bookkeeping compared with a serial mode, and finally improves the processing capacity on the premise of ensuring the strong consistency of the transaction bookkeeping.
In order to effectively improve the processing efficiency and accuracy of transaction bookkeeping in a high concurrency scenario from a hardware aspect, the present application provides an embodiment of an electronic device for implementing all or part of the contents in the transaction bookkeeping service data processing method, where the electronic device specifically includes the following contents:
A processor (processor), a memory (memory), a communication interface (Communications Interface), and a bus; the processor, the memory and the communication interface complete communication with each other through the bus; the communication interface is used for realizing information transmission between the transaction bookkeeping service data processing device and related equipment such as a core service system, a user terminal, a related database and the like; the logic controller may be a desktop computer, a tablet computer, a mobile terminal, etc., and the embodiment is not limited thereto. In this embodiment, the logic controller may refer to an embodiment of the transaction book-keeping service data processing method in the embodiment and an embodiment of the transaction book-keeping service data processing device, and the contents thereof are incorporated herein, and the repetition is omitted.
It is understood that the user terminal may include a smart phone, a tablet electronic device, a network set top box, a portable computer, a desktop computer, a Personal Digital Assistant (PDA), a vehicle-mounted device, a smart wearable device, etc. Wherein, intelligent wearing equipment can include intelligent glasses, intelligent wrist-watch, intelligent bracelet etc..
In practice, part of the transaction bookkeeping service data processing method may be performed on the electronic device side as described above, or all operations may be performed in the client device. Specifically, the selection may be made according to the processing capability of the client device, and restrictions of the use scenario of the user. The application is not limited in this regard. If all operations are performed in the client device, the client device may further include a processor.
The client device may have a communication module (i.e. a communication unit) and may be connected to a remote server in a communication manner, so as to implement data transmission with the server. The server may include a server on the side of the task scheduling center, and in other implementations may include a server of an intermediate platform, such as a server of a third party server platform having a communication link with the task scheduling center server. The server may include a single computer device, a server cluster formed by a plurality of servers, or a server structure of a distributed device.
Fig. 11 is a schematic block diagram of a system configuration of an electronic device 9600 according to an embodiment of the present application. As shown in fig. 11, the electronic device 9600 may include a central processor 9100 and a memory 9140; the memory 9140 is coupled to the central processor 9100. Notably, this fig. 11 is exemplary; other types of structures may also be used in addition to or in place of the structures to implement telecommunications functions or other functions.
In one embodiment, the transaction bookkeeping service data processing method functions may be integrated into the central processor 9100. The central processor 9100 may be configured to perform the following control:
Step S1001: a transaction bookkeeping service call request is received.
Step S1002: and generating corresponding service scheduling information according to a request source of the transaction bookkeeping service calling request and sending the service scheduling information to a service execution node so that the service execution node generates a corresponding service execution queue according to service scheduling information configuration and calls a corresponding bookkeeping micro service according to the service execution queue to execute transaction bookkeeping processing.
As can be seen from the above description, the electronic device provided in the embodiment of the present application uniformly receives the transaction bookkeeping call request by adding the observer node, performs access control, authority control and flow control, and sends service scheduling information to the service execution node; the service execution node executes processing tasks of transaction bookkeeping through multi-service and flexible transaction and dynamic service execution configuration, types of services are divided, reasonable scheduling sequence and rollback strategy are provided, service call is decoupled on the premise that final consistency of transactions is guaranteed, and therefore transaction bookkeeping task backlog of the same source and hot spot access of key processing services are prevented, and processing efficiency of transaction bookkeeping in a high concurrency scene is guaranteed to the greatest extent.
In another embodiment, the transaction book-keeping service data processing apparatus may be configured separately from the central processor 9100, for example, the transaction book-keeping service data processing apparatus may be configured as a chip connected to the central processor 9100, and the transaction book-keeping service data processing method functions are implemented under the control of the central processor.
As shown in fig. 11, the electronic device 9600 may further include: a communication module 9110, an input unit 9120, an audio processor 9130, a display 9160, and a power supply 9170. It is noted that the electronic device 9600 need not include all of the components shown in fig. 11; in addition, the electronic device 9600 may further include components not shown in fig. 11, and reference may be made to the related art.
As shown in fig. 11, the central processor 9100, sometimes referred to as a controller or operational control, may include a microprocessor or other processor device and/or logic device, which central processor 9100 receives inputs and controls the operation of the various components of the electronic device 9600.
The memory 9140 may be, for example, one or more of a buffer, a flash memory, a hard drive, a removable media, a volatile memory, a non-volatile memory, or other suitable device. The information about failure may be stored, and a program for executing the information may be stored. And the central processor 9100 can execute the program stored in the memory 9140 to realize information storage or processing, and the like.
The input unit 9120 provides input to the central processor 9100. The input unit 9120 is, for example, a key or a touch input device. The power supply 9170 is used to provide power to the electronic device 9600. The display 9160 is used for displaying display objects such as images and characters. The display may be, for example, but not limited to, an LCD display.
The memory 9140 may be a solid state memory such as Read Only Memory (ROM), random Access Memory (RAM), SIM card, etc. But also a memory which holds information even when powered down, can be selectively erased and provided with further data, an example of which is sometimes referred to as EPROM or the like. The memory 9140 may also be some other type of device. The memory 9140 includes a buffer memory 9141 (sometimes referred to as a buffer). The memory 9140 may include an application/function storage portion 9142, the application/function storage portion 9142 storing application programs and function programs or a flow for executing operations of the electronic device 9600 by the central processor 9100.
The memory 9140 may also include a data store 9143, the data store 9143 for storing data, such as contacts, digital data, pictures, sounds, and/or any other data used by an electronic device. The driver storage portion 9144 of the memory 9140 may include various drivers of the electronic device for communication functions and/or for performing other functions of the electronic device (e.g., messaging applications, address book applications, etc.).
The communication module 9110 is a transmitter/receiver 9110 that transmits and receives signals via an antenna 9111. A communication module (transmitter/receiver) 9110 is coupled to the central processor 9100 to provide input signals and receive output signals, as in the case of conventional mobile communication terminals.
Based on different communication technologies, a plurality of communication modules 9110, such as a cellular network module, a bluetooth module, and/or a wireless local area network module, etc., may be provided in the same electronic device. The communication module (transmitter/receiver) 9110 is also coupled to a speaker 9131 and a microphone 9132 via an audio processor 9130 to provide audio output via the speaker 9131 and to receive audio input from the microphone 9132 to implement usual telecommunications functions. The audio processor 9130 can include any suitable buffers, decoders, amplifiers and so forth. In addition, the audio processor 9130 is also coupled to the central processor 9100 so that sound can be recorded locally through the microphone 9132 and sound stored locally can be played through the speaker 9131.
An embodiment of the present application further provides a computer-readable storage medium capable of implementing all steps in the transaction bookkeeping service data processing method in which the execution subject is a server or a client in the above embodiment, the computer-readable storage medium storing a computer program thereon, the computer program implementing all steps in the transaction bookkeeping service data processing method in which the execution subject is a server or a client in the above embodiment when executed by a processor, for example, the processor implementing the following steps when executing the computer program:
Step S1001: a transaction bookkeeping service call request is received.
Step S1002: and generating corresponding service scheduling information according to a request source of the transaction bookkeeping service calling request and sending the service scheduling information to a service execution node so that the service execution node generates a corresponding service execution queue according to service scheduling information configuration and calls a corresponding bookkeeping micro service according to the service execution queue to execute transaction bookkeeping processing.
As can be seen from the above description, the computer readable storage medium provided by the embodiments of the present application uniformly receives a transaction bookkeeping call request by adding an observer node, performs access control, authority control and flow control, and transmits service scheduling information to a service execution node; the service execution node executes processing tasks of transaction bookkeeping through multi-service and flexible transaction and dynamic service execution configuration, types of services are divided, reasonable scheduling sequence and rollback strategy are provided, service call is decoupled on the premise that final consistency of transactions is guaranteed, and therefore transaction bookkeeping task backlog of the same source and hot spot access of key processing services are prevented, and processing efficiency of transaction bookkeeping in a high concurrency scene is guaranteed to the greatest extent.
It will be apparent to those skilled in the art that embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (devices), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The principles and embodiments of the present invention have been described in detail with reference to specific examples, which are provided to facilitate understanding of the method and core ideas of the present invention; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in accordance with the ideas of the present invention, the present description should not be construed as limiting the present invention in view of the above.
Claims (9)
1. A transaction bookkeeping service data processing method, applied to a service observation node, the method comprising:
receiving a transaction bookkeeping service call request;
generating corresponding service scheduling information according to a request source of the transaction bookkeeping service calling request and sending the service scheduling information to a service execution node so that the service execution node carries out feature classification on all bookkeeping micro services to be scheduled in the service scheduling information to obtain unassociated micro services, calling order insensitive micro services and calling order sensitive micro services, the unassociated micro services are included in an asynchronous service execution queue and are subjected to independent transaction control, the calling order insensitive micro services are included in a dynamic service execution queue and are uniformly distributed with service resources, the calling order sensitive micro services are included in the key service execution queue and service resource use conditions of the key service execution queue are monitored in real time, and the corresponding bookkeeping micro services are called according to the service execution queue so as to execute transaction bookkeeping processing.
2. A transaction bookkeeping service data processing method according to claim 1, wherein the generating corresponding service schedule information according to a request source of the transaction bookkeeping service call request includes:
Performing authority verification on a request source of the transaction bookkeeping service call request;
if the right verification result is passed, determining a corresponding access mode and service flow according to the specific type of the request source of the transaction bookkeeping service call request.
3. A transaction bookkeeping service data processing method, applied to a service execution node, the method comprising:
receiving service scheduling information sent by a service observation node, wherein the service scheduling information is generated by the service observation node according to a request source of a received transaction bookkeeping service call request;
and carrying out feature classification on all to-be-scheduled bookkeeping micro-services in the service scheduling information to obtain uncorrelated influence micro-services, calling order insensitive micro-services and calling order sensitive micro-services, incorporating the uncorrelated influence micro-services into an asynchronous service execution queue and carrying out independent transaction control, incorporating the calling order insensitive micro-services into a dynamic service execution queue and uniformly distributing service resources, incorporating the calling order sensitive micro-services into the key service execution queue and monitoring service resource use conditions of the key service execution queue in real time, and calling corresponding bookkeeping micro-services according to the service execution queue to execute transaction bookkeeping processing.
4. A transaction bookkeeping service data processing device, comprising:
a service call receiving module for receiving a transaction bookkeeping service call request;
the service scheduling control module is used for generating corresponding service scheduling information according to a request source of the transaction bookkeeping service calling request and sending the service scheduling information to a service execution node so that the service execution node can conduct feature classification on all bookkeeping micro services to be scheduled in the service scheduling information to obtain irrelevant micro services, calling order insensitive micro services and calling order sensitive micro services, the irrelevant micro services are included in an asynchronous service execution queue and conduct independent transaction control, the calling order insensitive micro services are included in a dynamic service execution queue and uniformly distribute service resources, the calling order sensitive micro services are included in an important service execution queue and service resource service use conditions of the important service execution queue are monitored in real time, and corresponding bookkeeping micro services are called according to the service execution queue to execute transaction bookkeeping processing.
5. The transaction bookkeeping service data processing apparatus of claim 4, wherein said service schedule control module includes:
The permission control unit is used for verifying the permission of a request source of the transaction bookkeeping service calling request;
and the access and flow control unit is used for determining a corresponding access mode and service flow according to the specific type of the request source of the transaction bookkeeping service call request if the result of the permission verification is passed.
6. A transaction bookkeeping service data processing device, comprising:
the scheduling information receiving module is used for receiving service scheduling information sent by a service observation node, wherein the service scheduling information is generated by the service observation node according to a request source of a received transaction bookkeeping service call request;
and the transaction queue processing module is used for classifying the characteristics of all to-be-scheduled bookkeeping micro-services in the service scheduling information to obtain uncorrelated micro-services, calling order insensitive micro-services and calling order sensitive micro-services, integrating the uncorrelated micro-services into an asynchronous service execution queue and performing independent transaction control, integrating the calling order insensitive micro-services into a dynamic service execution queue and uniformly distributing service resources, integrating the calling order sensitive micro-services into an important service execution queue and monitoring service resource use conditions of the important service execution queue in real time, and calling corresponding bookkeeping micro-services according to the service execution queue to execute transaction bookkeeping processing.
7. A transaction bookkeeping service data processing system, the system comprising:
a service call receiving module for receiving a transaction bookkeeping service call request;
the service scheduling control module is used for generating corresponding service scheduling information according to the request source of the transaction bookkeeping service call request and sending the corresponding service scheduling information to the service execution node;
the scheduling information receiving module is used for receiving service scheduling information sent by the service observation node;
and the transaction queue processing module is used for classifying the characteristics of all to-be-scheduled bookkeeping micro-services in the service scheduling information to obtain uncorrelated micro-services, calling order insensitive micro-services and calling order sensitive micro-services, integrating the uncorrelated micro-services into an asynchronous service execution queue and performing independent transaction control, integrating the calling order insensitive micro-services into a dynamic service execution queue and uniformly distributing service resources, integrating the calling order sensitive micro-services into an important service execution queue and monitoring service resource use conditions of the important service execution queue in real time, and calling corresponding bookkeeping micro-services according to the service execution queue to execute transaction bookkeeping processing.
8. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the transaction bookkeeping service data processing method of any one of claims 1 to 3 when the program is executed by the processor.
9. A computer-readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, carries out the steps of a transaction bookkeeping service data processing method according to any one of claims 1 to 3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010241030.7A CN111352719B (en) | 2020-03-31 | 2020-03-31 | Transaction bookkeeping service data processing method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010241030.7A CN111352719B (en) | 2020-03-31 | 2020-03-31 | Transaction bookkeeping service data processing method, device and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111352719A CN111352719A (en) | 2020-06-30 |
| CN111352719B true CN111352719B (en) | 2023-08-22 |
Family
ID=71196359
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010241030.7A Active CN111352719B (en) | 2020-03-31 | 2020-03-31 | Transaction bookkeeping service data processing method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111352719B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113205407A (en) * | 2021-05-28 | 2021-08-03 | 中国工商银行股份有限公司 | Distributed sub-transaction processing method and device |
| CN113448713B (en) * | 2021-07-12 | 2024-02-13 | 中国银行股份有限公司 | Asynchronous processing method, device, storage medium and equipment for stream data |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105357239A (en) * | 2014-08-20 | 2016-02-24 | 杭州华三通信技术有限公司 | Method and device for providing service, and method and device for acquiring service |
| CN105915575A (en) * | 2015-12-15 | 2016-08-31 | 乐视网信息技术（北京）股份有限公司 | Service calling method and equipment |
| CN110333939A (en) * | 2019-06-17 | 2019-10-15 | 腾讯科技(成都)有限公司 | Task mixed scheduling method, device, dispatch server and Resource Server |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021155496A1 (en) * | 2020-02-04 | 2021-08-12 | Honeywell International Inc. | Transaction based processing using asynchronous microservices |
-
2020
- 2020-03-31 CN CN202010241030.7A patent/CN111352719B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105357239A (en) * | 2014-08-20 | 2016-02-24 | 杭州华三通信技术有限公司 | Method and device for providing service, and method and device for acquiring service |
| CN105915575A (en) * | 2015-12-15 | 2016-08-31 | 乐视网信息技术（北京）股份有限公司 | Service calling method and equipment |
| CN110333939A (en) * | 2019-06-17 | 2019-10-15 | 腾讯科技(成都)有限公司 | Task mixed scheduling method, device, dispatch server and Resource Server |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111352719A (en) | 2020-06-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111352719B (en) | Transaction bookkeeping service data processing method, device and system | |
| CN110764881A (en) | Distributed system background retry method and device | |
| CN110675159A (en) | Financial market transaction advance risk control method and system and electronic equipment | |
| CN111985007A (en) | Contract signing and executing method and device based on block chain | |
| CN111510493B (en) | Distributed data transmission method and device | |
| CN111445331A (en) | Transaction matching method and device | |
| CN114257532B (en) | Method and device for detecting state of server | |
| CN112416616A (en) | Micro-service calling method and device, electronic equipment and storage medium | |
| CN115480937A (en) | Data processing method and device, electronic equipment and readable storage medium | |
| CN115099930A (en) | Financial business data processing method and device | |
| CN111930624B (en) | Test link message data processing method and device | |
| CN113434423A (en) | Interface test method and device | |
| CN116095074A (en) | Resource allocation method, device, related equipment and storage medium | |
| CN113221177A (en) | Data access method, device and system in distributed system | |
| CN113094571A (en) | Multi-platform account checking method and device | |
| CN111262794A (en) | Gateway flow control method and device | |
| CN111930620B (en) | Application running environment data processing method and device | |
| CN115731019A (en) | Flexible transaction data processing method and device | |
| CN116048776A (en) | Multi-process service processing method and device based on service requirements | |
| US20240152504A1 (en) | Data interaction method, apparatus, and electronic device | |
| CN110008283B (en) | Data processing method and device based on data tag | |
| US20230094279A1 (en) | Chat-based transaction automation system | |
| CN116069855A (en) | Distributed service routing method and device | |
| CN115719229A (en) | Outbound transaction verification method and device | |
| CN114881643A (en) | Loss reporting method, device and system for bank card |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |