CN113269557B - Transaction log acquisition system and working method thereof - Google Patents
Transaction log acquisition system and working method thereof Download PDFInfo
- Publication number
- CN113269557B CN113269557B CN202110601158.4A CN202110601158A CN113269557B CN 113269557 B CN113269557 B CN 113269557B CN 202110601158 A CN202110601158 A CN 202110601158A CN 113269557 B CN113269557 B CN 113269557B
- Authority
- CN
- China
- Prior art keywords
- transaction
- log
- call
- calling
- request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 230000000977 initiatory effect Effects 0.000 claims abstract description 27
- 238000004590 computer program Methods 0.000 claims description 16
- 238000012545 processing Methods 0.000 claims description 15
- 230000008569 process Effects 0.000 claims description 8
- 238000006243 chemical reaction Methods 0.000 claims description 7
- 238000005215 recombination Methods 0.000 claims description 6
- 230000006798 recombination Effects 0.000 claims description 6
- 238000004458 analytical method Methods 0.000 abstract description 28
- 238000010276 construction Methods 0.000 abstract description 9
- 238000005516 engineering process Methods 0.000 abstract description 2
- 230000006870 function Effects 0.000 description 21
- 238000010586 diagram Methods 0.000 description 16
- 238000012098 association analyses Methods 0.000 description 7
- 238000012550 audit Methods 0.000 description 5
- 238000010219 correlation analysis Methods 0.000 description 5
- 238000011161 development Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000007405 data analysis Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008521 reorganization Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q20/00—Payment architectures, schemes or protocols
- G06Q20/38—Payment protocols; Details thereof
- G06Q20/389—Keeping log of transactions for guaranteeing non-repudiation of a transaction
Landscapes
- Business, Economics & Management (AREA)
- Accounting & Taxation (AREA)
- Finance (AREA)
- Strategic Management (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention provides a transaction log acquisition system and a working method thereof, which relate to big data technology, wherein the system comprises: the transaction system is connected with the public transaction calling system and is used for initiating transaction according to service requirements, generating a transaction request and sending the transaction request to the public transaction calling system, and carrying out transaction calling according to the call request sent by the public transaction calling system; the public transaction calling system is arranged at the central positions of the transaction systems and is used for receiving transaction requests sent by the transaction systems initiating transactions, generating calling requests and configuring unique UUIDs, sending the calling requests to the transaction systems needing to be subjected to transaction calling, and generating transaction logs according to the unique UUIDs. The invention generates the log in the unified public transaction calling system, can easily form transaction log specification, reduces repeated construction of each transaction system, and can conveniently realize log analysis of cross-system transaction.
Description
Technical Field
The invention relates to the technical field of computer data processing, in particular to a transaction log acquisition system and a working method thereof.
Background
This section is intended to provide a background or context to the embodiments of the invention that are recited in the claims. The description herein is not admitted to be prior art by inclusion in this section.
The transaction system needs to record some transaction logs for auditing, problem analysis and other purposes in the normal operation process.
However, the transaction logs belong to nonfunctional functional requirements for service functions, and the record transaction logs not only occupy the development workload of the transaction system, but also increase the performance pressure of the operation of the production system, and meanwhile, because the most direct root cause of the problem can be known only by analyzing the transaction logs of a plurality of systems in series when the problem analysis is usually performed actually, the logs of all the systems can be related together according to a certain id, but the log records of all the systems are self-completed by all the systems, so that the logs are difficult to be related together to realize unified log data analysis.
When the current transaction system performs log association analysis, there are several problems:
1. the transaction log is recorded in each system independently, the main key of the log, the unified identification among the systems and the like are not unified, and the implementation of the global transaction log is not standard;
2. each system realizes the record of transaction logs and carries out a plurality of repeated development and test works;
3. cross-system tandem analysis of transactions cannot be conveniently implemented.
Therefore, how to provide a new solution to the above technical problem is a technical problem to be solved in the art.
Disclosure of Invention
The embodiment of the invention provides a transaction log acquisition system, which generates logs in a unified public transaction calling system, can easily form transaction log specifications, reduces repeated construction of each transaction system, and can conveniently realize log analysis of cross-system transactions, and the system comprises:
the transaction system is connected with the public transaction calling system and is used for initiating transaction according to service requirements, generating a transaction request and sending the transaction request to the public transaction calling system, and carrying out transaction calling according to the call request sent by the public transaction calling system;
The public transaction calling system is arranged at the central positions of the transaction systems and is used for receiving transaction requests sent by the transaction systems initiating transactions, generating calling requests and configuring unique UUIDs, sending the calling requests to the transaction systems needing to be subjected to transaction calling, and generating transaction logs according to the unique UUIDs.
The embodiment of the invention also provides a working method of the transaction log acquisition system, which comprises the following steps:
The transaction systems are connected with the public transaction calling system, initiate transactions according to business requirements, generate transaction requests and send the transaction requests to the public transaction calling system, and conduct transaction calling according to the call requests sent by the public transaction calling system;
The public transaction calling system is arranged at the central positions of the transaction systems, receives transaction requests sent by the transaction systems initiating transactions, generates calling requests, configures unique UUIDs, sends the calling requests to the transaction systems needing to be subjected to transaction calling, and generates transaction logs according to the unique UUIDs.
The embodiment of the invention also provides a computer device which comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor realizes the working method of the transaction log acquisition system when executing the computer program.
The embodiment of the invention also provides a computer readable storage medium, which stores a computer program for executing the working method of the transaction log acquisition system.
The transaction log acquisition system and the working method thereof provided by the embodiment of the invention comprise the following steps: the transaction system is connected with the public transaction calling system and is used for initiating transaction according to service requirements, generating a transaction request and sending the transaction request to the public transaction calling system, and carrying out transaction calling according to the call request sent by the public transaction calling system; the public transaction calling system is arranged at the central positions of the transaction systems and is used for receiving transaction requests sent by the transaction systems initiating transactions, generating calling requests and configuring unique UUIDs, sending the calling requests to the transaction systems needing to be subjected to transaction calling, and generating transaction logs according to the unique UUIDs. The embodiment of the invention aims to solve the problem that the aim of association analysis cannot be completed due to the fact that one business function spans a plurality of transaction systems and the log record of each transaction system is respectively and independently designed in the aspects of format, primary key, association relation and the like, and further realizes that each transaction system can be separated, and end-to-end transaction log collection is uniformly formed. In the embodiment of the invention, a public transaction calling system is designed, the system is positioned at a core position, the calling of each transaction system is completed through the public transaction calling system, and because the public transaction calling system is used for connecting all transaction systems, all transaction logs can be naturally recorded when the transaction is initiated and called, and because the transactions are called in the public transaction calling system, a unique UUID can be allocated for each transaction call of a service function. This UUID is thus recorded in each transaction log data item generated during each transaction. And when the transaction log is used for cross-system transaction log analysis in the scenes of audit, problem analysis and the like, the correlation analysis through UUID can be realized. Because the invention generates the log in the unified public transaction calling system, the transaction log specification can be easily formed, the repeated construction of each transaction system is reduced, and finally, the log analysis of the cross-system transaction can be conveniently realized. Therefore, the transaction log can be generated without separating from each transaction system, and the generated transaction log can realize end-to-end tracking according to the unique UUID. The invention can separate from the transaction systems through the public transaction calling system, and generates the transaction log at a single position without independently generating the transaction log by each transaction system.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art. In the drawings:
fig. 1 is a schematic diagram of a transaction log collection system according to an embodiment of the invention.
Fig. 2 is a block diagram of a transaction log collection system according to an embodiment of the present invention.
Fig. 3 is a schematic diagram of a working method of a transaction log collection system according to an embodiment of the present invention.
Fig. 4 is a schematic workflow diagram of a public transaction calling system in a working method of a transaction log collection system according to an embodiment of the present invention.
FIG. 5 is a schematic diagram of a computer device for operating a method of operating a transaction log collection system embodying the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the embodiments of the present invention will be described in further detail with reference to the accompanying drawings. The exemplary embodiments of the present invention and their descriptions herein are for the purpose of explaining the present invention, but are not to be construed as limiting the invention.
The invention relates to big data technology. Fig. 1 is a schematic diagram of a transaction log collection system according to an embodiment of the present invention, where as shown in fig. 1, the embodiment of the present invention provides a transaction log collection system, in which log generation is performed in a unified public transaction calling system, so that a transaction log specification can be easily formed, repeated construction of each transaction system is reduced, and log analysis of cross-system transactions can be conveniently implemented, and the system includes:
the transaction systems 101 are connected with the public transaction calling system and are used for initiating transaction according to service requirements, generating transaction requests and sending the transaction requests to the public transaction calling system, and carrying out transaction calling according to the call requests sent by the public transaction calling system;
the public transaction calling system 102 is arranged at the central positions of the transaction systems and is used for receiving transaction requests sent by the transaction systems initiating transactions, generating calling requests and configuring unique UUIDs, sending the calling requests to the transaction systems needing to be subjected to transaction calling, and generating transaction logs according to the unique UUIDs.
The transaction log acquisition system provided by the embodiment of the invention comprises: the transaction system is connected with the public transaction calling system and is used for initiating transaction according to service requirements, generating a transaction request and sending the transaction request to the public transaction calling system, and carrying out transaction calling according to the call request sent by the public transaction calling system; the public transaction calling system is arranged at the central positions of the transaction systems and is used for receiving transaction requests sent by the transaction systems initiating transactions, generating calling requests and configuring unique UUIDs, sending the calling requests to the transaction systems needing to be subjected to transaction calling, and generating transaction logs according to the unique UUIDs. The embodiment of the invention aims to solve the problem that the aim of association analysis cannot be completed due to the fact that one business function spans a plurality of transaction systems and the log record of each transaction system is respectively and independently designed in the aspects of format, primary key, association relation and the like, and further realizes that each transaction system can be separated, and end-to-end transaction log collection is uniformly formed. In the embodiment of the invention, a public transaction calling system is designed, the system is positioned at a core position, the calling of each transaction system is completed through the public transaction calling system, and because the public transaction calling system is used for connecting all transaction systems, all transaction logs can be naturally recorded when the transaction is initiated and called, and because the transactions are called in the public transaction calling system, a unique UUID can be allocated for each transaction call of a service function. This UUID is thus recorded in each transaction log data item generated during each transaction. And when the transaction log is used for cross-system transaction log analysis in the scenes of audit, problem analysis and the like, the correlation analysis through UUID can be realized. Because the invention generates the log in the unified public transaction calling system, the transaction log specification can be easily formed, the repeated construction of each transaction system is reduced, and finally, the log analysis of the cross-system transaction can be conveniently realized. Therefore, the transaction log can be generated without separating from each transaction system, and the generated transaction log can realize end-to-end tracking according to the unique UUID. The invention can separate from the transaction systems through the public transaction calling system, and generates the transaction log at a single position without independently generating the transaction log by each transaction system.
In the embodiment of the present invention, the specialized vocabulary is explained as follows:
Transaction system: also called business system, is a computer software system that implements business functions specifically.
Transaction log: is a number of individual data items recorded by the transaction system during operation for purposes of auditing, problem analysis, etc., including, but not limited to, date, time, business function number, function operation description, operator, etc.
End-to-end: i.e., all software systems that go through from the initiation of an operation by a client (or user) to the final completion of the business operation.
The system aims to solve the problem that the log record of each transaction system is independently designed in the aspects of format, primary key, association relation and the like so as to not complete the target of association analysis, and further realize that each transaction system can be separated, and end-to-end transaction log collection is uniformly formed.
Fig. 2 is a block diagram of a transaction log collection system according to an embodiment of the present invention, and as shown in fig. 2, when the transaction log collection system according to the embodiment of the present invention is implemented, in an embodiment, the method may include:
the transaction system is connected with the public transaction calling system and is used for initiating transaction according to service requirements, generating a transaction request and sending the transaction request to the public transaction calling system, and carrying out transaction calling according to the call request sent by the public transaction calling system;
The public transaction calling system is arranged at the central positions of the transaction systems and is used for receiving transaction requests sent by the transaction systems initiating transactions, generating calling requests and configuring unique UUIDs, sending the calling requests to the transaction systems needing to be subjected to transaction calling, and generating transaction logs according to the unique UUIDs.
The embodiment of the invention aims to solve the problem that the aim of association analysis cannot be completed due to the fact that one business function spans a plurality of transaction systems and the log record of each transaction system is respectively and independently designed in the aspects of format, primary key, association relation and the like, and further realizes that each transaction system can be separated, and end-to-end transaction log collection is uniformly formed.
In the embodiment of the invention, a public transaction calling system is designed, the system is positioned at a core position, the calling of each transaction system is completed through the public transaction calling system, and because the public transaction calling system is used for connecting all transaction systems, all transaction logs can be naturally recorded when the transaction is initiated and called, and because the transactions are called in the public transaction calling system, a unique UUID can be allocated for each transaction call of a service function. This UUID is thus recorded in each transaction log data item generated during each transaction.
And when the transaction log is used for cross-system transaction log analysis in the scenes of audit, problem analysis and the like, the correlation analysis through UUID can be realized.
When the transaction log collection system provided by the embodiment of the invention is implemented, in one embodiment, the public transaction calling system comprises:
The source transaction receiving module is used for receiving a transaction request sent by a transaction system for initiating a transaction and forwarding the transaction request to the transaction calling core module;
The transaction call core module is used for receiving the transaction request sent by the source transaction receiving module, carrying out protocol conversion, transaction message recombination and transaction flow control processing on the transaction request, and determining a call request and a transaction system needing transaction call;
the transaction forwarding module is used for sending the call request to a transaction system needing to be subjected to transaction call;
The transaction log UUID generation module is used for generating a call request for the transaction call core module and transmitting the call request to a transaction process configuration unique UUID of a transaction system needing transaction call by the transaction forwarding module;
and the transaction log generation module is used for generating a transaction log according to the unique UUID after the call request is sent to the transaction system needing to be subjected to transaction call.
In another embodiment, the public transaction calling system is disposed at a central position of the transaction systems, and is configured to receive a transaction request sent by the transaction system initiating the transaction, determine a calling request and a transaction system needing to perform transaction calling according to the transaction request, configure a unique UUID for the calling request, send the calling request configured with the unique UUID to the transaction system needing to perform transaction calling, and generate a transaction log according to the unique UUID after the sending of the calling request is completed.
A public transaction invocation system comprising: the system comprises a source transaction receiving module, a transaction calling core module, a transaction forwarding module, a transaction log UUID generating module and a transaction log generating module;
The source transaction receiving module is used for receiving transaction requests sent by other transaction systems and forwarding the transaction requests to the transaction calling core module;
The transaction call core module is used for receiving the transaction request sent by the transaction call core module, and generating a call request and a transaction system needing to be subjected to transaction call through corresponding processing such as protocol conversion, transaction message recombination, transaction flow control and the like.
And the transaction forwarding module is used for receiving the transaction request sent by the transaction calling core module and connecting to an external transaction system for transaction calling.
The transaction log UUID generation module is used for generating a unique id for identifying a unique transaction call, and the transaction log generation module can be used for realizing the record of each system transaction after the transaction is completed (success or failure) when the transaction is called to each system in the transaction call core module and the transaction forwarding module by using the id.
The transaction log generation module is used for calling the external system transaction in the transaction forwarding module, and calling the module to generate logs after the call is ended, wherein unique keys UUID in each log are the same in the logs generated by the transaction of each system, so that the requirement of unified analysis of the logs is met.
Because the invention generates the log in the unified public transaction calling system, the transaction log specification can be easily formed, the repeated construction of each transaction system is reduced, and finally, the log analysis of the cross-system transaction can be conveniently realized. Therefore, the transaction log can be generated without separating from each transaction system, and the generated transaction log can realize end-to-end tracking according to the unique UUID. The invention can separate from the transaction systems through the public transaction calling system, and generates the transaction log at a single position without independently generating the transaction log by each transaction system.
When the transaction log acquisition system provided by the embodiment of the invention is implemented, in one embodiment, when the transaction log generation module generates the transaction log, the transaction log generation module is linked to the transaction systems through the unique UUIDs, and the unique UUIDs are placed in the transaction log of each transaction system.
When the transaction log acquisition system provided by the embodiment of the invention is implemented, in one embodiment, the public transaction calling system further comprises: and the transaction log configuration module is used for configuring whether to generate a transaction log or not and configuring the recording time of the transaction log.
In an embodiment, the transaction log configuration module is configured to set whether to record a log, and a log recording timing.
When the transaction log acquisition system provided by the embodiment of the invention is implemented, in one embodiment, the recording time of the transaction log at least comprises one or any combination of the following:
When the transaction call core module generates a call request, the transaction forwarding module sends the call request to a transaction system needing to be subjected to transaction call, records before the transaction call, records after the transaction call is finished, and records before the transaction call and after the transaction call are finished.
In an embodiment, when configuring the recording timing of the transaction log, it is required to configure whether the recording is performed before the transaction call or after the transaction call is completed or both of the recording and the recording is performed, at least one of the recording and the recording is included in the process of processing the transaction by the transaction call core module or the transaction forwarding module.
When the transaction log acquisition system provided by the embodiment of the invention is implemented, in one embodiment, the transaction log acquisition system further comprises: transaction log output module for
And recording the generated transaction log into a log file or a log system, and storing the transaction log into a database.
In an embodiment, the transaction log output module is configured to record the generated log into a log file or a log system.
The main functions of the source transaction receiving module, the transaction calling core module and the transaction forwarding module are the calling of the transaction, and the core purpose is to connect the transaction in series. The modules optimize the original chain type transaction call to be in series connection with the transaction at the place, so that the call of the transaction is carried out in one system of the system, and the basis of carrying out log unified record is provided. The transaction call core module and the transaction forwarding module can determine whether the transaction log is required to be recorded according to the requirement in the transaction processing. The transaction log generation module is a core module for generating the transaction log, decides whether to generate the transaction log according to the requirements of the transaction call core module and the transaction forwarding module, wherein the unique id of the transaction log is completed by the transaction log UUID generation module, and the transaction log is recorded into a transaction log file or a log system for subsequent analysis through the transaction log output module after the transaction log is generated. The transaction log configuration module is used for uniformly controlling whether the transaction log is recorded, the recording time and the like.
The transaction log collection system provided by the embodiment of the invention is briefly described below with reference to a specific scenario:
Because the invention generates the log in the unified public transaction calling system, the transaction log specification can be easily formed, the repeated construction of each transaction system is reduced, and finally, the log analysis of the cross-system transaction can be conveniently realized. Therefore, the transaction log can be generated without separating from each transaction system, and the generated transaction log can realize end-to-end tracking according to the unique UUID.
The transaction log acquisition system provided by the embodiment of the invention mainly comprises: a plurality of transaction systems and a common transaction invocation system.
In a co-transaction invocation system, module scope and role, including:
Module 1: a source transaction receiving module:
the module receives transaction requests sent by other transaction systems and forwards the transaction requests to the module 2.
Module 2: the transaction calling core module:
The module receives the transaction request sent by the module 1, and then carries out corresponding processing such as protocol conversion, transaction message recombination, transaction flow control and the like.
Module 3: a transaction forwarding module:
the module is used for receiving the transaction request sent by the module 2 and connecting to an external system for transaction calling.
Module 4: transaction log UUID generation module:
The function of this module is to generate a unique id for identifying a unique transaction call, and by using this id, when the transaction is called to each system in the module 2 and the module 3, the record of each system transaction can be realized by using the module 5 after the transaction is completed (success or failure).
Module 5: a transaction log generation module:
In the module 3, the external system transaction is called, and the module is called to generate logs after the call is finished, at this time, the unique key UUID in each log is the same in the logs generated by each system transaction, so that the requirement of unified analysis of the logs is met.
And (6) module 6: a transaction log output module:
The log generated for the module 5 is recorded into a log file or log system.
Module 7: a transaction log configuration module:
Setting whether to record the log and the time for recording the log.
The relationship between modules includes: the main function of the modules 1, 2 and 3 is the invocation of the transaction, and the core purpose is to connect the transactions together in series. The modules optimize the original chain type transaction call to be in series connection with the transaction at the place, so that the call of the transaction is carried out in one system of the system, and the basis of carrying out log unified record is provided. The modules 2, 3 can determine if recording of the transaction log is required during the transaction process as required. The module 5 is a core module for generating the transaction log, determines whether to generate the transaction log according to the requirements of the modules 2 and 3, wherein the unique id of the transaction log is completed by the module 4, and the transaction log is recorded into a transaction log file or log system for subsequent analysis through the module 6 after the transaction log is generated. The module 7 performs unified control on whether the transaction log is recorded or not, recording timing, and the like.
When the technician develops the module, the technician needs to develop: (1) a source transaction receiving module; (2) Developing a transaction calling core module in a public transaction calling system; (3) transferring the transaction to a target system module; (4) developing a UUID generation module of the transaction log; (5) a transaction log generation module; (6) a transaction log output module; of these, the most important are the (2), (4) and (5) th modules.
The key points are as follows: the transaction call core module, the transaction forwarding module, the transaction log UUID generation module and the transaction log generation module.
The workflow of the above module comprises:
1. configuring information such as whether to generate a transaction log, a recording time of the transaction log (whether to record before transaction call or record after transaction call is finished in the module 2 or the module 3, or record both, at least one of the two is required to be included), and the like;
2. Receiving a source transaction;
3. processing source transaction, including protocol conversion, message reorganization, log recording (according to configuration requirement), etc.;
4. step 3, calling an external system after execution, and recording a log (according to configuration requirements) in the step;
5. generating UUIDs of the transaction logs;
6. generating a transaction log (which includes the UUID generated in step 4)
7. Outputting transaction logs to log files or log systems
Wherein, the step 1 and the step 7 are added steps;
Step 1, the record of the transaction log is more convenient to manage;
the log generated in step 7 is stored for further processing and analysis.
The embodiment of the invention aims to solve the problem that the aim of association analysis cannot be completed due to the fact that one business function spans a plurality of transaction systems and the log record of each transaction system is respectively and independently designed in the aspects of format, primary key, association relation and the like, and further realizes that each transaction system can be separated, and end-to-end transaction log collection is uniformly formed.
In the embodiment of the invention, a public transaction calling system is designed, the system is positioned at a core position, the calling of each transaction system is completed through the public transaction calling system, and because the public transaction calling system is used for connecting all transaction systems, all transaction logs can be naturally recorded when the transaction is initiated and called, and because the transactions are called in the public transaction calling system, a unique UUID can be allocated for each transaction call of a service function. This UUID is thus recorded in each transaction log data item generated during each transaction.
And when the transaction log is used for cross-system transaction log analysis in the scenes of audit, problem analysis and the like, the correlation analysis through UUID can be realized. Because the invention generates the log in the unified public transaction calling system, the transaction log specification can be easily formed, the repeated construction of each transaction system is reduced, and finally, the log analysis of the cross-system transaction can be conveniently realized.
Therefore, the transaction log can be generated without separating from each transaction system, and the generated transaction log can realize end-to-end tracking according to the unique UUID. The invention can separate from the transaction systems through the public transaction calling system, and generates the transaction log at a single position without independently generating the transaction log by each transaction system.
The embodiment of the invention also provides a working method of the transaction log acquisition system, as described in the following embodiment. Because the principle of the working method for solving the problems is similar to that of a transaction log acquisition system, the implementation of the working method can refer to the implementation of the transaction log acquisition system, and the repetition is omitted.
Fig. 3 is a schematic diagram of a working method of a transaction log collection system according to an embodiment of the present invention, as shown in fig. 3, where the working method of the transaction log collection system according to the embodiment of the present invention may include:
Step 301: the transaction systems are connected with the public transaction calling system, initiate transactions according to business requirements, generate transaction requests and send the transaction requests to the public transaction calling system, and conduct transaction calling according to the call requests sent by the public transaction calling system;
Step 302: the public transaction calling system is arranged at the central positions of the transaction systems, receives transaction requests sent by the transaction systems initiating transactions, generates calling requests, configures unique UUIDs, sends the calling requests to the transaction systems needing to be subjected to transaction calling, and generates transaction logs according to the unique UUIDs.
Fig. 4 is a schematic workflow diagram of a public transaction call system in a working method of a transaction log collection system according to an embodiment of the present invention, as shown in fig. 4, when the working method of the transaction log collection system according to the embodiment of the present invention is implemented, in an embodiment, the public transaction call system is disposed at a central position of a plurality of transaction systems, receives a transaction request sent by a transaction system initiating a transaction, generates a call request and configures a unique UUID, sends the call request to the transaction system needing to perform transaction call, and generates a transaction log according to the unique UUID, including:
Step 401: the source transaction receiving module receives a transaction request sent by a transaction system initiating a transaction and forwards the transaction request to the transaction calling core module;
Step 402: the transaction call core module receives the transaction request sent by the source transaction receiving module, performs protocol conversion, transaction message recombination and transaction flow control processing on the transaction request, and determines a call request and a transaction system needing transaction call;
step 403: the transaction forwarding module sends a call request to a transaction system needing to be subjected to transaction call;
Step 404: the transaction log UUID generation module generates a call request for the transaction call core module and the transaction forwarding module sends the call request to a transaction process configuration unique UUID of a transaction system needing transaction call;
Step 405: and the transaction log generation module generates a transaction log according to the unique UUID after the call request is sent to the transaction system needing to be subjected to transaction call.
When the working method of the transaction log acquisition system provided by the embodiment of the invention is implemented, in one embodiment, when the transaction log generation module generates the transaction log, the transaction log generation module is linked to the transaction system through the unique UUID, and the unique UUID is placed in the transaction log of each transaction system.
When the working method of the transaction log acquisition system provided by the embodiment of the invention is implemented, in one embodiment, the method further comprises the following steps: the transaction log configuration module configures whether to generate a transaction log or not and configures recording time of the transaction log.
When the working method of the transaction log acquisition system provided by the embodiment of the invention is implemented, in one embodiment, the recording time of the transaction log at least comprises one or any combination of the following steps:
When the transaction call core module generates a call request, the transaction forwarding module sends the call request to a transaction system needing to be subjected to transaction call, records before the transaction call, records after the transaction call is finished, and records before the transaction call and after the transaction call are finished.
When the working method of the transaction log acquisition system provided by the embodiment of the invention is implemented, in one embodiment, the method further comprises the step that the generated transaction log is recorded into a log file or a log system by the transaction log output module and is stored into a database.
Fig. 5 is a schematic diagram of a computer device for running a working method of a transaction log collection system implemented in the present invention, and as shown in fig. 5, an embodiment of the present invention further provides a computer device, including a memory, a processor, and a computer program stored on the memory and capable of running on the processor, where the processor implements the working method of the transaction log collection system when executing the computer program.
The embodiment of the invention also provides a computer readable storage medium, which stores a computer program for executing the working method for realizing the transaction log acquisition system.
In summary, the transaction log collection system and the working method thereof provided by the embodiment of the invention comprise the following steps: the transaction system is connected with the public transaction calling system and is used for initiating transaction according to service requirements, generating a transaction request and sending the transaction request to the public transaction calling system, and carrying out transaction calling according to the call request sent by the public transaction calling system; the public transaction calling system is arranged at the central positions of the transaction systems and is used for receiving transaction requests sent by the transaction systems initiating transactions, generating calling requests and configuring unique UUIDs, sending the calling requests to the transaction systems needing to be subjected to transaction calling, and generating transaction logs according to the unique UUIDs.
The embodiment of the invention aims to solve the problem that the aim of association analysis cannot be completed due to the fact that one business function spans a plurality of transaction systems and the log record of each transaction system is respectively and independently designed in the aspects of format, primary key, association relation and the like, and further realizes that each transaction system can be separated, and end-to-end transaction log collection is uniformly formed.
In the embodiment of the invention, a public transaction calling system is designed, the system is positioned at a core position, the calling of each transaction system is completed through the public transaction calling system, and because the public transaction calling system is used for connecting all transaction systems, all transaction logs can be naturally recorded when the transaction is initiated and called, and because the transactions are called in the public transaction calling system, a unique UUID can be allocated for each transaction call of a service function.
This UUID is thus recorded in each transaction log data item generated during each transaction. And when the transaction log is used for cross-system transaction log analysis in the scenes of audit, problem analysis and the like, the correlation analysis through UUID can be realized.
Because the invention generates the log in the unified public transaction calling system, the transaction log specification can be easily formed, the repeated construction of each transaction system is reduced, and finally, the log analysis of the cross-system transaction can be conveniently realized. Therefore, the transaction log can be generated without separating from each transaction system, and the generated transaction log can realize end-to-end tracking according to the unique UUID.
The invention can separate from the transaction systems through the public transaction calling system, and generates the transaction log at a single position without independently generating the transaction log by each transaction system.
It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The foregoing description of the embodiments has been provided for the purpose of illustrating the general principles of the invention, and is not meant to limit the scope of the invention, but to limit the invention to the particular embodiments, and any modifications, equivalents, improvements, etc. that fall within the spirit and principles of the invention are intended to be included within the scope of the invention.
Claims (12)
1. A transaction log collection system, comprising:
the transaction system is connected with the public transaction calling system and is used for initiating transaction according to service requirements, generating a transaction request and sending the transaction request to the public transaction calling system, and carrying out transaction calling according to the call request sent by the public transaction calling system;
the public transaction calling system is arranged at the central positions of the transaction systems and is used for receiving transaction requests sent by the transaction systems initiating transactions, generating calling requests and configuring unique UUIDs, sending the calling requests to the transaction systems needing to be subjected to transaction calling, and generating transaction logs according to the unique UUIDs;
A public transaction invocation system comprising:
The source transaction receiving module is used for receiving a transaction request sent by a transaction system for initiating a transaction and forwarding the transaction request to the transaction calling core module;
The transaction call core module is used for receiving the transaction request sent by the source transaction receiving module, carrying out protocol conversion, transaction message recombination and transaction flow control processing on the transaction request, and determining a call request and a transaction system needing transaction call;
the transaction forwarding module is used for sending the call request to a transaction system needing to be subjected to transaction call;
The transaction log UUID generation module is used for generating a call request for the transaction call core module and transmitting the call request to a transaction process configuration unique UUID of a transaction system needing transaction call by the transaction forwarding module;
and the transaction log generation module is used for generating a transaction log according to the unique UUID after the call request is sent to the transaction system needing to be subjected to transaction call.
2. The system of claim 1, wherein when the transaction log generation module is generating the transaction logs, the transaction log is linked to the transaction systems by unique UUIDs, the unique UUIDs being placed in the transaction log for each transaction system.
3. The system of claim 1, wherein the public transaction invocation system further comprises: and the transaction log configuration module is used for configuring whether to generate a transaction log or not and configuring the recording time of the transaction log.
4. The system of claim 3, wherein the transaction log recording opportunities include at least one or any combination of:
When the transaction call core module generates a call request, the transaction forwarding module sends the call request to a transaction system needing to be subjected to transaction call, records before the transaction call, records after the transaction call is finished, and records before the transaction call and after the transaction call are finished.
5. The system as recited in claim 1, further comprising: and the transaction log output module is used for recording the generated transaction log into a log file or a log system and storing the generated transaction log into a database.
6. A method of operating a transaction log collection system, comprising:
The transaction systems are connected with the public transaction calling system, initiate transactions according to business requirements, generate transaction requests and send the transaction requests to the public transaction calling system, and conduct transaction calling according to the call requests sent by the public transaction calling system;
the public transaction calling system is arranged at the central positions of a plurality of transaction systems, receives a transaction request sent by the transaction system initiating the transaction, generates a calling request, configures a unique UUID, sends the calling request to the transaction system needing to be subjected to transaction calling, and generates a transaction log according to the unique UUID;
The public transaction calling system is arranged at the center of a plurality of transaction systems, receives a transaction request sent by the transaction system initiating the transaction, generates a calling request, configures a unique UUID, sends the calling request to the transaction system needing to be subjected to transaction calling, and generates a transaction log according to the unique UUID, and comprises the following steps:
the source transaction receiving module receives a transaction request sent by a transaction system initiating a transaction and forwards the transaction request to the transaction calling core module;
The transaction call core module receives the transaction request sent by the source transaction receiving module, performs protocol conversion, transaction message recombination and transaction flow control processing on the transaction request, and determines a call request and a transaction system needing transaction call;
the transaction forwarding module sends a call request to a transaction system needing to be subjected to transaction call;
the transaction log UUID generation module generates a call request for the transaction call core module and the transaction forwarding module sends the call request to a transaction process configuration unique UUID of a transaction system needing transaction call;
And the transaction log generation module generates a transaction log according to the unique UUID after the call request is sent to the transaction system needing to be subjected to transaction call.
7. The method of claim 6, wherein when the transaction log generation module is generating transaction logs, linking to the transaction systems via unique UUIDs places the unique UUIDs in the transaction log for each transaction system.
8. The method of operation of claim 6, further comprising: the transaction log configuration module configures whether to generate a transaction log or not and configures recording time of the transaction log.
9. The method of claim 8, wherein the transaction log recording timing includes at least one or any combination of:
When the transaction call core module generates a call request, the transaction forwarding module sends the call request to a transaction system needing to be subjected to transaction call, records before the transaction call, records after the transaction call is finished, and records before the transaction call and after the transaction call are finished.
10. The method of claim 6, further comprising the transaction log output module recording the generated transaction log into a log file or log system for storage in a database.
11. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the method of any one of claims 6 to 10 when executing the computer program.
12. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, implements a method of operation as claimed in any one of claims 6 to 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110601158.4A CN113269557B (en) | 2021-05-31 | 2021-05-31 | Transaction log acquisition system and working method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110601158.4A CN113269557B (en) | 2021-05-31 | 2021-05-31 | Transaction log acquisition system and working method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113269557A CN113269557A (en) | 2021-08-17 |
| CN113269557B true CN113269557B (en) | 2024-06-21 |
Family
ID=77233656
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110601158.4A Active CN113269557B (en) | 2021-05-31 | 2021-05-31 | Transaction log acquisition system and working method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113269557B (en) |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1932875A (en) * | 2006-10-09 | 2007-03-21 | 杭州东信金融技术服务有限公司 | Prepositional system based on finance industry |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101958837B (en) * | 2010-09-30 | 2015-10-07 | 北京世纪互联宽带数据中心有限公司 | Log processing system, log processing method, node server and central server |
| US10860612B2 (en) * | 2018-04-19 | 2020-12-08 | Sap Se | Parallel replication across formats |
| CN109377216B (en) * | 2018-08-07 | 2021-03-23 | 创新先进技术有限公司 | Transaction method and system based on centralized settlement and block chain deposit certificate |
| WO2020062211A1 (en) * | 2018-09-30 | 2020-04-02 | 北京大学深圳研究生院 | Method and system for mimicry storage tamper-proof log fused with blockchain technology |
| CN110995466B (en) * | 2019-11-06 | 2022-04-26 | 通号通信信息集团有限公司 | Multi-format log unified processing method and system under security situation awareness system |
-
2021
- 2021-05-31 CN CN202110601158.4A patent/CN113269557B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1932875A (en) * | 2006-10-09 | 2007-03-21 | 杭州东信金融技术服务有限公司 | Prepositional system based on finance industry |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113269557A (en) | 2021-08-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111324480B (en) | Large-scale host transaction fault positioning system and method | |
| CN111897738B (en) | Automatic testing method and device based on atomic service | |
| Erraissi et al. | Meta-modeling of Zookeeper and MapReduce processing | |
| CN103593293A (en) | Parallel automated testing method | |
| CN113269557B (en) | Transaction log acquisition system and working method thereof | |
| CN114092246A (en) | Problem positioning method and device for financial transaction link | |
| CN105933396B (en) | A kind of each canalization interface of collaboration realizes the method and system of long flow | |
| CN109389271B (en) | Application performance management method and system | |
| CN107451435B (en) | Management and control method, management and control machine and management and control system of hardware encryption machine | |
| CN115168205A (en) | Automatic testing method and device | |
| CN111866576B (en) | On-line problem processing system and method | |
| CN115185825A (en) | Interface test scheduling method and device | |
| CN113742302A (en) | Service request processing method and device | |
| CN113709059A (en) | Link flow recording method and node | |
| CN112597119A (en) | Method and device for generating processing log and storage medium | |
| CN113204352A (en) | Application deployment method, target server, scheduling engine and distributed system | |
| CN111562937A (en) | Code method level defect early warning method | |
| CN112783653A (en) | Resource scheduling method and device based on containerization | |
| CN111949326A (en) | Micro-service workflow method based on Activiti | |
| CN113342695B (en) | Software version testing method and device | |
| CN114611335B (en) | Simulation task scheduling method based on distributed engine | |
| KR102679305B1 (en) | Flow management system and linked flow management method that provides linked flows between external systems | |
| CN112699156A (en) | Data processing method and device, storage medium and electronic terminal | |
| JPH10333917A (en) | Distributed compilation system | |
| CN116126819A (en) | System log processing method, device and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |