CN112765114A - Financial system log file processing method and system - Google Patents
Financial system log file processing method and system Download PDFInfo
- Publication number
- CN112765114A CN112765114A CN202110082422.8A CN202110082422A CN112765114A CN 112765114 A CN112765114 A CN 112765114A CN 202110082422 A CN202110082422 A CN 202110082422A CN 112765114 A CN112765114 A CN 112765114A
- Authority
- CN
- China
- Prior art keywords
- log file
- log
- log data
- financial system
- processing method
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/1805—Append-only file systems, e.g. using logs or journals to store data
- G06F16/1815—Journaling file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/174—Redundancy elimination performed by the file system
- G06F16/1744—Redundancy elimination performed by the file system using compression, e.g. sparse files
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/02—Banking, e.g. interest calculation or account maintenance
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Accounting & Taxation (AREA)
- Finance (AREA)
- Development Economics (AREA)
- Economics (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- Technology Law (AREA)
- General Business, Economics & Management (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a method and a system for processing a financial system log file, which relate to the field of computers.
Description
Technical Field
The invention relates to the field of computers, in particular to a method and a system for processing a financial system log file.
Background
With the continuous development of banking business, more and more financial systems and larger business data volume are provided, and the system security is subjected to more and more threats. For these security threats, banks are adopting various approaches to defend against the occurrence of insecure events. The log file is just one of the important files for analyzing the system condition.
The log files of the financial system are a set of certain operations of the designated objects of the financial system and operation results thereof in order according to time, each log file is composed of log records, each log record describes a single system event, and the log files record necessary and valuable information for resource-related activities of software, which plays an important role in system monitoring, query, reporting and safety audit. By analyzing the existing log files, there are mainly the following disadvantages:
(1) the log files are respectively stored according to a database, a gateway and the like, a complete transaction needs different log files, and the log files generated by the server end are stored and acquired in an asynchronous mode, so that the log files can have a cross phenomenon among different financial transactions, the incomplete and discontinuous log files are easy to generate, and the log files are difficult to read by maintenance personnel;
(2) in general, log files generated during financial transactions are large, with few tens of megabytes and many gigabytes, making it difficult to obtain log data and analyze the log data.
At present, a log file generated by a server side adopts a mode of a high-level message queue, when the volume of the log file is large, the high-level message queue is blocked, and the problem is solved in that the high-level message queue needs to be reestablished, log files existing in the high-level message queue before reestablishment are lost, and a server needs to be restarted.
Disclosure of Invention
In order to overcome the defects in the prior art, the embodiment of the invention provides a method and a system for processing a financial system log file.
In a first aspect, a method for processing a log file of a financial system provided in an embodiment of the present invention includes the following steps:
the server side compresses a plurality of pieces of log data generated in a set time period into a log file;
the server side sends the log file to the client side by adopting a TCP (Transmission control protocol);
and the client associates a plurality of preset index identifications with each piece of log data in the log file respectively.
Preferably, the method further comprises:
and according to the generation time of the log file, dividing the log data in the log file into current log data and historical log data.
Preferably, the plurality of index identifications include a date, an organization name, a teller number, a transaction code.
In a second aspect, a financial system log file processing system provided by an embodiment of the present invention includes:
the compression module is used for compressing a plurality of pieces of log data generated in a set time period into a log file;
the sending module is used for sending the log file to a client by adopting a TCP (transmission control protocol);
and the association module is used for associating a plurality of preset index identifications with each piece of log data in the log file respectively.
The method and the system for processing the financial system log file provided by the embodiment of the invention have the following beneficial effects:
the log files are compressed in sequence according to the time generated by the log files, the mode of compressing the log files once and transmitting the log files by using a TCP (transmission control protocol) protocol is adopted, the pressure of a server end is reduced, the input and output operations are greatly reduced, the risk brought to the system due to the blockage of the log files is avoided, and the service throughput and the transaction processing efficiency of the system are improved.
Detailed Description
The present invention will be described in detail with reference to the following embodiments.
The front-end page code generation method provided by the embodiment of the invention comprises the following steps:
s101, compressing a plurality of pieces of log data generated in a set time period into a log file by a server side.
And S102, the server side sends the log file to the client side by adopting a TCP (Transmission control protocol).
The client end directly starts thread processing after the log file, asynchronously registers each log data in the log file and returns the log data to the server end after each log data is registered.
S103, the client associates a plurality of preset index identifications with each piece of log data in the log file respectively.
Optionally, the method further comprises:
according to the generation time of the log file, the log data in the log file is divided into current log data and historical log data.
Optionally, the plurality of index identifications includes a date, an organization name, a teller number, a transaction code.
The embodiment of the invention also provides a financial system log file processing system, which comprises:
the compression module is used for compressing a plurality of pieces of log data generated in a set time period into a log file;
the sending module is used for sending the log file to a client by adopting a TCP (transmission control protocol);
and the association module is used for associating a plurality of preset index identifications with each piece of log data in the log file respectively.
According to the financial system log file processing method and system provided by the embodiment of the invention, a plurality of pieces of log data generated in a set time period are compressed into the log file at the server side, the TCP protocol is adopted, the log file is sent to the client side, the client side associates a plurality of preset index identifications with each piece of log data in the log file respectively, the pressure of the server side is reduced, the input and output operations are greatly reduced, the risk brought to the system due to the blockage of the log file is avoided, and the service throughput and the transaction processing efficiency of the system are improved.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
It will be appreciated that the relevant features of the method and apparatus described above are referred to one another.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
The algorithms and displays presented herein are not inherently related to any particular computer, virtual machine, or other apparatus. Various general purpose systems may also be used with the teachings herein. The required structure for constructing such a system will be apparent from the description above. Moreover, the present invention is not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.
In addition, the memory may include volatile memory in a computer readable medium, Random Access Memory (RAM) and/or nonvolatile memory such as Read Only Memory (ROM) or flash memory (flash RAM), and the memory includes at least one memory chip.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims (4)
1. A financial system log file processing method is characterized by comprising the following steps:
the server side compresses a plurality of pieces of log data generated in a set time period into a log file;
the server side sends the log file to the client side by adopting a TCP (Transmission control protocol);
and the client associates a plurality of preset index identifications with each piece of log data in the log file respectively.
2. The financial system log file processing method of claim 1, wherein the method further comprises:
and according to the generation time of the log file, dividing the log data in the log file into current log data and historical log data.
3. The financial system log file processing method of claim 1, wherein the plurality of index identifications include a date, an organization name, a teller number, a transaction code.
4. A financial system log file processing system, comprising:
the compression module is used for compressing a plurality of pieces of log data generated in a set time period into a log file;
the sending module is used for sending the log file to a client by adopting a TCP (transmission control protocol);
and the association module is used for associating a plurality of preset index identifications with each piece of log data in the log file respectively.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110082422.8A CN112765114A (en) | 2021-01-21 | 2021-01-21 | Financial system log file processing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110082422.8A CN112765114A (en) | 2021-01-21 | 2021-01-21 | Financial system log file processing method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112765114A true CN112765114A (en) | 2021-05-07 |
Family
ID=75702454
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110082422.8A Pending CN112765114A (en) | 2021-01-21 | 2021-01-21 | Financial system log file processing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112765114A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113360469A (en) * | 2021-06-25 | 2021-09-07 | 武汉众邦银行股份有限公司 | Structured low-storage log output method and device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1642104A (en) * | 2004-01-05 | 2005-07-20 | 华为技术有限公司 | Method and device for realizing system journal |
| CN103944744A (en) * | 2013-01-21 | 2014-07-23 | 博雅网络游戏开发（深圳）有限公司 | Method and system for log acquisition |
| CN109039749A (en) * | 2018-08-10 | 2018-12-18 | 广州天予智能科技有限公司 | A kind of acquisition of remote journal and encryption transmission system and method |
| CN109257230A (en) * | 2018-10-26 | 2019-01-22 | 武汉精鸿电子技术有限公司 | A kind of Log Administration System and method of semiconductor memory burn-in test |
| US10210162B1 (en) * | 2010-03-29 | 2019-02-19 | Carbonite, Inc. | Log file management |
| CN110110516A (en) * | 2019-01-04 | 2019-08-09 | 北京车和家信息技术有限公司 | Log recording method, apparatus and system |
| CN111639016A (en) * | 2020-05-29 | 2020-09-08 | 北京合力思腾科技股份有限公司 | Big data log analysis method and device and computer storage medium |
-
2021
- 2021-01-21 CN CN202110082422.8A patent/CN112765114A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1642104A (en) * | 2004-01-05 | 2005-07-20 | 华为技术有限公司 | Method and device for realizing system journal |
| US10210162B1 (en) * | 2010-03-29 | 2019-02-19 | Carbonite, Inc. | Log file management |
| CN103944744A (en) * | 2013-01-21 | 2014-07-23 | 博雅网络游戏开发（深圳）有限公司 | Method and system for log acquisition |
| CN109039749A (en) * | 2018-08-10 | 2018-12-18 | 广州天予智能科技有限公司 | A kind of acquisition of remote journal and encryption transmission system and method |
| CN109257230A (en) * | 2018-10-26 | 2019-01-22 | 武汉精鸿电子技术有限公司 | A kind of Log Administration System and method of semiconductor memory burn-in test |
| CN110110516A (en) * | 2019-01-04 | 2019-08-09 | 北京车和家信息技术有限公司 | Log recording method, apparatus and system |
| CN111639016A (en) * | 2020-05-29 | 2020-09-08 | 北京合力思腾科技股份有限公司 | Big data log analysis method and device and computer storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113360469A (en) * | 2021-06-25 | 2021-09-07 | 武汉众邦银行股份有限公司 | Structured low-storage log output method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11868373B2 (en) | Method and apparatus for monitoring an in-memory computer system | |
| US8825798B1 (en) | Business event tracking system | |
| CN109725899B (en) | Data stream processing method and device | |
| JP2019517040A (en) | Cloud platform based client application information statistics method and apparatus | |
| CN110175154A (en) | A kind of processing method of log recording, server and storage medium | |
| CN111143286B (en) | Cloud platform log management method and system | |
| CN113656245B (en) | Data inspection method and device, storage medium and processor | |
| US11144424B2 (en) | System and method for recording the beginning and ending of job level activity in a mainframe computing environment | |
| CN107784074A (en) | The recognition methods of connected transaction, device and, computer equipment and storage medium | |
| CN108717661B (en) | Cluster storage and analysis method for financial industry risk early warning | |
| CN112131305A (en) | Account processing system | |
| CN112116273A (en) | Employee query behavior risk monitoring method, device, equipment and storage medium | |
| CN112650728A (en) | Interface information storage method and device, server and distributed service system | |
| CN112346884A (en) | Message reach data processing method and device | |
| CN112765114A (en) | Financial system log file processing method and system | |
| CN116701525A (en) | Early warning method and system based on real-time data analysis and electronic equipment | |
| CN111274255B (en) | Service data monitoring method and system, monitoring architecture, equipment and storage medium | |
| CN116483822B (en) | Service data early warning method, device, computer equipment and storage medium | |
| CN112766975A (en) | Risk detection method and device, electronic equipment and readable storage medium | |
| US11144346B2 (en) | Systems and methods for batch job execution in clustered environments using execution timestamp granularity to execute or refrain from executing subsequent jobs | |
| WO2019106177A1 (en) | Automated logging | |
| US11113694B1 (en) | Automated anti-money laundering (AML) alerts investigation and disposition system and associated method thereof | |
| CN111461864A (en) | Transaction processing method and device | |
| US20240045880A1 (en) | Compact error tracking logs for etl | |
| CN115936637B (en) | Electronic receipt pull method, system, electronic device and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210507 |
|
| RJ01 | Rejection of invention patent application after publication |