CN109586968A - The log processing method of big data platform and the log processing system of big data platform - Google Patents

The log processing method of big data platform and the log processing system of big data platform Download PDF

Info

Publication number
CN109586968A
CN109586968A CN201811524309.5A CN201811524309A CN109586968A CN 109586968 A CN109586968 A CN 109586968A CN 201811524309 A CN201811524309 A CN 201811524309A CN 109586968 A CN109586968 A CN 109586968A
Authority
CN
China
Prior art keywords
log
processing terminal
server
journal file
acquisition
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811524309.5A
Other languages
Chinese (zh)
Inventor
张志远
宋珍
万月亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Ruian Technology Co Ltd
Original Assignee
Beijing Ruian Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Ruian Technology Co Ltd filed Critical Beijing Ruian Technology Co Ltd
Priority to CN201811524309.5A priority Critical patent/CN109586968A/en
Publication of CN109586968A publication Critical patent/CN109586968A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/06Management of faults, events, alarms or notifications
    • H04L41/069Management of faults, events, alarms or notifications using logs of notifications; Post-processing of notifications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/14Network analysis or design
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The invention discloses the log processing system of a kind of log processing method of big data platform and big data platform, a kind of log processing method of big data platform includes: that log processing terminal to log server sends log collection request;The content that log server is requested according to log collection, the log acquired needed for searching, and collected journal file is sent to log processing terminal;Log processing terminal is analyzed and processed collected journal file, obtains log analysis result;Log processing terminal stores log analysis result into presetting database, and show log analyzes result in the default page.The log processing method of big data platform disclosed by the invention and the log processing system of big data platform, for improving the O&M efficiency to big data platform.

Description

The log processing method of big data platform and the log processing system of big data platform
Technical field
The present embodiments relate to computer technology more particularly to a kind of log processing methods of big data platform and big number According to the log processing system of platform.
Background technique
The prosperity of science and technology and internet, pushes the arrival of big data era, and all trades and professions are all generating number daily Huge fragmentation of data is measured, in order to get valuable information from these fragmentation of data, every profession and trade field is related to The enterprise of big data business will establish enterprise's big data platform.
Very much, the big data platform that each enterprise builds of building the data processing link being related to of one big data platform Data processing link it is different.However, for many enterprises, each data processing link of big data platform Whether operating status normal or processing data volume number can only be by manually going to backstage to check the node state of each link With the data input and output amount namely journal file of respective handling link, this is for safeguarding that the operation maintenance personnel of big data platform is come It says, this is a serious repetitive work, this not only wastes the time of operation maintenance personnel but also cannot understand big number in time again According to the working condition of each data processing link of platform, to reduce O&M efficiency.
Summary of the invention
The present invention provides the log processing system of a kind of log processing method and big data platform, flat to big data to improve The O&M efficiency of platform.
In a first aspect, the embodiment of the present invention provides a kind of log processing method of big data platform, comprising:
Log processing terminal sends log collection request to log server;
The content that log server is requested according to log collection, the log acquired needed for searching, and to log processing terminal Send collected journal file;
Log processing terminal is analyzed and processed collected journal file, obtains log analysis result;
Log processing terminal stores log analysis result into presetting database, and the show log point in the default page Analyse result.
In a kind of possible implementation of first aspect, log processing terminal sends log collection to log server and asks It asks, comprising:
Log processing terminal searches the information of log server from preset configuration file, and according to the letter of log server Breath establishes connection with log server, then sends log collection request to log server, includes adopting in log collection request Collect Log Types and acquisition log path.
In a kind of possible implementation of first aspect, log processing terminal searches log clothes from preset configuration file The information of business device, and connection is established according to the information and log server of log server, comprising:
Log processing terminal successively use the address information in preset configuration file create socket, successively with multiple logs Server establishes connection.
In a kind of possible implementation of first aspect, the content that log server is requested according to log collection is searched The log of required acquisition, and collected journal file is sent to log processing terminal, comprising:
The content that log server is requested according to log collection, search needed for acquire log, and according to designated length by Item sends collected journal file to log processing terminal.
In a kind of possible implementation of first aspect, acquisition Log Types include real-time logs, history log and again Pass log;
Log processing terminal is analyzed and processed collected journal file, obtains log analysis result, comprising:
If judging journal file acquisition failure, the information preservation of journal file is being retransmitted container by log processing terminal In, and be set as the journal file type of acquisition failure to retransmit log;
If the journal file type of acquisition is to retransmit log, log processing terminal divides collected journal file Analysis processing removes the information retransmitted in container after obtaining log analysis result.
Second aspect, the embodiment of the invention also provides a kind of log processing systems of big data platform, comprising: at log Manage terminal and log server;
Log processing terminal, for sending log collection request to log server;
Log server, the content for being requested according to log collection, the log acquired needed for searching, and to log processing Terminal sends collected journal file;
Log processing terminal is also used to be analyzed and processed collected journal file, obtains log analysis result;It will Log analysis result is stored into presetting database, and show log analyzes result in the default page.
In a kind of possible implementation of second aspect, log processing terminal is specifically used for looking into from preset configuration file The information of log server is looked for, and connection is established according to the information of log server and log server, then to log services Device sends log collection request, includes acquisition Log Types and acquisition log path in log collection request.
In a kind of possible implementation of second aspect, log processing terminal is specifically used for successively using preset configuration Address information in file creates socket, successively establishes connection with multiple log servers.
In a kind of possible implementation of second aspect, log server, specifically for what is requested according to log collection Content, the log acquired needed for searching, and collected journal file is sent to log processing terminal one by one according to designated length.
In a kind of possible implementation of second aspect, acquisition Log Types include real-time logs, history log and again Pass log;
If log processing terminal is specifically used for judging journal file acquisition failure, by the information preservation of journal file in weight It passes in container, and is set as the journal file type of acquisition failure to retransmit log;If the journal file type of acquisition is to retransmit Log is then analyzed and processed collected journal file, removes the information retransmitted in container after obtaining log analysis result.
The log processing method of big data platform provided in an embodiment of the present invention and the log processing system of big data platform, It sends log collection to log server from log processing terminal to request, the content that log server is requested according to log collection, The log acquired needed for searching, and send collected journal file to log processing terminal, then log processing terminal is to adopting The journal file collected is analyzed and processed, and obtains log analysis as a result, and storing log analysis result to presetting database In, and show log is analyzed as a result, improving the efficiency for carrying out O&M to big data platform in the default page.
Detailed description of the invention
Fig. 1 is the flow chart of the log processing method embodiment one of big data platform provided in an embodiment of the present invention;
Fig. 2 is the processing routine logical schematic of the log processing method of big data platform provided in an embodiment of the present invention;
Fig. 3 is the structural schematic diagram of the log processing system embodiment one of big data platform provided in an embodiment of the present invention.
Specific embodiment
The present invention is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched The specific embodiment stated is used only for explaining the present invention rather than limiting the invention.It also should be noted that in order to just Only the parts related to the present invention are shown in description, attached drawing rather than entire infrastructure.
Fig. 1 is the flow chart of the log processing method embodiment one of big data platform provided in an embodiment of the present invention, such as Fig. 1 Shown, the log processing method of big data platform provided in this embodiment includes:
Step S101, log processing terminal send log collection request to log server.
Big data platform is the set for the server that mass data is uniformly processed, and the data bulk being related to is huge Greatly, and numerous types, and normal fortune from multiple servers and other equipment work cooperation realization big data platform is needed Row.In order to ensure the normal work of big data platform, the operating status of each node in much data platforms is needed to be monitored, but Since the node in big data platform is numerous, type is different, causes the maintenance work amoun being monitored to big data platform huge. For traditional maintenance work all by being accomplished manually, efficiency is lower, and cannot recognize the state of each node in big data platform in time.
And in each node of big data platform, with the work of each node, can all there be corresponding journal file to generate, The various processing record that each node is had recorded in journal file, you can learn that each node is in difference after analyzing journal file The working condition at time point.Therefore the present embodiment provides a kind of log processing methods of big data platform, by flat to big data The journal file of each node carries out unified acquisition and analysis processing in platform, so that the working condition to big data platform is united One monitoring.
Firstly, needing to be arranged a special day to realize the journal file acquisition to node each in big data platform Will processing terminal, log processing terminal be responsible for all journal files in big data platform carry out unified acquisition, analysis and Processing.Log processing terminal sends log collection request to log server, and Request Log server sends journal file.Log Server is set in big data platform in the various nodes that can generate journal file, passes through the company with log processing terminal It connects, journal file is acquired in each node and collected journal file is uniformly sent to log processing terminal.In big data In platform, the quantity of log server determines that log processing terminal only needs one according to the number of nodes of composition big data platform It is a.Log processing terminal periodically can send log collection request to log server, which can be according to practical need Ask determining, such as once a day, once every hour etc..Or log processing terminal can refer to according to the log collection that user sends The triggering of order sends log collection request to log server.Log processing terminal can be sent out to multiple log servers simultaneously It send log collection to request, successively can also send log collection request to each log server, it can also be according to demand to specific Log server send log collection request.
A configuration file can be prestored in log processing terminal, preserve each log server in the configuration file The information such as address, acquisition Log Types, log path.Log processing terminal can read phase according to demand from configuration file The information answered generates log collection request and is sent to log server.When log processing terminal is searched from preset configuration file To after the address information of log server, connection is established according to the address information and log server first, then log processing Terminal can send log collection request to log server by the connection of foundation, include acquisition log in log collection request Type and acquisition log path.
Due to having multiple log servers in big data platform, log processing terminal can be successively using preset configuration text Log server address information creation socket in part thus may be used to successively establish connection with multiple log servers Successively to acquire journal file from multiple log servers.
Step S102, the content that log server is requested according to log collection, the log acquired needed for searching, and to log Processing terminal sends collected journal file.
When log server receive log collection request after, will be requested according to log collection in requested content, The journal file acquired needed for searching in the node that log server is disposed, is then sent to day for collected journal file Will processing terminal.
Since the connection between log processing terminal and log server is established according to certain communication protocol, Log server needs to send collected day to log processing terminal one by one according to designated length after collecting journal file Will file, log processing terminal are saved into corresponding file after receiving journal file.
Step S103, log processing terminal are analyzed and processed collected journal file, obtain log analysis result.
After log processing terminal receives the journal file of log server acquisition, processing is analyzed it, thus The working condition of the corresponding node of the available journal file.Wherein, the result analyzed to journal file can be with Including corresponding node in the working condition of various time points and the relevant information of the node inputoutput data etc., Cong Zhongke To analyze the different working condition of each node in different time points.And it is put down since log processing terminal can receive big data The journal file of each node in platform can also be judged after the journal file to multiple interdependent nodes carries out united analysis The information such as the processing bottleneck in entire big data platform.
Step S104, log processing terminal store log analysis result into presetting database, and in the default page Show log analyzes result.
After log processing terminal obtains log analysis result, it can be stored in preset database, so as to To pay close attention to the work of log processing terminal in real time without operation maintenance personnel.Operation maintenance personnel can be known whole by inquiring the database Each node carries out big data platform to be conducive to operation maintenance personnel in the working condition of different time in a big data platform O&M and management.In addition, log analysis result can also preset the page with graphical or formatting by log processing terminal Mode is shown that such operation maintenance personnel can intuitively grasp the operating condition of big data platform, can be effectively improved The O&M efficiency of operation maintenance personnel.
Preset database can using mysql database storage log analysis as a result, SQL statement specification and have it is good Good operational efficiency also with the network support of abundant information, therefore can pass through the page by MYSQL data query mode Show log analysis result.
The log processing method of big data platform provided in this embodiment is sent from log processing terminal to log server Log collection request, the content that log server request according to log collection, the log of acquisition needed for searching, and to log processing Terminal sends collected journal file, and then log processing terminal is analyzed and processed collected journal file, obtains Log analysis is as a result, and store log analysis result into presetting database, and the show log analysis knot in the default page Fruit improves the efficiency that O&M is carried out to big data platform.
Further, in the log collection request that log processing terminal is sent, including acquisition Log Types include real-time Log, history log and re-transmission log.Wherein, if acquisition Log Types are real-time logs, log server receives log After acquisition request, current real-time logs file is directly sent to log processing terminal.And if Log Types be history log, After log server receives log collection request, according to the setting of history log, corresponding go through is sent to log processing terminal History log, such as the journal file of the previous day.If Log Types are to retransmit log, it means that log processing terminal is last Received journal file reception failure, this is received as the journal file retransmitted.
Correspondingly, after the journal file that log processing terminal receives that log server is sent, if judging, journal file is adopted Collection failure, then log processing terminal by the information preservation of journal file retransmit container in, and will acquisition failure journal file Type is set as retransmitting log.If the journal file type of acquisition is to retransmit log, log processing terminal is to collected day Will file is analyzed and processed, and removes the information retransmitted in container after obtaining log analysis result.
Fig. 2 is the processing routine logical schematic of the log processing method of big data platform provided in an embodiment of the present invention, As shown in Fig. 2, log processing processing logic provided in this embodiment includes:
Terminal main thread Client_main and server main thread Server_main, is separately operable in log processing terminal In log server.Terminal main thread further includes signal processing thread, and message queue reads, saves configuration information, Timer is created, task dispatch thread exits multiple threads such as detection, is respectively used to perform corresponding processing.Signal processing line Journey further includes that signal thread is exited in detection timer signal and detection, when detecting timer signal, to task point Hair line journey sends order.Task dispatch thread further includes processing the previous day log thread, processing real-time logs thread, place Reason the previous day log failure reconnection thread and database aging thread.Server main thread includes signal processing thread, to task Dispatch thread sends order, exits the several sub threads of detection.By the setting of above-mentioned thread so that log processing terminal and Log server establishes connection, and completes the interaction of log file data.
Fig. 3 is the structural schematic diagram of the log processing system embodiment one of big data platform provided in an embodiment of the present invention, As shown in figure 3, the log processing system of big data platform provided in this embodiment includes:
Log processing terminal 31 and log server 32.Log server 32 is deployed in each node of big data platform, Quantity is multiple.
Log processing terminal 31, for sending log collection request to log server 32;
Log server 32, the content for being requested according to log collection, the log acquired needed for searching, and at log Reason terminal 31 sends collected journal file;
Log processing terminal 31 is also used to be analyzed and processed collected journal file, obtains log analysis result; Log analysis result is stored into presetting database, and show log analyzes result in the default page.
The log processing system of big data platform provided in this embodiment for realizing big data platform shown in Fig. 1 log Processing method, it is similar that the realization principle and technical effect are similar, and details are not described herein again.
Further, on the basis of embodiment shown in Fig. 3, log processing terminal 31 is specifically used for from preset configuration file The middle information for searching log server 32, and connection is established according to the information of log server 32 and log server 32, then Log collection request is sent to log server 32, includes acquisition Log Types and acquisition log path in log collection request.
Further, on the basis of embodiment shown in Fig. 3, log processing terminal 31 is specifically used for successively using default Address information in configuration file creates socket, successively establishes connection with multiple log servers 32.
Further, on the basis of embodiment shown in Fig. 3, log server 32, specifically for being asked according to log collection The content asked, the log acquired needed for searching, and collected day is sent to log processing terminal 31 one by one according to designated length Will file.
Further, on the basis of embodiment shown in Fig. 3, acquisition Log Types include real-time logs, history log and Retransmit log;
If log processing terminal 31 is specifically used for judging journal file acquisition failure, the information preservation of journal file is existed It retransmits in container, and is set as the journal file type of acquisition failure to retransmit log;If the journal file type of acquisition is attached most importance to Log is passed, then collected journal file is analyzed and processed, removes the letter retransmitted in container after obtaining log analysis result Breath.
By the description above with respect to embodiment, it is apparent to those skilled in the art that, the present invention It can be realized by software and required common hardware, naturally it is also possible to which by hardware realization, but in many cases, the former is more Good embodiment.Based on this understanding, technical solution of the present invention substantially in other words contributes to the prior art Part can be embodied in the form of software products, which can store in computer readable storage medium In, floppy disk, read-only memory (Read-Only Memory, ROM), random access memory (Random such as computer Access Memory, RAM), flash memory (FLASH), hard disk or CD etc., including some instructions are with so that a computer is set Standby (can be personal computer, server or the network equipment etc.) executes method described in each embodiment of the present invention.
Note that the above is only a better embodiment of the present invention and the applied technical principle.It will be appreciated by those skilled in the art that The invention is not limited to the specific embodiments described herein, be able to carry out for a person skilled in the art it is various it is apparent variation, It readjusts and substitutes without departing from protection scope of the present invention.Therefore, although being carried out by above embodiments to the present invention It is described in further detail, but the present invention is not limited to the above embodiments only, without departing from the inventive concept, also It may include more other equivalent embodiments, and the scope of the invention is determined by the scope of the appended claims.

Claims (10)

1. a kind of log processing method of big data platform characterized by comprising
Log processing terminal sends log collection request to log server;
The content that the log server is requested according to the log collection, the log acquired needed for searching, and to the log Processing terminal sends collected journal file;
The log processing terminal is analyzed and processed the collected journal file, obtains log analysis result;
The log processing terminal stores the log analysis result into presetting database, and shows institute in the default page State log analysis result.
2. the method according to claim 1, wherein the log processing terminal sends log to log server Acquisition request, comprising:
The log processing terminal searches the information of log server from preset configuration file, and according to the letter of log server Breath establishes connection with the log server, then sends log collection request, the log collection to the log server It include acquisition Log Types and acquisition log path in request.
3. according to the method described in claim 2, it is characterized in that, the log processing terminal is searched from preset configuration file The information of log server, and connection is established according to the information of log server and the log server, comprising:
The log processing terminal successively use the address information in preset configuration file create socket, successively with multiple logs Server establishes connection.
4. according to the method in claim 2 or 3, which is characterized in that the log server is asked according to the log collection The content asked, the log acquired needed for searching, and collected journal file is sent to the log processing terminal, comprising:
The content that the log server is requested according to the log collection, the log acquired needed for searching, and according to specified length Degree sends collected journal file to the log processing terminal one by one.
5. according to the method in claim 2 or 3, which is characterized in that the acquisition Log Types include real-time logs, history Log and re-transmission log;
The log processing terminal is analyzed and processed the collected journal file, obtains log analysis result, comprising:
If judging the journal file acquisition failure, the log processing terminal is by the information preservation of the journal file in weight It passes in container, and is set as the journal file type of acquisition failure to retransmit log;
If the journal file type of acquisition is to retransmit log, the log processing terminal divides collected journal file Analysis processing removes the information retransmitted in container after obtaining log analysis result.
6. a kind of log processing system of big data platform characterized by comprising log processing terminal and log server;
The log processing terminal, for sending log collection request to the log server;
The log server, the content for being requested according to the log collection, the log acquired needed for searching, and to described Log processing terminal sends collected journal file;
The log processing terminal is also used to be analyzed and processed the collected journal file, obtains log analysis knot Fruit;The log analysis result is stored into presetting database, and shows the log analysis result in the default page.
7. system according to claim 6, which is characterized in that the log processing terminal is specifically used for from preset configuration text The information of log server is searched in part, and connection is established according to the information of log server and the log server, then Log collection request is sent to the log server, includes acquisition Log Types and acquisition log in the log collection request Path.
8. system according to claim 7, which is characterized in that the log processing terminal is specifically used for successively using pre- If the address information in configuration file creates socket, connection successively is established with multiple log servers.
9. system according to claim 7 or 8, which is characterized in that the log server was specifically used for according to the day The content of will acquisition request, the log acquired needed for searching, and sent one by one to the log processing terminal according to designated length Collected journal file.
10. system according to claim 7 or 8, which is characterized in that the acquisition Log Types include real-time logs, go through History log and re-transmission log;
If the log processing terminal is specifically used for judging the journal file acquisition failure, by the information of the journal file It is stored in and retransmits in container, and be set as the journal file type of acquisition failure to retransmit log;If the journal file class of acquisition Type is to retransmit log, then is analyzed and processed to collected journal file, removes re-transmission container after obtaining log analysis result In information.
CN201811524309.5A 2018-12-13 2018-12-13 The log processing method of big data platform and the log processing system of big data platform Pending CN109586968A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811524309.5A CN109586968A (en) 2018-12-13 2018-12-13 The log processing method of big data platform and the log processing system of big data platform

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811524309.5A CN109586968A (en) 2018-12-13 2018-12-13 The log processing method of big data platform and the log processing system of big data platform

Publications (1)

Publication Number Publication Date
CN109586968A true CN109586968A (en) 2019-04-05

Family

ID=65927941

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811524309.5A Pending CN109586968A (en) 2018-12-13 2018-12-13 The log processing method of big data platform and the log processing system of big data platform

Country Status (1)

Country Link
CN (1) CN109586968A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114500254A (en) * 2022-02-16 2022-05-13 平安科技(深圳)有限公司 Historical log collection method, device and storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105824958A (en) * 2016-03-31 2016-08-03 广州华多网络科技有限公司 Method, device and system for inquiring log
WO2017197566A1 (en) * 2016-05-16 2017-11-23 华为技术有限公司 Method, device, and system for journal displaying
CN107644017A (en) * 2016-07-20 2018-01-30 平安科技(深圳)有限公司 The querying method and device of journal file
CN107784050A (en) * 2016-12-14 2018-03-09 平安科技(深圳)有限公司 Log information lookup method and device
CN108052675A (en) * 2017-12-28 2018-05-18 惠州Tcl家电集团有限公司 Blog management method, system and computer readable storage medium
CN108519942A (en) * 2018-04-11 2018-09-11 车巴达(苏州)网络科技有限公司 A kind of Log Analysis System
CN108763044A (en) * 2018-05-30 2018-11-06 中国建设银行股份有限公司 A kind of log processing method and device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105824958A (en) * 2016-03-31 2016-08-03 广州华多网络科技有限公司 Method, device and system for inquiring log
WO2017197566A1 (en) * 2016-05-16 2017-11-23 华为技术有限公司 Method, device, and system for journal displaying
CN107644017A (en) * 2016-07-20 2018-01-30 平安科技(深圳)有限公司 The querying method and device of journal file
CN107784050A (en) * 2016-12-14 2018-03-09 平安科技(深圳)有限公司 Log information lookup method and device
CN108052675A (en) * 2017-12-28 2018-05-18 惠州Tcl家电集团有限公司 Blog management method, system and computer readable storage medium
CN108519942A (en) * 2018-04-11 2018-09-11 车巴达(苏州)网络科技有限公司 A kind of Log Analysis System
CN108763044A (en) * 2018-05-30 2018-11-06 中国建设银行股份有限公司 A kind of log processing method and device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114500254A (en) * 2022-02-16 2022-05-13 平安科技(深圳)有限公司 Historical log collection method, device and storage medium
CN114500254B (en) * 2022-02-16 2023-08-22 平安科技(深圳)有限公司 Historical log collection method, device and storage medium

Similar Documents

Publication Publication Date Title
US8352589B2 (en) System for monitoring computer systems and alerting users of faults
US20040167912A1 (en) Unified logging service for distributed applications
CN112118174B (en) Software defined data gateway
JP2019517040A (en) Cloud platform based client application information statistics method and apparatus
CN106777371A (en) Result collection system and method
CN105824744A (en) Real-time log collection and analysis method on basis of B2B (Business to Business) platform
CN112350854B (en) Flow fault positioning method, device, equipment and storage medium
CN112765103B (en) File analysis method, system, device and equipment
CN112835792B (en) Pressure testing system and method
CN111338893A (en) Process log processing method and device, computer equipment and storage medium
CN107357804A (en) The analysis system and method for internet finance massive logs
CN111782486A (en) Alarm implementation method and system based on dynamic configuration
CN111177094A (en) Log data processing method and device, electronic equipment and storage medium
CN114039900A (en) Efficient network data packet protocol analysis method and system
CN109409948B (en) Transaction abnormity detection method, device, equipment and computer readable storage medium
CN113472858B (en) Buried point data processing method and device and electronic equipment
CN109586968A (en) The log processing method of big data platform and the log processing system of big data platform
CN113868248A (en) Index data pre-polymerization method
CN117453280A (en) Code topology and service topology generation method, device, equipment and medium
CN103916463A (en) Network access statistical analysis method and system
CN113630442B (en) Data transmission method, device and system
CN106161339A (en) Obtain the method and device of IP access relation
US11016807B2 (en) Intermediary system for data streams
CN113704203A (en) Log file processing method and device
CN108959041A (en) Method, server and the computer readable storage medium that information is sent

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190405

RJ01 Rejection of invention patent application after publication