CN109586968A - The log processing method of big data platform and the log processing system of big data platform - Google Patents
The log processing method of big data platform and the log processing system of big data platform Download PDFInfo
- Publication number
- CN109586968A CN109586968A CN201811524309.5A CN201811524309A CN109586968A CN 109586968 A CN109586968 A CN 109586968A CN 201811524309 A CN201811524309 A CN 201811524309A CN 109586968 A CN109586968 A CN 109586968A
- Authority
- CN
- China
- Prior art keywords
- log
- processing terminal
- server
- journal file
- acquisition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/069—Management of faults, events, alarms or notifications using logs of notifications; Post-processing of notifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/14—Network analysis or design
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses the log processing system of a kind of log processing method of big data platform and big data platform, a kind of log processing method of big data platform includes: that log processing terminal to log server sends log collection request;The content that log server is requested according to log collection, the log acquired needed for searching, and collected journal file is sent to log processing terminal;Log processing terminal is analyzed and processed collected journal file, obtains log analysis result;Log processing terminal stores log analysis result into presetting database, and show log analyzes result in the default page.The log processing method of big data platform disclosed by the invention and the log processing system of big data platform, for improving the O&M efficiency to big data platform.
Description
Technical field
The present embodiments relate to computer technology more particularly to a kind of log processing methods of big data platform and big number
According to the log processing system of platform.
Background technique
The prosperity of science and technology and internet, pushes the arrival of big data era, and all trades and professions are all generating number daily
Huge fragmentation of data is measured, in order to get valuable information from these fragmentation of data, every profession and trade field is related to
The enterprise of big data business will establish enterprise's big data platform.
Very much, the big data platform that each enterprise builds of building the data processing link being related to of one big data platform
Data processing link it is different.However, for many enterprises, each data processing link of big data platform
Whether operating status normal or processing data volume number can only be by manually going to backstage to check the node state of each link
With the data input and output amount namely journal file of respective handling link, this is for safeguarding that the operation maintenance personnel of big data platform is come
It says, this is a serious repetitive work, this not only wastes the time of operation maintenance personnel but also cannot understand big number in time again
According to the working condition of each data processing link of platform, to reduce O&M efficiency.
Summary of the invention
The present invention provides the log processing system of a kind of log processing method and big data platform, flat to big data to improve
The O&M efficiency of platform.
In a first aspect, the embodiment of the present invention provides a kind of log processing method of big data platform, comprising:
Log processing terminal sends log collection request to log server;
The content that log server is requested according to log collection, the log acquired needed for searching, and to log processing terminal
Send collected journal file;
Log processing terminal is analyzed and processed collected journal file, obtains log analysis result;
Log processing terminal stores log analysis result into presetting database, and the show log point in the default page
Analyse result.
In a kind of possible implementation of first aspect, log processing terminal sends log collection to log server and asks
It asks, comprising:
Log processing terminal searches the information of log server from preset configuration file, and according to the letter of log server
Breath establishes connection with log server, then sends log collection request to log server, includes adopting in log collection request
Collect Log Types and acquisition log path.
In a kind of possible implementation of first aspect, log processing terminal searches log clothes from preset configuration file
The information of business device, and connection is established according to the information and log server of log server, comprising:
Log processing terminal successively use the address information in preset configuration file create socket, successively with multiple logs
Server establishes connection.
In a kind of possible implementation of first aspect, the content that log server is requested according to log collection is searched
The log of required acquisition, and collected journal file is sent to log processing terminal, comprising:
The content that log server is requested according to log collection, search needed for acquire log, and according to designated length by
Item sends collected journal file to log processing terminal.
In a kind of possible implementation of first aspect, acquisition Log Types include real-time logs, history log and again
Pass log;
Log processing terminal is analyzed and processed collected journal file, obtains log analysis result, comprising:
If judging journal file acquisition failure, the information preservation of journal file is being retransmitted container by log processing terminal
In, and be set as the journal file type of acquisition failure to retransmit log;
If the journal file type of acquisition is to retransmit log, log processing terminal divides collected journal file
Analysis processing removes the information retransmitted in container after obtaining log analysis result.
Second aspect, the embodiment of the invention also provides a kind of log processing systems of big data platform, comprising: at log
Manage terminal and log server;
Log processing terminal, for sending log collection request to log server;
Log server, the content for being requested according to log collection, the log acquired needed for searching, and to log processing
Terminal sends collected journal file;
Log processing terminal is also used to be analyzed and processed collected journal file, obtains log analysis result;It will
Log analysis result is stored into presetting database, and show log analyzes result in the default page.
In a kind of possible implementation of second aspect, log processing terminal is specifically used for looking into from preset configuration file
The information of log server is looked for, and connection is established according to the information of log server and log server, then to log services
Device sends log collection request, includes acquisition Log Types and acquisition log path in log collection request.
In a kind of possible implementation of second aspect, log processing terminal is specifically used for successively using preset configuration
Address information in file creates socket, successively establishes connection with multiple log servers.
In a kind of possible implementation of second aspect, log server, specifically for what is requested according to log collection
Content, the log acquired needed for searching, and collected journal file is sent to log processing terminal one by one according to designated length.
In a kind of possible implementation of second aspect, acquisition Log Types include real-time logs, history log and again
Pass log;
If log processing terminal is specifically used for judging journal file acquisition failure, by the information preservation of journal file in weight
It passes in container, and is set as the journal file type of acquisition failure to retransmit log;If the journal file type of acquisition is to retransmit
Log is then analyzed and processed collected journal file, removes the information retransmitted in container after obtaining log analysis result.
The log processing method of big data platform provided in an embodiment of the present invention and the log processing system of big data platform,
It sends log collection to log server from log processing terminal to request, the content that log server is requested according to log collection,
The log acquired needed for searching, and send collected journal file to log processing terminal, then log processing terminal is to adopting
The journal file collected is analyzed and processed, and obtains log analysis as a result, and storing log analysis result to presetting database
In, and show log is analyzed as a result, improving the efficiency for carrying out O&M to big data platform in the default page.
Detailed description of the invention
Fig. 1 is the flow chart of the log processing method embodiment one of big data platform provided in an embodiment of the present invention;
Fig. 2 is the processing routine logical schematic of the log processing method of big data platform provided in an embodiment of the present invention;
Fig. 3 is the structural schematic diagram of the log processing system embodiment one of big data platform provided in an embodiment of the present invention.
Specific embodiment
The present invention is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched
The specific embodiment stated is used only for explaining the present invention rather than limiting the invention.It also should be noted that in order to just
Only the parts related to the present invention are shown in description, attached drawing rather than entire infrastructure.
Fig. 1 is the flow chart of the log processing method embodiment one of big data platform provided in an embodiment of the present invention, such as Fig. 1
Shown, the log processing method of big data platform provided in this embodiment includes:
Step S101, log processing terminal send log collection request to log server.
Big data platform is the set for the server that mass data is uniformly processed, and the data bulk being related to is huge
Greatly, and numerous types, and normal fortune from multiple servers and other equipment work cooperation realization big data platform is needed
Row.In order to ensure the normal work of big data platform, the operating status of each node in much data platforms is needed to be monitored, but
Since the node in big data platform is numerous, type is different, causes the maintenance work amoun being monitored to big data platform huge.
For traditional maintenance work all by being accomplished manually, efficiency is lower, and cannot recognize the state of each node in big data platform in time.
And in each node of big data platform, with the work of each node, can all there be corresponding journal file to generate,
The various processing record that each node is had recorded in journal file, you can learn that each node is in difference after analyzing journal file
The working condition at time point.Therefore the present embodiment provides a kind of log processing methods of big data platform, by flat to big data
The journal file of each node carries out unified acquisition and analysis processing in platform, so that the working condition to big data platform is united
One monitoring.
Firstly, needing to be arranged a special day to realize the journal file acquisition to node each in big data platform
Will processing terminal, log processing terminal be responsible for all journal files in big data platform carry out unified acquisition, analysis and
Processing.Log processing terminal sends log collection request to log server, and Request Log server sends journal file.Log
Server is set in big data platform in the various nodes that can generate journal file, passes through the company with log processing terminal
It connects, journal file is acquired in each node and collected journal file is uniformly sent to log processing terminal.In big data
In platform, the quantity of log server determines that log processing terminal only needs one according to the number of nodes of composition big data platform
It is a.Log processing terminal periodically can send log collection request to log server, which can be according to practical need
Ask determining, such as once a day, once every hour etc..Or log processing terminal can refer to according to the log collection that user sends
The triggering of order sends log collection request to log server.Log processing terminal can be sent out to multiple log servers simultaneously
It send log collection to request, successively can also send log collection request to each log server, it can also be according to demand to specific
Log server send log collection request.
A configuration file can be prestored in log processing terminal, preserve each log server in the configuration file
The information such as address, acquisition Log Types, log path.Log processing terminal can read phase according to demand from configuration file
The information answered generates log collection request and is sent to log server.When log processing terminal is searched from preset configuration file
To after the address information of log server, connection is established according to the address information and log server first, then log processing
Terminal can send log collection request to log server by the connection of foundation, include acquisition log in log collection request
Type and acquisition log path.
Due to having multiple log servers in big data platform, log processing terminal can be successively using preset configuration text
Log server address information creation socket in part thus may be used to successively establish connection with multiple log servers
Successively to acquire journal file from multiple log servers.
Step S102, the content that log server is requested according to log collection, the log acquired needed for searching, and to log
Processing terminal sends collected journal file.
When log server receive log collection request after, will be requested according to log collection in requested content,
The journal file acquired needed for searching in the node that log server is disposed, is then sent to day for collected journal file
Will processing terminal.
Since the connection between log processing terminal and log server is established according to certain communication protocol,
Log server needs to send collected day to log processing terminal one by one according to designated length after collecting journal file
Will file, log processing terminal are saved into corresponding file after receiving journal file.
Step S103, log processing terminal are analyzed and processed collected journal file, obtain log analysis result.
After log processing terminal receives the journal file of log server acquisition, processing is analyzed it, thus
The working condition of the corresponding node of the available journal file.Wherein, the result analyzed to journal file can be with
Including corresponding node in the working condition of various time points and the relevant information of the node inputoutput data etc., Cong Zhongke
To analyze the different working condition of each node in different time points.And it is put down since log processing terminal can receive big data
The journal file of each node in platform can also be judged after the journal file to multiple interdependent nodes carries out united analysis
The information such as the processing bottleneck in entire big data platform.
Step S104, log processing terminal store log analysis result into presetting database, and in the default page
Show log analyzes result.
After log processing terminal obtains log analysis result, it can be stored in preset database, so as to
To pay close attention to the work of log processing terminal in real time without operation maintenance personnel.Operation maintenance personnel can be known whole by inquiring the database
Each node carries out big data platform to be conducive to operation maintenance personnel in the working condition of different time in a big data platform
O&M and management.In addition, log analysis result can also preset the page with graphical or formatting by log processing terminal
Mode is shown that such operation maintenance personnel can intuitively grasp the operating condition of big data platform, can be effectively improved
The O&M efficiency of operation maintenance personnel.
Preset database can using mysql database storage log analysis as a result, SQL statement specification and have it is good
Good operational efficiency also with the network support of abundant information, therefore can pass through the page by MYSQL data query mode
Show log analysis result.
The log processing method of big data platform provided in this embodiment is sent from log processing terminal to log server
Log collection request, the content that log server request according to log collection, the log of acquisition needed for searching, and to log processing
Terminal sends collected journal file, and then log processing terminal is analyzed and processed collected journal file, obtains
Log analysis is as a result, and store log analysis result into presetting database, and the show log analysis knot in the default page
Fruit improves the efficiency that O&M is carried out to big data platform.
Further, in the log collection request that log processing terminal is sent, including acquisition Log Types include real-time
Log, history log and re-transmission log.Wherein, if acquisition Log Types are real-time logs, log server receives log
After acquisition request, current real-time logs file is directly sent to log processing terminal.And if Log Types be history log,
After log server receives log collection request, according to the setting of history log, corresponding go through is sent to log processing terminal
History log, such as the journal file of the previous day.If Log Types are to retransmit log, it means that log processing terminal is last
Received journal file reception failure, this is received as the journal file retransmitted.
Correspondingly, after the journal file that log processing terminal receives that log server is sent, if judging, journal file is adopted
Collection failure, then log processing terminal by the information preservation of journal file retransmit container in, and will acquisition failure journal file
Type is set as retransmitting log.If the journal file type of acquisition is to retransmit log, log processing terminal is to collected day
Will file is analyzed and processed, and removes the information retransmitted in container after obtaining log analysis result.
Fig. 2 is the processing routine logical schematic of the log processing method of big data platform provided in an embodiment of the present invention,
As shown in Fig. 2, log processing processing logic provided in this embodiment includes:
Terminal main thread Client_main and server main thread Server_main, is separately operable in log processing terminal
In log server.Terminal main thread further includes signal processing thread, and message queue reads, saves configuration information,
Timer is created, task dispatch thread exits multiple threads such as detection, is respectively used to perform corresponding processing.Signal processing line
Journey further includes that signal thread is exited in detection timer signal and detection, when detecting timer signal, to task point
Hair line journey sends order.Task dispatch thread further includes processing the previous day log thread, processing real-time logs thread, place
Reason the previous day log failure reconnection thread and database aging thread.Server main thread includes signal processing thread, to task
Dispatch thread sends order, exits the several sub threads of detection.By the setting of above-mentioned thread so that log processing terminal and
Log server establishes connection, and completes the interaction of log file data.
Fig. 3 is the structural schematic diagram of the log processing system embodiment one of big data platform provided in an embodiment of the present invention,
As shown in figure 3, the log processing system of big data platform provided in this embodiment includes:
Log processing terminal 31 and log server 32.Log server 32 is deployed in each node of big data platform,
Quantity is multiple.
Log processing terminal 31, for sending log collection request to log server 32;
Log server 32, the content for being requested according to log collection, the log acquired needed for searching, and at log
Reason terminal 31 sends collected journal file;
Log processing terminal 31 is also used to be analyzed and processed collected journal file, obtains log analysis result;
Log analysis result is stored into presetting database, and show log analyzes result in the default page.
The log processing system of big data platform provided in this embodiment for realizing big data platform shown in Fig. 1 log
Processing method, it is similar that the realization principle and technical effect are similar, and details are not described herein again.
Further, on the basis of embodiment shown in Fig. 3, log processing terminal 31 is specifically used for from preset configuration file
The middle information for searching log server 32, and connection is established according to the information of log server 32 and log server 32, then
Log collection request is sent to log server 32, includes acquisition Log Types and acquisition log path in log collection request.
Further, on the basis of embodiment shown in Fig. 3, log processing terminal 31 is specifically used for successively using default
Address information in configuration file creates socket, successively establishes connection with multiple log servers 32.
Further, on the basis of embodiment shown in Fig. 3, log server 32, specifically for being asked according to log collection
The content asked, the log acquired needed for searching, and collected day is sent to log processing terminal 31 one by one according to designated length
Will file.
Further, on the basis of embodiment shown in Fig. 3, acquisition Log Types include real-time logs, history log and
Retransmit log;
If log processing terminal 31 is specifically used for judging journal file acquisition failure, the information preservation of journal file is existed
It retransmits in container, and is set as the journal file type of acquisition failure to retransmit log;If the journal file type of acquisition is attached most importance to
Log is passed, then collected journal file is analyzed and processed, removes the letter retransmitted in container after obtaining log analysis result
Breath.
By the description above with respect to embodiment, it is apparent to those skilled in the art that, the present invention
It can be realized by software and required common hardware, naturally it is also possible to which by hardware realization, but in many cases, the former is more
Good embodiment.Based on this understanding, technical solution of the present invention substantially in other words contributes to the prior art
Part can be embodied in the form of software products, which can store in computer readable storage medium
In, floppy disk, read-only memory (Read-Only Memory, ROM), random access memory (Random such as computer
Access Memory, RAM), flash memory (FLASH), hard disk or CD etc., including some instructions are with so that a computer is set
Standby (can be personal computer, server or the network equipment etc.) executes method described in each embodiment of the present invention.
Note that the above is only a better embodiment of the present invention and the applied technical principle.It will be appreciated by those skilled in the art that
The invention is not limited to the specific embodiments described herein, be able to carry out for a person skilled in the art it is various it is apparent variation,
It readjusts and substitutes without departing from protection scope of the present invention.Therefore, although being carried out by above embodiments to the present invention
It is described in further detail, but the present invention is not limited to the above embodiments only, without departing from the inventive concept, also
It may include more other equivalent embodiments, and the scope of the invention is determined by the scope of the appended claims.
Claims (10)
1. a kind of log processing method of big data platform characterized by comprising
Log processing terminal sends log collection request to log server;
The content that the log server is requested according to the log collection, the log acquired needed for searching, and to the log
Processing terminal sends collected journal file;
The log processing terminal is analyzed and processed the collected journal file, obtains log analysis result;
The log processing terminal stores the log analysis result into presetting database, and shows institute in the default page
State log analysis result.
2. the method according to claim 1, wherein the log processing terminal sends log to log server
Acquisition request, comprising:
The log processing terminal searches the information of log server from preset configuration file, and according to the letter of log server
Breath establishes connection with the log server, then sends log collection request, the log collection to the log server
It include acquisition Log Types and acquisition log path in request.
3. according to the method described in claim 2, it is characterized in that, the log processing terminal is searched from preset configuration file
The information of log server, and connection is established according to the information of log server and the log server, comprising:
The log processing terminal successively use the address information in preset configuration file create socket, successively with multiple logs
Server establishes connection.
4. according to the method in claim 2 or 3, which is characterized in that the log server is asked according to the log collection
The content asked, the log acquired needed for searching, and collected journal file is sent to the log processing terminal, comprising:
The content that the log server is requested according to the log collection, the log acquired needed for searching, and according to specified length
Degree sends collected journal file to the log processing terminal one by one.
5. according to the method in claim 2 or 3, which is characterized in that the acquisition Log Types include real-time logs, history
Log and re-transmission log;
The log processing terminal is analyzed and processed the collected journal file, obtains log analysis result, comprising:
If judging the journal file acquisition failure, the log processing terminal is by the information preservation of the journal file in weight
It passes in container, and is set as the journal file type of acquisition failure to retransmit log;
If the journal file type of acquisition is to retransmit log, the log processing terminal divides collected journal file
Analysis processing removes the information retransmitted in container after obtaining log analysis result.
6. a kind of log processing system of big data platform characterized by comprising log processing terminal and log server;
The log processing terminal, for sending log collection request to the log server;
The log server, the content for being requested according to the log collection, the log acquired needed for searching, and to described
Log processing terminal sends collected journal file;
The log processing terminal is also used to be analyzed and processed the collected journal file, obtains log analysis knot
Fruit;The log analysis result is stored into presetting database, and shows the log analysis result in the default page.
7. system according to claim 6, which is characterized in that the log processing terminal is specifically used for from preset configuration text
The information of log server is searched in part, and connection is established according to the information of log server and the log server, then
Log collection request is sent to the log server, includes acquisition Log Types and acquisition log in the log collection request
Path.
8. system according to claim 7, which is characterized in that the log processing terminal is specifically used for successively using pre-
If the address information in configuration file creates socket, connection successively is established with multiple log servers.
9. system according to claim 7 or 8, which is characterized in that the log server was specifically used for according to the day
The content of will acquisition request, the log acquired needed for searching, and sent one by one to the log processing terminal according to designated length
Collected journal file.
10. system according to claim 7 or 8, which is characterized in that the acquisition Log Types include real-time logs, go through
History log and re-transmission log;
If the log processing terminal is specifically used for judging the journal file acquisition failure, by the information of the journal file
It is stored in and retransmits in container, and be set as the journal file type of acquisition failure to retransmit log;If the journal file class of acquisition
Type is to retransmit log, then is analyzed and processed to collected journal file, removes re-transmission container after obtaining log analysis result
In information.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811524309.5A CN109586968A (en) | 2018-12-13 | 2018-12-13 | The log processing method of big data platform and the log processing system of big data platform |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811524309.5A CN109586968A (en) | 2018-12-13 | 2018-12-13 | The log processing method of big data platform and the log processing system of big data platform |
Publications (1)
Publication Number | Publication Date |
---|---|
CN109586968A true CN109586968A (en) | 2019-04-05 |
Family
ID=65927941
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201811524309.5A Pending CN109586968A (en) | 2018-12-13 | 2018-12-13 | The log processing method of big data platform and the log processing system of big data platform |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109586968A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114500254A (en) * | 2022-02-16 | 2022-05-13 | 平安科技(深圳)有限公司 | Historical log collection method, device and storage medium |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105824958A (en) * | 2016-03-31 | 2016-08-03 | 广州华多网络科技有限公司 | Method, device and system for inquiring log |
WO2017197566A1 (en) * | 2016-05-16 | 2017-11-23 | 华为技术有限公司 | Method, device, and system for journal displaying |
CN107644017A (en) * | 2016-07-20 | 2018-01-30 | 平安科技(深圳)有限公司 | The querying method and device of journal file |
CN107784050A (en) * | 2016-12-14 | 2018-03-09 | 平安科技(深圳)有限公司 | Log information lookup method and device |
CN108052675A (en) * | 2017-12-28 | 2018-05-18 | 惠州Tcl家电集团有限公司 | Blog management method, system and computer readable storage medium |
CN108519942A (en) * | 2018-04-11 | 2018-09-11 | 车巴达(苏州)网络科技有限公司 | A kind of Log Analysis System |
CN108763044A (en) * | 2018-05-30 | 2018-11-06 | 中国建设银行股份有限公司 | A kind of log processing method and device |
-
2018
- 2018-12-13 CN CN201811524309.5A patent/CN109586968A/en active Pending
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105824958A (en) * | 2016-03-31 | 2016-08-03 | 广州华多网络科技有限公司 | Method, device and system for inquiring log |
WO2017197566A1 (en) * | 2016-05-16 | 2017-11-23 | 华为技术有限公司 | Method, device, and system for journal displaying |
CN107644017A (en) * | 2016-07-20 | 2018-01-30 | 平安科技(深圳)有限公司 | The querying method and device of journal file |
CN107784050A (en) * | 2016-12-14 | 2018-03-09 | 平安科技(深圳)有限公司 | Log information lookup method and device |
CN108052675A (en) * | 2017-12-28 | 2018-05-18 | 惠州Tcl家电集团有限公司 | Blog management method, system and computer readable storage medium |
CN108519942A (en) * | 2018-04-11 | 2018-09-11 | 车巴达(苏州)网络科技有限公司 | A kind of Log Analysis System |
CN108763044A (en) * | 2018-05-30 | 2018-11-06 | 中国建设银行股份有限公司 | A kind of log processing method and device |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114500254A (en) * | 2022-02-16 | 2022-05-13 | 平安科技(深圳)有限公司 | Historical log collection method, device and storage medium |
CN114500254B (en) * | 2022-02-16 | 2023-08-22 | 平安科技(深圳)有限公司 | Historical log collection method, device and storage medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8352589B2 (en) | System for monitoring computer systems and alerting users of faults | |
US20040167912A1 (en) | Unified logging service for distributed applications | |
CN112118174B (en) | Software defined data gateway | |
JP2019517040A (en) | Cloud platform based client application information statistics method and apparatus | |
CN106777371A (en) | Result collection system and method | |
CN105824744A (en) | Real-time log collection and analysis method on basis of B2B (Business to Business) platform | |
CN112350854B (en) | Flow fault positioning method, device, equipment and storage medium | |
CN112765103B (en) | File analysis method, system, device and equipment | |
CN112835792B (en) | Pressure testing system and method | |
CN111338893A (en) | Process log processing method and device, computer equipment and storage medium | |
CN107357804A (en) | The analysis system and method for internet finance massive logs | |
CN111782486A (en) | Alarm implementation method and system based on dynamic configuration | |
CN111177094A (en) | Log data processing method and device, electronic equipment and storage medium | |
CN114039900A (en) | Efficient network data packet protocol analysis method and system | |
CN109409948B (en) | Transaction abnormity detection method, device, equipment and computer readable storage medium | |
CN113472858B (en) | Buried point data processing method and device and electronic equipment | |
CN109586968A (en) | The log processing method of big data platform and the log processing system of big data platform | |
CN113868248A (en) | Index data pre-polymerization method | |
CN117453280A (en) | Code topology and service topology generation method, device, equipment and medium | |
CN103916463A (en) | Network access statistical analysis method and system | |
CN113630442B (en) | Data transmission method, device and system | |
CN106161339A (en) | Obtain the method and device of IP access relation | |
US11016807B2 (en) | Intermediary system for data streams | |
CN113704203A (en) | Log file processing method and device | |
CN108959041A (en) | Method, server and the computer readable storage medium that information is sent |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190405 |
|
RJ01 | Rejection of invention patent application after publication |