CN107544894B - Log processing method and device and server - Google Patents

Log processing method and device and server Download PDF

Info

Publication number
CN107544894B
CN107544894B CN201610463674.4A CN201610463674A CN107544894B CN 107544894 B CN107544894 B CN 107544894B CN 201610463674 A CN201610463674 A CN 201610463674A CN 107544894 B CN107544894 B CN 107544894B
Authority
CN
China
Prior art keywords
log
information
retrieval
description information
description
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610463674.4A
Other languages
Chinese (zh)
Other versions
CN107544894A (en
Inventor
高丽红
郑纪伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN201610463674.4A priority Critical patent/CN107544894B/en
Publication of CN107544894A publication Critical patent/CN107544894A/en
Application granted granted Critical
Publication of CN107544894B publication Critical patent/CN107544894B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Debugging And Monitoring (AREA)

Abstract

The invention provides a method, a device and a server for processing logs, relates to the field of communication, and solves the problem that the existing log processing mode can not simultaneously give consideration to rapidity, accuracy and integrity of log recording, wherein the method comprises the following steps: determining various preset log information, and distributing different retrieval identifiers for different log information, wherein each log information comprises description information and data information, the description information is used for describing a parameter, and the data information is used for representing the value of the parameter and a log track; the method comprises the steps of obtaining first log information generated in the running process of equipment, extracting first data information and first description information in the first log information, and determining a first retrieval identifier corresponding to the first description information; and storing the first data information and the first retrieval identification as a log record. The scheme of the invention radically simplifies the log content and ensures the rapidity, accuracy and integrity of log recording.

Description

Log processing method and device and server
Technical Field
The present invention relates to the field of communications, and in particular, to a method, an apparatus, and a server for processing a log.
Background
The running log information is recorded, so that the running condition of the equipment can be known, and the running log information can also be used as an important reference for analyzing the fault when the equipment is abnormal. Especially for large and complex equipment such as a base station, the more detailed the content of the log is, the longer the recording time is, the more beneficial the analysis of the operation condition of the equipment is. But the storage capacity of the log is limited due to the limitation of the storage space of the device.
The log recording duration is not enough or in order to take account of the limitations of both log recording time and log storage capacity, the log is recorded only at the key position, which often results in that the information is not comprehensive enough when the log is used for analyzing the operation condition of the equipment, and the abnormal condition cannot be clearly analyzed. Particularly, faults with small occurrence probability often consume a large amount of manpower, material resources, time for building the environment and the like when the faults are repeated.
The existing log collection and processing technologies mainly include three types of processing methods: the first method reduces the log record by combining the repeated log records and updating the log record time; the second is to record different log information under different running conditions by classifying and recording the log records; and the third method is to attach an independent storage device to store log records specially to enlarge the log storage capacity. Of these methods, the first and second methods cannot guarantee the integrity of log records, and it is possible that a critical abnormal log is covered by a new record or a critical log is not recorded; the third method can ensure the integrity of the log, but the use of attached storage devices tends to increase the time consumption of the logging process of the log.
Disclosure of Invention
The technical problem to be solved by the invention is to provide a method, a device and a server for log processing, and solve the problem that the log processing mode in the prior art cannot simultaneously give consideration to rapidity, accuracy and integrity of log recording.
To solve the foregoing technical problem, an embodiment of the present invention provides a method for processing a log, including:
determining various preset log information, and distributing different retrieval identifiers for different log information, wherein each log information comprises description information and data information, the description information is used for describing a parameter, and the data information is used for representing the value of the parameter and a log track;
the method comprises the steps of obtaining first log information generated in the running process of equipment, extracting first data information and first description information in the first log information, and determining a first retrieval identifier corresponding to the first description information;
and storing the first data information and the first retrieval identification as a log record.
Wherein, after storing the first data information and the first retrieval identifier as a log record, the method further comprises:
extracting a log record, and obtaining second data information and a second retrieval identifier in the log record;
retrieving corresponding second description information according to the second retrieval identification;
and restoring and displaying the log according to the second data information and the second description information.
Wherein, the step of allocating different retrieval identifiers for different log information comprises:
and distributing different retrieval identifications for different log information according to the number of the file where the log is located and the line number of the log in the file.
After different retrieval identifiers are allocated to different log information, the method further includes:
combining a plurality of pieces of description information with the same description content to obtain a piece of combined description information;
distributing a retrieval identifier for the merged description information according to the retrieval identifiers corresponding to the plurality of pieces of description information before merging respectively, and establishing the corresponding relation between the retrieval identifiers corresponding to the plurality of pieces of description information before merging respectively and the retrieval identifier of the merged description information.
After obtaining first log information generated in an operating process of the device, extracting first data information and first description information in the first log information, and determining a first retrieval identifier corresponding to the first description information, the method further includes:
and extracting and storing the generation time, the level information, the recording position information and/or the type information of the first log information.
To solve the foregoing technical problem, an embodiment of the present invention further provides an apparatus for processing a log, including:
the system comprises a first distribution module, a second distribution module and a third distribution module, wherein the first distribution module is used for determining various preset log information and distributing different retrieval identifiers for different log information, each log information comprises description information and data information, the description information is used for describing a parameter, and the data information is used for representing the value of the parameter and a log track;
the device comprises a first extraction module, a second extraction module and a third extraction module, wherein the first extraction module is used for obtaining first log information generated in the running process of equipment, extracting first data information and first description information in the first log information, and determining a first retrieval identifier corresponding to the first description information;
and the first storage module is used for storing the first data information and the first retrieval identifier as a log record.
Wherein the apparatus further comprises:
the second extraction module is used for extracting the log record and obtaining second data information and a second retrieval identifier in the log record;
the retrieval module is used for retrieving corresponding second description information according to the second retrieval identifier;
and the restoration module is used for restoring and displaying the log according to the second data information and the second description information.
Wherein the first distribution module comprises:
and the distribution unit is used for distributing different retrieval identifications for different log information according to the number of the file where the log is located and the line number of the log in the file.
Wherein the apparatus further comprises:
the merging module is used for merging a plurality of pieces of description information with the same description content to obtain a piece of merged description information;
and the second distribution module is used for distributing a retrieval identifier for the merged description information according to the retrieval identifiers respectively corresponding to the plurality of pieces of description information before merging, and establishing the corresponding relation between the retrieval identifiers respectively corresponding to the plurality of pieces of description information before merging and the retrieval identifier of the merged description information.
Wherein the apparatus further comprises:
and the second storage module is used for extracting and storing the generation time, the level information, the recording position information and/or the type information of the first log information.
To solve the above technical problem, an embodiment of the present invention further provides a server, including: an apparatus for log processing as claimed in any one of the preceding claims.
The technical scheme of the invention has the following beneficial effects:
the log processing method of the embodiment of the invention comprises the steps of firstly determining various preset log information and distributing different retrieval identifications for different log information, wherein each log information comprises description information and data information, the description information is used for describing a parameter, and the data information is used for representing the value of the parameter and a log track; after first log information generated in the running process of equipment is obtained, first data information and first description information in the first log information are extracted, and a first retrieval identifier corresponding to the first description information is determined; and finally, storing the first data information and the first retrieval identification as a log record. Therefore, by separating the description information and the data information of the log, the description information for the readability of the log is not recorded in the running process of the equipment, and only the data information is recorded, so that the repeated content in the log is greatly reduced. By adopting the method, the log content is simplified; the time consumption of the log storage process is shortened, and the storage efficiency is improved; the log storage capacity in a limited space is increased, and the feasibility of long-time recording is ensured; the information quantity of the log transmitted between the devices is reduced; the rapidness, the accuracy and the integrity of the log record are guaranteed, the service upper limit of the service is improved, and the service quality is improved. The problem that the rapidity, the accuracy and the integrity of log recording cannot be simultaneously considered in a log processing mode in the prior art is solved.
Drawings
FIG. 1 is a flow chart of a method of log processing according to the present invention;
FIG. 2 is a flow chart of a log separation and collection phase of the log processing method of the present invention;
FIG. 3 is a flow chart of a method of log processing of the present invention during log synthesis and display;
FIG. 4 is a schematic diagram of a log processing apparatus according to the present invention.
Detailed Description
In order to make the technical problems, technical solutions and advantages of the present invention more apparent, the following detailed description is given with reference to the accompanying drawings and specific embodiments.
In order to make those skilled in the art better understand the present invention, description information and data information referred to in the embodiments of the present invention will be first explained.
The log is used for recording the operation process of the equipment, and the log is required to be readable and understood and identified, so the log record usually comprises two parts: the data information is used for describing a parameter, describing information for explaining the log record content and recording the parameter value and the log track of the running scene at that time. The description information of the log is not changed after the program is determined, but the data information recording the current running state is changed every time. And in order to ensure readability, the description information occupies most of the content of the log information.
Aiming at the characteristics of the log, in order to efficiently utilize the limited log storage space, the log processing method of the embodiment of the invention separates the description information and the data information of the log content, and only records the data information in the running process of the equipment, thereby ensuring the rapidity, the accuracy and the integrity of log recording.
Referring to fig. 1, a method for processing a log according to an embodiment of the present invention includes:
step 101, determining various preset log information, and allocating different retrieval identifiers to different log information, wherein each log information includes description information and data information, the description information is used for describing a parameter, and the data information is used for representing a value of the parameter and a log track.
Here, when log information needs to be recorded, a uniform log output interface is called, log information calling the log output interface can be searched in the version making process, different retrieval identifiers are allocated to different log information, and the data information and the description information of the log information carry the same retrieval identifier.
Furthermore, all the description information carrying the retrieval identification can be stored in a retrieval database for standby.
Step 102, obtaining first log information generated in the device operation process, extracting first data information and first description information in the first log information, and determining a first retrieval identifier corresponding to the first description information.
During the operation of the device, the data information of the current operation state recorded by the call log output interface is extracted, and the corresponding retrieval identifier is found.
Step 103, storing the first data information and the first retrieval identifier as a log record.
Only the data information and the corresponding retrieval identification are stored, and the log record content is simplified.
According to the log processing method, the description information and the data information of the log are separated, the description information for the readability of the log is not recorded in the operation process of the equipment, only the data information is recorded, and repeated content in the log is greatly reduced. By adopting the method, the log content is simplified; the time consumption of the log storage process is shortened, and the storage efficiency is improved; the log storage capacity in a limited space is increased, and the feasibility of long-time recording is ensured; the information quantity of the log transmitted among the devices is reduced; the rapidness, the accuracy and the integrity of the log record are guaranteed, the service upper limit of the service is improved, and the service quality is improved. The problem that the rapidity, the accuracy and the integrity of log recording cannot be simultaneously considered in a log processing mode in the prior art is solved.
Further, after the step 103, the method may further include:
and 104, extracting the log record, and acquiring second data information and a second retrieval identifier in the log record.
When the log information needs to be checked, the stored data information and the retrieval identification are extracted so as to restore the log.
And 105, retrieving corresponding second description information according to the second retrieval identifier.
Here, the description information corresponding to the retrieval identifier can be quickly inquired in the retrieval database.
In order to accelerate the search speed, the description information can be quickly searched by a space time-changing method or a HASH algorithm and the like.
And 106, restoring and displaying the log according to the second data information and the second description information.
And the complete log information is restored according to the data information and the description information and then displayed, so that the readability of the log is ensured. Wherein, the log display form can be decided according to the log viewing strategy. Such as sorting, ranking, or time period display of the logs according to log display requirements.
At the moment, when the log needs to be displayed, the description information and the data information are synthesized into a complete log, so that the readability of the log is ensured while the rapidity, the accuracy and the integrity of log recording are ensured, and a user can complete related work through the content of the log recording.
Preferably, in step 101, the step of assigning different search identifiers to different log information may include:
and step 1011, distributing different retrieval identifications for different log information according to the number of the file where the log is located and the line number of the log in the file.
Here, the numerical value obtained by adding the number of the file in which the log is located to the line number of the log in the file may be directly used as the retrieval identifier, or the retrieval identifier may be obtained by further abstracting according to the numerical value. Wherein the retrieval identification assigned to each log information is unique.
Specifically, the description information may directly adopt the complete content of the log, that is, the format of data information padding is also reserved.
In the running process of the equipment, when a certain log is run, the actual data information can be extracted according to the filling format of the data information, and the retrieval identification, the current time information and the actual data information are stored together. Wherein the retrieval identification can be used for searching corresponding description information, and the time information can be used for viewing the log according to the time period.
Preferably, in step 101, after allocating different search identifiers to different log information, the method may further include:
step 1001, merging a plurality of pieces of description information with the same description content to obtain a piece of merged description information.
Here, by merging a plurality of pieces of description information having the same content, the amount of description information storage is reduced, and the retrieval speed of the description information can be increased, thereby improving the service efficiency.
Step 1002, according to the retrieval identifiers respectively corresponding to the plurality of pieces of description information before merging, allocating a retrieval identifier to the merged description information, and establishing a corresponding relationship between the retrieval identifiers respectively corresponding to the plurality of pieces of description information before merging and the retrieval identifier of the merged description information.
Here, by establishing a correspondence table between the search identifiers before and after merging, normal search and use of multiple pieces of merged description information are ensured.
At this time, by merging the description information with the same content, the data size of the description information storage is reduced, and particularly for the equipment with a relatively high repetition probability, the retrieval speed can be effectively increased.
Further, after the step 102, the method may further include:
and step 107, extracting and storing the generation time, the level information, the recording position information and/or the type information of the first log information.
At this time, by extracting the generation time of the log, the level information (normal/alarm/error), the recording position information and/or the type information (running log/operation log), the management of the log and the control of the log output display are facilitated. Specifically, the output format of the log may be set in advance, and information such as the log level may be output according to the output format of the log.
As can be seen from the above description, the method for processing logs of the embodiment of the present invention may include a log separation and collection phase and a log synthesis and display phase. The following illustrates the specific implementation flow of these two stages.
Referring to fig. 2, in the log separation and collection phase, the method of the embodiment of the present invention includes:
step 201, start.
Step 202, obtaining a single log information of the call log output interface.
Step 203, judging whether the equipment is in the operation process, if so, skipping to step 205, otherwise, skipping to step 204.
Step 204, extracting the description information in the log information, allocating a retrieval identifier for the log information, storing the description information carrying the retrieval identifier in a retrieval database for later use, and then jumping to step 207.
In this case, before the device operates, in the version creation process, the log that calls the log output interface is obtained, and different retrieval identifiers can be allocated to different description information through this step.
Step 205, extracting the data information, the description information and the generation time of the log, determining a retrieval identifier corresponding to the description information, and storing the data information, the retrieval identifier and the generation time as a log record.
Here, only data information is recorded during the operation of the apparatus.
And step 206, judging whether the equipment operation is finished, if so, skipping to step 207, otherwise, skipping to step 202.
And step 207, ending.
Therefore, the log separation and collection work is completed.
Referring to fig. 3, in the log synthesizing and displaying stage, the method of the embodiment of the present invention includes:
step 301, begin.
Step 302, obtaining single data information in the log record and the corresponding retrieval identification.
Step 303, searching the description information in the retrieval database through the retrieval identifier.
And step 304, judging whether the description information matched with the retrieval identifier is found, if so, jumping to step 306, otherwise, jumping to step 305.
Step 305, recording the error retrieval information, and then jumping to step 302.
Step 306, the description information and the data information are synthesized into a complete log.
Step 307, judging whether all logs in the log record are synthesized, if so, jumping to step 308, otherwise, jumping to step 302.
Step 308, displaying the log as required.
And step 309, ending.
Thus, the synthesis and display work of the log is completed.
To sum up, in the method for processing the log according to the embodiment of the present invention, in the version making process, all the description information is extracted, and the description information is stored in the search library for standby by carrying the search identifier; in the running process of the equipment, extracting data information recording the current running state, carrying a retrieval identifier and time information, and storing the data information as a log record; when the log information needs to be checked, the stored data information is extracted, and the corresponding description information is inquired by using the retrieval identification carried in each piece of data information; and finally, after the log is restored according to the description information and the data information, displaying the log according to a log viewing strategy.
According to the log processing method, the description information and the data information of the log are separated, the description information for the readability of the log is not recorded in the operation process of the equipment, only the data information is recorded, and repeated content in the log is greatly reduced. By adopting the method, the log content is fundamentally simplified; the time consumption of the log storage process is shortened, and the storage efficiency is improved; the log storage capacity in a limited space is increased, and the feasibility of long-time recording is ensured; the information quantity of the log transmitted between the devices is reduced; the rapidness, the accuracy and the integrity of the log record are guaranteed, the service upper limit of the service is improved, and the service quality is improved. The problem that the rapidity, the accuracy and the integrity of log recording cannot be simultaneously considered in a log processing mode in the prior art is solved.
Referring to fig. 4, an embodiment of the present invention further provides an apparatus for log processing, including:
the system comprises a first distribution module, a second distribution module and a third distribution module, wherein the first distribution module is used for determining various preset log information and distributing different retrieval identifiers for different log information, each log information comprises description information and data information, the description information is used for describing a parameter, and the data information is used for representing the value of the parameter and a log track;
the device comprises a first extraction module, a second extraction module and a third extraction module, wherein the first extraction module is used for obtaining first log information generated in the running process of equipment, extracting first data information and first description information in the first log information, and determining a first retrieval identifier corresponding to the first description information;
and the first storage module is used for storing the first data information and the first retrieval identifier as a log record.
According to the log processing device, the description information and the data information of the log are separated, the description information for the readability of the log is not recorded in the operation process of the equipment, only the data information is recorded, and repeated content in the log is greatly reduced. By adopting the method, the log content is fundamentally simplified; the time consumption of the log storage process is shortened, and the storage efficiency is improved; the log storage capacity in a limited space is increased, and the feasibility of long-time recording is ensured; the information quantity of the log transmitted between the devices is reduced; the rapidness, the accuracy and the integrity of the log record are guaranteed, the service upper limit of the service is improved, and the service quality is improved. The problem that the rapidity, the accuracy and the integrity of log recording cannot be simultaneously considered in a log processing mode in the prior art is solved.
Wherein, all the description information carrying the retrieval identification can be stored in the retrieval database for standby.
Further, the apparatus may further include:
the second extraction module is used for extracting the log record and obtaining second data information and a second retrieval identifier in the log record;
the retrieval module is used for retrieving corresponding second description information according to the second retrieval identifier;
and the restoration module is used for restoring and displaying the log according to the second data information and the second description information.
Wherein the retrieval module can be completed by post-processing software independent of the running device. In the retrieval process, in order to accelerate the search speed, the description information can be quickly searched by a space time-changing method or a HASH algorithm and the like.
Preferably, the first distribution module may include:
and the distribution unit is used for distributing different retrieval identifications for different log information according to the number of the file where the log is located and the line number of the log in the file.
Preferably, the apparatus may further include:
the merging module is used for merging a plurality of pieces of description information with the same description content to obtain a piece of merged description information;
and the second distribution module is used for distributing a retrieval identifier for the merged description information according to the retrieval identifiers respectively corresponding to the plurality of pieces of description information before merging, and establishing the corresponding relation between the retrieval identifiers respectively corresponding to the plurality of pieces of description information before merging and the retrieval identifier of the merged description information.
Further, the apparatus may further include:
and the second storage module is used for extracting and storing the generation time, the level information, the recording position information and/or the type information of the first log information.
According to the log processing device, the description information and the data information of the log are separated, the description information for the readability of the log is not recorded in the operation process of the equipment, only the data information is recorded, and repeated content in the log is greatly reduced. By adopting the method, the log content is fundamentally simplified; the time consumption of the log storage process is shortened, and the storage efficiency is improved; the log storage capacity in a limited space is increased, and the feasibility of long-time recording is ensured; the information quantity of the log transmitted between the devices is reduced; the rapidness, the accuracy and the integrity of the log record are guaranteed, the service upper limit of the service is improved, and the service quality is improved. The problem that the rapidity, the accuracy and the integrity of log recording cannot be simultaneously considered in a log processing mode in the prior art is solved.
The log processing device is a device corresponding to the log processing method, and all the implementation manners in the method embodiment are applicable to the embodiment of the device, so that the same technical effects can be achieved.
Because the log processing apparatus of the embodiment of the present invention is applied to a server, an embodiment of the present invention further provides a server, including: the log processing apparatus as described in the above embodiments. The implementation embodiments of the log processing device are all applicable to the embodiment of the server, and the same technical effect can be achieved. The server of the present invention may be a base station or other devices.
In various embodiments of the present invention, it should be understood that the sequence numbers of the above-mentioned processes do not mean the execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.
In embodiments of the present invention, modules may be implemented in software for execution by various types of processors. An identified module of executable code may, for instance, comprise one or more physical or logical blocks of computer instructions which may, for instance, be constructed as an object, procedure, or function. Nevertheless, the executables of an identified module need not be physically located together, but may comprise disparate instructions stored in different bits which, when joined logically together, comprise the module and achieve the stated purpose for the module.
Indeed, a module of executable code may be a single instruction, or many instructions, and may even be distributed over several different code segments, among different programs, and across several memory devices. Likewise, operational data may be identified within the modules and may be embodied in any suitable form and organized within any suitable type of data structure. The operational data may be collected as a single data set, or may be distributed over different locations including over different storage devices, and may exist, at least partially, merely as electronic signals on a system or network.
When a module can be implemented by software, considering the level of existing hardware technology, a module implemented by software may build a corresponding hardware circuit to implement a corresponding function, without considering cost, and the hardware circuit may include a conventional Very Large Scale Integration (VLSI) circuit or a gate array and an existing semiconductor such as a logic chip, a transistor, or other discrete components. A module may also be implemented in programmable hardware devices such as field programmable gate arrays, programmable array logic, programmable logic devices or the like.
While the foregoing is directed to the preferred embodiment of the present invention, it will be appreciated by those skilled in the art that various changes and modifications may be made therein without departing from the principles of the invention as set forth in the appended claims.

Claims (11)

1. A method of log processing, comprising:
determining various preset log information, and distributing different retrieval identifiers for different log information, wherein each log information comprises description information and data information, the description information is used for describing a parameter, and the data information is used for representing the value of the parameter and a log track;
the method comprises the steps of obtaining first log information generated in the running process of equipment, extracting first data information and first description information in the first log information, and determining a first retrieval identifier corresponding to the first description information;
and storing the first data information and the first retrieval identification as a log record.
2. The method of claim 1, wherein after storing the first data information and the first retrieval identification as a log record, the method further comprises:
extracting a log record, and obtaining second data information and a second retrieval identifier in the log record;
retrieving corresponding second description information according to the second retrieval identification;
and restoring and displaying the log according to the second data information and the second description information.
3. The method of claim 1, wherein the step of assigning different retrieval identifiers to different log information comprises:
and distributing different retrieval identifications for different log information according to the number of the file where the log is located and the line number of the log in the file.
4. The method of claim 1, wherein after assigning different retrieval identifiers to different log information, the method further comprises:
combining a plurality of pieces of description information with the same description content to obtain a piece of combined description information;
distributing a retrieval identifier for the merged description information according to the retrieval identifiers corresponding to the plurality of pieces of description information before merging respectively, and establishing the corresponding relation between the retrieval identifiers corresponding to the plurality of pieces of description information before merging respectively and the retrieval identifier of the merged description information.
5. The method according to claim 1, wherein after obtaining first log information generated during operation of the device, extracting first data information and first description information in the first log information, and determining a first retrieval identifier corresponding to the first description information, the method further comprises:
and extracting and storing the generation time, the level information, the recording position information and/or the type information of the first log information.
6. An apparatus for log processing, comprising:
the system comprises a first distribution module, a second distribution module and a third distribution module, wherein the first distribution module is used for determining various preset log information and distributing different retrieval identifiers for different log information, each log information comprises description information and data information, the description information is used for describing a parameter, and the data information is used for representing the value of the parameter and a log track;
the device comprises a first extraction module, a second extraction module and a third extraction module, wherein the first extraction module is used for obtaining first log information generated in the running process of equipment, extracting first data information and first description information in the first log information, and determining a first retrieval identifier corresponding to the first description information;
and the first storage module is used for storing the first data information and the first retrieval identifier as a log record.
7. The apparatus of claim 6, further comprising:
the second extraction module is used for extracting the log record and obtaining second data information and a second retrieval identifier in the log record;
the retrieval module is used for retrieving corresponding second description information according to the second retrieval identifier;
and the restoration module is used for restoring and displaying the log according to the second data information and the second description information.
8. The apparatus of claim 6, wherein the first distribution module comprises:
and the distribution unit is used for distributing different retrieval identifications for different log information according to the number of the file where the log is located and the line number of the log in the file.
9. The apparatus of claim 6, further comprising:
the merging module is used for merging a plurality of pieces of description information with the same description content to obtain a piece of merged description information;
and the second distribution module is used for distributing a retrieval identifier for the merged description information according to the retrieval identifiers respectively corresponding to the plurality of pieces of description information before merging, and establishing the corresponding relation between the retrieval identifiers respectively corresponding to the plurality of pieces of description information before merging and the retrieval identifier of the merged description information.
10. The apparatus of claim 6, further comprising:
and the second storage module is used for extracting and storing the generation time, the level information, the recording position information and/or the type information of the first log information.
11. A server, comprising: an apparatus for log processing according to any of claims 6 to 10.
CN201610463674.4A 2016-06-23 2016-06-23 Log processing method and device and server Active CN107544894B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610463674.4A CN107544894B (en) 2016-06-23 2016-06-23 Log processing method and device and server

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610463674.4A CN107544894B (en) 2016-06-23 2016-06-23 Log processing method and device and server

Publications (2)

Publication Number Publication Date
CN107544894A CN107544894A (en) 2018-01-05
CN107544894B true CN107544894B (en) 2022-06-21

Family

ID=60960948

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610463674.4A Active CN107544894B (en) 2016-06-23 2016-06-23 Log processing method and device and server

Country Status (1)

Country Link
CN (1) CN107544894B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110611576B (en) * 2018-06-14 2023-05-09 亿阳信通股份有限公司 Data quality monitoring method, device, equipment and storage medium
CN108958652A (en) * 2018-06-25 2018-12-07 郑州云海信息技术有限公司 A kind of method, apparatus and computer readable storage medium of record log information
CN109446167A (en) * 2018-10-10 2019-03-08 北京北信源软件股份有限公司 A kind of storage of daily record data, extracting method and device

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1955159B1 (en) * 2005-11-12 2012-07-04 Logrhythm, Inc. Log collection, structuring and processing
CN102521269B (en) * 2011-11-22 2013-06-19 清华大学 Index-based computer continuous data protection method
CN102750326A (en) * 2012-05-30 2012-10-24 浪潮电子信息产业股份有限公司 Log management optimization method of cluster system based on downsizing strategy
CN105022751B (en) * 2014-04-28 2019-03-05 深圳华智融科技股份有限公司 Log recording method and system and log reproducting method and system
CN104035729B (en) * 2014-05-22 2017-02-15 中国科学院计算技术研究所 Block device thin-provisioning method for log mapping
WO2015187001A2 (en) * 2014-06-04 2015-12-10 Mimos Berhad System and method for managing resources failure using fast cause and effect analysis in a cloud computing system
CN104283723B (en) * 2014-10-31 2018-09-21 北京蓝汛通信技术有限责任公司 Network access log processing method and processing device
CN105138592B (en) * 2015-07-31 2019-03-26 武汉虹信技术服务有限责任公司 A kind of daily record data storage and search method based on distributed structure/architecture

Also Published As

Publication number Publication date
CN107544894A (en) 2018-01-05

Similar Documents

Publication Publication Date Title
CN107040578B (en) Data synchronization method, device and system
CN105095059A (en) Method and device for automated testing
CN110287696B (en) Detection method, device and equipment for rebound shell process
CN107544894B (en) Log processing method and device and server
CN111399764B (en) Data storage method, data reading device, data storage equipment and data storage medium
CN110321383A (en) Big data platform method of data synchronization, device, computer equipment and storage medium
CN112615758B (en) Application identification method, device, equipment and storage medium
CN107040576A (en) Information-pushing method and device, communication system
CN107357731A (en) Process produces monitoring, analysis and the processing method of core dump problems
CN109582548B (en) Page element circle selection method and device based on non-buried points
CN103475532A (en) Hardware detection method and system thereof
CN106649000A (en) Fault recovery method for real-time processing engine, and corresponding server
CN111723087A (en) Mining method and device of data blood relationship, storage medium and electronic equipment
CN112232290A (en) Data clustering method, server, system, and computer-readable storage medium
CN114598731B (en) Cluster log acquisition method, device, equipment and storage medium
CN115237889A (en) Database switching method and device, storage medium and computer equipment
CN109586994A (en) A kind of whole machine cabinet server burn-in test monitoring method and system
CN112818204B (en) Service processing method, device, equipment and storage medium
CN114448775A (en) Equipment fault information processing method and device, electronic equipment and storage medium
CN108733845B (en) Data processing method and device, computer equipment and storage medium
CN112328498A (en) Service testing method and device, storage medium and electronic device
CN111722783A (en) Data storage method and device
CN112015614B (en) Buried point processing method and device and electronic equipment
CN112306499B (en) Program element extraction method and device
CN112073824B (en) Data processing method and device based on live video

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant