WO2018006721A1

WO2018006721A1 - Method and apparatus for storing log file

Info

Publication number: WO2018006721A1
Application number: PCT/CN2017/090172
Authority: WO
Inventors: 翟学敏
Original assignee: 中兴通讯股份有限公司
Priority date: 2016-07-08
Filing date: 2017-06-27
Publication date: 2018-01-11
Also published as: CN107590162A

Abstract

A method and apparatus for storing a log file. The method comprises: receiving a log file (102); determining a service type of the log file (104); and according to the service type, recording the log file to a corresponding first disk space (106).

Description

Log file storage method and device

Technical field

The present disclosure relates to the field of communications, for example, to a method and apparatus for storing log files.

Background technique

In a variety of systems, logging is a widely used means of information logging and fault location. For example, in the process of locating faults, if each service module can record some important information of the running process, it can greatly help fault analysis and fault location, and the positioning fault often combines multiple information of multiple service modules. , get a comprehensive analysis. When the same log file is recorded, multiple log files can be used to cover the loop. The capacity of each log file is fixed. However, if a service module has a large number of logs generated during a period of time, the logs that have been recorded by the service module will be covered by the loop, which is not conducive to obtaining comprehensive log information, and is not conducive to fault location.

Regarding the above problems existing in the related art, no related solutions have been found.

Summary of the invention

A storage method and device for a log file, which avoids the phenomenon that a log file of one or more service types of the related technology covers log files of other service types.

A method for storing log files, including:

Receive log files;

Determining the type of business of the log file;

Recording the log file to the corresponding first disk space according to the service type.

Optionally, before the recording the log file to the corresponding first disk space according to the service type, the method further includes:

Determine the total disk space on the storage device used to store log files;

The total disk space is divided into a plurality of sub-disk spaces according to a plurality of service types, wherein each of the sub-disk spaces stores a log file of a service type.

Optionally, determine the total disk space on the storage device for storing log files, including one of the following:

Determining the total disk space preset on the storage device for storing log files;

Determining a remaining capacity of the storage device, and the total disk space occupies a preset percentage of the remaining capacity, and determining the total disk space according to the remaining capacity and the preset percentage.

Optionally, determining the service type of the log file includes:

Determining, according to a file prefix of the log file, a service module that generates the log file;

Determining the service type according to the service module.

Optionally, the logging the log file to the corresponding first disk space according to the service type includes:

Determining whether the stored capacity of the first disk space exceeds a preset threshold;

And when the stored capacity exceeds the preset threshold, obtaining a specified log file with the earliest storage time according to a timestamp of multiple log files in the first disk space, and deleting the specified log file;

Recording the log file in the first disk space.

Determining whether the stored capacity of the first disk space exceeds a second preset threshold;

When the stored capacity of the first disk space exceeds a second preset threshold, calculating an index number of the second disk space according to a preset rule;

Recording the log file to the second disk space.

Optionally, recording the log file to the second disk space includes:

After the second disk space already exists, after the data originally stored in the second disk space is deleted, the log file is recorded to the second disk space;

In the case where the second disk space does not exist, after the second disk space is created, the log file is recorded to the second disk space.

A storage device for a log file, comprising:

a receiving module, configured to receive a log file;

a first determining module, configured to determine a service type of the log file;

The recording module is configured to record the log file to the corresponding first disk space according to the service type.

Optionally, the device further includes:

a second determining module, configured to determine, after the recording module records the log file to the corresponding first disk space according to the service type, total disk space for storing the log file on the storage device;

The partitioning module is configured to divide the total disk space into a plurality of sub-disk spaces according to a plurality of service types, wherein each of the sub-disk spaces stores a log file of a service type.

Optionally, the recording module includes:

a determining unit, configured to determine whether the stored capacity of the first disk space exceeds a first preset threshold;

a processing unit, configured to: when the stored capacity exceeds the preset threshold, obtain a specified log file with the earliest storage time according to a timestamp of multiple log files in the first disk space, and delete the specified log file ;as well as

a recording unit configured to record the log file in the first disk space.

A computer readable storage medium. The storage medium is arranged to store program code for performing the following steps:

Receive log files;

Determining the type of business of the log file;

An electronic device comprising:

At least one processor;

a memory communicatively coupled to the at least one processor; wherein

The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to cause the at least one processor to perform the method described above.

In the above solution, the log file is received; the service type of the log file is determined; and the log file is recorded to the corresponding first disk space according to the service type. Because the disk space of the log file is corresponding to the service type, the log files of multiple service types are stored in multiple disk spaces, and the log files of multiple service types are not covered by each other. The phenomenon that log files of multiple service types cover log files of other service types.

DRAWINGS

The drawings illustrated herein are provided to provide an understanding of the following embodiments. In the drawing:

1 is a flowchart of a method of storing a log file of Embodiment 1;

2 is a block diagram showing the structure of a storage device of a log file of Embodiment 2;

3 is a block diagram 1 of an optional structure of a storage device of a log file of Embodiment 2;

4 is a block diagram 2 of an optional structure of a storage device of a log file of Embodiment 2;

5 is a schematic diagram of a limitation of the total capacity occupied by the log of Embodiment 3;

6 is a schematic diagram showing a storage layout of logs of a plurality of service modules of Embodiment 3 on a disk;

FIG. 7 is a schematic structural diagram of hardware of an electronic device according to an embodiment.

detailed description

The technical solutions will be described in detail below with reference to the accompanying drawings in conjunction with the embodiments. The features of the following embodiments and examples may be combined with each other without conflict.

The terms "first", "second" and the like in the specification and claims and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a particular order or order.

Example 1

This embodiment provides a method for storing a log file. FIG. 1 is a flowchart of a method for storing a log file according to the embodiment. As shown in FIG. 1 , the process includes the following steps.

In step 102, a log file is received.

In step 104, the business type of the log file is determined.

In step 106, the log file is recorded to the corresponding first disk space according to the service type.

Through the above steps, the log file is received; the service type of the log file is determined; and the log file is recorded to the corresponding first disk space according to the service type. Because the disk space of the log file is corresponding to the service type, the log files of multiple service types are stored in multiple disk spaces, and the log files of multiple service types are not covered by each other. A problem with log files of multiple business types overwriting log files of other business types.

Optionally, the execution body of the foregoing step may be at least one of a storage device and a control device of the storage device.

Optionally, before the log file is recorded to the corresponding first disk space according to the service type, the foregoing method further includes:

Determine the total disk space on the storage device used to store log files;

The total disk space is divided into multiple subdisk spaces according to multiple service types, wherein each subdisk space stores a log file of a service type.

Optionally, use one of the following two methods to determine the total disk space on the storage device for storing log files:

Determine the total disk space preset on the storage device for storing log files;

Determine the remaining capacity of the storage device, and the total disk space as a percentage of the remaining capacity, and determine the total disk space based on the remaining capacity and the preset percentage.

Optionally, determining the service type of the log file includes: determining a service module for generating a log file according to a file prefix of the log file; and determining a service type according to the service module. Multiple service modules correspond to the service type of multiple generated log files.

Optionally, the log file is recorded to the corresponding first disk space according to the service type, including:

Determining whether the stored capacity of the first disk space exceeds a first preset threshold;

When the stored capacity exceeds the first preset threshold, the specified log file with the earliest storage time is obtained according to the timestamp of multiple log files in the first disk space, and the specified log file is deleted;

Log files are recorded in the first disk space.

When the stored capacity of the first disk space exceeds a second preset threshold, the index number of the second disk space is calculated according to a preset rule;

Log the log file to the second disk space.

If the index of the first disk is A, when the stored capacity of the first disk space exceeds the second preset threshold, the index number of the second disk B=A+a can be obtained by the formula, and a can be a natural number set by the user. .

Optionally, logging the log file to the second disk space includes:

Through the description of the foregoing embodiments, the method of the foregoing embodiment may be implemented by means of software plus a general hardware platform, or may be implemented by hardware. The above technical solution can be embodied in the form of a software product stored in a non-transitory storage medium (such as a read-only memory (ROM), a random access memory (RAM), The magnetic disk or the optical disk may also be stored in a temporary storage medium, and the storage medium includes one or more instructions for causing a terminal device (which may be a mobile phone, a computer, a server, a network device, etc.) to execute the above embodiment. Methods.

Example 2

In this embodiment, a storage device for a log file is provided, and the device can implement the foregoing embodiments and optional embodiments. As used hereinafter, the term "module" may implement software, hardware, or a combination of software and hardware for a predetermined function. The apparatus described in the following embodiments may be implemented in software, hardware, or a combination of software and hardware.

2 is a structural block diagram of a storage device of a log file according to the embodiment. As shown in FIG. 2, the device includes: a receiving module 20, a first determining module 22, and a recording module 24.

The receiving module 20 is arranged to receive a log file.

The first determining module 22 is arranged to determine the type of service of the log file.

The recording module 24 is arranged to record the log file to the corresponding first disk space according to the type of service.

3 is a block diagram of an optional structure of a storage device for a log file according to the embodiment. As shown in FIG. 3, the device may include: a second determining module 30 and a dividing module, in addition to all the modules shown in FIG. 32.

The second determining module 30 is configured to determine the total disk space on the storage device for storing the log file before the recording module records the log file to the corresponding first disk space according to the service type.

The partitioning module 32 is configured to divide the total disk space into a plurality of sub-disk spaces according to a plurality of service types, wherein each sub-disk space stores a log file of a service type.

4 is a block diagram 2 of an optional structure of a storage device for a log file according to the embodiment. On the basis of the foregoing embodiment, the recording module 24 may include: a determining unit 40, a processing unit 42, and a recording unit 44.

The determining unit 40 is configured to determine whether the stored capacity of the first disk space exceeds a first preset threshold.

The processing unit 42 is configured to: when the stored capacity exceeds the first preset threshold, obtain the specified log file with the earliest storage time according to the time stamp of the plurality of log files in the first disk space, and delete the specified log file.

The recording unit 44 is arranged to record a log file in the first disk space.

The foregoing multiple modules may be implemented by software or hardware. For the hardware implementation, the foregoing modules may be implemented by: the foregoing modules are all located in the same processor; or, the multiple modules are respectively located in different combinations in different combinations. In the device.

Example 3

This embodiment provides a method for preventing a log file of a service module from overwriting an important log file of another service module when a log file of a service module increases linearly in a limited disk space.

This embodiment can avoid the problem that a service module log existing in the related art covers the logs recorded by the remaining service modules, and provides a method and apparatus for adaptively dividing the log files.

The embodiment provides a method and a device for automatically splitting a log file, and can set a preset condition, for example, importing a configuration file, where the disk space occupied by the log file can be configured in the configuration file. The disk space occupied by the service modules of the log file can make each service module occupy a fixed disk space, and the disk space between multiple service modules does not affect each other. The storage space of multiple storage devices may be different. You can also configure the storage space of the log file in the configuration file to take up the percentage of the remaining space of the storage device and the percentage of the storage space occupied by each service module.

With this embodiment, it is possible to solve the problem that the log file of the service module covers important log files of other service modules when the linear growth of the log file of one service module is too fast. Compared with the related technology, even if the number of log files of a service module increases linearly in a short time, it can be ensured that important log files recorded by other service modules are not covered by the loop, and comprehensive fault information can be obtained.

5 is a schematic diagram of the limitation of the total capacity occupied by the log in the embodiment, and FIG. 6 is a schematic diagram of the storage layout of the logs of the plurality of service modules (module 1, module 2, ..., module n) of the embodiment on the disk. In FIG. 6, a plurality of files (file-1, file-2, ..., file-x) are logs recorded in the service module (may correspond to the log files in Embodiment 1). Where n and x are positive integers, respectively.

In the configuration file of the preset condition, the “capacity” element can store the total capacity S occupied by the positioning log, and the “modules/module” element can store the module that needs to record the log. “Single file size (per- The file-size) element can store the size of a single file. You can obtain the number of service modules M and the name of each service module by reading the configuration file. The file name prefix of the log file generated by each service module can be the service. The name of the module, the file name can contain a timestamp accurate to the second. Each service module can generate multiple files. The disk space occupied by each service module is S/M, and the number of generated files is S/M/size. S is the total disk capacity occupied by the location log; M is the number of service modules, size is a single file size, and / is a division operator. When the number of files in a business module is full and a new file needs to be generated, the file with the oldest timestamp is automatically deleted.

In order to adapt to the storage space of multiple storage devices, the total remaining space of the disk can be calculated, and the total capacity S that can be occupied is calculated according to the total proportion of the preset. For the service module M1, the percentage occupied by the configuration (percent) The total space occupied by the service module M1 is calculated as S1=S*percent, and the number of generated files is: S1/size. S1 is the total disk space occupied by the service module M1, the size is a single file size, * is a multiplication operator, and / is a division operator. When the number of files of the service module M1 is full and a new file needs to be generated, the file with the oldest timestamp is automatically deleted.

Assume that the number of files that can be generated by each service module calculated by the system configuration file is N (N=S/M/size or N=S1/size), and the log file (the file that stores the log is equivalent to disk space or storage). The space number can be in the range of [0, N-1].

In this embodiment, the method that the log file of a service module does not cover the log files of other service modules may include the following steps.

In step 1, start the system, determine the serial number of the log file of each service module, and if there is no log file in the log directory, the serial number of the log file of all service modules obtained is CIndex(1)=0, CIndex(2)= 0,...CIndex(N-1)=0; If the system is restarted, the last recorded file is obtained according to the timestamp contained in the file name, and the serial number of the last recorded file is obtained, and CIndex(1), CIndex is found. (2), ... CIndex(N-1), the system starts running and logs to the log file with the sequence number CIndex(1), CIndex(2),...CIndex(N-1).

In step 2, after a period of time, for example, when the service module p logs, it is detected that the size of the currently recorded file CIndex(p) has exceeded the size defined by the configuration file, and the current log file may be ended and the file may be switched. According to the formula CIndex'(p)=(CIndex(p)+1)%(N), the sequence number (index number) of the log file to be switched to is CIndex'(p), where % is the remainder operator. , p is an integer, and the value of p is [0, N-1]. It is determined whether there is a log file with the sequence number CIndex'(p). If there is a log file with the sequence number CIndex'(p), the sequence number can be deleted. For the log file of CIndex'(p), store the part of the log file with the serial number CIndex(p) that exceeds the size defined by the configuration file in the storage space where the log file with the serial number CIndex'(p) is located. That is, the log file whose log file number is CIndex'(p) is overwritten by the loop.

Optionally, when the service module q logs, it is found that the size of the currently recorded file CIndex(q) has exceeded the size defined by the configuration file, and the current log file record can be ended, and the file is switched. Calculate the sequence number of the log file to be switched to CIndex'(q) according to the formula CIndex'(q)=(CIndex(q)+1)%(N), and determine whether there is a log file with the sequence number CIndex'(q). If there is a log file with the sequence number CIndex'(q), you can delete the log file with the sequence number CIndex'(q), and the part of the log file with the sequence number CIndex(q) that exceeds the size defined by the configuration file. Stored in the storage space where the log file with the sequence number CIndex'(q) is located, that is, the log file whose log file number is CIndex'(q) is covered by the loop. Where q is an integer, and the value of q is [0, N). -1], and q is not equal to p.

The files recorded by the business module p and the business module q are in the same directory (the same type of log is recorded in Under the same directory), but do not affect each other.

In step three, repeat step two until the system starts the mth day and restart the system. m can be a positive integer.

In step four, step one to step three are repeated, and the service module records the log and the loop coverage without affecting each other.

Example 4

This embodiment provides a storage medium. Optionally, in the embodiment, the foregoing storage medium may be configured to store program code for performing the following steps:

Receive log files;

Determine the business type of the log file;

The log file is recorded to the corresponding first disk space according to the type of the service.

Optionally, in this embodiment, the foregoing storage medium may include a USB flash drive, a Read-Only Memory (ROM), a Random Access Memory (RAM), a mobile hard disk, a magnetic disk, or an optical disk. A variety of non-transitory storage media that can store program code, and can also be transitory storage media.

Optionally, the processor executes the receiving log file according to the stored program code in the storage medium.

Optionally, the processor performs a service type determining the log file according to the stored program code in the storage medium.

Optionally, the processor records, according to the stored program code in the storage medium, the log file to the corresponding first disk space according to the service type.

The processor may also perform the method in the above embodiments in accordance with stored program code in the storage medium.

For examples in this embodiment, reference may be made to the examples described in the above embodiments and alternative embodiments.

The plurality of modules or steps described above may be implemented by a general-purpose computing device, which may be centralized on a single computing device or distributed over a network of multiple computing devices, optionally using computing devices Executable program code is implemented, which may be stored in a storage device for execution by a computing device, and in some cases, may be performed in a different order than that illustrated herein or The steps described are either made separately into a plurality of integrated circuit modules, or a plurality of modules or steps are fabricated as a single integrated circuit module.

This embodiment provides a hardware structure diagram of an electronic device. Referring to FIG. 7, the electronic device includes:

At least one processor 70 is exemplified by a processor 70 in FIG. 7; a memory 71; and a communication interface 72 and a bus 73. Among them, the processor 70, the memory 71, and the communication interface 72 can complete communication with each other through the bus 73. Communication interface 72 can carry signals and data. The processor 70 can call the logic instructions in the memory 71 to perform the methods in the above embodiments.

In addition, the logic instructions in the memory 71 described above may be implemented in the form of a software functional unit and sold or used as a stand-alone product, and may be stored in a computer readable storage medium.

The memory 71 is a computer readable storage medium and can be used to store software programs, computer executable programs, such as program instructions or modules corresponding to the methods in the above embodiments. The processor 70 executes the functional application and the data processing by executing a software program, an instruction or a module stored in the memory 71, that is, implementing the method in the above embodiment.

The memory 71 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may store data created according to usage of the terminal device, and the like. Further, the memory 71 may include a high speed random access memory, and may also include a nonvolatile memory.

Industrial applicability

The storage method and device of the log file are used to avoid the phenomenon that the log files of one or more service types of the related technology cover the log files of other service types.

Claims

A method for storing log files, including:

Receive log files;

Determining the type of business of the log file;

Recording the log file to the corresponding first disk space according to the service type.
The method according to claim 1, before the recording of the log file to the corresponding first disk space according to the service type, the method further includes:

Determine the total disk space on the storage device used to store log files;

The total disk space is divided into a plurality of sub-disk spaces according to a plurality of service types, wherein each of the sub-disk spaces stores a log file of a service type.
The method of claim 2 wherein determining the total disk space on the storage device for storing log files comprises one of the following:

Determining the total disk space preset on the storage device for storing log files;

Determining a remaining capacity of the storage device, and the total disk space occupies a preset percentage of the remaining capacity, and determining the total disk space according to the remaining capacity and the preset percentage.
The method of claim 1, wherein determining the service type of the log file comprises:

Determining, according to a file prefix of the log file, a service module that generates the log file;

Determining the service type according to the service module.
The method of claim 1, wherein the recording the log file to the corresponding first disk space according to the service type comprises:

Determining whether the stored capacity of the first disk space exceeds a preset threshold;

When the stored capacity exceeds the preset threshold, the specified log file with the earliest storage time is obtained according to the timestamp of multiple log files in the first disk space, and the specified log file is deleted; as well as

Recording the log file in the first disk space.
The method of claim 1, wherein the recording the log file to the corresponding first disk space according to the service type comprises:

Determining whether the stored capacity of the first disk space exceeds a second preset threshold;

When the stored capacity of the first disk space exceeds a second preset threshold, calculating an index number of the second disk space according to a preset rule;

Recording the log file to the second disk space.
The method of claim 6 wherein recording the log file to the second disk space comprises:

After the second disk space already exists, after the data originally stored in the second disk space is deleted, the log file is recorded to the second disk space;

In the case where the second disk space does not exist, after the second disk space is created, the log file is recorded to the second disk space.
A storage device for a log file, comprising:

a receiving module, configured to receive a log file;

a first determining module, configured to determine a service type of the log file;

The recording module is configured to record the log file to the corresponding first disk space according to the service type.
The apparatus of claim 8 further comprising:

a second determining module, configured to determine a total disk for storing the log file on the storage device before the recording module records the log file to the corresponding first disk space according to the service type Space;

The partitioning module is configured to divide the total disk space into a plurality of sub-disk spaces according to a plurality of service types, wherein each of the sub-disk spaces stores a log file of a service type.
The apparatus of claim 8 wherein said recording module comprises:

a determining unit, configured to determine whether the stored capacity of the first disk space exceeds a first preset threshold;

a processing unit, configured to: when the stored capacity exceeds the preset threshold, obtain a specified log file with the earliest storage time according to a timestamp of multiple log files in the first disk space, and delete the specified log file ;as well as

a recording unit configured to record the log file in the first disk space.
A computer readable storage medium storing computer executable instructions arranged to perform the method of any of claims 1-7.