WO2021043212A1

WO2021043212A1 - Log data storage method, electronic device and storage medium

Info

Publication number: WO2021043212A1
Application number: PCT/CN2020/113253
Authority: WO
Inventors: 邹佳池
Original assignee: 深圳市道通智能航空技术有限公司
Priority date: 2019-09-03
Filing date: 2020-09-03
Publication date: 2021-03-11
Also published as: CN110727608A; CN110727608B

Abstract

Disclosed is a log data storage method. The method comprises: acquiring log data and a write identifier in a preset cache region, wherein the preset cache region comprises a plurality of storage blocks, and the write identifier comprises a write block address and a write start address; starting from the write start address, writing the log data from the storage block corresponding to the write block address into the preset cache region; acquiring a read block address in the preset cache region; and storing, in a memory, data in the storage block corresponding to the read block address. Further disclosed are an electronic device and a storage medium. In the present invention, log data is written into a cache region in real time, and is then read, as a whole block, into a memory, thereby improving the efficiency of storing the log data in the memory and increasing the throughput of data writing.

Description

Log data storage method, electronic equipment and storage medium

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on September 3, 2019, the application number is 201910829352.0, and the application name is "a method for storing log data, electronic equipment and storage medium", and the entire content of the application is approved The reference is incorporated in this application.

Technical field

This application relates to the field of data processing, and in particular to a storage method, electronic equipment and storage medium of log data.

Background technique

The flight log is an indispensable part of the flight control system. It not only provides developers with means of debugging and simulation during the development phase, but also provides functions similar to the aircraft "black box" for the future productization phase. In the event of an accident, you can understand the cause of the accident by viewing the flight log data.

The flight control system needs to have a fairly high control accuracy. The execution cycle of the system is relatively fast (usually in the microsecond level), and a large amount of flight data will be generated in a short time. Currently, a common method for recording flight logs is to periodically write all log data that needs to be recorded into a memory, such as an SD card, Fash, etc. And this will cause two problems:

Since the log data is written in pieces, rather than in a whole block, the speed at which the data is written into the memory is greatly reduced, thereby reducing the throughput of the total log record data.

Summary of the invention

In order to overcome the problem that the log data recording method in the prior art has a low writing speed to the memory and affects the real-time performance of the system, the purpose of the present invention is to provide a log data storage method, electronic equipment and storage medium.

In order to achieve the above objective, the present invention provides a log data storage method, including:

Acquiring log data and a write identifier in a preset cache area, where the preset cache area includes a plurality of storage blocks, and the write identifier includes a write block address and a write start address;

Writing the log data into the preset buffer area starting from the storage block corresponding to the writing block address and the writing start address;

Acquiring the read block address in the preset cache area;

The data in the storage block corresponding to the read block address is stored in the memory.

Further, before storing the data in the storage block corresponding to the read block address into the memory, the method further includes:

Determine whether there is a storage block to be stored;

If there is a storage block to be stored, the data in the storage block corresponding to the read block address is stored in the memory.

Further, the judging whether there is a data block to be read specifically includes:

Judging whether the read block address and the write block address are the same;

If the read block address and the write block address are different, there is a data block to be read.

Further, after storing the data in the storage block corresponding to the read block address in the memory, the method further includes:

The read block address is updated to the address of the next storage block according to the preset arrangement sequence.

Further, after the log data is written into the preset buffer area from the storage block corresponding to the write block address and the write start address, the method further includes:

The write end address after the log data is written and the address of the memory block where the write end address is located are assigned to the write start address and the write block address, respectively.

Further, the method further includes:

Judging whether the current log data is all written into the preset buffer area;

If not, store the data in the storage block corresponding to the read block address in the memory;

If yes, store all unstored data in the preset cache area into the memory.

Further, the writing of the log data into the preset buffer area starting from the storage block corresponding to the writing block address and the writing start address specifically includes:

Judging the content of the log data, the content of the log data includes a log header and a data packet;

If the log data is a log header, write the log header into the preset buffer area according to the write identifier;

If the log data is a data packet, the data packet is written into the preset buffer area according to a preset cycle according to the writing identifier.

Further, before the obtaining the log data and the writing identifier in the preset cache area, the method further includes:

The preset cache area is allocated, the preset cache area includes a plurality of storage blocks, and the size of the storage block is the same as the storage block size of the memory.

The present invention also provides an electronic device that includes a processor and a memory, the memory stores a log data storage program, the computer-readable program is configured to be executed by the processor, and the log data storage program When executed by the processor, the above-mentioned method is realized.

The present invention also provides a computer-readable storage medium on which a storage program of log data is stored, characterized in that the storage program of log data is executed by a processor to implement the above-mentioned method.

Compared with the prior art, the present invention has the beneficial effect that by acquiring the log data and the write identifier of the preset cache area, the log data is first written into the pre-recorded data from the storage block corresponding to the write block address and the write start address. In the cache area, the data in the storage block corresponding to the read block address is stored in the memory according to the read block address, so that the log data is written into the cache area in real time, and then the entire block is read into the memory to improve the log The efficiency of data storage to the memory ensures that the address written by the memory is block-aligned and improves the throughput of data writing.

Description of the drawings

FIG. 1 is a flowchart of a method for storing log data provided by the first embodiment of the present invention;

2 is a schematic diagram of log data provided by an embodiment of the present invention;

FIG. 3 is a schematic diagram of a cache area provided by an embodiment of the present invention;

4 is a flowchart of a method for storing log data provided by the second embodiment of the present invention;

Fig. 5 is an internal structure diagram of an electronic device provided by an embodiment of the present invention.

detailed description

In the following, the present invention will be further described with reference to the drawings and specific implementations. It should be noted that, provided that there is no conflict, the following embodiments or technical features can be combined to form new embodiments. .

As shown in Figure 1, the log data storage method provided by the embodiment of the present invention is applied to a drone, and the method includes:

Step S101: Obtain log data and a write identifier in a preset cache area, where the preset cache area includes a number of storage blocks, and the write identifier includes a write block address and a write start address.

Among them, log data is generated during the flight of the drone. As shown in Figure 2, the log data includes a log header and at least one data packet. The log header contains data packet information corresponding to each data packet, and each data packet corresponds to a unique Packet ID. The data package information includes the data package ID of the corresponding data package, the data package name and the item list. The item list includes the item name, data type, and data dimension corresponding to each item. By parsing the log header, the data packets in the flight log and the list of entries contained in each data packet can be obtained. That is, by reading the packet information in the log header, the information of each packet can be completely analyzed.

The preset cache area is a storage area in the memory. Before log data is recorded, the preset cache area is first allocated in the memory. As shown in FIG. 3, the preset cache area includes a number of storage blocks 10, and the size of the storage block 10 is the same as the size of the storage block of the memory. For example, the size of the storage block of the memory is 4K, the size of the storage block in the preset cache area is also 4K, and the preset cache area includes 5 storage blocks with a size of 20K. Each storage block corresponds to an address, the writing block address is the address of the storage block in the preset cache area, and the writing start position is the address of the writing position in the storage block.

Step S102: starting from the storage block corresponding to the writing block address and the writing start address, writing the log data into the preset buffer area.

Specifically, when the drone generates log data, it first writes the log data into the preset buffer area in the form of data packets from the write start address according to the storage block corresponding to the write block address and the write start address.

In an embodiment, the data packet information further includes a log data update frequency. The user obtains the update frequency of the log data by analyzing the log header, and the write cycle of the data packet can be set by the update frequency. Since the traditional log writing method is generally written in a fixed period, for example, the set period is 1ms, but the update frequency of some data is low, for example, 1s. If data is written in the set period, redundancy will occur. I data. In this application, by acquiring the data update frequency in the log header, and setting the data writing period according to the update frequency, different writing periods can be set for log data with different update frequencies, thereby reducing redundant log information.

It should be noted that the write cycle can also be set to a fixed cycle according to the update frequency of the log data.

For example, please refer to Figure 3. The shaded area in the figure is the area where data has been stored, and the blank area is the area where data is not stored. Define the write block address as head and the write start address as index. The initial values of head and index are both If it is 0, the processor calculates the corresponding storage block according to the obtained head value, and writes the log data from the position corresponding to the index.

In one embodiment, after the log data is written into the preset buffer area, the write end address after the log data is written and the address of the memory block where the write end address is located are respectively assigned to the write start Address and write block address. For example, after the current storage block is full, the head is updated to the address of the next storage block. After the current data packet is written, head is the address of the storage block where the write end address is located. After the writing of the current data packet is completed, the current writing end position is assigned to index for the next call. When the last storage block is full, write data again from the first storage block.

Step S103: Obtain the read block address in the preset cache area.

Wherein, the read block address is the address of the storage block in the preset cache area.

Step S104: Store the data in the storage block corresponding to the read block address in the memory.

In one embodiment, it is first determined whether there is a storage block to be stored. If there is a storage block to be stored, the data in the storage block corresponding to the read block address is stored in the memory. If there is no storage block to be stored, Block, no data is read.

Among them, judging whether there is a data block to be read specifically includes: judging whether the read block address and the write block address are the same, if the read block address and the write block address are different, then there is a data block to be read, if the block is read If the address is the same as the write block address, there is no data block to be read. For example, it is judged whether the head and tail are the same. If they are different, there is a data block to be read. If they are the same, there is no data block to be read. That is, if the current storage block in the preset cache area is not full, it cannot The log data of the current storage block is stored in the memory. After the current storage block is full, the data of the storage block corresponding to the read block address is stored in the memory, and the corresponding storage block is cleared at the same time. Therefore, the data is always Stored in units of storage blocks.

In one embodiment, after the data in the current data block is stored in the memory, the read block address is updated to the address of the next storage block according to the preset arrangement sequence. The preset arrangement order is the arrangement order of the storage blocks. After the data in the current data block is stored in the memory, the read block address is updated to the address of the next adjacent storage block for the next call. Because the process of writing log data into the preset buffer area is circular writing, the process of storing log data in the memory is also circular storage, that is, after the data in the last storage block is fully stored in the memory, it starts to store in the first storage block The data.

During the log data writing process, when the log data is written into the memory, the writing task has been waiting for the response from the storage device, and the response is received to indicate that the writing is complete, and this period of time is the longest time in the data writing process of. The traditional log writing method generally writes data directly in the current thread that needs to write data. If the current thread is a high-priority task, while waiting for the memory response, the lower-priority tasks cannot be executed. Destroy the real-time nature of the system. In one embodiment, the log data writing task is set as a low-priority task, and the processor's task processing adopts a multithreading mechanism. While waiting for the memory response, the writing task is suspended so that it can be High-priority tasks preempt, thereby ensuring the real-time performance of the system.

In another embodiment, before storing the data block in the memory, it is determined whether the current log data is all written into the preset cache area, if not, step S104 is executed; if so, the data in the preset cache area All unstored data is stored in the memory, that is, if logging data is stopped, all data remaining in the preset buffer area is stored in the memory at once.

Wherein, when the data packets corresponding to the log header are all written into the preset area, the current log data are all written into the preset buffer area. When the current log data is all written into the preset cache area, there are one or more storage blocks currently to be read, and the data in all read storage blocks in the preset cache area are stored in the memory at one time. Waiting to read the next log data.

The log data storage method provided in the above embodiment first writes log data into a preset buffer area according to the write block address and the write start address, and then reads the corresponding block address in the buffer area according to the read block address. The data in the storage block is stored in the memory, thereby realizing the whole block storage of log data, improving data storage efficiency, increasing the throughput of data writing, and ensuring the real-time nature of system processing tasks.

As shown in Figure 4, the log data storage method provided by the second embodiment of the present invention differs from the first embodiment in that the method further includes:

Step S201: Determine the content of the log data. The content of the log data includes a log header and a data packet; if the log data is a log header, step S202 is executed; if the log data is a data packet, step S203 is executed.

Step S202: Write the log header into the preset buffer area according to the write identifier.

Step S203: Write the data packet into the preset buffer area according to the preset cycle according to the write identifier.

Specifically, when log data starts to be written into the preset cache area, a log header is first generated. If the acquired data is a log header, when the complete log header is obtained, the log header is written into the preset cache area. By parsing the log header, the information update frequency is obtained, and the write cycle of the data packet is set according to the information update frequency. When the acquired data is a data packet, the data packet is written into the preset buffer area according to the set write cycle . For example, the time when the write function is called is set by the information update frequency, and the write function writes data according to the set calling time.

In the above embodiment, if the acquired data is a log header, the log header is written into the preset buffer area, and if the acquired data is a data packet, the data packet is written into the preset buffer area according to the set period , Which can reduce redundant log information.

The present invention also provides an electronic device. FIG. 5 is an internal structure diagram of the electronic device provided by the present invention.

In this embodiment, the electronic device may be a PC (Personal Computer, personal computer), or a terminal device such as a smart phone, a tablet computer, or a portable computer. The electronic device includes at least a memory 11, a processor 12, a communication bus 13, and a network interface 14.

The memory 11 includes at least one type of readable storage medium, and the readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), magnetic memory, magnetic disk, optical disk, and the like. In some embodiments, the memory 11 may be an internal storage unit of an electronic device, such as a hard disk of the electronic device. In other embodiments, the memory 11 may also be an external storage device of the electronic device, such as a plug-in hard disk, a smart media card (SMC), and a secure digital (SD) card equipped on the electronic device. Flash Card, etc. Further, the memory 11 may also include both an internal storage unit of an electronic device and an external storage device. The memory 11 can be used not only to store application software and various data installed in the electronic device, such as the code of the log data storage method program 01, etc., but also to temporarily store data that has been output or will be output.

In some embodiments, the processor 12 may be a central processing unit (CPU), controller, microcontroller, microprocessor, or other data processing chip, for running program codes or processing stored in the memory 11 Data, such as the storage method program 01 of the execution log data, etc.

The bus 13 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus. The bus can be divided into address bus, data bus, control bus and so on. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.

Further, the electronic device may also include a network interface 14. The network interface 14 may optionally include a wired interface and/or a wireless interface (such as a WI-FI interface, a Bluetooth interface, etc.), which is usually used to connect the electronic device to other electronic devices. Establish a communication connection between.

Figure 5 only shows an electronic device with components 11-14 and log data storage method program 01. Those skilled in the art can understand that the structure shown in Figure 5 does not constitute a limitation on the electronic device, and may include comparisons. Fewer or more parts are shown, or some parts are combined, or different parts are arranged.

It can be known from the description of the above embodiments that those skilled in the art can clearly understand that the present invention can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution of the present invention can be embodied in the form of a software product in essence or a part that contributes to the existing technology. The present invention also relates to a computer-readable storage medium, such as ROM/RAM, magnetic disk, optical disc, etc., on which a computer program is stored, and the method for storing log data is realized when the computer program is executed by a processor.

It should be noted that the sequence numbers of the above-mentioned embodiments of the present invention are only for description, and do not represent the superiority of the embodiments. And the terms "include", "include" or any other variants thereof in this article are intended to cover non-exclusive inclusion, so that a process, device, article or method including a series of elements not only includes those elements, but also includes those elements that are not explicitly included. The other elements listed may also include elements inherent to the process, device, article, or method. If there are no more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, device, article, or method that includes the element.

It can be known from the description of the above embodiments that those skilled in the art can clearly understand that the present invention can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution of the present invention can be embodied in the form of a software product in essence or a part that contributes to the existing technology. The present invention also relates to a computer-readable storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., on which a computer program is stored, and the computer program is executed by a processor to realize the above method.

The foregoing embodiments are only preferred embodiments of the present invention, and cannot be used to limit the scope of protection of the present invention. Any insubstantial changes and substitutions made by those skilled in the art on the basis of the present invention belong to the present invention. The scope of protection required.

Claims

A method for storing log data, which is characterized in that it includes:

Acquiring log data and a write identifier in a preset cache area, where the preset cache area includes a plurality of storage blocks, and the write identifier includes a write block address and a write start address;

Writing the log data into the preset buffer area starting from the storage block corresponding to the writing block address and the writing start address;

Acquiring the read block address in the preset cache area;

The data in the storage block corresponding to the read block address is stored in the memory.
5. The log data storage method according to claim 1, wherein before storing the data in the storage block corresponding to the read block address in the memory, the method further comprises:

Determine whether there is a storage block to be stored;

If there is a storage block to be stored, the data in the storage block corresponding to the read block address is stored in the memory.
3. The log data storage method according to claim 2, wherein said determining whether there is a data block to be read specifically comprises:

Judging whether the read block address and the write block address are the same;

If the read block address and the write block address are different, there is a data block to be read.
5. The log data storage method according to claim 1, wherein after storing the data in the storage block corresponding to the read block address in the memory, the method further comprises:

The read block address is updated to the address of the next storage block according to the preset arrangement sequence.
The method for storing log data according to claim 1, wherein the log data is written into the preset buffer area starting from the storage block corresponding to the writing block address and the writing start address After the middle, the method further includes:

The write end address after the log data is written and the address of the memory block where the write end address is located are assigned to the write start address and the write block address, respectively.
5. The log data storage method according to claim 1, wherein the method further comprises:

Judging whether the current log data is all written into the preset buffer area;

If not, store the data in the storage block corresponding to the read block address in the memory;

If yes, store all unstored data in the preset cache area into the memory.
The log data storage method according to claim 1, wherein the log data is written into the preset starting address from the storage block corresponding to the writing block address and the writing start address. The cache area includes:

Judging the content of the log data, the content of the log data includes a log header and a data packet;

If the log data is a log header, write the log header into the preset buffer area according to the write identifier;

If the log data is a data packet, the data packet is written into the preset buffer area according to a preset cycle according to the write identifier.
5. The log data storage method according to claim 1, wherein before said obtaining the log data and the write identifier in the preset cache area, the method further comprises:

The preset cache area is allocated, the preset cache area includes a plurality of storage blocks, and the size of the storage block is the same as the storage block size of the memory.
An electronic device, comprising a processor and a memory, the memory storing a log data storage program, the computer-readable program is configured to be executed by the processor, and the log data storage program When executed by the processor, the method according to any one of claims 1-8 is implemented.
A computer-readable storage medium with a log data storage program stored thereon, wherein the log data storage program is executed by a processor to implement the method according to any one of claims 1-8.