CN107391762A - The processing method and processing device of daily record data - Google Patents
The processing method and processing device of daily record data Download PDFInfo
- Publication number
- CN107391762A CN107391762A CN201710752714.1A CN201710752714A CN107391762A CN 107391762 A CN107391762 A CN 107391762A CN 201710752714 A CN201710752714 A CN 201710752714A CN 107391762 A CN107391762 A CN 107391762A
- Authority
- CN
- China
- Prior art keywords
- identification code
- data
- log information
- daily record
- log
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/258—Data format conversion from or to a database
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/1805—Append-only file systems, e.g. using logs or journals to store data
- G06F16/1815—Journaling file systems
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Storage Device Security (AREA)
- Debugging And Monitoring (AREA)
Abstract
The embodiments of the invention provide a kind of processing method and processing device of daily record data, this method includes：The identification code and supplemental characteristic of every log information are obtained, log information includes format data and supplemental characteristic, and identification code is unique daily record generation mark corresponding to every log information in log data；Corresponding relation between the identification code, supplemental characteristic and identification code and supplemental characteristic of each log information is generated into journal file, stores journal file；When carrying out daily record parsing, formatted file corresponding with journal file is obtained, formatted file includes the corresponding relation between identification code, format data and identification code and the format data of every log information in log data；Journal file and formatted file are parsed according to identification code, obtain corresponding log information.The present invention can greatly reduce the memory space of daily record data occupancy, and the performance of daily record is write in lifting, and reduce causes the risk divulged a secret because plaintext daily record prints.
Description
Technical field
The present invention relates to technical field of data processing, more particularly to a kind of processing method and processing device of daily record data.
Background technology
Daily record data is the significant data of orientation problem in communication system.Such as：Certain mobile subscriber complains, and he is before three days
Somewhere poor signal, make a phone call always to go offline.We can not allow client to come back to the old place and make a phone call again, only
Analyzing and positioning can be carried out to problem by the daily record data of backstage storage.Meanwhile the storable daily record data amount of system background, it is right
It is same critically important for case study positioning.Such as：One communication system backstage can only store 1000MByte daily record data,
And 500MByte daily record data can be produced daily, then, this system can only at most store the daily record data of two days, for three days
Preceding produced problem can not just position, and then lead to not produced problem before solving three days that user is complained.Moreover, by
Possesses high real-time in communication system requirements, the influence of the process performance of daily record to communication system is very big.
Problems with least be present in inventor in realizing process of the present invention invents existing daily record data processing method：Day
Will data take a large amount of memory spaces, and then influence systematic function；And the printing of plaintext daily record data also results in what is divulged a secret
Risk.Therefore, more detailed daily record data can be stored safe efficiently by how providing one kind, and it is whole not influence communication system
The daily record data processing method of body performance is significant.
The content of the invention
In view of the above problems, it is proposed that the present invention so as to provide one kind overcome above mentioned problem or at least in part solve on
State the processing method and processing device of the daily record data of problem.
One aspect of the present invention, there is provided a kind of processing method of daily record data, this method include:
The identification code and supplemental characteristic of every log information are obtained, the log information includes format data and parameter number
According to the identification code is unique daily record generation mark corresponding to every log information in log data；
Corresponding relation between the identification code, supplemental characteristic and identification code and supplemental characteristic of each log information is generated
Journal file, store the journal file；
When carrying out daily record parsing, formatted file corresponding with the journal file is obtained, the formatted file includes institute
Between identification code, format data and identification code and the format data of stating every log information in log data
Corresponding relation；
The journal file and the formatted file are parsed according to the identification code, obtain corresponding daily record letter
Breath.
Wherein, it is described that the journal file and the formatted file are parsed according to the identification code, including：
In the journal file and the formatted file will there is the supplemental characteristic of same identification code and format data to press
It is combined according to specified rule.
Wherein, before the identification code and supplemental characteristic of every log information of the acquisition, in addition to：
The log data is read, every log information in the log data is numbered, will be right
The identification code as the log information should be numbered；
The log data is parsed, extracts and is repeated out in every log information of the log data
Existing format data, by between the format data of every log information, identification code and identification code and format data
Corresponding relation generates the formatted file.
Wherein, it is described to read the log data, every log information in the log data is carried out
Numbering, including：
Log information is read from the log data according to daily record printing interface keyword, successively to the day of reading
Will information is numbered.
Wherein, it is described the journal file and the formatted file are parsed according to the identification code after, institute
Stating method also includes：
The log information parsed is output to specified file.
Another aspect of the present invention, there is provided a kind of processing unit of daily record data, it is single that the device includes daily record storage
Member and daily record resolution unit, the log storage unit include extraction module and the first generation module, the daily record resolution unit
Including acquisition module and parsing module:
Extraction module, for extracting the identification code and supplemental characteristic of every log information, the log information includes form
Change data and supplemental characteristic, the identification code is unique daily record generation mark corresponding to every log information in log data
Know；
First generation module, for by the identification code of each log information, supplemental characteristic and identification code and supplemental characteristic
Between corresponding relation generation journal file, store the journal file；
Acquisition module, for when carrying out daily record parsing, obtaining formatted file corresponding with the journal file, the lattice
Formula file includes identification code, format data and the identification code and form of every log information in the log data
Change the corresponding relation between data；
Parsing module, for being parsed according to the identification code to the journal file and the formatted file, obtain
Corresponding log information.
Wherein, the parsing module, specifically for will there is like-identified in the journal file and the formatted file
The supplemental characteristic and format data of code are combined according to specified rule, obtain corresponding log information.
Wherein, described device also includes log integrity unit, and the log integrity unit includes mark module and the
Two generation modules：
Mark module, for reading the log data, to every log information in the log data
It is numbered, the identification code using reference numeral as the log information；
Second generation module, for being parsed to the log data, extract the every of the log data
The format data repeated in bar log information, by the format data of every log information, identification code and identification code
Corresponding relation between format data generates the formatted file.
In addition, present invention also offers a kind of computer-readable recording medium, computer program is stored thereon with, the program
The step of method as described above is realized when being executed by processor.
In addition, present invention also offers a kind of computer equipment, including memory, processor and storage are on a memory simultaneously
The computer program that can be run on a processor, the step of realizing method as described above during the computing device described program.
The processing method and processing device of daily record data provided in an embodiment of the present invention, in existing daily record data processing method
The problem of existing, on the premise of being read not influenceing the later stage, the memory space of daily record data occupancy is greatly reduced, lifting is write
The performance of daily record, reduce causes the risk divulged a secret because plaintext daily record prints.The present invention stores more detailed not only safe efficiently
Thin daily record data, and the overall performance of communication system will not be impacted.
Described above is only the general introduction of technical solution of the present invention, in order to better understand the technological means of the present invention,
And can be practiced according to the content of specification, and in order to allow above and other objects of the present invention, feature and advantage can
Become apparent, below especially exemplified by the embodiment of the present invention.
Brief description of the drawings
By reading the detailed description of hereafter preferred embodiment, it is various other the advantages of and benefit it is common for this area
Technical staff will be clear understanding.Accompanying drawing is only used for showing the purpose of preferred embodiment, and is not considered as to the present invention
Limitation.And in whole accompanying drawing, identical part is denoted by the same reference numerals.In the accompanying drawings：
Fig. 1 is a kind of flow chart of the processing method of daily record data of the embodiment of the present invention；
Fig. 2 is a kind of flow chart of the processing method of daily record data of another embodiment of the present invention；
Fig. 3 is a kind of specific implementation flow of the processing method of daily record data of another embodiment of the present invention；
Fig. 4 is a kind of structural representation of the processing unit of daily record data of the embodiment of the present invention；
Fig. 5 is a kind of structural representation of the processing unit of daily record data of another embodiment of the present invention；
Fig. 6 is the schematic diagram of the computer equipment of the embodiment of the present invention.
Embodiment
The exemplary embodiment of the disclosure is more fully described below with reference to accompanying drawings.Although the disclosure is shown in accompanying drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here
Limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure
Completely it is communicated to those skilled in the art.
Those skilled in the art of the present technique are appreciated that unless otherwise defined, all terms used herein (including technology art
Language and scientific terminology), there is the general understanding identical meaning with the those of ordinary skill in art of the present invention.Should also
Understand, those terms defined in such as general dictionary, it should be understood that have with the context of prior art
The consistent meaning of meaning, and unless by specific definitions, otherwise will not be explained with the implication of idealization or overly formal.
It is an object of the present invention on the premise of later stage log read is not influenceed, the storage that daily record data takes is reduced
The performance of daily record is write in space, lifting, reduces due to the risk that plaintext daily record prints and divulges a secret, to realize the mesh of the present invention
, the embodiments of the invention provide a kind of processing method of daily record data.
Fig. 1 diagrammatically illustrates the flow chart of the processing method of the daily record data of one embodiment of the invention.Reference picture 1,
The processing method of the daily record data of the embodiment of the present invention specifically includes following steps：
S11, the identification code and supplemental characteristic for obtaining every log information, the log information include format data and ginseng
Number data, the identification code are unique daily record generation mark corresponding to every log information in log data.Wherein, institute
It can be the character that numbering, mark etc. have mark action to state identification code.
Log data in the present embodiment refers to system source code, and each bar daily record letter is included in system source code
Cease, include format data and supplemental characteristic in every log information.Wherein, format data is specially in log information
Format string, supplemental characteristic are specially the data portions contents of variable element in log information.In the embodiment of the present invention, source
Every log information in code is respectively provided with a unique daily record generation identification code.
S12, by the corresponding relation between the identification code, supplemental characteristic and identification code and supplemental characteristic of each log information
Journal file is generated, stores the journal file.
In the present embodiment, system operation carry out daily record printing when, this implementations only preservation daily record identification code with it is variable
The data portions contents of parameter, it is not necessary to be formatted to daily record, and format string need not be preserved.Last daily record
Data are saved as binary journal file, such as log_data.dat.
S13, when carrying out daily record parsing, obtain corresponding with journal file formatted file, the formatted file bag
Include every log information in the log data identification code, format data and identification code and format data it
Between corresponding relation.
In the present embodiment, in advance by the identification code of every log information, format data and identification code with formatting number
Corresponding relation generation formatted file between, and text is preserved into, such as log_describe.dat.Carrying out day
When will parses, first by obtaining formatted file corresponding with journal file, so as to literary to daily record subsequently according to the formatted file
Part carries out parsing reduction.
S14, according to the identification code journal file and the formatted file are parsed, obtain corresponding daily record
Information.
Wherein, it is described that the journal file and the formatted file are parsed according to the identification code, especially by
Following steps are realized：By the supplemental characteristic in the journal file and the formatted file with same identification code and format number
It is combined according to according to specified rule.
In the present embodiment, by handling log_describe.dat and log_data.dat files, and then two
The journal file of system is reduced into readable information.
The processing method of daily record data provided in an embodiment of the present invention, present in existing daily record data processing method
Problem, when carrying out daily record printing, the identification code and supplemental characteristic of every log information are obtained, by the mark of each log information
Corresponding relation generation journal file between code, supplemental characteristic and identification code and supplemental characteristic, stores journal file；Carry out
When daily record parses, formatted file corresponding with journal file is obtained, and then journal file and formatted file are entered according to identification code
Row parsing, corresponding log information is obtained, on the premise of the embodiment of the present invention can be read not influenceing the later stage, greatly reduces day
The performance of daily record is write in the memory space that will data take, lifting, and reduce causes the risk divulged a secret because plaintext daily record prints.
The present invention stores more detailed daily record data not only safe efficiently, and will not be to the globality of communication system
It can impact.
In an alternate embodiment of the present invention where, in step S14 according to the identification code to the journal file
After being parsed with the formatted file, methods described is further comprising the steps of：The log information parsed is output to finger
Determine file.
The embodiment of the present invention, by the way that the log information parsed is output into specified file, such as log.txt.Now
Content inside log.txt is generally readable text log.
Fig. 2 diagrammatically illustrates the flow chart of the processing method of the daily record data of another embodiment of the present invention.Reference picture
2, the processing method of the daily record data of the embodiment of the present invention, the identification code and ginseng of every log information of acquisition in step s 11
It is further comprising the steps of before number data：
S01, the log data is read, every log information in the log data is numbered,
Identification code using reference numeral as the log information.The reading log data in the present embodiment, to the original
Every log information in beginning daily record data is numbered, and is realized especially by following steps：It is crucial according to daily record printing interface
Word reads log information from the log data, and the log information of reading is numbered successively.
S10, the log data is parsed, extract weight in every log information of the log data
Appear again existing format data, by the format data of every log information, identification code and identification code and format data it
Between corresponding relation generate the formatted file.
Log data in the present embodiment is specially system source code.The embodiment of the present invention passes through scanning system source generation
Code, encodes, every log information is printed with a unique number successively to every log information in source code.Then
By scanning source code, the numbering and format string of every log information in source code are extracted, preserves into text.
Below by a specific embodiment, the implementation process of technical solution of the present invention is specifically described, specifically
Reference can be made to Fig. 3.
If have in system source code WRITE_LOG (0xFFFFFFFF, " and hello world, %d n ", 2017) so
A line print code, is scanned to source code first, according to daily record printing interface keyword WRITE_LOG, successively to each
Bar printing is numbered, and numbers in system source code uniquely, and the printing of example from above is such as encoded to WRITE_LOG
(0x10000001, " and hello world, %d n ", 2017), be written back in source code.
Source code is scanned, according to the numbering of each printing of daily record printing interface keyword extraction and formats word
Symbol string, as the 0x10000001 in illustrating and " hello world, %d n ", and be saved in log_describe.dat.
During system progress, other modules call log storage unit interface WRITE_LOG to enter row write journalizing.
Come into from WRITE_LOG interfaces and daily record unique number and supplemental characteristic are obtained in the parameter come, in citing
0x10000001 and 2017.
Journal number 0x10000001 and supplemental characteristic 2017 are saved in binary file log_ by certain form
In data.dat.
Daily record data is read one by one from log_data.dat, obtains daily record unique number and corresponding print parameters data
(such as the 0x10000001 and 2017 of citing).
Corresponding format string is found (as illustrated from log_describe.dat files according to daily record unique number
" hello world, %d n ").
According to format string " hello world, %d n ", and corresponding supplemental characteristic 2017 is reduced into text
Content " hello world, 2017 ".
The content of text restored, " hello world, 2017 " are output to file, such as log.txt.Now
Content inside log.txt be with the text log content that we usually see just as.
Compared with prior art, the processing method of daily record data provided in an embodiment of the present invention possesses following beneficial effect：
Due to only preserving the numerical value of journal number and variable element, the larger format string of space-consuming is not preserved, therefore greatly
Reduce the memory space that daily record data takes；Due to that need not be formatted operation to daily record, therefore the property of daily record is write in lifting
Energy；Due to only preserving the binary data such as journal number and variable element numerical value, if do not parsed by daily record resolution system,
It can not understand, therefore be reduced due to the risk that plaintext daily record prints and divulges a secret at all.
For embodiment of the method, in order to be briefly described, therefore it is all expressed as to a series of combination of actions, but this area
Technical staff should know that the embodiment of the present invention is not limited by described sequence of movement, because implementing according to the present invention
Example, some steps can use other orders or carry out simultaneously.Secondly, those skilled in the art should also know, specification
Described in embodiment belong to preferred embodiment, necessary to the involved action not necessarily embodiment of the present invention.
Fig. 4 diagrammatically illustrates the structural representation of the processing unit of the daily record data of one embodiment of the invention.Reference
Fig. 4, the processing unit of the daily record data of the embodiment of the present invention include log storage unit 10 and daily record resolution unit 20.
In the present embodiment, log storage unit 10 further comprises the generation module 102 of extraction module 101 and first, wherein：
Extraction module 101, for extracting the identification code and supplemental characteristic of every log information, the log information includes format data
And supplemental characteristic, the identification code are unique daily record generation mark corresponding to every log information in log data；The
One generation module 102, for pair between the identification code, supplemental characteristic and identification code and supplemental characteristic by each log information
Generation journal file should be related to, store the journal file；
In the present embodiment, daily record resolution unit 20 includes acquisition module 201 and parsing module 202, wherein:Acquisition module
201, for when carrying out daily record parsing, obtaining formatted file corresponding with the journal file, the formatted file includes institute
Between identification code, format data and identification code and the format data of stating every log information in log data
Corresponding relation；Parsing module 202, for being parsed according to the identification code to the journal file and the formatted file,
Obtain corresponding log information.
In an alternate embodiment of the present invention where, the parsing module 202, specifically for by the journal file and institute
State the supplemental characteristic in formatted file with same identification code and format data is combined according to specified rule, obtain correspondingly
Log information.
In an alternate embodiment of the present invention where, the printing that the daily record resolution unit 20 also includes not shown in figure is defeated
Go out module, the printout module, in parsing module 202 according to the identification code to the journal file and the form
After file is parsed, the log information parsed is output to specified file.
Fig. 5 diagrammatically illustrates the structural representation of the processing unit of the daily record data of another embodiment of the present invention.Ginseng
According to Fig. 5, the processing unit of the daily record data of the embodiment of the present invention also includes log integrity unit 30, the log integrity list
Member 30 includes the generation module 301 of mark module 301 and second, wherein：Mark module 301, for reading the original log number
According to every log information in the log data being numbered, the mark using reference numeral as the log information
Know code；Second generation module 302, for being parsed to the log data, extract the every of the log data
The format data repeated in bar log information, by the format data of every log information, identification code and identification code
Corresponding relation between format data generates the formatted file.
In the present embodiment, the mark module 301 is specifically used for reading the log data, is connect according to daily record printing
Mouth keyword reads log information from the log data, and the log information of reading is numbered successively.
For device embodiment, because it is substantially similar to embodiment of the method, so description is fairly simple, it is related
Part illustrates referring to the part of embodiment of the method.
Device embodiment described above is only schematical, wherein the unit illustrated as separating component can
To be or may not be physically separate, it can be as the part that unit is shown or may not be physics list
Member, you can with positioned at a place, or can also be distributed on multiple NEs.It can be selected according to the actual needs
In some or all of module realize the purpose of this embodiment scheme.Those of ordinary skill in the art are not paying creativeness
Work in the case of, you can to understand and implement.
The processing method and processing device of daily record data provided in an embodiment of the present invention, in existing daily record data processing method
The problem of existing, on the premise of being read not influenceing the later stage, the memory space of daily record data occupancy is greatly reduced, lifting is write
The performance of daily record, reduce causes the risk divulged a secret because plaintext daily record prints.The present invention stores more detailed not only safe efficiently
Thin daily record data, and the overall performance of communication system will not be impacted.
In addition, the embodiment of the present invention additionally provides a kind of computer-readable recording medium, computer program is stored thereon with,
The step of program realizes method as described above when being executed by processor.
In the present embodiment, if module/unit that the processing unit of the daily record data integrates is with SFU software functional unit
Form is realized and is used as independent production marketing or in use, can be stored in a computer read/write memory medium.Base
In such understanding, the present invention realizes all or part of flow in above-described embodiment method, can also pass through computer program
To instruct the hardware of correlation to complete, described computer program can be stored in a computer-readable recording medium, the calculating
Machine program when being executed by processor, can be achieved above-mentioned each embodiment of the method the step of.Wherein, the computer program includes
Computer program code, the computer program code can be source code form, object identification code form, executable file or certain
A little intermediate forms etc..The computer-readable medium can include：Any entity of the computer program code can be carried
Or device, recording medium, USB flash disk, mobile hard disk, magnetic disc, CD, computer storage, read-only storage (ROM, Read-Only
Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software
Distribution medium etc..It should be noted that the content that includes of the computer-readable medium can be according to making laws in jurisdiction
Appropriate increase and decrease is carried out with the requirement of patent practice, such as in some jurisdictions, according to legislation and patent practice, computer
Computer-readable recording medium does not include electric carrier signal and telecommunication signal.
Fig. 6 is the schematic diagram of computer equipment provided in an embodiment of the present invention.Computer provided in an embodiment of the present invention is set
It is standby, including memory 501, processor 502 and it is stored in the computer journey that can be run on memory 501 and on processor 502
Sequence, the processor 502 are realized when performing the computer program in the processing method embodiment of above-mentioned each daily record data
Step, such as S11, the identification code and supplemental characteristic of every log information of acquisition shown in Fig. 1, the log information include form
Change data and supplemental characteristic, the identification code is unique daily record generation mark corresponding to every log information in log data
Know；S12, by between the identification code, supplemental characteristic and identification code and supplemental characteristic of each log information corresponding relation generate
Journal file, store the journal file；S13, when carrying out daily record parsing, it is literary to obtain corresponding with journal file form
Part, the formatted file include identification code, format data and the mark of every log information in the log data
Know the corresponding relation between code and format data；S14, according to the identification code to the journal file and the formatted file
Parsed, obtain corresponding log information.Or the processor 502 realize when performing the computer program it is above-mentioned each
The function of each module/unit in the processing unit embodiment of daily record data, such as the generation of extraction module 101, first shown in Fig. 4
Module 102, acquisition module 201 and parsing module 202.
Exemplary, the computer program can be divided into one or more module/units, one or more
Individual module/unit is stored in the memory, and by the computing device, to complete the present invention.It is one or more
Individual module/unit can be the series of computation machine programmed instruction section that can complete specific function, and the instruction segment is used to describe institute
State implementation procedure of the computer program in the processing unit of the daily record data.For example, the computer program can be divided
Extraction module 101, the first generation module 102, acquisition module 201 and parsing module 202 are cut into, each module concrete function is as follows：
Extraction module 101, for extracting the identification code and supplemental characteristic of every log information, the log information includes format data
And supplemental characteristic, the identification code are unique daily record generation mark corresponding to every log information in log data；The
One generation module 102, for pair between the identification code, supplemental characteristic and identification code and supplemental characteristic by each log information
Generation journal file should be related to, store the journal file；Acquisition module 201, for when carrying out daily record parsing, obtain and institute
Formatted file corresponding to journal file is stated, the formatted file includes the mark of every log information in the log data
Corresponding relation between knowledge code, format data and identification code and format data；Parsing module 202, for according to
Identification code parses to the journal file and the formatted file, obtains corresponding log information.
The computer equipment can be that the calculating such as desktop PC, notebook, palm PC and cloud server are set
It is standby.The computer equipment may include, but be not limited only to, processor, memory.It is it will be understood by those skilled in the art that described
Schematic diagram 6 be only computer equipment example, do not form the restriction to computer equipment, can include than illustrate it is more or
Less part, some parts or different parts are either combined, such as the computer equipment can also be defeated including inputting
Go out equipment, network access equipment, bus etc..
The processor can be CPU (Central Processing Unit, CPU), can also be it
His general processor, digital signal processor (Digital Signal Processor, DSP), application specific integrated circuit
(Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field-
Programmable Gate Array, FPGA) either other PLDs, discrete gate or transistor logic,
Discrete hardware components etc..General processor can be microprocessor or the processor can also be any conventional processor
Deng the processor is the control centre of the computer equipment, utilizes various interfaces and the whole computer equipment of connection
Various pieces.
The memory can be used for storing the computer program and/or module, and the processor is by running or performing
The computer program and/or module being stored in the memory, and the data being stored in memory are called, described in realization
The various functions of computer equipment.The memory can mainly include storing program area and storage data field, wherein, storage program
Area can storage program area, the application program (such as sound-playing function, image player function etc.) needed at least one function
Deng；Storage data field can store uses created data (such as voice data, phone directory etc.) etc. according to mobile phone.In addition,
Memory can include high-speed random access memory, can also include nonvolatile memory, such as hard disk, internal memory, grafting
Formula hard disk, intelligent memory card (Smart Media Card, SMC), secure digital (Secure Digital, SD) card, flash card
(Flash Card), at least one disk memory, flush memory device or other volatile solid-state parts.
It will be appreciated by those of skill in the art that although some embodiments in this are included included by other embodiments
Some features rather than further feature, but the combination of the feature of different embodiments means to be within the scope of the present invention simultaneously
And form different embodiments.For example, in the following claims, the one of any of embodiment claimed all may be used
Used in a manner of in any combination.
Finally it should be noted that：The above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；Although
The present invention is described in detail with reference to the foregoing embodiments, it will be understood by those within the art that：It still may be used
To be modified to the technical scheme described in foregoing embodiments, or equivalent substitution is carried out to which part technical characteristic；
And these modification or replace, do not make appropriate technical solution essence depart from various embodiments of the present invention technical scheme spirit and
Scope.
Claims (10)
- A kind of 1. processing method of daily record data, it is characterised in that including:The identification code and supplemental characteristic of every log information are obtained, the log information includes format data and supplemental characteristic, The identification code is unique daily record generation mark corresponding to every log information in log data；Corresponding relation between the identification code, supplemental characteristic and identification code and supplemental characteristic of each log information is generated into daily record File, store the journal file；When carrying out daily record parsing, formatted file corresponding with the journal file is obtained, the formatted file includes the original It is corresponding between the identification code of every log information in beginning daily record data, format data and identification code and format data Relation；The journal file and the formatted file are parsed according to the identification code, obtain corresponding log information.
- 2. according to the method for claim 1, it is characterised in that it is described according to the identification code to the journal file and institute Formatted file is stated to be parsed, including：By the supplemental characteristic and format data in the journal file and the formatted file with same identification code according to finger Set pattern is then combined.
- 3. according to the method for claim 1, it is characterised in that in the identification code and parameter of every log information of the acquisition Before data, in addition to：The log data is read, every log information in the log data is numbered, is compiled corresponding Identification code number as the log information；The log data is parsed, extracts what is repeated in every log information of the log data Format data, will be corresponding between the format data of every log information, identification code and identification code and format data Relation generates the formatted file.
- 4. according to the method for claim 2, it is characterised in that it is described to read the log data, to described original Every log information in daily record data is numbered, including：Log information is read from the log data according to daily record printing interface keyword, the daily record to reading successively is believed Breath is numbered.
- 5. according to the method described in claim any one of 1-4, it is characterised in that it is described according to the identification code to the day After will file and the formatted file are parsed, methods described also includes：The log information parsed is output to specified file.
- A kind of 6. processing unit of daily record data, it is characterised in that including log storage unit and daily record resolution unit, the day Will memory cell includes extraction module and the first generation module, and the daily record resolution unit includes acquisition module and parsing module, Wherein:Extraction module, for extracting the identification code and supplemental characteristic of every log information, the log information includes formatting number According to and supplemental characteristic, the identification code be unique daily record generation mark corresponding to every log information in log data；First generation module, between the identification code, supplemental characteristic and identification code and supplemental characteristic by each log information Corresponding relation generation journal file, store the journal file；Acquisition module, for when carrying out daily record parsing, obtaining formatted file corresponding with the journal file, the form text Part includes identification code, format data and the identification code of every log information in the log data with formatting number Corresponding relation between；Parsing module, for being parsed according to the identification code to the journal file and the formatted file, obtain correspondingly Log information.
- 7. device according to claim 6, it is characterised in that the parsing module, specifically for by the journal file With in the formatted file there is the supplemental characteristic of same identification code and format data to be combined according to specified rule, obtain Corresponding log information.
- 8. device according to claim 6, it is characterised in that described device also includes log integrity unit, the day Will pretreatment unit includes mark module and the second generation module, wherein：Mark module, for reading the log data, every log information in the log data is carried out Numbering, the identification code using reference numeral as the log information；Second generation module, for being parsed to the log data, extract every day of the log data The format data repeated in will information, by the format data of every log information, identification code and identification code dative Corresponding relation between formula data generates the formatted file.
- 9. a kind of computer-readable recording medium, is stored thereon with computer program, it is characterised in that the program is held by processor Realized during row such as the step of any one of claim 1-5 methods described.
- 10. a kind of computer equipment, including memory, processor and storage are on a memory and the meter that can run on a processor Calculation machine program, it is characterised in that realized during the computing device described program such as any one of claim 1-5 methods described Step.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710752714.1A CN107391762B (en) | 2017-08-28 | 2017-08-28 | Log data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710752714.1A CN107391762B (en) | 2017-08-28 | 2017-08-28 | Log data processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107391762A true CN107391762A (en) | 2017-11-24 |
| CN107391762B CN107391762B (en) | 2021-02-05 |
Family
ID=60347016
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710752714.1A Active CN107391762B (en) | 2017-08-28 | 2017-08-28 | Log data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107391762B (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108459939A (en) * | 2018-01-08 | 2018-08-28 | 平安科技（深圳）有限公司 | A kind of log collecting method, device, terminal device and storage medium |
| CN108876963A (en) * | 2018-07-11 | 2018-11-23 | 广东远峰汽车电子有限公司 | A kind of storage method, device, microprocessor and the storage medium of automobile log |
| CN109446173A (en) * | 2018-09-18 | 2019-03-08 | 平安科技（深圳）有限公司 | Daily record data processing method, device, computer equipment and storage medium |
| CN110362547A (en) * | 2018-04-02 | 2019-10-22 | 阿里巴巴集团控股有限公司 | Coding, parsing, storage method and the device of journal file |
| CN111125644A (en) * | 2018-11-01 | 2020-05-08 | 百度在线网络技术（北京）有限公司 | Information hiding method and device for application product |
| CN111400128A (en) * | 2020-03-04 | 2020-07-10 | 平安科技（深圳）有限公司 | Log management method and device, computer equipment and storage medium |
| CN112559458A (en) * | 2020-12-11 | 2021-03-26 | 深圳金信诺高新技术股份有限公司 | Method and system for reducing log size |
| CN112559478A (en) * | 2020-12-22 | 2021-03-26 | 上海金卓科技有限公司 | Log generation method and device, terminal equipment and storage medium |
| CN112685373A (en) * | 2020-12-24 | 2021-04-20 | 北京浪潮数据技术有限公司 | Embedded system log processing method, device, system and medium |
| CN113283884A (en) * | 2020-12-31 | 2021-08-20 | 深圳怡化电脑股份有限公司 | Log processing method and device |
| CN113672483A (en) * | 2021-08-09 | 2021-11-19 | 深圳市猿人创新科技有限公司 | Equipment log storage method and device, electronic equipment and medium |
Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030037054A1 (en) * | 2001-08-09 | 2003-02-20 | International Business Machines Corporation | Method for controlling access to medical information |
| US20060082374A1 (en) * | 2004-10-15 | 2006-04-20 | Jiaqi Xiao | Minimizing the effect of borehole current in tensor induction logging tools |
| US20060230292A1 (en) * | 2005-04-12 | 2006-10-12 | International Business Machines Corporation | Method, apparatus, and program to post process applications encrypting sensitive objects that are logged |
| CN101163046A (en) * | 2007-11-22 | 2008-04-16 | 北京金山软件有限公司 | Distributed website log data acquisition method and distributed website system |
| CN101178709A (en) * | 2006-11-08 | 2008-05-14 | 中兴通讯股份有限公司 | Diary record system and method |
| CN101320348A (en) * | 2008-06-25 | 2008-12-10 | 中兴通讯股份有限公司 | Log function implementing method of embedded system |
| CN101339504A (en) * | 2008-08-08 | 2009-01-07 | 中兴通讯股份有限公司 | Human machine command output formats checking procedure based on text |
| CN101692226A (en) * | 2009-09-25 | 2010-04-07 | 中国人民解放军国防科学技术大学 | Storage method of mass filing stream data |
| CN101697520A (en) * | 2009-11-12 | 2010-04-21 | 杭州华三通信技术有限公司 | Method and device for processing system logs |
| CN102065416A (en) * | 2009-11-18 | 2011-05-18 | 成都市华为赛门铁克科技有限公司 | Method, device and system for formatting logs |
| CN102098401A (en) * | 2009-12-11 | 2011-06-15 | 华为技术有限公司 | Voucher card generating, charging and inquiring methods and systems |
| CN102103604A (en) * | 2009-12-18 | 2011-06-22 | 百度在线网络技术（北京）有限公司 | Method and device for determining core weight of term |
| CN102611611A (en) * | 2011-12-13 | 2012-07-25 | 北京安天电子设备有限公司 | Log caching system and method |
| CN102654864A (en) * | 2011-03-02 | 2012-09-05 | 华北计算机系统工程研究所 | Independent transparent security audit protection method facing real-time database |
| CN106021417A (en) * | 2016-05-12 | 2016-10-12 | 京信通信系统（广州）有限公司 | Log compression method and device |
| CN106354617A (en) * | 2016-08-29 | 2017-01-25 | 广州华多网络科技有限公司 | Program compression log file output method and device |
| CN106547782A (en) * | 2015-09-22 | 2017-03-29 | 阿里巴巴集团控股有限公司 | The acquisition methods and device of log information |
-
2017
- 2017-08-28 CN CN201710752714.1A patent/CN107391762B/en active Active
Patent Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030037054A1 (en) * | 2001-08-09 | 2003-02-20 | International Business Machines Corporation | Method for controlling access to medical information |
| US20060082374A1 (en) * | 2004-10-15 | 2006-04-20 | Jiaqi Xiao | Minimizing the effect of borehole current in tensor induction logging tools |
| US20060230292A1 (en) * | 2005-04-12 | 2006-10-12 | International Business Machines Corporation | Method, apparatus, and program to post process applications encrypting sensitive objects that are logged |
| CN101178709A (en) * | 2006-11-08 | 2008-05-14 | 中兴通讯股份有限公司 | Diary record system and method |
| CN101163046A (en) * | 2007-11-22 | 2008-04-16 | 北京金山软件有限公司 | Distributed website log data acquisition method and distributed website system |
| CN101320348A (en) * | 2008-06-25 | 2008-12-10 | 中兴通讯股份有限公司 | Log function implementing method of embedded system |
| CN101339504A (en) * | 2008-08-08 | 2009-01-07 | 中兴通讯股份有限公司 | Human machine command output formats checking procedure based on text |
| CN101692226A (en) * | 2009-09-25 | 2010-04-07 | 中国人民解放军国防科学技术大学 | Storage method of mass filing stream data |
| CN101697520A (en) * | 2009-11-12 | 2010-04-21 | 杭州华三通信技术有限公司 | Method and device for processing system logs |
| CN102065416A (en) * | 2009-11-18 | 2011-05-18 | 成都市华为赛门铁克科技有限公司 | Method, device and system for formatting logs |
| CN102098401A (en) * | 2009-12-11 | 2011-06-15 | 华为技术有限公司 | Voucher card generating, charging and inquiring methods and systems |
| CN102103604A (en) * | 2009-12-18 | 2011-06-22 | 百度在线网络技术（北京）有限公司 | Method and device for determining core weight of term |
| CN102654864A (en) * | 2011-03-02 | 2012-09-05 | 华北计算机系统工程研究所 | Independent transparent security audit protection method facing real-time database |
| CN102611611A (en) * | 2011-12-13 | 2012-07-25 | 北京安天电子设备有限公司 | Log caching system and method |
| CN106547782A (en) * | 2015-09-22 | 2017-03-29 | 阿里巴巴集团控股有限公司 | The acquisition methods and device of log information |
| CN106021417A (en) * | 2016-05-12 | 2016-10-12 | 京信通信系统（广州）有限公司 | Log compression method and device |
| CN106354617A (en) * | 2016-08-29 | 2017-01-25 | 广州华多网络科技有限公司 | Program compression log file output method and device |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108459939A (en) * | 2018-01-08 | 2018-08-28 | 平安科技（深圳）有限公司 | A kind of log collecting method, device, terminal device and storage medium |
| CN108459939B (en) * | 2018-01-08 | 2020-06-23 | 平安科技（深圳）有限公司 | Log collection method and device, terminal equipment and storage medium |
| CN110362547A (en) * | 2018-04-02 | 2019-10-22 | 阿里巴巴集团控股有限公司 | Coding, parsing, storage method and the device of journal file |
| CN110362547B (en) * | 2018-04-02 | 2023-10-03 | 杭州阿里巴巴智融数字技术有限公司 | Method and device for encoding, analyzing and storing log file |
| CN108876963A (en) * | 2018-07-11 | 2018-11-23 | 广东远峰汽车电子有限公司 | A kind of storage method, device, microprocessor and the storage medium of automobile log |
| CN109446173A (en) * | 2018-09-18 | 2019-03-08 | 平安科技（深圳）有限公司 | Daily record data processing method, device, computer equipment and storage medium |
| CN109446173B (en) * | 2018-09-18 | 2023-05-16 | 平安科技（深圳）有限公司 | Log data processing method, device, computer equipment and storage medium |
| CN111125644A (en) * | 2018-11-01 | 2020-05-08 | 百度在线网络技术（北京）有限公司 | Information hiding method and device for application product |
| CN111400128A (en) * | 2020-03-04 | 2020-07-10 | 平安科技（深圳）有限公司 | Log management method and device, computer equipment and storage medium |
| CN112559458B (en) * | 2020-12-11 | 2021-11-30 | 深圳金信诺高新技术股份有限公司 | Method and system for reducing log size |
| CN112559458A (en) * | 2020-12-11 | 2021-03-26 | 深圳金信诺高新技术股份有限公司 | Method and system for reducing log size |
| CN112559478A (en) * | 2020-12-22 | 2021-03-26 | 上海金卓科技有限公司 | Log generation method and device, terminal equipment and storage medium |
| CN112559478B (en) * | 2020-12-22 | 2024-05-14 | 神经元信息技术(成都)有限公司 | Log generation method and device, terminal equipment and storage medium |
| CN112685373A (en) * | 2020-12-24 | 2021-04-20 | 北京浪潮数据技术有限公司 | Embedded system log processing method, device, system and medium |
| CN113283884A (en) * | 2020-12-31 | 2021-08-20 | 深圳怡化电脑股份有限公司 | Log processing method and device |
| CN113672483A (en) * | 2021-08-09 | 2021-11-19 | 深圳市猿人创新科技有限公司 | Equipment log storage method and device, electronic equipment and medium |
| CN113672483B (en) * | 2021-08-09 | 2024-05-31 | 深圳市猿人创新科技有限公司 | Device log storage method and device, electronic device and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107391762B (en) | 2021-02-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107391762A (en) | The processing method and processing device of daily record data | |
| WO2020244066A1 (en) | Text classification method, apparatus, device, and storage medium | |
| US10846474B2 (en) | Methods, devices and systems for data augmentation to improve fraud detection | |
| CN109684476B (en) | Text classification method, text classification device and terminal equipment | |
| US11010543B1 (en) | Systems and methods for table extraction in documents | |
| CN105654127A (en) | End-to-end-based picture character sequence continuous recognition method | |
| CN110555206A (en) | named entity identification method, device, equipment and storage medium | |
| CN115391439B (en) | Document data export method, device, electronic equipment and storage medium | |
| CN106598946A (en) | Content extracting method and device | |
| CN112951233A (en) | Voice question and answer method and device, electronic equipment and readable storage medium | |
| CN114004221A (en) | Method and device for correcting table content | |
| CN113934834A (en) | Question matching method, device, equipment and storage medium | |
| CN117522094A (en) | Seal management method, platform, electronic equipment and storage medium | |
| CN109871516A (en) | A kind of method of bilayer PDF Mass production WORD | |
| CN116384344A (en) | Document conversion method, device and storage medium | |
| US20200226162A1 (en) | Automated Reporting System | |
| CN113158635B (en) | Electronic report generation method and device | |
| CN109120509A (en) | A kind of method and device that information is collected | |
| CN112613315A (en) | Text knowledge automatic extraction method, device, equipment and storage medium | |
| US20240126791A1 (en) | Method and system for long-form answer extraction based on combination of sentence index generation techniques | |
| CN109635681B (en) | Document processing method and device | |
| CN108415930A (en) | Data analysis method and device | |
| CN112163088A (en) | Method, system and equipment for mining short message user information of telecommunication network based on DenseNet | |
| CN107690130A (en) | A kind of information identifying method and system | |
| CN114706541A (en) | Document printing method and device and computer readable medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20200123 Address after: 510663 Guangzhou Science City, Guangdong Shenzhou Road, No. 10 Applicant after: Comba Telecom System (China) Ltd. Address before: 510663 Shenzhou Road 10, Guangzhou Science City, Guangzhou economic and Technological Development Zone, Guangzhou, Guangdong Applicant before: Comba Telecom System (China) Ltd. Applicant before: COMBA TELECOM SYSTEMS (GUANGZHOU) Ltd. Applicant before: COMBA TELECOM TECHNOLOGY (GUANGZHOU) Ltd. Applicant before: TIANJIN COMBA TELECOM SYSTEMS Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 510663 Shenzhou Road 10, Science City, Guangdong, Guangzhou Patentee after: Jingxin Network System Co.,Ltd. Address before: 510663 Shenzhou Road 10, Science City, Guangdong, Guangzhou Patentee before: Comba Telecom System (China) Ltd. |
|
| CP01 | Change in the name or title of a patent holder |