CN108255884A - A kind of data processing method and device of the log information of OMC - Google Patents
A kind of data processing method and device of the log information of OMC Download PDFInfo
- Publication number
- CN108255884A CN108255884A CN201611250316.1A CN201611250316A CN108255884A CN 108255884 A CN108255884 A CN 108255884A CN 201611250316 A CN201611250316 A CN 201611250316A CN 108255884 A CN108255884 A CN 108255884A
- Authority
- CN
- China
- Prior art keywords
- log information
- threshold value
- buffer zone
- data buffer
- omc
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/172—Caching, prefetching or hoarding of files
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/1805—Append-only file systems, e.g. using logs or journals to store data
- G06F16/1815—Journaling file systems
Abstract
An embodiment of the present invention provides a kind of data processing method and device of the log information of OMC, the operation maintenance center OMC includes log information recording module and database, and the log information recording module includes data buffer zone, the method includes：Log information that OMC is generated is cached to the data buffer zone；Judge whether the log information in the data buffer zone is more than preset capacity threshold value；When the log information is less than preset capacity threshold value, judge whether the quantity of the log information meets default value；When the quantity of the log information meets default value, the log information is stored in database.So that log information buffer memory capacity can manage, resource utilization ratio maximizes.So that log information storage controllable-rate is adjusted, database performance utilization rate maximizes.
Description
Technical field
The present invention relates to the technical field of data processing, more particularly to a kind of data processing side of the log information of OMC
Method and a kind of device of the data processing of the log information of OMC.
Background technology
OMC (operation maintenance center, Operation and Maintenance Center) system is management mobile network
One of basic module, and journal module is an important basic module of OMC systems, it is responsible for all kinds of behaviour of OMC systems
Make the work such as log recording and inquiry, network element device daily record extraction, daily record classification audit, and operation log recording is one of which
Key function.In OMC systems, journal module records all kinds of operation logs according to certain rule and category level, including OMT
(Operation Maintenance Terminal, operating maintenance terminal) logs in the security log published and interface menu behaviour
Make, OMC is issued to the multiple types daily records such as configuration order and the network element notification event of network element.It is well known that the network element of OMC management
Device data is generally more, thousands of or even more than 10,000, so all kinds of operation logs generate, frequency is frequent, and daily record item number is huge, often
More than second about 500 is a plurality of, therefore the handling capacity of journal module is one of bottleneck for restricting OMC system performances.
As shown in Figure 1, the logical construction of existing log recording is simply designed as " session layer and database processing " two
Layer structure." session layer " is responsible for monitoring the log record request of the business module of OMC, and request data is converted into log entities
(Entity Bean) object；" data analysis layer " is responsible for creating database (DB, Database) connection and affairs, log entities
The work such as the insertion of (Entity Bean) and inquiry operation, affairs submission.It is analyzed in logic from business, above-mentioned double-layer structure is set
Meter can substantially meet the regular traffic demand of log recording, and daily record storage mode is put in storage for single daily record, i.e. session
Layer often receives a log record request and calls data analysis layer that daily record data is inserted into database at once.Existing daily record note
Record mode can meet the record scene of a small amount of daily record using two layers of business structure, exist for the log recording scene of high frequency time
Serious performance issue,
Invention content
In view of the above problems, it is proposed that the embodiment of the present invention overcomes the above problem or at least partly in order to provide one kind
The data processing dress of a kind of data processing method of the log information of OMC to solve the above problems and a kind of log information of OMC
It puts.
To solve the above-mentioned problems, the embodiment of the invention discloses a kind of data processing method of the log information of OMC, institutes
It states operation maintenance center OMC and includes log information recording module and database, the log information recording module is delayed including data
Area is rushed, the method includes：
Log information that OMC is generated is cached to the data buffer zone；
Judge whether the log information in the data buffer zone is more than preset capacity threshold value；
When the log information is less than preset capacity threshold value, judge whether the quantity of the log information meets present count
Value；
When the quantity of the log information meets default value, the log information is stored in database.
The embodiment of the invention discloses a kind of data processing equipment of the log information of OMC, the operation maintenance center OMC
Including log information recording module and database, the log information recording module includes data buffer zone, and described device includes：
Cache module, for caching the log information of OMC generations to the data buffer zone；
First judgment module, for judging whether the log information in the data buffer zone is more than preset capacity threshold value；
Second judgment module, for when the log information is less than preset capacity threshold value, judging the log information
Whether quantity meets default value；
Module is stored in, for when the quantity of the log information meets default value, the log information to be stored in number
According to library.
The embodiment of the present invention includes advantages below：
In the embodiment of the present invention, the OMC includes log information recording module and database, the log information recording mould
Block includes data buffer zone, the log information that log information recording module caching OMC is generated to the data buffer zone；Judge institute
State whether the log information in data buffer zone is more than preset capacity threshold value；When the log information is less than preset capacity threshold value
When, judge whether the quantity of the log information meets default value；When the quantity of the log information meets default value,
The log information is stored in database；So that log information buffer memory capacity can manage, resource utilization ratio maximizes.So that
Log information storage controllable-rate is adjusted, and database performance utilization rate maximizes.
Description of the drawings
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment
Attached drawing is briefly described, it should be apparent that, the accompanying drawings in the following description is only some embodiments of the present invention, for
For those of ordinary skill in the art, without creative efforts, other are can also be obtained according to these attached drawings
Attached drawing
Fig. 1 is a kind of flow chart of the data processing of the log information of OMC of the prior art；
Fig. 2 is a kind of step flow chart of the data processing method embodiment of the log information of OMC of the embodiment of the present invention；
Fig. 3 is a kind of flow chart of the data processing of the log information of OMC of the embodiment of the present invention；
Fig. 4 is a kind of step flow chart of the data processing method embodiment of the log information of OMC of the embodiment of the present invention；
Fig. 5 is the sequence diagram of a kind of JConsole tools of the embodiment of the present invention, log buffer pond and batch processing thread；
Fig. 6 is a kind of structure diagram of the data processing equipment embodiment of the log information of OMC of the embodiment of the present invention.
Specific embodiment
The technical issues of in order to solve the embodiment of the present invention, technical solution and advantageous effect are more clearly understood, with
The embodiment of the present invention is further described in lower combination accompanying drawings and embodiments.It should be appreciated that specific implementation described herein
Example is only used to explain the present invention, is not intended to limit the present invention.
With reference to Fig. 2, a kind of data processing method embodiment one of the log information of OMC of the embodiment of the present invention is shown
Flow chart of steps, the operation maintenance center OMC include log information recording module and database, the log information recording mould
Block includes data buffer zone, specifically may include steps of：
Step 101, the log information that caching OMC is generated is to the data buffer zone；
In the embodiment of the present invention, OMC includes business module, log information recording module and database, and OMC can be by business mould
Block generates log information and is sent to the log information recording module, is stored log information by log information recording module supreme
The database stated.
Specifically, the OMC log informations generated can be cached to data buffer zone by log information recording module, such as Fig. 3 institutes
Show, a kind of flow chart of the data processing of the log information of OMC of the embodiment of the present invention is shown, the generation of business module in OMC
Log information caches the log buffer area into data buffer zone by log recording background service, will via batch processing thread
Log information is stored in bulk to the database of OMC.
Step 102, judge whether the log information in the data buffer zone is more than preset capacity threshold value；
It applies in the embodiment of the present invention, preset capacity threshold value is provided in OMC, OMC can judge that the data are delayed
Whether the log information rushed in area is more than preset capacity threshold value, if preset capacity threshold value is 100MB, and the day in data buffer zone
Will information is 110MB, then OMC can compare the log information in the data buffer zone and preset capacity threshold value, is needed
It is noted that preset capacity threshold value can be any numerical value that those skilled in the art set according to actual conditions, this hair
Bright embodiment is not restricted this.
In addition, the size of preset capacity threshold value can also be counted with the item number of log information, the embodiment of the present invention pair
This is not restricted, and if preset capacity threshold value is set as 1000 log informations, OMC can judge the daily record in the data buffer zone
Whether information is more than the upper limit of 1000 log informations, performs the operation of next step.
Step 103, when the log information is less than preset capacity threshold value, judge whether the quantity of the log information accords with
Close default value；
Further, in the case where log information is less than preset capacity threshold value, OMC can judge the number of the log information
Whether amount meets default value, it should be noted that default value can be that those skilled in the art set according to actual conditions
Fixed any numerical value, the embodiment of the present invention are not restricted this, and default value can in real time be changed according to actual conditions,
Realize the effect of dynamic batch processing.
Step 104, when the quantity of the log information meets default value, the log information is stored in database.
Specific in the embodiment of the present invention, when the quantity of the log information meets default value, also that is, log information
Quantity when meeting the batch unit of OMC batch processing thread managers, log information recording module can pass through database manipulation
By log information bulk storage to database.
In the embodiment of the present invention, the OMC includes log information recording module and database, the log information recording mould
Block includes data buffer zone, the log information that log information recording module caching OMC is generated to the data buffer zone；Judge institute
State whether the log information in data buffer zone is more than preset capacity threshold value；When the log information is less than preset capacity threshold value
When, judge whether the quantity of the log information meets default value；When the quantity of the log information meets default value,
The log information is stored in database；So that log information buffer memory capacity can manage, resource utilization ratio maximizes.So that
Log information storage controllable-rate is adjusted, and database performance utilization rate maximizes.
With reference to Fig. 4, a kind of data processing method embodiment two of the log information of OMC of the embodiment of the present invention is shown
Flow chart of steps, the operation maintenance center OMC include log information recording module and database, the log information recording mould
Block includes data buffer zone, specifically may include steps of：
Step 201, the log information that caching OMC is generated is to the data buffer zone；
In the embodiment of the present invention, in OMC the generation log information of business module by log recording background service cache to
Log buffer area in data buffer zone stores log information in bulk to the database of OMC.
Step 202, judge whether the log information in the data buffer zone is more than preset capacity threshold value；
In a kind of preferred embodiment of the embodiment of the present invention, whether the log information judged in the data buffer zone
Include more than the step of preset capacity threshold value：The capacity of the data buffer zone fixed proportion is determined as preset capacity threshold value；
The capacity of log information in the data buffer zone is compared with the preset capacity threshold value.
For example, the capacity of data buffer zone is 1000MB, and it 90% is default that can set fixing for data buffer zone
Capacity threshold, the embodiment of the present invention do not limit specifically.
Step 203, when the log information is less than preset capacity threshold value, judge whether the quantity of the log information accords with
Close default value；
It applies in the embodiment of the present invention, when the log information is less than preset capacity threshold value, described in OMC judgements
Whether the quantity of log information meets default value；Preferably, the method further includes：When the log information is more than default hold
When measuring threshold value, the log information in the data buffer zone is cleared up.
Preferably, the method further includes：When the log information is more than preset capacity threshold value, adjusts the data and delay
Rush the capacity in area.
Step 204, when the quantity of the log information meets default value, according to predeterminated frequency by the log information
It is stored in database.
Specifically, when the quantity of the log information meets default value, OMC is by log information according to predeterminated frequency
Log information is stored in database in bulk, if predeterminated frequency could be provided as 50 seconds, OMC is at 50 seconds run-down batches
Log information in lineation journey judges that the quantity of the log information meets default value；When the quantity of the log information accords with
When closing default value, the log information is stored in database according to predeterminated frequency.
Preferably, the method further includes；The capacity for obtaining the log information increases data；Judge that the capacity increases
Whether data are more than default growth threshold value；If so, reduce the predeterminated frequency.
In the embodiment of the present invention, the capacity that OMC also gets log information increases data, judges that the capacity increases data
Whether default growth threshold value is more than；It is more than default growth threshold value when the capacity increases data, then reduces the predeterminated frequency, it can
Predeterminated frequency to be reduced to 30 seconds from 50 seconds, increase storage number of processing.
In the embodiment of the present invention, the OMC includes log information recording module and database, the log information recording mould
Block includes data buffer zone, the log information that log information recording module caching OMC is generated to the data buffer zone；Judge institute
State whether the log information in data buffer zone is more than preset capacity threshold value；When the log information is less than preset capacity threshold value
When, judge whether the quantity of the log information meets default value；When the quantity of the log information meets default value,
The log information is stored in database；Session layer causes log recording delay to reduce with data analysis layer isolation technology, accelerates
Service response speed.Dynamic buffering causes log object buffer memory capacity that can manage, and resource utilization ratio maximizes.It is dynamic
State batch processing technology causes daily record storage controllable-rate to be adjusted, and database performance utilization rate maximizes；Realize real-time logs
Warehouse-in efficiency maximizes and the effective protection of system resource, on the one hand improves session layer log record request answer speed, separately
One side effective protection system memory resource enhances system stability；So that conventional batch storage has dynamic management work(
Can, so as to be effectively improved the coordination ability between data analysis layer and database.
For those skilled in the art is made to more fully understand the embodiment of the present invention, illustrated below by way of an example.
In the embodiment of the present invention, increase on the basis of log information recording module original " session layer " and " data analysis layer "
" data buffer zone " module is added, its major responsibility is into row buffering and reprocessing to the operation log object that will be put in storage.
The data buffering that dotted line frame is included divides into four parts：(1) " log buffer pond " is the buffering field before log object storage
Institute, the business module of OMC initiate the request of log recording, and log object is temporarily deposited in this rather than stood by session layer at once
It is carved into library.(2) " buffer pool manager " is a MBean (Managed Bean can manage constructor) background service, after startup
24 hours periods monitor log buffer tankage, in the case that automatic switch is opened, once listening to capacity reaches alarm threshold
It is worth (90%) to clear up automatically at once and send cleaning JMS (Java Message Service, message clothes to system monitoring terminal
Business) message；Conversely, in the case that automatic switch is closed, capacity reaches threshold value and sends capacity alarm JMS message at once.Work as people
After work receives alarm JMS message, connecting the manager by JConsole tools, (JConsole is the use based on JMX
Family graphic interface tool for connecting the JVM being currently running, monitors the performance of application program and resource consumption situation.) or
Perform manual cleaning operation or according to OMC memory service conditions, it is appropriate to adjust pond size (increase is reduced).(3) " batch
Handle thread " it is a self-starting background thread, when not having log object in daily record buffer pool, this thread is blocked in extension
The state of rising；It to be waken up when there are threads during log object in daily record buffering area, while extract certain amount and (be less than or equal to batch ticket
First number) log object, then call data analysis layer batch that a plurality of daily record is once submitted to storage to database.(4) " batch
Handle thread manager " it is also a MBean background service, which is connected by JConsole tools, can manually be moved
The state adjustment processing execution period of thread and batch unit population size, can be adjusted to the working efficiency of processing thread in this way
It is optimal.
It in the embodiment of the present invention, is realized, is operated on JVM based on ripe JavaEE technologies, log buffer pond uses
Linked list type obstruction queue (LinkedBlockingQueue) realizes that log object enters buffer pool and uses " first in first out " strategy,
The log object stored in pond is the abstract type of various daily records, wherein " tankage " and " preset capacity threshold value " is two main
Attribute, while also comprising " automatic cleaning " and " cleaning manually " two interface methods；Batch processing thread, which is one, to be realized
The thread class of Runable interfaces is started by buffer pool triggering thread, wherein " scan frequency " and " batch unit " is important for its
Generic attribute；Batch processing thread performs and abstract daily record is converted into specific object when batch is put in storage, and then selects different data
It handles class and performs batch in-stockroom operation, embody the combination of " abstract and specific ".The manager of the two is all based on standard
MBean specifications are developed, and are registered by PlatformMBeanServer into the MBean service containers of JVM, such as
MBean client utilities as JConsole lead to the remote interface side of unique each manager of ObjectName identification access
Method realizes the online modification of class instance parameter.
The log recording session request of the business module of OM C and data loading are operated into completely isolated, the daily record from sequential
Object calls sequential that must terminate at once after being buffered；Log buffer pond and batch processing thread will form one solely in sequential
Vertical unit, according to the log object that fixed frequency batch processing is buffered, does not have direct interaction in sequential with OMC business modules；
The operating parameter of log buffer pond and batch processing thread can realize dynamic on-line tuning, to reach operational efficiency highest,
Work schedule is mainly reflected in the interaction with JConsole tools.With reference to Fig. 5, one kind of the embodiment of the present invention is shown
The sequence diagram of JConsole tools, log buffer pond and batch processing thread.
The business module of OMC referred to independently of other modules except log information recording module, weight in these modules
The operating process wanted needs to be recorded in database, in case subsequent query, interface is called using EJB modes, and OMC business modules are
EJB client, the session layer of journal module is EJB server-sides, and application service is published in the form of stateless Bean (constructor)
In device.Illustrate that the call flow between them is as follows with reference to Fig. 5：
(1) the client object stub of the stateless Bean of log information recording module is got.
(2) the long-range record log interface methods of stateless Bean are accessed by object stub.
(3) after log sessions layer receives log record request, daily record is stored using log buffer pond class instance method
Into buffer pool.
(4) log sessions layer returns to successful respond message to OMC business modules simultaneously.
" batch processing thread " is a center module formed a connecting link and is a cycle in daily record storage flow
Backstage scheduling thread, on the one hand it extracts batch daily record from log buffer pond, on the other hand calls different data analysis layers
In-stockroom operation is performed, is described as follows with reference to the basic operating process of Fig. 4 .3 batch log recordings：
(1) when there are started at batch using " asynchronous thread wake-up mechanism " at once during first log object in buffer pool
Lineation journey, hereafter this thread survive always and by the batches of operation log of period treatment.
(2) batch processing thread is delayed a clock cycle, starts to extract " a batch ticket from buffer pool for the first time
The log object of member ", i.e. the daily record quantity of actual extracting should be not more than batch unit.
(3) and then by this batch of log object classify, all kinds of log objects call different database processing layers respectively
In-stockroom operation is carried out, each database processing layer equally submits technology to complete using batch.
(4) all database processing layers are put in storage successful, this batch operation success；Otherwise the behaviour of record storage failure
Make log object.
(5) the next clock cycle repeats 2-4 steps.
Logger module manager is divided into " buffer pool manager " and " batch thread manager " two, they are issued
MBean for standard is serviced, and the remote interface of statement can be accessed by JConsole tools, and exploitation is simple, easy to use.
Illustrate that two kinds of manager operating processes are as follows with reference to Fig. 4 .3：
(1) start a backstage watcher thread after buffer pool manager is issued successfully at once, this thread cycle is monitored slow
Tankage is rushed, once capacity reaches threshold value, performs automatic cleaning operation at once.
(2) if the abundant situation of physical memory, JConsole tools can increase the amount of capacity of buffer pool, on the contrary it can
To reduce the capacity of buffer pool.
(3) when buffering tankage speed increasing ratio is very fast, JConsole tools can increase batch processing frequency or increase batch
Processing units quantity is measured, to alleviate buffer pool pressure.
It should be noted that for embodiment of the method, in order to be briefly described, therefore it is all expressed as to a series of action group
It closes, but those skilled in the art should know, the embodiment of the present invention is not limited by described sequence of movement, because according to
According to the embodiment of the present invention, certain steps may be used other sequences or be carried out at the same time.Secondly, those skilled in the art also should
Know, embodiment described in this description belongs to preferred embodiment, and the involved action not necessarily present invention is implemented
Necessary to example.
With reference to Fig. 6, a kind of knot of the data processing equipment embodiment of the log information of OMC of the embodiment of the present invention is shown
Structure block diagram, the operation maintenance center OMC include log information recording module and database, the log information recording module packet
Data buffer zone is included, can specifically include following module：
Cache module 301, for caching the log information of OMC generations to the data buffer zone；
First judgment module 302, for judging whether the log information in the data buffer zone is more than preset capacity threshold
Value；
Second judgment module 303, for when the log information is less than preset capacity threshold value, judging the log information
Quantity whether meet default value；
Module 304 is stored in, for when the quantity of the log information meets default value, the log information to be stored in
Database.
Preferably, first judgment module includes：
Preset capacity threshold value determination sub-module, for the capacity of the data buffer zone fixed proportion to be determined as default appearance
Measure threshold value；
Submodule is compared, for the capacity of log information in the data buffer zone and the preset capacity threshold value to be carried out
It compares.
Preferably, described device further includes：
Cleaning modul, for when the log information is more than preset capacity threshold value, clearing up in the data buffer zone
Log information.
Preferably, described device further includes：
Adjustment module, for when the log information is more than preset capacity threshold value, adjusting the appearance of the data buffer zone
Amount.
Preferably, the deposit module includes；
Be stored in submodule, for when the quantity of the log information meets default value, according to predeterminated frequency will described in
Log information is stored in database.
Preferably, described device further includes；
Acquisition module increases data for obtaining the capacity of the log information；
Third judgment module, for judging that the capacity increases whether data are more than default growth threshold value；
Module is reduced, increases data more than default growth threshold value for working as the capacity, then reduces the predeterminated frequency.
For device embodiment, since it is basicly similar to embodiment of the method, so description is fairly simple, it is related
Part illustrates referring to the part of embodiment of the method.
Each embodiment in this specification is described by the way of progressive, the highlights of each of the examples are with
The difference of other embodiment, just to refer each other for identical similar part between each embodiment.
It should be understood by those skilled in the art that, the embodiment of the embodiment of the present invention can be provided as method, apparatus or calculate
Machine program product.Therefore, the embodiment of the present invention can be used complete hardware embodiment, complete software embodiment or combine software and
The form of the embodiment of hardware aspect.Moreover, the embodiment of the present invention can be used one or more wherein include computer can
With in the computer-usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) of program code
The form of the computer program product of implementation.
The embodiment of the present invention be with reference to according to the method for the embodiment of the present invention, terminal device (system) and computer program
The flowchart and/or the block diagram of product describes.It should be understood that flowchart and/or the block diagram can be realized by computer program instructions
In each flow and/or block and flowchart and/or the block diagram in flow and/or box combination.These can be provided
Computer program instructions are set to all-purpose computer, special purpose computer, Embedded Processor or other programmable data processing terminals
Standby processor is to generate a machine so that is held by the processor of computer or other programmable data processing terminal equipments
Capable instruction generation is used to implement in one flow of flow chart or multiple flows and/or one box of block diagram or multiple boxes
The device for the function of specifying.
These computer program instructions, which may also be stored in, can guide computer or other programmable data processing terminal equipments
In the computer-readable memory to work in a specific way so that the instruction being stored in the computer-readable memory generates packet
The manufacture of command device is included, which realizes in one flow of flow chart or multiple flows and/or one side of block diagram
The function of being specified in frame or multiple boxes.
These computer program instructions can be also loaded into computer or other programmable data processing terminal equipments so that
Series of operation steps are performed on computer or other programmable terminal equipments to generate computer implemented processing, thus
The instruction offer performed on computer or other programmable terminal equipments is used to implement in one flow of flow chart or multiple flows
And/or specified in one box of block diagram or multiple boxes function the step of.
Although the preferred embodiment of the embodiment of the present invention has been described, those skilled in the art once know base
This creative concept can then make these embodiments other change and modification.So appended claims are intended to be construed to
Including preferred embodiment and fall into all change and modification of range of embodiment of the invention.
Finally, it is to be noted that, herein, relational terms such as first and second and the like be used merely to by
One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation
Between there are any actual relationship or orders.Moreover, term " comprising ", "comprising" or its any other variant meaning
Covering non-exclusive inclusion, so that process, method, article or terminal device including a series of elements are not only wrapped
Those elements are included, but also including other elements that are not explicitly listed or are further included as this process, method, article
Or the element that terminal device is intrinsic.In the absence of more restrictions, it is wanted by what sentence "including a ..." limited
Element, it is not excluded that also there are other identical elements in the process including the element, method, article or terminal device.
It above to a kind of method provided by the present invention and a kind of device, is described in detail, tool used herein
Body example is expounded the principle of the present invention and embodiment, and the explanation of above example is only intended to help to understand this hair
Bright method and its core concept；Meanwhile for those of ordinary skill in the art, thought according to the present invention, specific real
There will be changes in mode and application range are applied, in conclusion the content of the present specification should not be construed as the limit to the present invention
System.
Claims (12)
1. a kind of data processing method of the log information of OMC, which is characterized in that the operation maintenance center OMC includes daily record
Information logging modle and database, the log information recording module include data buffer zone, the method includes：
Log information that OMC is generated is cached to the data buffer zone；
Judge whether the log information in the data buffer zone is more than preset capacity threshold value；
When the log information is less than preset capacity threshold value, judge whether the quantity of the log information meets default value；
When the quantity of the log information meets default value, the log information is stored in database.
2. according to the method described in claim 1, it is characterized in that, the log information in the judgement data buffer zone is
No the step of being more than preset capacity threshold value, includes：
The capacity of the data buffer zone fixed proportion is determined as preset capacity threshold value；
The capacity of log information in the data buffer zone is compared with the preset capacity threshold value.
3. according to the method described in claim 1, it is characterized in that, the method further includes：
When the log information is more than preset capacity threshold value, the log information in the data buffer zone is cleared up.
4. method according to claim 1 or 2, which is characterized in that the method further includes：
When the log information is more than preset capacity threshold value, the capacity of the data buffer zone is adjusted.
It is 5. according to the method described in claim 1, it is characterized in that, described when the quantity of the log information meets default value
When, the step of log information deposit database, is included；
When the quantity of the log information meets default value, the log information is stored in database according to predeterminated frequency.
6. according to the method described in claim 5, it is characterized in that, the method further includes；
The capacity for obtaining the log information increases data；
Judge that the capacity increases whether data are more than default growth threshold value；
If so, reduce the predeterminated frequency.
7. a kind of data processing equipment of the log information of OMC, which is characterized in that the operation maintenance center OMC includes daily record
Information logging modle and database, the log information recording module include data buffer zone, and described device includes：
Cache module, for caching the log information of OMC generations to the data buffer zone；
First judgment module, for judging whether the log information in the data buffer zone is more than preset capacity threshold value；
Second judgment module, for when the log information is less than preset capacity threshold value, judging the quantity of the log information
Whether default value is met；
Module is stored in, for when the quantity of the log information meets default value, the log information to be stored in database.
8. device according to claim 7, which is characterized in that first judgment module includes：
Preset capacity threshold value determination sub-module, for the capacity of the data buffer zone fixed proportion to be determined as preset capacity threshold
Value；
Submodule is compared, for the capacity of log information in the data buffer zone and the preset capacity threshold value to be compared
It is right.
9. device according to claim 7, which is characterized in that described device further includes：
Cleaning modul, for when the log information is more than preset capacity threshold value, clearing up the daily record in the data buffer zone
Information.
10. the device according to claim 7 or 9, which is characterized in that described device further includes：
Adjustment module, for when the log information is more than preset capacity threshold value, adjusting the capacity of the data buffer zone.
11. device according to claim 7, which is characterized in that the deposit module includes；
Submodule is stored in, for when the quantity of the log information meets default value, according to predeterminated frequency by the daily record
Information is stored in database.
12. according to the devices described in claim 11, which is characterized in that described device further includes；
Acquisition module increases data for obtaining the capacity of the log information；
Third judgment module, for judging that the capacity increases whether data are more than default growth threshold value；
Module is reduced, increases data more than default growth threshold value for working as the capacity, then reduces the predeterminated frequency.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611250316.1A CN108255884A (en) | 2016-12-29 | 2016-12-29 | A kind of data processing method and device of the log information of OMC |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611250316.1A CN108255884A (en) | 2016-12-29 | 2016-12-29 | A kind of data processing method and device of the log information of OMC |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108255884A true CN108255884A (en) | 2018-07-06 |
Family
ID=62722038
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611250316.1A Pending CN108255884A (en) | 2016-12-29 | 2016-12-29 | A kind of data processing method and device of the log information of OMC |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108255884A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107766408A (en) * | 2017-08-31 | 2018-03-06 | 西安交大捷普网络科技有限公司 | The storage method of audit log |
| CN110113224A (en) * | 2019-03-19 | 2019-08-09 | 深圳壹账通智能科技有限公司 | Capacity monitor method, apparatus, computer equipment and storage medium |
| CN113872785A (en) * | 2020-06-30 | 2021-12-31 | 大唐移动通信设备有限公司 | Model obtaining method and device and operation maintenance terminal |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101557606A (en) * | 2009-05-15 | 2009-10-14 | 东南大学 | Media access control (MAC) method applicable to wireless sensor network |
| CN103795950A (en) * | 2014-02-21 | 2014-05-14 | 深圳创维－Rgb电子有限公司 | Television audio signal processing device |
| CN104050100A (en) * | 2014-05-27 | 2014-09-17 | 重庆大学 | Data flow storage and management method and system suitable for big data environment |
| CN104580396A (en) * | 2014-12-19 | 2015-04-29 | 华为技术有限公司 | Task scheduling method, node and system |
| CN106161074A (en) * | 2015-04-21 | 2016-11-23 | 中兴通讯股份有限公司 | A kind of cloud terminal log processing method, Apparatus and system |
| CN106202307A (en) * | 2016-07-01 | 2016-12-07 | 百势软件(北京)有限公司 | A kind of batch log preservation method and device |
-
2016
- 2016-12-29 CN CN201611250316.1A patent/CN108255884A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101557606A (en) * | 2009-05-15 | 2009-10-14 | 东南大学 | Media access control (MAC) method applicable to wireless sensor network |
| CN103795950A (en) * | 2014-02-21 | 2014-05-14 | 深圳创维－Rgb电子有限公司 | Television audio signal processing device |
| CN104050100A (en) * | 2014-05-27 | 2014-09-17 | 重庆大学 | Data flow storage and management method and system suitable for big data environment |
| CN104580396A (en) * | 2014-12-19 | 2015-04-29 | 华为技术有限公司 | Task scheduling method, node and system |
| CN106161074A (en) * | 2015-04-21 | 2016-11-23 | 中兴通讯股份有限公司 | A kind of cloud terminal log processing method, Apparatus and system |
| CN106202307A (en) * | 2016-07-01 | 2016-12-07 | 百势软件(北京)有限公司 | A kind of batch log preservation method and device |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107766408A (en) * | 2017-08-31 | 2018-03-06 | 西安交大捷普网络科技有限公司 | The storage method of audit log |
| CN110113224A (en) * | 2019-03-19 | 2019-08-09 | 深圳壹账通智能科技有限公司 | Capacity monitor method, apparatus, computer equipment and storage medium |
| CN110113224B (en) * | 2019-03-19 | 2022-08-09 | 深圳壹账通智能科技有限公司 | Capacity monitoring method and device, computer equipment and storage medium |
| CN113872785A (en) * | 2020-06-30 | 2021-12-31 | 大唐移动通信设备有限公司 | Model obtaining method and device and operation maintenance terminal |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8832063B1 (en) | Dynamic request throttling | |
| US7171668B2 (en) | Automatic data interpretation and implementation using performance capacity management framework over many servers | |
| CN103617038B (en) | A kind of service monitoring method and device of distribution application system | |
| Zhang et al. | Workload management in database management systems: A taxonomy | |
| CN110134674A (en) | A kind of money and credit big data monitoring analysis system | |
| CN105323111A (en) | Operation and maintenance automation system and method | |
| CN104009883A (en) | Computer resource centralized remote real-time monitoring system and method | |
| CN106201722A (en) | The load regulation method of server and system | |
| JP2008502044A (en) | Performance management system and performance management method in multi-tier computing environment | |
| CN108255884A (en) | A kind of data processing method and device of the log information of OMC | |
| US8032633B2 (en) | Computer-implemented method for implementing a requester-side autonomic governor using feedback loop information to dynamically adjust a resource threshold of a resource pool scheme | |
| CN110019247A (en) | Data storage and querying method, device and monitoring system | |
| CN105426238B (en) | A kind of control method of the equipment backstage instruction management system based on internal memory | |
| CN106484709A (en) | A kind of auditing method of daily record data and audit device | |
| CN104601562B (en) | The exchange method and system of game server and database | |
| CN114443435A (en) | Container micro-service oriented performance monitoring alarm method and alarm system | |
| CN110351532B (en) | Video big data cloud platform cloud storage service method | |
| CN110413488A (en) | Server utilization rate method for early warning and device | |
| CN108182263A (en) | A kind of date storage method of data center's total management system | |
| CN113407421A (en) | Dynamic log record management method and system for micro-service gateway | |
| CN105022823B (en) | A kind of cloud service performance early warning event generation method based on data mining | |
| KR20050030539A (en) | Real-time sla impact analysis | |
| CN107071045A (en) | A kind of resource scheduling system based on multi-tenant | |
| CN105812432B (en) | Cloud document processing method and device | |
| US8250212B2 (en) | Requester-side autonomic governor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180706 |
|
| RJ01 | Rejection of invention patent application after publication |