CN1859168A - Transfer method and system for journal information in application system - Google Patents

Transfer method and system for journal information in application system Download PDF

Info

Publication number
CN1859168A
CN1859168A CN 200510102073 CN200510102073A CN1859168A CN 1859168 A CN1859168 A CN 1859168A CN 200510102073 CN200510102073 CN 200510102073 CN 200510102073 A CN200510102073 A CN 200510102073A CN 1859168 A CN1859168 A CN 1859168A
Authority
CN
China
Prior art keywords
log information
module
foreground
transfer rate
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN 200510102073
Other languages
Chinese (zh)
Other versions
CN100484026C (en
Inventor
吴燕宇
魏末平
王克峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CNB2005101020732A priority Critical patent/CN100484026C/en
Publication of CN1859168A publication Critical patent/CN1859168A/en
Application granted granted Critical
Publication of CN100484026C publication Critical patent/CN100484026C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The present invention provides application system log information transmission method and system. Said application system includes background manage module and said background manage module management controlled foreground processing module; said foreground processing module transmitting application system generated log information to background manage module. Said method includes A, foreground processing to proceed cache processing to log information; B, background manage module transmitting log calling command to foreground processing module; C, foreground processing module according to said log calling command transmitting log information to background manage module. The present invention can avoid communication blocking between before and foreground and background module due to a lot of log information transmission, at the same time capable of greatly raising data transmission quantity between foreground processing module and background manage module.

Description

The transfer approach of log information and system in a kind of application system
Technical field
The invention belongs to network communication field, relate in particular to the transfer approach and the system of log information in the application system.
Background technology
At present, the general mode that adopts a Back Administration Module to manage a plurality of foregrounds processing module of the distribution application system of using in the professional domains such as telecommunications, as shown in Figure 1.Wherein, the foreground processing module is directly exported to Back Administration Module with daily record by communication channel, as shown in Figure 2:
In step S201, the foreground processing module directly is sent to Back Administration Module by communication channel in real time with log information;
In step S202, Back Administration Module is directly preserved after receiving log information.
In such scheme, when the foreground processing module is in the load peak operation, some failure condition can produce a large amount of log informations that need record unusually down, if these log informations directly send to Back Administration Module, very big to the influence of the communication between the AM/BAM module, be easy to cause communication obstruction between the AM/BAM module, cause urgent alarm information or important attended operation order to be issued to the foreground processing module, can cause the communicating interrupt between the AM/BAM module when serious by Back Administration Module.In addition, because the restriction of Back Administration Module disposal ability can't guarantee that the log information of the surge formula that the foreground processing module sends can be preserved by Back Administration Module like clockwork.
Summary of the invention
The objective of the invention is to propose the log-output method in a kind of application system, to solve in the prior art foreground processing module when Back Administration Module is exported a large amount of log information, communication before and after causing easily between the module is stopped up, and influences the problem of system management.
Another object of the present invention is to provide the output system of the daily record in a kind of application system.
For achieving the above object, the invention provides the transfer approach of log information in a kind of application system, described application system comprises Back Administration Module, and the foreground processing module of described Back Administration Module management control, described foreground processing module is used for the log information that application system produces is sent to Back Administration Module, it is characterized in that described method comprises the steps:
A. the foreground processing module is carried out caching process to log information;
B. Back Administration Module sends daily record to the foreground processing module and transfers order;
C. the foreground processing module is transferred order according to described daily record log information is sent to Back Administration Module.
Before described step C, described method comprises that further the log information after the foreground processing module is to caching process compresses the step of processing.
As one embodiment of the present of invention, log information is compressed the mode that adopts the piecemeal compression.
As an alternative embodiment of the invention, adjust compression procedure according to system CPU occupancy rate, when system CPU occupancy rate surpassed the threshold value of default, the foreground processing module stopped the compression of log information.
Described method further comprises:
The foreground processing module is provided with the acquiescence transfer rate and the maximum transfer rate of log information;
When Back Administration Module was not specified the transfer rate of log information, the foreground processing module transmitted log information according to described acquiescence transfer rate to Back Administration Module;
When Back Administration Module is specified the transfer rate of log information, and described transfer rate is during more than or equal to described maximum transfer rate, and the foreground processing module transmits log information according to described maximum transfer rate to Back Administration Module;
When Back Administration Module is specified the transfer rate of log information, and described transfer rate is during less than described maximum transfer rate, and the foreground processing module transmits log information according to the transfer rate of described Back Administration Module appointment to Back Administration Module.
After described step C, described method comprises that further the foreground processing module empties the step that transmits the shared spatial cache of log information.
After described step C, described method further comprises the step of the transport process information of foreground processing module log information.
For achieving the above object, the present invention also provides the transfer system of log information in a kind of application system, described application system comprises Back Administration Module, and the foreground processing module of described Back Administration Module management control, described foreground processing module is used for the log information that application system produces is sent to Back Administration Module, described transfer system comprises foreground log information processing subsystem that is positioned at the foreground processing module and the backstage log information processing subsystem that is positioned at Back Administration Module, and described foreground log information processing subsystem comprises:
Information cache module is used for log information is carried out caching process;
Information transfer module is used for transferring order according to daily record and transmits log information to described backstage log information processing subsystem;
Described backstage log information processing subsystem comprises:
Transmit control module, be used to send daily record and transfer order;
Signal dispatcher module is used for that order is transferred in described daily record and sends to described foreground log information processing subsystem, and receives the log information that described foreground log information processing subsystem transmits;
Information storage module is used to store the log information that described foreground log information processing subsystem transmits.
Described foreground log information processing subsystem further comprises:
The Information Compression module is used for the log information after the caching process is compressed.
Described foreground log information processing subsystem further comprises:
Transfer rate is provided with module, is used to be provided with the acquiescence transfer rate and the maximum transfer rate of log information.
Described foreground log information processing subsystem further comprises:
The procedural information memory module is used for the transport process information of log information.
Described backstage log information processing subsystem further comprises:
The transfer rate designated module is used to specify the transfer rate of log information.
Described backstage log information processing subsystem further comprises:
The information decompression module is used for the log information of compression is carried out decompression processing.
The present invention is sent to the Back Administration Module row cache that advances at log information, transfer the transmission log information of order according to the daily record of Back Administration Module then to Back Administration Module, can avoid causing communication obstruction between the AM/BAM module because a large amount of log information transmits, compress by log information simultaneously, can improve the volume of transmitted data between foreground processing module and the Back Administration Module greatly buffer memory.
Description of drawings
Fig. 1 is the structural representation of application system;
Fig. 2 is the realization flow figure that the log information of prior art transmits;
Fig. 3 is the realization flow figure that log information of the present invention transmits;
Fig. 4 is the structure chart of daily record output system provided by the invention.
Embodiment
In order to make purpose of the present invention, technical scheme and advantage clearer,, the present invention is further elaborated below in conjunction with drawings and Examples.Should be appreciated that specific embodiment described herein only in order to explanation the present invention, and be not used in qualification the present invention.
In the present invention, before the log information that produces in system was sent to Back Administration Module, processing module advanced row cache in foreground was handled, and directly is not sent to Back Administration Module.When communication had idle bandwidth between the AM/BAM administration module, Back Administration Module sent daily record to the foreground processing module and transfers order, and the foreground processing module receives that the log information that daily record is transferred after the order buffer memory is sent to Back Administration Module.
Fig. 3 shows the realization flow of daily record output provided by the invention, and details are as follows:
In step S301, the foreground processing module is put into the log buffer district with log information and is carried out caching process;
The mode of system configuration is adopted in the distribution of log buffer district size, is set by Back Administration Module when system initialization, the memory field of foreground processing module is divided into a part of space is used for the log information that storage system produces.The user can select that log information directly is sent to Back Administration Module by debug command and still send to buffer memory in the log buffer district of foreground processing module earlier.
When the user selected that log information carried out caching process, all log informations that system produces were sent to buffer memory in the log buffer district of foreground processing module.Unless Back Administration Module is sent out the debug command request and transferred log information, the foreground processing module does not initiatively output to Back Administration Module with the log information in the buffering area.Therefore, if Back Administration Module is not transferred log information for a long time, along with log information constantly deposits the log buffer district in, the free space in log buffer district will gradually reduce, and be taken up to the log buffer district.In one embodiment of the invention, if the log buffer district is taken, the foreground processing module will continue storing daily record information in the log buffer district with coverage mode, send alarm information to Back Administration Module simultaneously.
In step S302, the foreground processing module is compressed processing to log information;
As a preferred embodiment of the present invention, after log information writes the log buffer district, log information is compressed processing, promptly refer to the log information after the format is compressed after sending into the log buffer district, log information after the compression is kept in the log buffer district, specifically can adopts compression algorithms such as RAR, ZIP to realize.
As one embodiment of the present of invention, still can decompress(ion) as much as possible when in delivering to the process of Back Administration Module, making a mistake for the log information after guaranteeing to compress, can when being compressed, take the log information in the log buffer district mode of piecemeal compression, promptly the log information in log buffer district is divided into a certain size log blocks, compresses respectively.
In another embodiment of the present invention, because compression process must cause the rising of system CPU occupancy rate, therefore take too much cpu resource and have influence on service operation for fear of the compression processing, can set the threshold value of CPU usage, for example 80%, too high in CPU usage, when surpassing threshold value, can select to stop log information being continued to write the log buffer district.
As an alternative embodiment of the invention, for the flexibility that guarantees that compression is handled to log information, when starting log information is write the log buffer district, can indicate whether the log information in the log buffer district is compressed, compressive state can dynamically change at the log information run duration, promptly can when starting, be set at compression, cancellation compression after operation a period of time perhaps is set at when starting and does not compress, and is adjusted into compression after operation a period of time.
In step S303, the foreground processing module sends log information to Back Administration Module;
In the present invention, when needs are transferred log information, Back Administration Module sends daily record to the foreground processing module and transfers order, after the foreground processing module receives that order is transferred in daily record that Back Administration Module sends, the log information in log buffer district is sent to Back Administration Module.
As one embodiment of the present of invention, excessive and cause traffic congestion between foreground processing module and the Back Administration Module for fear of the transmission rate of log information, the transmission rate of log information is limited.The acquiescence transfer rate and the maximum transfer rate of log information are set in the processing module of foreground, and Back Administration Module is specified the transfer rate of log information when transferring log information.When log information transmitted, if Back Administration Module is not specified the transfer rate of log information, the foreground processing module adopted the acquiescence transfer rate to send log information to Back Administration Module; If Back Administration Module has been specified the transfer rate of log information, and during the maximum transfer rate that the transfer rate of Back Administration Module appointment is provided with greater than the foreground processing module, the foreground processing module adopts this maximum transfer rate to send log information to Back Administration Module, otherwise presses the transfer rate transmission log information of Back Administration Module appointment.
After the log information in the daily record buffering area successfully sends to Back Administration Module, the content that has sent in the automatic Clear Log message buffer of foreground processing module.The user also can send debug command by Back Administration Module and force to empty buffering area.
In step S304, Back Administration Module directly is saved in specified path with the form of file after receiving log information.When the foreground processing module was compressed log information, Back Administration Module need carry out decompression processing to the log information after the compression.
In one embodiment of the invention, for the process that log information is sent to Back Administration Module is monitored, the procedural information that foreground management module records daily record sends comprises and receives that daily record transfers the time of order, command parameter, sends the relevant information of each frame and send ending message etc.
Fig. 4 shows the structure of log information transfer system provided by the invention, comprises the foreground log information processing subsystem 100 that is arranged in the foreground processing module, and the backstage log information treatment system 200 that is positioned at Back Administration Module.
Foreground log information processing subsystem 100 comprises that information cache module 101, Information Compression module 102, information transfer module 103, transfer rate are provided with module 104 and procedural information memory module 105.
Backstage log information processing subsystem 200 comprises transmission control module 201, information receiving module 202, information storage module 203, transfer rate designated module 204 and Information Compression module 205.
Before the foreground processing module was sent to Back Administration Module with log information, foreground log information processing subsystem 100 was sent to log information and carries out buffer memory in the information cache module 101.On specific implementation, information cache module 101 is partial memory spaces that are used for log cache information that system divides in internal memory.As mentioned above, along with writing of more log informations, when the memory space of information cache module 101 is taken, adopt coverage mode to continue to write log information, and send alarm information to Back Administration Module by information transfer module 103.After daily record information is sent to Back Administration Module, this log information will be cleared in information cache module 101 shared correspondence memory spaces.
Information Compression module 102 is compressed processing in log information writing information cache module 101 backs to log information, in order to improve the decompress(ion) effect of Back Administration Module, can take the mode of piecemeal compression, and can control flexibly compression procedure according to system CPU occupancy rate.When the compression because of log information causes CPU usage to surpass threshold value, can stop the compression of log information.
Cause the transmission passage between foreground processing module and the Back Administration Module to block for fear of the log information transfer rate is too high, transfer rate is provided with acquiescence transfer rate and the maximum transfer rate that module 104 is provided with log information, with the transfer rate of control log information.
Information transfer module 103 is used for after order is transferred in the daily record that receives the Back Administration Module transmission corresponding log information being sent to Back Administration Module.If Back Administration Module is not specified the transfer rate of log information, then information transfer module 103 is provided with the default rate transmission log information that module 104 is provided with according to transfer rate, if Back Administration Module has been specified the transfer rate of log information, and the transfer rate of appointment is provided with the maximum transfer rate that module 104 is provided with more than or equal to transfer rate, then information transfer module 103 transmits log information according to this maximum transfer rate that transfer rate is provided with module 104 settings to Back Administration Module, otherwise transmits log information with the transfer rate of Back Administration Module appointment.
Procedural information memory module 105 is mainly used to the procedural information that storing daily record transmits, for example time, the command parameter of order, the relevant information that sends each frame and transmission ending message etc. are transferred in daily record, be beneficial to the foreground processing module transport process of log information is monitored.
When Back Administration Module need be transferred log information, transmission control module 201 was sent daily record and is transferred order, and signal dispatcher module 202 is transferred order with daily record and sent to the foreground processing module.
When Back Administration Module need be specified the transfer rate of log information, transfer rate designated module 204 is specified the transfer rate of log information, by transmission control module 201 the transfer rate information of the log information of this appointment is put into daily record and transfer order, send to the foreground processing module by signal dispatcher module 202.
After signal dispatcher module 202 is received the log information of foreground processing module transmission, will preserve in the log information writing information memory module 203.Under the situation that log information compresses, Information Compression module 205 need be carried out decompression processing to the log information after the compression.
The present invention can be widely used in various distributed or built-in applied systems.
The above only is preferred embodiment of the present invention, not in order to restriction the present invention, all any modifications of being done within the spirit and principles in the present invention, is equal to and replaces and improvement etc., all should be included within protection scope of the present invention.

Claims (13)

1, the transfer approach of log information in a kind of application system, described application system comprises Back Administration Module, and the foreground processing module of described Back Administration Module management control, described foreground processing module is used for the log information that application system produces is sent to Back Administration Module, it is characterized in that described method comprises the steps:
A. the foreground processing module is carried out caching process to log information;
The B Back Administration Module sends daily record to the foreground processing module and transfers order;
C. the foreground processing module is transferred order according to described daily record log information is sent to Back Administration Module.
2, the method for claim 1 is characterized in that, before described step C, described method comprises that further the log information after the foreground processing module is to caching process compresses the step of processing.
3, method as claimed in claim 2 is characterized in that, log information is compressed the mode that adopts the piecemeal compression.
4, method as claimed in claim 2 is characterized in that, adjusts compression procedure according to system CPU occupancy rate, and when system CPU occupancy rate surpassed the threshold value of default, the foreground processing module stopped the compression of log information.
5, the method for claim 1 is characterized in that, described method further comprises:
The foreground processing module is provided with the acquiescence transfer rate and the maximum transfer rate of log information;
When Back Administration Module was not specified the transfer rate of log information, the foreground processing module transmitted log information according to described acquiescence transfer rate to Back Administration Module;
When Back Administration Module is specified the transfer rate of log information, and described transfer rate is during more than or equal to described maximum transfer rate, and the foreground processing module transmits log information according to described maximum transfer rate to Back Administration Module;
When Back Administration Module is specified the transfer rate of log information, and described transfer rate is during less than described maximum transfer rate, and the foreground processing module transmits log information according to the transfer rate of described Back Administration Module appointment to Back Administration Module.
6, the method for claim 1 is characterized in that, after described step C, described method comprises that further the foreground processing module empties the step that transmits the shared spatial cache of log information.
7, the method for claim 1 is characterized in that, after described step C, described method further comprises the step of the transport process information of foreground processing module log information.
8, the transfer system of log information in a kind of application system, described application system comprises Back Administration Module, and the foreground processing module of described Back Administration Module management control, described foreground processing module is used for the log information that application system produces is sent to Back Administration Module, it is characterized in that, described transfer system comprises foreground log information processing subsystem that is positioned at the foreground processing module and the backstage log information processing subsystem that is positioned at Back Administration Module, and described foreground log information processing subsystem comprises:
Information cache module is used for log information is carried out caching process;
Information transfer module is used for transferring order according to daily record and transmits log information to described backstage log information processing subsystem;
Described backstage log information processing subsystem comprises:
Transmit control module, be used to send daily record and transfer order;
Signal dispatcher module is used for that order is transferred in described daily record and sends to described foreground log information processing subsystem, and receives the log information that described foreground log information processing subsystem transmits;
Information storage module is used to store the log information that described foreground log information processing subsystem transmits.
9, system as claimed in claim 8 is characterized in that, described foreground log information processing subsystem further comprises:
The Information Compression module is used for the log information after the caching process is compressed.
10, system as claimed in claim 8 is characterized in that, described foreground log information processing subsystem further comprises:
Transfer rate is provided with module, is used to be provided with the acquiescence transfer rate and the maximum transfer rate of log information.
11, system as claimed in claim 8 is characterized in that, described foreground log information processing subsystem further comprises:
The procedural information memory module is used for the transport process information of log information.
12, system as claimed in claim 8 is characterized in that, described backstage log information processing subsystem further comprises:
The transfer rate designated module is used to specify the transfer rate of log information.
13, system as claimed in claim 8 is characterized in that, described backstage log information processing subsystem further comprises:
The information decompression module is used for the log information of compression is carried out decompression processing.
CNB2005101020732A 2005-12-01 2005-12-01 Transfer method and system for journal information in application system Expired - Fee Related CN100484026C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2005101020732A CN100484026C (en) 2005-12-01 2005-12-01 Transfer method and system for journal information in application system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2005101020732A CN100484026C (en) 2005-12-01 2005-12-01 Transfer method and system for journal information in application system

Publications (2)

Publication Number Publication Date
CN1859168A true CN1859168A (en) 2006-11-08
CN100484026C CN100484026C (en) 2009-04-29

Family

ID=37298035

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2005101020732A Expired - Fee Related CN100484026C (en) 2005-12-01 2005-12-01 Transfer method and system for journal information in application system

Country Status (1)

Country Link
CN (1) CN100484026C (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103368756A (en) * 2012-03-29 2013-10-23 福建星网视易信息系统有限公司 A management system for monitoring the operation log of an embedded system
CN103532943A (en) * 2013-10-08 2014-01-22 北京神州绿盟信息安全科技股份有限公司 Web application firewall device and asynchronous security protection log processing method
CN103942134A (en) * 2014-04-04 2014-07-23 福建星网视易信息系统有限公司 Method and system for viewing embedded device log
CN105553875A (en) * 2015-12-15 2016-05-04 南京欣网互联网络科技有限公司 E-commerce interaction system and method based on image cutting
CN111143157A (en) * 2019-11-28 2020-05-12 华为技术有限公司 Fault log processing method and device

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103368756A (en) * 2012-03-29 2013-10-23 福建星网视易信息系统有限公司 A management system for monitoring the operation log of an embedded system
CN103368756B (en) * 2012-03-29 2016-08-03 福建星网视易信息系统有限公司 For monitoring the management system of the daily record of operation for embedded system
CN103532943A (en) * 2013-10-08 2014-01-22 北京神州绿盟信息安全科技股份有限公司 Web application firewall device and asynchronous security protection log processing method
CN103942134A (en) * 2014-04-04 2014-07-23 福建星网视易信息系统有限公司 Method and system for viewing embedded device log
CN103942134B (en) * 2014-04-04 2017-04-26 福建星网视易信息系统有限公司 Method and system for viewing embedded device log
CN105553875A (en) * 2015-12-15 2016-05-04 南京欣网互联网络科技有限公司 E-commerce interaction system and method based on image cutting
CN105553875B (en) * 2015-12-15 2019-04-26 南京欣网互联网络科技有限公司 Electric business interactive system and method based on picture cutting
CN111143157A (en) * 2019-11-28 2020-05-12 华为技术有限公司 Fault log processing method and device
CN111143157B (en) * 2019-11-28 2021-08-27 华为技术有限公司 Fault log processing method and device

Also Published As

Publication number Publication date
CN100484026C (en) 2009-04-29

Similar Documents

Publication Publication Date Title
CN101877604B (en) Method and system for transmitting files
CN1170446C (en) Radio resource allocation method and base station thereby
CN1859168A (en) Transfer method and system for journal information in application system
CN1272945C (en) Packet conversion system and method thereof
CN1558639A (en) Method for transmitting variable-length protocol data units in rlc transparent entity
CN1515100A (en) Apparatus and method for controlling packet data transmission between BSC and BTS
CN1878144A (en) Multi-queue flow control method
CN101567849A (en) Data buffer caching method and device
CN101039333A (en) Method and apparatus for dynamically adjusting bandwidth of advanced data link control channel
CN1901668A (en) Multiple person video frequency data display processing method and system
CN102447606A (en) Flow control method and device for data transmission
CN101043373A (en) Apparatus and method for improving reliability of communication system and communication system thereof
CN1290434A (en) Rlp communication device and method for mobile communication system
CN1933451A (en) Interplate communicating method and interface plate
KR100276380B1 (en) Method for controlling queue assignment for correcting transmission delay of real time data in communication system
CN1797976A (en) Method for transmitting data between main and standby boards
CN101035349A (en) System and method for processing the signaling message report
CN1941952A (en) Method and system for buffering applied service medium data
CN1725728A (en) Buffer management method based on signaling protocol
CN103747253B (en) A kind of video data encoder transmission method based on FIFO
CN101303675B (en) Data transmission method for data processing equipment and data processing equipment
CN102176705A (en) Method and device for processing mass-sending service
US20140297792A1 (en) Server, data caching method, and communication system
CN106487711B (en) Method and system for dynamic cache allocation
CN1266883C (en) Method for controlling network port flow

Legal Events

Date Code Title Description
PB01 Publication
C06 Publication
SE01 Entry into force of request for substantive examination
C10 Entry into substantive examination
GR01 Patent grant
C14 Grant of patent or utility model
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20090429

Termination date: 20121201

C17 Cessation of patent right