CN104618144A - Method and system for tracking data package according to message identifier - Google Patents
Method and system for tracking data package according to message identifier Download PDFInfo
- Publication number
- CN104618144A CN104618144A CN201410853952.8A CN201410853952A CN104618144A CN 104618144 A CN104618144 A CN 104618144A CN 201410853952 A CN201410853952 A CN 201410853952A CN 104618144 A CN104618144 A CN 104618144A
- Authority
- CN
- China
- Prior art keywords
- time
- message
- message identifier
- packet
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a method and a system for tracking a data package according to a message identifier. The message identifier is added to the data package, the analysis is performed on a message log according to the message identifier, and accordingly the processing condition of the data package in every server can be effectively tracked, the time of the processing on every server and whether the information such as a result is correctly returned or not can be checked, and the positioning on system performance bottlenecks and the processing on the main time consumption of the development personnel are greatly facilitated; the real-time monitoring on the message log can be achieved, an administrator can be timely informed when system problems are found, and accordingly the maintenance efficiency is effectively improved and the time of the problem treatment is greatly reduced; the method and the system for tracking the data package according to the message identifier can be widely applied to a distributed system.
Description
Technical field
The present invention relates to communication technical field, particularly relate to a kind of method and system according to message identifier trace data bag.
Background technology
Solicited message and return information is only had in message logging in existing distributed system, every bar request is not distinguished, can only know whether and return results, cause the ruuning situation that cannot monitor system, also cannot add up request success rate and mean consumption time.When needing people and tracing solicited message, because amount of calculation is comparatively large, need the cost plenty of time to find request content and return information, efficiency is lower.
Summary of the invention
In order to solve the problems of the technologies described above, the object of this invention is to provide one and can facilitate trace data bag disposition, and a kind of method and system according to message identifier trace data bag of amount of calculation can be reduced.
The technical solution adopted in the present invention is:
According to a method for message identifier trace data bag, comprise the following steps:
A, when server receive packet, start handle packet, processing data packets terminate or packet be forwarded to the node of next server process time, generate the message logging comprising message identifier;
B, described message logging collected and processes, and then generating the form describing server health.
As described a kind of further improvements in methods according to message identifier trace data bag, described message logging is collected and processes in described step B, it specifically comprises:
B1, according to message identifier, the message logging comprising this message identifier is searched, and returns lookup result;
B2, according to lookup result, therefrom extract the time of this packet that receives, time that time that time that time that the time being distributed to backend services server, backend services server receive this packet, backend services server send object command, Tcp server receive this result and Tcp server send result.
As described a kind of further improvements in methods according to message identifier trace data bag, also comprise:
C, the message logging that monitoring is all in real time, message logging is sampled or complete analysis, when occur the processing time exceed Preset Time or process failed quantity be greater than the situation of predetermined threshold value time, call note and mail interface according to the contact method of the system manager preset, send current system problem to system manager.
As described a kind of further improvements in methods according to message identifier trace data bag, the form of described packet includes four attributes, and it is specially: message identifier, function, operational motion and sending object.
As described a kind of further improvements in methods according to message identifier trace data bag, described message identifier is the character string with global unique identifier adopting UUID to generate.
Another technical scheme of the present invention is:
According to a system for message identifier trace data bag, comprising:
Message logging memory module, for receiving packet when server, starts handle packet, processing data packets when terminating or packet be forwarded to the node of next server process, generates the message logging comprising message identifier;
Message logging analysis module, for collecting described message logging and processing, and then generates the form describing server health.
As the further improvement of described a kind of system according to message identifier trace data bag, described message logging analysis module comprises:
Search unit, for according to message identifier, the message logging comprising this message identifier is searched, and returns lookup result;
Extraction unit, for according to lookup result, therefrom extract the time of this packet that receives, time that time that time that time that the time being distributed to backend services server, backend services server receive this packet, backend services server send object command, Tcp server receive this result and Tcp server send result.
As the further improvement of described a kind of system according to message identifier trace data bag, also comprise:
Monitoring module, for monitoring all message loggings in real time, message logging is sampled or complete analysis, when occur the processing time exceed Preset Time or process failed quantity be greater than the situation of predetermined threshold value time, call note and mail interface according to the contact method of the system manager preset, send current system problem to system manager.
As the further improvement of described a kind of system according to message identifier trace data bag, the form of described packet includes four attributes, and it is specially: message identifier, function, operational motion and sending object.
As the further improvement of described a kind of system according to message identifier trace data bag, described message identifier is the character string with global unique identifier adopting UUID to generate.
The invention has the beneficial effects as follows:
A kind of method and system according to message identifier trace data bag of the present invention are by setting up message identifier in the packet, and according to this message identifier, message logging is analyzed, effectively can track packet disposition in the server, and the information such as can view time of spending in each server process and whether correctly return results, facilitates developer's navigation system performance bottleneck and the consumption of process main time greatly.And the present invention can also monitoring message daily record situation in real time, when finding system problem, can notify keeper in time, effectively improving the efficiency safeguarded, greatly reducing the time of issue handling.
Accompanying drawing explanation
Below in conjunction with accompanying drawing, the specific embodiment of the present invention is described further:
Fig. 1 is the flow chart of steps of a kind of method according to message identifier trace data bag of the present invention;
Fig. 2 is the flow chart of steps of a kind of method step B according to message identifier trace data bag of the present invention;
Fig. 3 is the block diagram of a kind of system according to message identifier trace data bag of the present invention.
Embodiment
With reference to figure 1, a kind of method according to message identifier trace data bag of the present invention, comprises the following steps:
A, when server receive packet, start handle packet, processing data packets terminate or packet be forwarded to the node of next server process time, generate the message logging comprising message identifier;
B, described message logging collected and processes, and then generating the form describing server health.
With reference to figure 2, as described a kind of further improvements in methods according to message identifier trace data bag, described message logging is collected and processes in described step B, it specifically comprises:
B1, according to message identifier, the message logging comprising this message identifier is searched, and returns lookup result;
B2, according to lookup result, therefrom extract the time of this packet that receives, time that time that time that time that the time being distributed to backend services server, backend services server receive this packet, backend services server send object command, Tcp server receive this result and Tcp server send result.
As described a kind of further improvements in methods according to message identifier trace data bag, also comprise:
C, the message logging that monitoring is all in real time, message logging is sampled or complete analysis, when occur the processing time exceed Preset Time or process failed quantity be greater than the situation of predetermined threshold value time, call note and mail interface according to the contact method of the system manager preset, send current system problem to system manager.
As described a kind of further improvements in methods according to message identifier trace data bag, the form of described packet includes four attributes, and it is specially: message identifier, function, operational motion and sending object.
As described a kind of further improvements in methods according to message identifier trace data bag, described message identifier is the character string with global unique identifier adopting UUID to generate.
With reference to figure 3, a kind of system according to message identifier trace data bag of the present invention, comprising:
Message logging memory module, for receiving packet when server, starts handle packet, processing data packets when terminating or packet be forwarded to the node of next server process, generates the message logging comprising message identifier;
Message logging analysis module, for collecting described message logging and processing, and then generates the form describing server health.
As the further improvement of described a kind of system according to message identifier trace data bag, described message logging analysis module comprises:
Search unit, for according to message identifier, the message logging comprising this message identifier is searched, and returns lookup result;
Extraction unit, for according to lookup result, therefrom extract the time of this packet that receives, time that time that time that time that the time being distributed to backend services server, backend services server receive this packet, backend services server send object command, Tcp server receive this result and Tcp server send result.
As the further improvement of described a kind of system according to message identifier trace data bag, also comprise:
Monitoring module, for monitoring all message loggings in real time, message logging is sampled or complete analysis, when occur the processing time exceed Preset Time or process failed quantity be greater than the situation of predetermined threshold value time, call note and mail interface according to the contact method of the system manager preset, send current system problem to system manager.
As the further improvement of described a kind of system according to message identifier trace data bag, the form of described packet includes four attributes, and it is specially: message identifier, function, operational motion and sending object.
As the further improvement of described a kind of system according to message identifier trace data bag, described message identifier is the character string with global unique identifier adopting UUID to generate.
Server in the specific embodiment of the invention adopts distributed system, and packet structure of the present invention is as follows:
{
“header”:{
“send_to”: “xxxxxx”，
“module”: “xxxx”，
“action”: “set”，
“msg_id”: “ be71029dc3b9a299cd722fc9070d92ec”
}，
“body”:{
…………
}
}；
It should be noted that, described packet structure comprises Header and Body two parts, and Body part is a Map, is stored in general message using Property Name as key-value pair; Header part comprises msg_id, module, action, send_to, is followed successively by: message identifier, function, operational motion and sending object be totally four attributes by front to rear arrangement.In these four attributes, msg_id is the data cell of 8 bytes, and be 32 16 system characters with string representation, any one service request, all possesses the id information that an overall situation is unique; Module is the character string that a length is not limit, and distinguishes according to product function; The corresponding HTTP additions and deletions of action are looked into and are changed four kinds of operations; Send_to represents that this message current sends to which client or which service cluster.
Wherein, undertaken analyzing data message at random or all by Filter messages mark msg_id, the time that every station server spends in Message Processing can be obtained, and then generation server health status, form etc., to help the performance bottleneck of the positioning distributed system of developer.
When a Tcp request sends to Tcp server, be distributed to Business server by Tcp server, and return to Tcp server by after Business server process.
Use the state that the whole order of following Linux order acquisition runs in systems in which:
find ./ |xargs grep “be71029dc3b9a299cd722fc9070d92ec”，
Then from the result returned, obtain the time of this message, time that time that time that time that the time being distributed to backend services server, backend services server receive this message, backend services server send object command, Tcp server receive this result and Tcp server send result.The time difference can be obtained easily according to these times, just can calculate the bottleneck of system cloud gray model and the position of pressure, thus the working quantity of whole server cluster can be regulated, optimization system performance.
Further, the message log file that the monitoring that can continue in the present invention is all, and sample or complete analysis according to the message logging of pressure to server of current server.When having processing time overlength and processing a large amount of failed situation, short breath, mail interface can be called according to the contact method of the system manager preset, send current system problem to system manager.System manager can process in time according to problem.
From foregoing, a kind of method and system according to message identifier trace data bag of the present invention are by setting up message identifier in the packet, and according to this message identifier, message logging is analyzed, effectively can track packet disposition in the server, and the information such as can view time of spending in each server process and whether correctly return results, facilitates developer's navigation system performance bottleneck and the consumption of process main time greatly.And the present invention can also monitoring message daily record situation in real time, when finding system problem, can notify keeper in time, effectively improving the efficiency safeguarded, greatly reducing the time of issue handling.
More than that better enforcement of the present invention is illustrated, but the invention is not limited to described embodiment, those of ordinary skill in the art also can make all equivalent variations or replacement under the prerequisite without prejudice to spirit of the present invention, and these equivalent distortion or replacement are all included in the application's claim limited range.
Claims (10)
1. according to a method for message identifier trace data bag, it is characterized in that, comprise the following steps:
A, when server receive packet, start handle packet, processing data packets terminate or packet be forwarded to the node of next server process time, generate the message logging comprising message identifier;
B, described message logging collected and processes, and then generating the form describing server health.
2. a kind of method according to message identifier trace data bag according to claim 1, is characterized in that, collecting described message logging and processing in described step B, and it specifically comprises:
B1, according to message identifier, the message logging comprising this message identifier is searched, and returns lookup result;
B2, according to lookup result, therefrom extract the time of this packet that receives, time that time that time that time that the time being distributed to backend services server, backend services server receive this packet, backend services server send object command, Tcp server receive this result and Tcp server send result.
3. a kind of method according to message identifier trace data bag according to claim 1, is characterized in that, also comprise:
C, the message logging that monitoring is all in real time, message logging is sampled or complete analysis, when occur the processing time exceed Preset Time or process failed quantity be greater than the situation of predetermined threshold value time, call note and mail interface according to the contact method of the system manager preset, send current system problem to system manager.
4. a kind of method according to message identifier trace data bag according to claim 1, is characterized in that, the form of described packet includes four attributes, and it is specially: message identifier, function, operational motion and sending object.
5. a kind of method according to message identifier trace data bag according to claim 1, is characterized in that, described message identifier is the character string with global unique identifier adopting UUID to generate.
6. according to a system for message identifier trace data bag, it is characterized in that, comprising:
Message logging memory module, for receiving packet when server, starts handle packet, processing data packets when terminating or packet be forwarded to the node of next server process, generates the message logging comprising message identifier;
Message logging analysis module, for collecting described message logging and processing, and then generates the form describing server health.
7. a kind of system according to message identifier trace data bag according to claim 6, is characterized in that, described message logging analysis module comprises:
Search unit, for according to message identifier, the message logging comprising this message identifier is searched, and returns lookup result;
Extraction unit, for according to lookup result, therefrom extract the time of this packet that receives, time that time that time that time that the time being distributed to backend services server, backend services server receive this packet, backend services server send object command, Tcp server receive this result and Tcp server send result.
8. a kind of system according to message identifier trace data bag according to claim 6, is characterized in that, also comprise:
Monitoring module, for monitoring all message loggings in real time, message logging is sampled or complete analysis, when occur the processing time exceed Preset Time or process failed quantity be greater than the situation of predetermined threshold value time, call note and mail interface according to the contact method of the system manager preset, send current system problem to system manager.
9. a kind of system according to message identifier trace data bag according to claim 6, is characterized in that, the form of described packet includes four attributes, and it is specially: message identifier, function, operational motion and sending object.
10. a kind of system according to message identifier trace data bag according to claim 6, is characterized in that, described message identifier is the character string with global unique identifier adopting UUID to generate.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410853952.8A CN104618144A (en) | 2014-12-31 | 2014-12-31 | Method and system for tracking data package according to message identifier |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410853952.8A CN104618144A (en) | 2014-12-31 | 2014-12-31 | Method and system for tracking data package according to message identifier |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104618144A true CN104618144A (en) | 2015-05-13 |
Family
ID=53152435
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410853952.8A Pending CN104618144A (en) | 2014-12-31 | 2014-12-31 | Method and system for tracking data package according to message identifier |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104618144A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105488202A (en) * | 2015-12-09 | 2016-04-13 | 浪潮(北京)电子信息产业有限公司 | Method, apparatus and system for performance bottleneck location for distributed file system |
| CN106301948A (en) * | 2016-08-31 | 2017-01-04 | 北京奇艺世纪科技有限公司 | A kind of message circulation visualization and monitoring method and system |
| CN106789301A (en) * | 2016-12-29 | 2017-05-31 | 北京神州绿盟信息安全科技股份有限公司 | A kind of method and device of the running log of generation WEB gateways |
| CN108462750A (en) * | 2018-03-22 | 2018-08-28 | 平安好房（上海）电子商务有限公司 | Distribution calls method for tracing, operation system, monitoring system and storage medium |
| CN109739741A (en) * | 2018-11-26 | 2019-05-10 | 北京网众共创科技有限公司 | System detection method and device, storage medium and electronic device |
| CN110750684A (en) * | 2018-07-06 | 2020-02-04 | 武汉斗鱼网络科技有限公司 | Message prompting method for multi-dimensional verification, storage medium, electronic device and system |
| WO2020107342A1 (en) * | 2018-11-29 | 2020-06-04 | 华为技术有限公司 | Method and device for tracking service execution process in distributed system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101056208A (en) * | 2007-05-31 | 2007-10-17 | 华为技术有限公司 | Service tracking method, network device, O&M controller, and service request device |
| US20090125758A1 (en) * | 2001-12-12 | 2009-05-14 | Jeffrey John Anuszczyk | Method and apparatus for managing components in an it system |
| CN101436956A (en) * | 2007-11-12 | 2009-05-20 | 北京启明星辰信息技术有限公司 | Method and system for measuring and calculating database operation response time |
| CN101808167A (en) * | 2009-02-13 | 2010-08-18 | 华为技术有限公司 | Method for procedure tracking, device and system |
| CN102088376A (en) * | 2010-12-31 | 2011-06-08 | 中国航空工业集团公司第六三一研究所 | Communication monitoring system and method for integrated avionics system |
| CN102394773A (en) * | 2011-11-01 | 2012-03-28 | 杭州华三通信技术有限公司 | Trap message submission method and equipment |
-
2014
- 2014-12-31 CN CN201410853952.8A patent/CN104618144A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090125758A1 (en) * | 2001-12-12 | 2009-05-14 | Jeffrey John Anuszczyk | Method and apparatus for managing components in an it system |
| CN101056208A (en) * | 2007-05-31 | 2007-10-17 | 华为技术有限公司 | Service tracking method, network device, O&M controller, and service request device |
| CN101436956A (en) * | 2007-11-12 | 2009-05-20 | 北京启明星辰信息技术有限公司 | Method and system for measuring and calculating database operation response time |
| CN101808167A (en) * | 2009-02-13 | 2010-08-18 | 华为技术有限公司 | Method for procedure tracking, device and system |
| CN102088376A (en) * | 2010-12-31 | 2011-06-08 | 中国航空工业集团公司第六三一研究所 | Communication monitoring system and method for integrated avionics system |
| CN102394773A (en) * | 2011-11-01 | 2012-03-28 | 杭州华三通信技术有限公司 | Trap message submission method and equipment |
Non-Patent Citations (1)
| Title |
|---|
| 左羽: "《网络追踪技术研究》", 《重庆工学院学报》 * |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105488202A (en) * | 2015-12-09 | 2016-04-13 | 浪潮(北京)电子信息产业有限公司 | Method, apparatus and system for performance bottleneck location for distributed file system |
| CN105488202B (en) * | 2015-12-09 | 2018-12-18 | 浪潮(北京)电子信息产业有限公司 | A kind of distributed file system performance bottleneck localization method, device and system |
| CN106301948A (en) * | 2016-08-31 | 2017-01-04 | 北京奇艺世纪科技有限公司 | A kind of message circulation visualization and monitoring method and system |
| CN106789301A (en) * | 2016-12-29 | 2017-05-31 | 北京神州绿盟信息安全科技股份有限公司 | A kind of method and device of the running log of generation WEB gateways |
| CN106789301B (en) * | 2016-12-29 | 2020-11-20 | 北京神州绿盟信息安全科技股份有限公司 | Method and device for generating running log of WEB gateway |
| CN108462750A (en) * | 2018-03-22 | 2018-08-28 | 平安好房（上海）电子商务有限公司 | Distribution calls method for tracing, operation system, monitoring system and storage medium |
| CN110750684A (en) * | 2018-07-06 | 2020-02-04 | 武汉斗鱼网络科技有限公司 | Message prompting method for multi-dimensional verification, storage medium, electronic device and system |
| CN110750684B (en) * | 2018-07-06 | 2022-08-16 | 武汉斗鱼网络科技有限公司 | Message prompting method for multi-dimensional verification, storage medium, electronic device and system |
| CN109739741A (en) * | 2018-11-26 | 2019-05-10 | 北京网众共创科技有限公司 | System detection method and device, storage medium and electronic device |
| WO2020107342A1 (en) * | 2018-11-29 | 2020-06-04 | 华为技术有限公司 | Method and device for tracking service execution process in distributed system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104618144A (en) | Method and system for tracking data package according to message identifier | |
| CN106330602B (en) | A kind of virtual tenant network monitoring method of cloud computing and system | |
| US8676729B1 (en) | Network traffic classification using subspace clustering techniques | |
| CN110222091A (en) | A kind of mass data real-time statistic analysis method | |
| KR20140119561A (en) | System and method for big data aggregaton in sensor network | |
| CN105072196B (en) | The storage of distributed data packet, retrogressive method and system | |
| CN107273267A (en) | Log analysis method based on elastic components | |
| CN104753732A (en) | Distribution based network traffic analysis system and method | |
| CN107229556A (en) | Log Analysis System based on elastic components | |
| CN104579823A (en) | Large-data-flow-based network traffic abnormality detection system and method | |
| US20170295068A1 (en) | Logical network topology analyzer | |
| EP3364627B1 (en) | Adaptive session intelligence extender | |
| EP3397932A1 (en) | System and method for acquiring, processing and updating global information | |
| CN105376248A (en) | Method and device for identifying abnormal flow | |
| CN103326896A (en) | System and method for collecting information data generated by a user on Internet | |
| CN108519942A (en) | A kind of Log Analysis System | |
| CN104734894A (en) | Flow data screening method and device | |
| CN112637366A (en) | Vehicle network vehicle data acquisition method based on micro-service | |
| CN110661807A (en) | Automatic acquisition method and device for IPv6 address | |
| CN111224893A (en) | VPN-based android mobile phone traffic collection and labeling system and method | |
| CN105933208A (en) | Message processing method and device | |
| CN104333485A (en) | Business data acquisition and analysis method and system based on interchanger total quantity | |
| CN104468248A (en) | Service performance monitoring method, reverse proxy server, statistical analysis server and system | |
| CN103517292A (en) | Mobile terminal information reporting method and apparatus | |
| CN116737523B (en) | Observability data acquisition method based on edge calculation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 518000 Nanshan Medical Instrument Industrial Park 1019, Nanhai Road, Nanshan District, Shenzhen, Guangdong, A211-A213 Applicant after: Shenzhen Hai Yun new energy Co., Ltd. Address before: 518052 Nanshan Medical Instrument Industrial Park 1019, Nanhai Road, Nanshan District, Shenzhen, Guangdong, A211-A213 Applicant before: SHENZHEN GOLDWEB TECHNOLOGY CO., LTD. |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20150513 |