CN106789418A - A kind of method of IDC computer rooms traffic sampling monitoring analysis - Google Patents

A kind of method of IDC computer rooms traffic sampling monitoring analysis Download PDF

Info

Publication number
CN106789418A
CN106789418A CN201611159351.2A CN201611159351A CN106789418A CN 106789418 A CN106789418 A CN 106789418A CN 201611159351 A CN201611159351 A CN 201611159351A CN 106789418 A CN106789418 A CN 106789418A
Authority
CN
China
Prior art keywords
sampling
computer room
flow
idc computer
monitoring
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201611159351.2A
Other languages
Chinese (zh)
Inventor
高勇
刘善武
孟繁瑞
孙涛
吴凤军
李新
王晓莹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tianjin Rui Digital Security System Ltd By Share Ltd
Shandong Communications Administration
Original Assignee
Tianjin Rui Digital Security System Ltd By Share Ltd
Shandong Communications Administration
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tianjin Rui Digital Security System Ltd By Share Ltd, Shandong Communications Administration filed Critical Tianjin Rui Digital Security System Ltd By Share Ltd
Priority to CN201611159351.2A priority Critical patent/CN106789418A/en
Publication of CN106789418A publication Critical patent/CN106789418A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0876Network utilisation, e.g. volume of load or congestion level
    • H04L43/0888Throughput
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/50Testing arrangements

Abstract

The invention discloses a kind of flow monitoring analysis method optimal to IDC computer room flows.The inventive method goes out in flow in certain IDC computer room, in the case that data are flowed into the different sampling ratios of line period adjustment monitoring, simulate the content such as website target spot keyword in the access IDC computer rooms of concurrent fixed number of times, and record the probable value that target spot content is found in the range of different time, it is inferred to optimal sampling ratio and input ratio under the building environment so as to analyze, reduces input cost and reach optimal monitoring effect.This method is applied to the application of all IDC computer rooms web site contents monitoring matching.

Description

A kind of method of IDC computer rooms traffic sampling monitoring analysis
Technical field
The invention discloses the system that a kind of flow monitoring analysis method optimal to IDC computer room flows, the method are realized IDC computer rooms are deployed in by the way of bypass, sampling monitoring is carried out to the flow that backs towards in computer room, reached by lengthening the sampling time Equal effect is monitored to non-sampled.
Background technology
With the development and the progress of internet management technological means of information technology, the collection of internet comprehensive management platform, Treatment, the data for accumulating are more and more, and data volume speedup is also more and more faster.Internet data center (abbreviation IDC) is pacified in information Full monitoring aspect has consequence, strengthens the supervision to internet site, and this is a commanding elevation, according to information security The requirement of management system in supervision computer room deployment probe device, it is necessary to realize monitoring, management and control, the analysis to internet traffic data Etc. information.Because the flow of national IDC computer rooms is huge, and bandwidth dilatation is carried out with exponential speed every year, so in reality Applying and dispose managing and control system and technical elements will put into very big cost, and constantly be put into according to the growth of bandwidth new Equipment carry out overall monitor, cost is huge.
In going out to flow it is an object of the invention to provide a kind of IDC computer rooms, data are flowed into line period adjustment monitoring In the case of difference sampling ratio, the content such as website target spot keyword in the access IDC computer rooms of concurrent fixed number of times is simulated, and record The probable value that lower target spot content is found in the range of different time, so as to analyze be inferred to optimal sampling under the building environment Than and input ratio, reduce input cost reach optimal monitoring effect.
The content of the invention
The invention discloses a kind of flow monitoring analysis method optimal to IDC computer room flows.The inventive method is in certain IDC During computer room goes out to flow, in the case that data are flowed into the different sampling ratios of line period adjustment monitoring, concurrent fixed number of times is simulated Access IDC computer rooms in the content such as website target spot keyword, and record what target spot content was found in the range of different time Probable value, so as to analyze be inferred to optimal sampling ratio and input ratio under the building environment, reduce input cost reach it is optimal Monitoring effect.This method is applied to the application of all IDC computer rooms web site contents monitoring matching.
The present invention has following characteristics:
1st, by reducing the sample rate of covering computer room link, input management and control devices are reduced, reaches the effect of reduces cost;
2nd, under the premise of the sampling time is lengthened, sample rate is reduced, the matching of keyword content and discovery effect are unaffected;
3rd, in actual network context environment, by the simulation test environment built, can quickly determine different pieces of information, The optimum sampling ratio of the IDC computer rooms under different business environment.
Brief description of the drawings
A kind of computer room test topology schematic diagrames of IDC computer rooms traffic sampling monitoring analysis of Fig. 1.
The schematic diagram for reporting and storing of Fig. 2 domain names, IP address and correspondence visit capacity.
The lower auto-associating classification schematic diagram of Fig. 3 IP rules.
Fig. 4 IDC computer rooms website is classified management and control schematic diagram.
Fig. 5, Fig. 6 internet user access control flow chart.
Specific embodiment
Existing network data test is that fluidic device is respectively provided with 10%, 15%, 20%, 30% under IDC computer room data environments Sampling rate when, what kind of effect the discovery Website page function of IDC systems, keyword monitoring function respectively reach.Will test Data are contrasted, and draw one group of data of system performance index under different time sections, different background flow, different sampling rates.
The scenario test cycle is 3 days, is tested 3 time slices are divided into daily.Respectively daily 10:00-13: 00、15:00-18:00、19:00-22:00.In each time slice, then separate sampling fraction 10%, 15%, 20%, 30% this four The situation of kind.By way of simulating client and accessing website, respectively under different sampling fractions, 20 concurrent access requests, test All target spot URL (1000), the page and keyword are by the time of system discovery, the keyword monitoring for target spot content of pages Accuracy rate.
12 tasks can be divided into according to testing process, be respectively task P-1-1, P-1-2, P-1-3, P-1-4, P-2- 1st, P-2-2, P-2-3, P-2-4, P-3-1, P-3-2, P-3-3, P-3-4.Wherein P represents this test plan, middle numeral First testing time section in representing one day, last one-bit digital represents 4 sampling rate conditions.This 12 tasks will according to when Between order perform following all steps successively.
Task P-1-1 starts to perform following steps successively before test:
When the 1st, testing this first, the startup set of time that pseudo-terminal is accessed is good;
2nd, tester and technical support personnel determine that test environment has been restored to original state, and correlation module is not deposited In the data that last time test is produced;
3rd, test system is logged in, Monitoring instruction is issued;
4th, tester records the startup time in table;
Task P-1-1 performs following steps successively during testing:
1st, tester ensures that pseudo-terminal accesses normal operation;
Task P-1-1 tests perform following steps successively after terminating:
1st, after this test terminates, tester dumps under specified file path this test result;
2nd, notification technique support staff immediately after this test terminates, allow he at the scene perform script remove this test and exist The data that EU ends produce;
3rd, after tester derives discovery data, perform script removes the data produced in this test;
4th, circular order performs other tasks.

Claims (4)

1., the invention discloses a kind of flow monitoring analysis method optimal to IDC computer room flows, the system that the method is realized is adopted IDC computer rooms are deployed in the mode of bypass, sampling monitoring is carried out to the flow that backs towards in computer room, reached by lengthening the sampling time Non-sampled monitors equal effect.
2. according to claim 1 it is a kind of based on back towards flow rate calculation optional sampling than method, computer room flow is divided into Enter to go out to flow, only match and search for qualified content in going out to flow, and object content has and repeats The characteristics of, calculated based on the sampling that above rule is rationalized.
3. a kind of increase sampling time according to claim 1 reduce the method for sampling of sample rate, in IDC computer room super larges Under traffic conditions, the processing equipment amount that carry out full flow covering needs is huge, and sample rate is reduced by increasing the sampling period, reaches To the method for reduces cost.
4. the one kind according to claim 1 builds simulation in the case of existing network environment is as background traffic in computer room Multiple target spot servers as accessed object, in computer room, outer using terminal system simulation client accesses concurrent request, passes through The step of being repeated several times property, calculates optimum sampling ratio;Characterized in that, fixed target spot server keyword content quantity, fixation In the case of the concurrent access request of client, fixed computer room background traffic acquisition time section, by testing repeatedly, multigroup experiment is obtained Data are calculated and compared, prove optional sampling than method.
CN201611159351.2A 2016-12-15 2016-12-15 A kind of method of IDC computer rooms traffic sampling monitoring analysis Pending CN106789418A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611159351.2A CN106789418A (en) 2016-12-15 2016-12-15 A kind of method of IDC computer rooms traffic sampling monitoring analysis

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611159351.2A CN106789418A (en) 2016-12-15 2016-12-15 A kind of method of IDC computer rooms traffic sampling monitoring analysis

Publications (1)

Publication Number Publication Date
CN106789418A true CN106789418A (en) 2017-05-31

Family

ID=58889237

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611159351.2A Pending CN106789418A (en) 2016-12-15 2016-12-15 A kind of method of IDC computer rooms traffic sampling monitoring analysis

Country Status (1)

Country Link
CN (1) CN106789418A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107171871A (en) * 2017-07-19 2017-09-15 山东省通信管理局 It is a kind of based on the internet site's management and control separation method gone here and there and combined
CN107231376A (en) * 2017-07-19 2017-10-03 山东省通信管理局 A kind of IDC computer rooms dynamic cataloging hierarchical management system
CN109460829A (en) * 2018-11-05 2019-03-12 常熟理工学院 Based on the intelligent monitoring method and platform under big data processing and cloud transmission
CN112350887A (en) * 2020-10-19 2021-02-09 北京基调网络股份有限公司 APM probe sampling rate determining method, computer equipment and storage medium
CN117118868A (en) * 2023-07-03 2023-11-24 合肥拓扑信息科技有限公司 Distributed mobile ad hoc network target monitoring and evaluating system and method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101267349A (en) * 2008-04-29 2008-09-17 杭州华三通信技术有限公司 Network traffic analysis method and device
CN102404231A (en) * 2011-12-19 2012-04-04 曙光信息产业(北京)有限公司 System and method for dynamically adjusting message sampling rate by combining software with hardware
CN103051552A (en) * 2012-12-04 2013-04-17 恒安嘉新(北京)科技有限公司 Intelligent management and control method and system based on separation of tandem connection blockage and side channel analysis
CN104618379A (en) * 2015-02-04 2015-05-13 北京天地互连信息技术有限公司 IDC service scene-oriented security service arranging method and network structure
CN104702463A (en) * 2014-12-17 2015-06-10 北京百度网讯科技有限公司 Method, device and system for bypass testing of multiple machine rooms

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101267349A (en) * 2008-04-29 2008-09-17 杭州华三通信技术有限公司 Network traffic analysis method and device
CN102404231A (en) * 2011-12-19 2012-04-04 曙光信息产业(北京)有限公司 System and method for dynamically adjusting message sampling rate by combining software with hardware
CN103051552A (en) * 2012-12-04 2013-04-17 恒安嘉新(北京)科技有限公司 Intelligent management and control method and system based on separation of tandem connection blockage and side channel analysis
CN104702463A (en) * 2014-12-17 2015-06-10 北京百度网讯科技有限公司 Method, device and system for bypass testing of multiple machine rooms
CN104618379A (en) * 2015-02-04 2015-05-13 北京天地互连信息技术有限公司 IDC service scene-oriented security service arranging method and network structure

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107171871A (en) * 2017-07-19 2017-09-15 山东省通信管理局 It is a kind of based on the internet site's management and control separation method gone here and there and combined
CN107231376A (en) * 2017-07-19 2017-10-03 山东省通信管理局 A kind of IDC computer rooms dynamic cataloging hierarchical management system
CN109460829A (en) * 2018-11-05 2019-03-12 常熟理工学院 Based on the intelligent monitoring method and platform under big data processing and cloud transmission
CN112350887A (en) * 2020-10-19 2021-02-09 北京基调网络股份有限公司 APM probe sampling rate determining method, computer equipment and storage medium
CN112350887B (en) * 2020-10-19 2021-07-13 北京基调网络股份有限公司 APM probe sampling rate determining method, computer equipment and storage medium
CN117118868A (en) * 2023-07-03 2023-11-24 合肥拓扑信息科技有限公司 Distributed mobile ad hoc network target monitoring and evaluating system and method

Similar Documents

Publication Publication Date Title
CN106789418A (en) A kind of method of IDC computer rooms traffic sampling monitoring analysis
JP5160556B2 (en) Log file analysis method and system based on distributed computer network
CN103188112B (en) Network flow detection method and device
CN105224691B (en) A kind of information processing method and device
CN102724059A (en) Website operation state monitoring and abnormal detection based on MapReduce
CN104683182B (en) IDC network of computer room service quality detection method and device
KR20210118452A (en) Real-time event detection for social data streams
CN105718587A (en) Network content resource evaluation method and evaluation system
Zhang et al. Identifying, analyzing, and modeling flashcrowds in bittorrent
CN103428042A (en) Method and system for carrying out stress test on server
CN109063158A (en) A kind of method, equipment, system and the medium of the inquiry of website visiting ranking information
CN115776449B (en) Train Ethernet communication state monitoring method and system
CN104202418B (en) Recommend the method and system of the content distributing network of business for content supplier
CN107526748B (en) Method and equipment for identifying user click behavior
CN106027408A (en) CDN (Content Delivery Network) network model node server access pressure detection method and system
Dick et al. An empirical investigation of Web session workloads: Can self-similarity be explained by deterministic chaos?
CN104376027B (en) Information acquisition and analysis system and its method based on social media
CN115225455A (en) Abnormal device detection method and device, electronic device and storage medium
GB2382492A (en) System analysis
CN108268370B (en) Website quality analysis method, device and system based on Referer and template library matching
CN111611508A (en) Identification method and device for actual website access of user
Babić et al. Network analysis of evolving software-systems
Li et al. Application of autonomous monitoring method based on distributed environment deployment in network fault
Uzun et al. End-to-end internet speed analysis of mobile networks with mapReduce
CN102075379A (en) Method and apparatus for the efficient indexing and storage of network traffic

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20170531

WD01 Invention patent application deemed withdrawn after publication