CN109947863A - Traffic statistics analysis system for mobile network - Google Patents
Traffic statistics analysis system for mobile network Download PDFInfo
- Publication number
- CN109947863A CN109947863A CN201711358369.XA CN201711358369A CN109947863A CN 109947863 A CN109947863 A CN 109947863A CN 201711358369 A CN201711358369 A CN 201711358369A CN 109947863 A CN109947863 A CN 109947863A
- Authority
- CN
- China
- Prior art keywords
- data
- module
- server
- network
- data server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The present invention provides a kind of traffic statistics analysis system for mobile network, including a data server and Duo Tai client, data server are connect with mobile communications network, and more clients are connected by Business Administration Network or internet with data server；Data server is PC server；Data server includes sequentially connected raw data acquisition module, decoding and merger processing module, data summarization module, report form showing module, decoding and merger processing module are equipped with balanced binary tree algoritic module, high-volume replication module, the Report Forms Service module of Microsoft's database software.The balanced binary tree algorithm that this system uses greatly improves global analysis arithmetic speed, and system Construction cost is greatly reduced in PC server；ReportingServices report component technology provides B/S and C/S operating mode together with client software for client.
Description
Technical field
The present invention relates to the performance analysis systems in operation support management system field, and in particular to mobile network's traffic system
Score analysis system.
Background technique
Network performance problems are not single unilateral problems, are difficult to be handled with simple unified method.For one
Completely dynamic network, the optimizing cycle needed is longer, and optimal way is also more complicated.Mobile communication is due to radio propagation environment
It is complicated and changeable, lead to many communication quality problems, such as slow fading phenomenon, rapid fading phenomenon, Doppler frequency shift noise, mobile station
Self-interference etc., network performance changes at any time, therefore awareness network changes trend in real time, analyzes reason of changes in time for operator
Operating condition, the network quality for grasping mobile communications network seem very necessary.
Performance analysis system is network analysis and the important means and reference frame optimized and revised, is mobile communication operator
One of essential daily management tool.
Traffic statistics include many communication network statistical indicators, these indexs be assess network performance it is important according to
According to some indexs are statistics with entire RNC (Radio Network Controller, radio network controller) network range
Benchmark, some are counted on the basis of each Cell (cell).Therefore these indexs both can be from the single angle Cell
Degree can also react the running quality situation of communication network from the angle of overall network.
By to traffic statistics carry out it is a series of the data processings such as decode, screen, summarize, can be from traffic measurement
Data obtain most concerned many Key Performance Indicator (KPI, the Key Performance of mobile communication operator
), such as call setup success rate (call_setup_success_rate), cutting off rate (drop_call_ Indicator
Rate), handover success rate (handover_success_rate), TCH telephone traffic (tch_traffic), SDCCH blocking rate
(sdcch_congestion_key) indexs such as.Network operation situation report promptly and accurately is provided for mobile communication operator.
The data volume of traffic measurement is very big, for the small city communication network of 300 Cell, about generates the original words of 3G daily
Business data 450MB may be up to 10000 Cell, the original words of the 3G generated daily for the communication network of certain large size cities
Business data are up to 15GB data.Therefore it must pay attention to data operation velocity efficiency, i.e. original data processing speed, data storage
And retrieval capability.
1, original data processing speed
2G network is not high to data-handling efficiency requirement, but 3G network is very high to data-handling efficiency requirement, because of 3G
Network ratio 2G network increases a data merging process.By analysis, 3G network aggregation of data process is analysis system
Most time consuming part, this is also the distinctive treatment process of 3G network.
Because 3G network breaches the fixed mode of 2G, the flexible customization of network implementations, initial data is arranged with client
Configuration variation and change, this 3G customization technology facilitates customer account management, but brings completely new challenge to data processing, handles 3G
Network traffic statistical data must solve two problems, and be that multiple field datas of same record may be stored separately first
In the different places of original document, followed by part field data it is possible that repeating.
Network analysis software known to the country often uses database merger scheme when handling 3G network data, i.e., sharp
The processing of 3G aggregation of data is realized with the ranking function of database, although these scheme functions are correct, poor efficiency needs to disappear
The SQL database retrieval that consumption is million times, wherein SQL full name in English is Structured Query Language, be it is a kind of most
Common database technology.This means that consuming a large amount of operation time, the speed of service is very slow, and the data service used
Device is high-grade unix server, therefore client is difficult to receive.
The showing to original traffic statistics merger processing for network analysis software system known to the country as shown in Figure 1
It is intended to.A1, A2, A3, A4, A5 are 5 fields of same data record, but are separately placed on the different piece of original document,
And A2 field data repeats 3 times in original document.Therefore 3G network analyzing software system is needed through merging mistake
Journey solves these problems, and the effect of merging is to be merged together the data of the identical recordings of different places, and delete
Except duplicate data, therefore different merger realizes that technology directly influences the processing speed of system.
2, data storage and search ability
Valid data of the original traffic statistics of 3G after merger need to be stored in database, for 300
The small scale network of cell, database design capacity are approximately 2GB, for the large scale network of 10000 cell, database design
Capacity will reach 50GB.Database has mass data to import daily and exports operation, and the 2G network analysis software of low side is common
Access database (Microsoft Office Access, a kind of database software of Microsoft) is can not to undertake this
Data scale, it is therefore necessary to based on the large database for selecting profession.
It can be seen that the analysis software of many 2G networks can not reach the requirement of 3G network due to various reasons at present,
As China's 3G network gradually promotes and applies, there is an urgent need to the new analysis softwares of 3G network.
Summary of the invention
The primary purpose of the present invention is that the shortcomings that overcoming the above-mentioned prior art and deficiency, provide a kind of mobile network's traffic
Statistical analysis system, present system inside uses the efficient balanced binary tree algorithm towards memory, instead of traditional number
It is handled according to library merger, greatly improves global analysis arithmetic speed, realized in cheap PC server and high-grade unix server phase
Same function, can be greatly reduced system Construction cost；System introduce SQL Server (Microsoft SQL Server, it is micro-
The database software of soft company) Reporting Services (Report Forms Service module), together with client software, be client
B/S (Browser/Server architecture model, browser/server framework mode) and C/S (client/ are provided
Serverarchitecture model, client/server architecture mode) two kinds of operating modes.
The object of the invention is achieved through the following technical solutions: traffic statistics analysis system for mobile network includes a number of units according to clothes
Business device and Duo Tai client, data server are connect with mobile communications network, and more clients are by Business Administration Network or mutually
Networking is connected with data server；The data server is PC server；The data server includes sequentially connected
Raw data acquisition module, decoding and merger processing module, data summarization module, report form showing module, wherein decoding and merger
Processing module is provided with balanced binary tree algoritic module, SqlBulkCopy module (high-volume replication module), the report form showing
Module uses SQL Server Reporting Services module (the Report Forms Service module of Microsoft's database software).
The data server uses the PC server of windows platform, can be taken by connecting with mobile communications network
The analysis data for obtaining mobile communication equipment save in this data server after decoding and arrangement.
The raw data acquisition module obtains original traffic measurement from mobile communication equipment in regular 15 minutes or 1 hour
Data；Data acquisition module also has the function of that mistake retries and recalls acquisition, and break number caused by waiting a variety of causes in a network
After mistakes and omissions, acquisition data can be automatically replenished, guarantee the integrality of data to greatest extent.
The balanced binary tree algoritic module is established in partial memory (about 50MB size), using balanced binary tree algorithm
Merger processing is carried out to original traffic statistics, the balanced binary tree module of all merger operations all in memory carries out,
Save million database manipulations；The SqlBulkCopy module uses SqlBulkCopy (high-volume reproduction technology) skill
Treated that traffic statistics quickly introduce in data server saves by merger for art.
The data summarization module is according to the theory of data warehouse, and temporally two dimensions of dimension and network element dimension are to traffic
Statistical data, which intersect, to summarize, and can produce that the moon summarizes data, day summarizes data, hour summarizes data on time dimension
Deng can produce the whole network in network element dimension and summarize data, RNC/BSC (radio network controller/base station controller) total amount
According to cell summarizes data etc..
The report form showing module uses SQL Server Reporting Services module, the analysis that both pictures and texts are excellent
Report.SQL Server Reporting Services is SQL Server 2005 (version of SQL Server)
One integrated package is the report platform based on server；SQL Server Reporting Services has number abundant
According to the ability of presentation, can create and manage the tables of the data in inclusion relation data source and multi-dimensional data source, matrix, figure and
The report of free-format can be exported by checking and managing created report based on the connection of WWW
The report of HTML, PDF, Excel format etc..SQL Server Reporting Services can carry out deeper time simultaneously
The functions such as data mining.The report form showing module reference SQL Server Reporting Services module is as number
According to one of presentation mode, the various map-integrated OA such as user-friendly report, especially histogram, curve graph is generated, allows administrator
Intuitively understand COMMUNICATION NETWORK PERFORMANCES variation trend.
More clients are connected by Business Administration Network with data server, more clients can with concurrent working,
The telecommuting pipe of safety can also be realized by VPN (Virtual Private Network, Virtual Private Network) gateway
Reason.Client can run client software under C/S model, execute the network analysis operation of various professions；Client may be used also
Daily network analysis work is easily carried out to run IE browser under B/S mode.
The present invention has the following advantages and effects with respect to the prior art:
(1) the high-grade UNIX that data server of the present invention replaces traditional traffic data statistical system to use using PC server
System Construction cost can be greatly reduced in server；
(2) the efficient balanced binary tree algorithm towards memory is used inside present system, instead of traditional data
Library merger processing, greatly improves global analysis arithmetic speed；
(3) the SqlBulkCopy module in present system is using SqlBulkCopy technology by merger treated traffic
Statistical data is quickly introduced in data server and is saved, and improves data boot speed significantly；
(4) the report form showing module in present system uses SQL Server Reporting Services module, makees
For one of data presentation mode, the various map-integrated OA such as user-friendly report, especially histogram, curve graph is generated, allows pipe
Reason person intuitively understands COMMUNICATION NETWORK PERFORMANCES variation trend.
Detailed description of the invention
Fig. 1 is schematic diagram of the network analysis software system known to the country to original traffic statistics merger processing；
Fig. 2 is hardware structure diagram of the invention；
Fig. 3 is schematic diagram of the present invention to original traffic statistics merger processing.
Specific embodiment
Below with reference to examples and drawings, the present invention is described in further detail, but embodiments of the present invention are not
It is limited to this.
Embodiment
Fig. 2 show hardware configuration of the invention, and traffic statistics analysis system for mobile network includes a data server
With more clients, which uses the PC server of windows platform, and data server and mobile communications network connect
It connects, the analysis data of mobile communication equipment can be obtained, saved in this data server after decoding and arrangement；
More clients are connected by Business Administration Network or internet with data server；More clients can be simultaneously
Row work can also realize the telecommuting management of safety by vpn gateway；Client can run client under C/S model
Software is held, the network analysis operation of various professions is executed；Client can also be run under B/S mode IE browser easily into
The daily network analysis work of row.
The data server includes sequentially connected raw data acquisition module, decoding and merger processing module, data
Summarizing module, report form showing module, wherein decoding and merger processing module be provided with balanced binary tree algoritic module,
SqlBulkCopy module, the report form showing module use SQL Server Reporting Services module.
The raw data acquisition module obtains original traffic measurement from mobile communication equipment in regular 15 minutes or 1 hour
Data；Data acquisition module also has the function of that mistake retries and recalls acquisition, and break number caused by waiting a variety of causes in a network
After mistakes and omissions, acquisition data can be automatically replenished, guarantee the integrality of data to greatest extent.
The balanced binary tree algoritic module is established in partial memory (about 50MB size), using balanced binary tree algorithm
Merger processing is carried out to original traffic statistics, the balanced binary tree module of all merger operations all in memory carries out,
Save million database manipulations.Fig. 3 show this system using the merger process schematic after balanced binary tree, specifically
It is as follows:
The characteristics of original document:
1, multiple item datas of same record are divided among different location；
2, partial data item may repeat；
3, partial data item may lack.
Merger is illustrated in figure:
1, A1, A2, A3, A4, A5 belong to same record, but are separately placed on the different location of original document, need to merge
It is recorded at one；
2, the field datas such as A2 in original document, B2 repeat repeatedly, to need to delete repetition；
3, partial data may lack, such as B4 and D3 shortage of data, be replaced with blank " ".
By merger, treated that traffic statistics are quick using SqlBulkCopy technology for the SqlBulkCopy module
It imported into data server and saves.SqlBulkCopy technology is that one of Microsoft Corporation SQL Server database is big
Mass replication technique.Dedicated for improving the boot speed of bulk data.Although it is not belonging to stsndard SQL sentence, feasibility
Can be very high, the test result under equal conditions shows that stsndard SQL sentence imports ACCESS database and needs 30 seconds, stsndard SQL
Sentence imports 2005 database of SQL Server and needs 6 seconds, and SqlBulkCopy sentence is used to import SQL Server
2005 databases only need 1.5 seconds.In other words, this special technology is 4 speeds of stsndard SQL sentence, more compares ACCESS
Database is 10 times or more fast.
The data summarization module is according to the theory of data warehouse, and temporally two dimensions of dimension and network element dimension are to traffic
Statistical data, which intersect, to summarize, and can produce that the moon summarizes data, day summarizes data, hour summarizes data on time dimension
Deng can produce that the whole network summarizes data, RNC/BSC summarizes data in network element dimension, cell summarizes data etc..
The report form showing module uses SQL Server Reporting Services module, the analysis that both pictures and texts are excellent
Report.SQL Server Reporting Services is an integrated package of SQL Server 2005, is based on service
The report platform of device；There are SQL Server Reporting Services data abundant ability is presented, and can create and manage
The report for managing the tables of inclusion relation data source and the data in multi-dimensional data source, matrix, figure and free-format, can pass through
Created report is checked and managed based on the connection of WWW, the report of HTML, PDF, Excel format etc. can be exported.
SQL Server Reporting Services can carry out the functions such as deeper data mining simultaneously.The report exhibition
Existing module reference SQL Server Reporting Services module generates user friendly as one of data presentation mode
Report, the especially various map-integrated OA such as histogram, curve graph allows administrator to intuitively understand COMMUNICATION NETWORK PERFORMANCES variation dynamic
To.Client can operate on IE web browser, and system retrieves corresponding business datum from database, need by client
Data presentation mode generates network performance analysis report.Statement form is rich and varied, either data list, is also possible to figure
The report of Wen Bingmao can both show the operating condition of the whole network, can also show the practival operating condition of certain cells.
After this system is using technical measures such as balanced binary tree algorithm and SqlBulkCopy, solves the property of key component
Energy problem, reaches the technical requirements of 3G network, and done a contrast test, here is main test condition:
Test result shows certain traditional call-data analysis software time-consuming 1 hour 29 points altogether, and this system is 3 minutes 20
Second, it is seen that this system improves 20 times or more than traditional traffic software speed.
This system has following technical indicator and parameter according to the scale and business demand of home communications network:
1,2G and 3G network traffic statistics are supported；
2, the data analysis capabilities of larger communication network, 10000 cell of network capacity > (Cell) are supported；
3, realization high-speed data merger processing capacity, processing speed > 15OMB/15 minutes；
4, IE browser mode of operation and client operation mode are supported；
5, supported web page report and excel report.
This system research and development are using mature 2.0 Development of Framework platform technology of Microsoft Dot Net, with SQL Server 2005
As Basis of Database, have good scalability and technology perspective.
The above embodiment is a preferred embodiment of the present invention, but embodiments of the present invention are not by above-described embodiment
Limitation, other any changes, modifications, substitutions, combinations, simplifications made without departing from the spirit and principles of the present invention,
It should be equivalent substitute mode, be included within the scope of the present invention.
Claims (2)
1. traffic statistics analysis system for mobile network, including a data server and Duo Tai client, data server and shifting
Dynamic communication network connection, more clients are connected by Business Administration Network or internet with data server；Its feature exists
In: the data server is PC server；The data server includes sequentially connected raw data acquisition module, decoding
With merger processing module, data summarization module, report form showing module, merger processing module is provided with balanced binary wherein decoding
Tree algorithm module, high-volume replication module, the report form showing module use the Report Forms Service mould of Microsoft's database software
Block.
2. traffic statistics analysis system for mobile network according to claim 1, it is characterised in that: the data server is
Using the PC server of windows platform.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711358369.XA CN109947863A (en) | 2017-12-17 | 2017-12-17 | Traffic statistics analysis system for mobile network |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711358369.XA CN109947863A (en) | 2017-12-17 | 2017-12-17 | Traffic statistics analysis system for mobile network |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109947863A true CN109947863A (en) | 2019-06-28 |
Family
ID=67005609
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711358369.XA Pending CN109947863A (en) | 2017-12-17 | 2017-12-17 | Traffic statistics analysis system for mobile network |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109947863A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112100181A (en) * | 2020-09-22 | 2020-12-18 | 国网辽宁省电力有限公司电力科学研究院 | Data resource management method based on sand table |
| CN112100181B (en) * | 2020-09-22 | 2024-06-11 | 国网辽宁省电力有限公司电力科学研究院 | Data resource management method based on sand table |
-
2017
- 2017-12-17 CN CN201711358369.XA patent/CN109947863A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112100181A (en) * | 2020-09-22 | 2020-12-18 | 国网辽宁省电力有限公司电力科学研究院 | Data resource management method based on sand table |
| CN112100181B (en) * | 2020-09-22 | 2024-06-11 | 国网辽宁省电力有限公司电力科学研究院 | Data resource management method based on sand table |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8874600B2 (en) | System and method for building a cloud aware massive data analytics solution background | |
| CN108536778B (en) | Data application sharing platform and method | |
| CN105930446B (en) | A kind of telecom client label generating method based on Hadoop distributed computing technology | |
| EP3654204A1 (en) | Low-latency database analysis using external data sources | |
| US20120066204A1 (en) | Providing lightweight multidimensional online data storage for web service usage reporting | |
| CN105528337B (en) | A kind of method that data conversion realizes performance management system export PPT forms | |
| US11907246B2 (en) | Methods, systems, and computer readable mediums for performing a free-form query | |
| EP4064066A1 (en) | Aggregation operations in a distributed database | |
| CN110706125A (en) | Water conservancy big data analysis information service system and platform service system | |
| CN113642299A (en) | One-key generation method based on power grid statistical form | |
| CN115168396A (en) | Comprehensive intelligent platform data management method and system based on spatio-temporal system | |
| US20240119054A1 (en) | Phrase Translation for a Low-Latency Database Analysis System | |
| CN112506887B (en) | Vehicle terminal CAN bus data processing method and device | |
| Koudas et al. | Data stream query processing. | |
| CN201336731Y (en) | Traffic statistics analysis system for mobile network | |
| US20230252022A1 (en) | Secure And Efficient Database Command Execution Support | |
| CN109947863A (en) | Traffic statistics analysis system for mobile network | |
| US20180367425A1 (en) | Method and apparatus for determining resource indicator | |
| CN111352963A (en) | Data statistical method and device | |
| US20210357398A1 (en) | Intelligent Search Modification Guidance | |
| EP3771990A1 (en) | Object indexing | |
| US20140143278A1 (en) | Application programming interface layers for analytical applications | |
| Dia et al. | Fast SPARQL join processing between distributed streams and stored RDF graphs using bloom filters | |
| Shi | Government data exchange platform and algorithm implementation in cloud computing environment | |
| US20230376509A1 (en) | Interactive Graphical User Interface for Displaying Search Data for an Observability Pipeline System |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20190628 |