CN101159603A - Wireless network mass data storing method - Google Patents
Wireless network mass data storing method Download PDFInfo
- Publication number
- CN101159603A CN101159603A CNA2007101660263A CN200710166026A CN101159603A CN 101159603 A CN101159603 A CN 101159603A CN A2007101660263 A CNA2007101660263 A CN A2007101660263A CN 200710166026 A CN200710166026 A CN 200710166026A CN 101159603 A CN101159603 A CN 101159603A
- Authority
- CN
- China
- Prior art keywords
- data
- server
- network
- data server
- storage means
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Mobile Radio Communication Systems (AREA)
Abstract
The invention relates to a wireless network mass data storage method which comprises: each network element data server, according to the preset integration strategy, processes the original data captured from the corresponding network element and stores the data, and reduces the data to the secondary data under the premise of guaranteeing the necessary analytic information; each network element data server, according to the preset data acquisition strategy, centralizes the data required for the statistics in a data server from the secondary data stored therein, and sends the data to a centralized data server for storage via the network. The method constructs the hierarchical data storage, and according to the service rule and analysis requirement, extracts the mass original data at different hierarchies on the premise of guaranteeing the necessary analytic information, to form the hierarchical data. Additionally, the method can prolong the storage period of secondary data hierarchy by reducing the storage period of the original data, that is, the method can meet not only the requirement of original data query but also the statistical requirement for routine maintenance and centralized control, and provide strong support for the field network maintenance and optimization.
Description
Technical field
The present invention relates to the communication network management, be specifically related to a kind of wireless network mass data storing method.
Background technology
The cdma wireless network management mainly is the network element data that collects by in analysis, the comparison system, and whole network is managed, plans and optimizes.Be attendant's monitoring network operation conditions, improve the main means of network operation performance, be embodied in the following aspects:
1. quality of service monitor: comprise service access capability, service reliability, service retentivity three aspects.Service access capability data have: mobile phone registration and paging, network accessibility, call setup duration etc.The service reliability data have: call out definition, disturbed condition etc.Service retentivity data have: mobile phone can't arrive calling termination, urgent call conversion channel that destination channel, equipment fault cause and cause the factors such as calling of losing in switching.
2. malfunction monitoring: promptly in time find mis-behave but still at the network element of work by statistics.Such as frequency drift, functional failure of electromechanical (finger has problem, channel that noise is big in standing) or the like.
3. operation is optimized: assist to adjust handoff parameter, cell parameter, antenna, frequency planning etc., thereby improve system performance.
4. the network planning: carry out volume calculation, cooperate performance datas such as telephone traffic, blocking rate to consider the dilatation scale, for subsequent network planning provides guidance.
In actual at present on-site wireless network; Network Element Layer can produce mass data every day; base station controller with one 600 contained fan is an example; the data volume of every day reaches 400MB; historical data will reach 12GB in one month; and along with the attendant to the going deep into of cdma wireless network understanding, constantly submit new demand to, this data scale also can constantly be expanded.These mass performance datas have mainly caused following three problems:
1. data analysis efficient is very low, and adding up a comprehensive form needs 30 minutes or longer time, does not satisfy the requirement of daily O﹠M;
2. data acquisition efficiency is very low, before carrying out the new data warehouse-in, need verify historical data, and data loading is chronic, when system loading is heavy, can't finish normal warehouse-in;
3. can't concentrate monitoring in real time to the whole network performance condition effectively, an intensive data server need be managed 10～40 base station controllers usually, and data volume can be up to 120G～480G, and conventional treatment method is difficult to these data are effectively analyzed;
Above-mentioned situation can have a strong impact on daily network operation and optimization work, can't follow situation to wireless network maintenance and optimization, can't satisfy the market demand complicated and changeable day by day.
Summary of the invention
The technical issues that need to address of the present invention provide a kind of wireless network mass data storing method, can take into account the demand of initial data inquiry, have satisfied the statistical demand of regular maintenance and centralized monitor again, for field network is safeguarded and optimization provides strong backing.
Above-mentioned technical problem of the present invention solves like this, and a kind of wireless network mass data storing method is provided, and stores data at many levels, may further comprise the steps:
1.1) each network element data server handles from corresponding network element according to the integrated strategy of setting in advance and obtain initial data and preserve, under the prerequisite that guarantees necessary analytical information, again it is subdued to be secondary data, that is: the ground floor secondary data;
1.2) each network element data server according to the data acquisition strategy of setting in advance will be in secondary data that its place preserves the part of intensive data server statistics needs send to the intensive data server and preserve by connecting network, that is: second layer secondary data is further subdued the ground floor secondary data by the data acquisition strategy.
According to storage means provided by the invention, described integrated strategy comprises that the original data object granularity is simplified with the original data object number and simplifies.
According to storage means provided by the invention, described original data object granularity is simplified and is comprised deletion redundant field, packed data preservation type, compression type of service and index compression.
According to storage means provided by the invention, described original data object number is simplified and is comprised removal and merge.
According to storage means provided by the invention, described data acquisition strategy is to select the time period to gather.
According to storage means provided by the invention, the described time period can dynamically be adjusted.
According to storage means provided by the invention, described preservation correspondence is preserved the time limit separately, comprise initial data and the preservation of ground floor secondary data and the preservation of the second layer secondary data on the intensive data server on each network element data server, the ground floor secondary data that the second layer secondary data preservation time limit on the described intensive data server is longer than on each network element data server is preserved the time limit.
According to storage means provided by the invention, described intensive data server is also preserved the isomeric data that generates from described initial data in addition, and promptly second layer secondary data also comprises isomeric data.
According to storage means provided by the invention, described intensive data server also comprises the preliminary data server, and their data are identical or part is identical, and promptly the preliminary data server is gone back the data that retention time is more preceding or still less be used except that backup.
According to storage means provided by the invention, when the user uses described data, visit each network element data server or intensive data server as required; Described data comprise initial data, ground floor secondary data and second layer secondary data.
According to storage means provided by the invention, described wireless network includes, but are not limited to GSM network, cdma network or WCDMA network.
According to storage means provided by the invention, described intensive data server is a network management center NMC server, and described network element data server is a network element Operation and Maintenance OMM server.
Wireless network mass data storing method provided by the invention, make up a cover and improve the multi-levels data storage, press business rule and analyze demands, under the prerequisite that guarantees necessary analytical information, the initial data of magnanimity is carried out the extraction of different levels, form initial data, ground floor secondary data and second layer secondary data, by reducing the pot-life of initial data, prolong the pot-life of secondary data layer, promptly taken into account the demand of initial data inquiry, satisfied the statistical demand of regular maintenance and centralized monitor again, safeguard and optimization provides strong backing for field network, fully take into account follow-up expandability simultaneously, can satisfy the demand of on-site maintenance fast, for the stability that improves the wireless network operation, adapt to flexible and changeable configuration surroundings, and whole system maintainability and power of test, on the customer satisfaction with services, important practical value is arranged, following concrete advantage is arranged than prior art:
1. by the wireless network data layering is handled, realize storage at many levels, can solve the problem that wireless network is analyzed real-time, convenience effectively.Can solve simultaneously the problem of data compatibility between many versions;
2. on-site wireless network data analysis efficient be can improve greatly, thereby maintenance, optimizing efficiency and quality improved;
3. from the angle of software architecture, clear-cut job responsibility between each data hierarchy is easy to expand, and is convenient to analyze.
Description of drawings
Further the present invention is described in detail below in conjunction with the drawings and specific embodiments.
Fig. 1 is that schematic diagram is deposited in mass data distribution of the present invention.
Fig. 2 is that data hierarchy of the present invention is divided schematic diagram.
Fig. 3 is that the framework schematic diagram is handled in mass data layering of the present invention.
Fig. 4 is a mass data layering stores processor schematic flow sheet of the present invention;
Fig. 5 is a mass data storage Physical View of the present invention.
Embodiment
At first, core of the present invention is described:
Adopt (one) data integrated strategy and (two) Dynamic Data Acquiring strategy to eliminate data volume on a large scale, guarantee active data information simultaneously, satisfy the analyze demands of field network situation.
(1) data integrated strategy
1. the original data object granularity is simplified
Granularity is simplified and can data volume be simplified significantly, keeps the information that needs simultaneously, several optimal way below main the existence:
● the deletion redundant field,, there be " sum, successfully number, failure number " such as switching in the object, can boil down to " successfully number, failure number ".Also has some other field that can not use.
● packed data is preserved type, such as the attribute use INT of part object, and can boil down to SMALLINT according to actual conditions.
● the compression type of service, there are 9 kinds such as the sub-district registered type, can boil down to 3 kinds etc.
● the index compression: for the complicated index of part, computing formula is very complicated, needs usually to use a plurality of original data object, can calculate these indexs and preserve in advance, and relevant original data object does not just need to preserve.
2. the original data object number is simplified
The original data object number is simplified to be divided into and is removed and the merging dual mode, and removal just is meant directly removes the unwanted original data object of part in secondary data; Merging just is meant merges into a secondary data object with the part original data object, thereby merge the original data object repeated content, keep exclusive information, reach the requirement that reduces data space, such as objects such as calling, switching, release, resource are merged into several objects, location that each object is shared and index field have just obtained saving.
(2) Dynamic Data Acquiring
Adopt the means of dynamic adjusting data acquisition time section, that is: safeguard angle from real network, the user might not be concerned about the data of each time period of every day, usually only pay close attention to data between 8:00～20:00 such as part operator, the probability that all the other data of 12 hours are seen is very little, also be nearly to have that 1 half data do not have actual using, certainly for different users, it pays close attention to the time period is different, therefore this part can provide a kind of mechanism more flexibly, can be by the own definition of data acquisition time of user section.Can strengthen the utilization and the processing of valid data greatly.
In second step, further specify characteristics of the present invention:
(1) storage framework
As shown in Figure 2, the network element data server is preserved initial data and ground floor secondary data, intensive data server and preliminary data server thereof are preserved second layer secondary data, promptly as required the deposit level of mass data on different server carried out unified planning, described second layer secondary data also comprises isomeric data.
(2) data hierarchy is handled
As shown in Figure 3, mainly comprise data and integrate, data acquisition, 3 functional modules of data management are complied with strategy execution separately.
(3) dynamic adjusting data is deposited granularity
From on-site actual situations, the base station controller number that centralized servers is managed does not wait between 2～40, and according to the configuration difference of junior office NE type, presents very big difference on data volume.So can realize a kind of preservation mechanism of data more flexibly.Promptly the disposal ability with database server is a thresholding, in conjunction with the NE quantity and the NE type of actual loading.The granularity and the time limit of coming dynamic adjusting data to preserve.
Such as: when 40 base station controllers of centralized services management, may can only preserve 3 days 60 minutes granularity datas, half a year the sky granularity data, but when centralized servers is only managed 2 base station controllers, can preserve 30 days 60 minutes granularity datas, 1 year sky granularity data.As seen dynamic historical deposit data strategy can very relevantly satisfy user's demand.
In the 3rd step, describe the present invention in detail in conjunction with idiographic flow:
On the network element server, can periodically handle initial data according to the integrated strategy that configures in advance, the magnanimity initial data is converted into secondary data, then can be according to the data acquisition strategy, according to the situation of edition compatibility, the secondary data that needs is copied to the centralized maintenance center, under abnormal conditions, can carry out the data filling mining, guarantee the integrality that data are duplicated.On OMM and NMC, all there is relevant data management module original historical data and secondary historical data to be safeguarded, thereby finishes the storage by different level of mass data according to the maintenance strategy that configures.Specifically see accompanying drawing 4, wherein:
Data are integrated: finish the conversion of initial data to secondary data;
Strategy is set: comprise the setting and the maintenance of data integrated strategy, acquisition strategies, deletion strategy;
Data acquisition: finish the copy or the migration of secondary data;
Data management: carry out the maintenance of initial data, secondary data.
At last, with further aid illustration of actual physical structure of the present invention:
As shown in Figure 5, NMC is the intensive data server, and OMM is a data server, and the data on NMC and the OMM distribute as follows:
1. in the present embodiment, deposit secondary data on the NMC server, deposit initial data and secondary data on the OMM server.
2.OMM can regularly be integrated into secondary data to initial data according to the acquisition granularity and integrated strategy on the server, after finishing, can initiatively send to the NMC server to secondary data.
3. on the OMM server, initial data only kept 7 days, and secondary data kept 30 days, and secondary data kept 7～180 days on the NMC server.
4.NMC on statistical analysis based on historical trend and pinpointing the problems, the user visits initial data if desired on NMC, can directly visit the OMM database.
5. keeping under the situation of same analytical information, 1/10th before the storage data volume is reduced to, analysis efficiency has improved 20 times, implements in product at present.
Claims (10)
1. a wireless network mass data storing method is characterized in that, stores data at many levels, may further comprise the steps:
1.1) each network element data server handles from corresponding network element according to the integrated strategy of setting in advance and obtain initial data and preserve, it is subdued to be secondary data again;
1.2) each network element data server according to the data acquisition strategy of setting in advance will be in secondary data that its place preserves the part of intensive data server statistics needs send to the intensive data server and preserve by connecting network.
2. according to the described storage means of claim 1, it is characterized in that described integrated strategy comprises that the original data object granularity is simplified with the original data object number and simplifies.
3. according to the described storage means of claim 2, it is characterized in that described original data object granularity is simplified and comprised deletion redundant field, packed data preservation type, compression type of service and index compression; Described original data object number is simplified and is comprised removal and merge.
4. according to the described storage means of claim 1, it is characterized in that described data acquisition strategy is to select the time period to gather; This time period can dynamically be adjusted.
5. according to the described storage means of claim 1, it is characterized in that described intensive data server is also preserved the isomeric data that generates from described initial data in addition.
6. according to the described storage means of claim 1, it is characterized in that described intensive data server also comprises the preliminary data server, their data are identical or part is identical.
7. according to the described storage means of claim 1, it is characterized in that described preservation correspondence is preserved the time limit separately, the secondary data that the secondary data preservation time limit on the described intensive data server is longer than on each network element data server is preserved the time limit; Secondary data on the described intensive data server is preserved the time limit and is dynamically adjusted according to disposal ability, actual loading NE quantity and the NE type of intensive data server.
8. according to the described storage means of claim 1, it is characterized in that, when the user uses described data, visit each network element data server or intensive data server as required.
9. according to the described storage means of claim 1, it is characterized in that described wireless network is GSM network, cdma network or WCDMA network.
10. according to the described storage means of claim 1, it is characterized in that described intensive data server is the network management center server, described network element data server is a network element Operation and Maintenance server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200710166026.3A CN101159603B (en) | 2007-10-30 | 2007-10-30 | Wireless network mass data storing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200710166026.3A CN101159603B (en) | 2007-10-30 | 2007-10-30 | Wireless network mass data storing method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101159603A true CN101159603A (en) | 2008-04-09 |
| CN101159603B CN101159603B (en) | 2010-06-02 |
Family
ID=39307530
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200710166026.3A Expired - Fee Related CN101159603B (en) | 2007-10-30 | 2007-10-30 | Wireless network mass data storing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101159603B (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101790257A (en) * | 2009-01-22 | 2010-07-28 | 大唐移动通信设备有限公司 | Method for memorizing data and network management system |
| CN102254030A (en) * | 2011-08-02 | 2011-11-23 | 中国科学院计算机网络信息中心 | Global change research-oriented automatic space science data gathering method |
| CN102291440A (en) * | 2011-07-28 | 2011-12-21 | 清华大学 | Method and device for optimizing rule in cloud environment |
| CN102289483A (en) * | 2011-08-02 | 2011-12-21 | 中国科学院计算机网络信息中心 | Method for automatically gathering metadata of space science data facing global change research |
| CN102648614A (en) * | 2009-10-09 | 2012-08-22 | 瑞典爱立信有限公司 | Method for handling data stored by a communication system |
| CN103916256A (en) * | 2013-01-04 | 2014-07-09 | 中国移动通信集团公司 | Network optimization method, device and system |
| CN107819838A (en) * | 2017-10-31 | 2018-03-20 | 无锡港湾网络科技有限公司 | Memory-type computer network supervising device |
| CN107896209A (en) * | 2017-10-31 | 2018-04-10 | 无锡港湾网络科技有限公司 | Computer network supervising device |
| CN107995163A (en) * | 2017-10-31 | 2018-05-04 | 无锡港湾网络科技有限公司 | Computer network monitoring device |
| CN111339221A (en) * | 2018-12-18 | 2020-06-26 | 中兴通讯股份有限公司 | Data processing method, system and storage medium |
| CN111343416A (en) * | 2018-12-18 | 2020-06-26 | 华为技术有限公司 | Distributed image analysis method, system and storage medium |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106533715B (en) * | 2015-09-09 | 2019-11-19 | 大唐移动通信设备有限公司 | A kind of data analysing method and system |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| ATE354128T1 (en) * | 1999-12-20 | 2007-03-15 | Dainippon Printing Co Ltd | DISTRIBUTED DATA ARCHIVING APPARATUS AND SYSTEM |
| CN1177435C (en) * | 2001-08-24 | 2004-11-24 | 华为技术有限公司 | Hierarchical management system for distributed network management platform |
| US6817522B2 (en) * | 2003-01-24 | 2004-11-16 | Hewlett-Packard Development Company, L.P. | System and method for distributed storage management |
| CN1897540A (en) * | 2005-07-15 | 2007-01-17 | 中兴通讯股份有限公司 | Network element data processing method and system |
| CN100504303C (en) * | 2006-03-28 | 2009-06-24 | 北京瑞图万方科技有限公司 | Distributed data processing system and method |
-
2007
- 2007-10-30 CN CN200710166026.3A patent/CN101159603B/en not_active Expired - Fee Related
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101790257A (en) * | 2009-01-22 | 2010-07-28 | 大唐移动通信设备有限公司 | Method for memorizing data and network management system |
| CN102648614A (en) * | 2009-10-09 | 2012-08-22 | 瑞典爱立信有限公司 | Method for handling data stored by a communication system |
| US9282143B2 (en) | 2009-10-09 | 2016-03-08 | Telefonaktiebolaget L M Ericsson (Publ) | Method for handling data stored by a communication system |
| CN102291440A (en) * | 2011-07-28 | 2011-12-21 | 清华大学 | Method and device for optimizing rule in cloud environment |
| CN102289483A (en) * | 2011-08-02 | 2011-12-21 | 中国科学院计算机网络信息中心 | Method for automatically gathering metadata of space science data facing global change research |
| CN102254030A (en) * | 2011-08-02 | 2011-11-23 | 中国科学院计算机网络信息中心 | Global change research-oriented automatic space science data gathering method |
| CN103916256A (en) * | 2013-01-04 | 2014-07-09 | 中国移动通信集团公司 | Network optimization method, device and system |
| CN103916256B (en) * | 2013-01-04 | 2017-06-20 | 中国移动通信集团公司 | Network optimized approach and device, system |
| CN107819838A (en) * | 2017-10-31 | 2018-03-20 | 无锡港湾网络科技有限公司 | Memory-type computer network supervising device |
| CN107896209A (en) * | 2017-10-31 | 2018-04-10 | 无锡港湾网络科技有限公司 | Computer network supervising device |
| CN107995163A (en) * | 2017-10-31 | 2018-05-04 | 无锡港湾网络科技有限公司 | Computer network monitoring device |
| CN111339221A (en) * | 2018-12-18 | 2020-06-26 | 中兴通讯股份有限公司 | Data processing method, system and storage medium |
| CN111343416A (en) * | 2018-12-18 | 2020-06-26 | 华为技术有限公司 | Distributed image analysis method, system and storage medium |
| CN111343416B (en) * | 2018-12-18 | 2021-06-01 | 华为技术有限公司 | Distributed image analysis method, system and storage medium |
| CN111339221B (en) * | 2018-12-18 | 2024-04-26 | 中兴通讯股份有限公司 | Data processing method, system and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101159603B (en) | 2010-06-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101159603B (en) | Wireless network mass data storing method | |
| CN105005570B (en) | Magnanimity intelligent power data digging method and device based on cloud computing | |
| CN102843418B (en) | A kind of resource scheduling system | |
| CN101290668B (en) | Time sharing operation dynamic dispatching method and device | |
| CN101556678A (en) | Processing method of batch processing services, system and service processing control equipment | |
| CN101853287A (en) | Data compression quick retrieval file system and method thereof | |
| CN103793204A (en) | Data analysis system (SRC) based on cloud computing | |
| CN103365971A (en) | Mass data access processing system based on cloud computing | |
| CN107450491A (en) | A kind of robot scheduling system, method, electronic equipment and storage medium | |
| CN106528853A (en) | Data interaction management device and cross-database data interaction processing device and method | |
| CN101778400B (en) | Database-based telephone traffic analysis and prediction system and telephone traffic prediction method using same | |
| CN106502875A (en) | A kind of daily record generation method and system based on cloud computing | |
| CN105139253A (en) | Cloud optimization method for self-service tax handling | |
| CN106649869A (en) | Statistical method and statistical device for big data in database | |
| CN103235793A (en) | On-line data processing method, equipment and system | |
| CN104735104A (en) | Intelligent public platform system of WeChat | |
| CN104636395A (en) | Count processing method and device | |
| CN102411757B (en) | Method and system for forecasting capacity of large host central processing unit (CPU) | |
| CN102740341A (en) | Method and device for predicting network traffic | |
| CN103561092A (en) | Method and device for managing resources under private cloud environment | |
| CN102137449B (en) | Business process method and system for business support system | |
| CN100558048C (en) | Radio resource management system device | |
| CN101242299A (en) | Networking method for data hinge-service supporting system | |
| CN105975614A (en) | Cluster configuration device and data updating method and device | |
| CN107203256A (en) | Energy-conservation distribution method and device under a kind of network function virtualization scene |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20100602 Termination date: 20171030 |