CN108430067A - A kind of Internet service mass analysis method and system based on XDR - Google Patents
A kind of Internet service mass analysis method and system based on XDR Download PDFInfo
- Publication number
- CN108430067A CN108430067A CN201710076723.3A CN201710076723A CN108430067A CN 108430067 A CN108430067 A CN 108430067A CN 201710076723 A CN201710076723 A CN 201710076723A CN 108430067 A CN108430067 A CN 108430067A
- Authority
- CN
- China
- Prior art keywords
- data
- xdr
- convergence table
- real time
- internet service
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W24/00—Supervisory, monitoring or testing arrangements
- H04W24/02—Arrangements for optimising operational condition
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The present invention discloses a kind of Internet service mass analysis method and system based on XDR.Wherein, the method includes：It stores change server and obtains XDR data, and the XDR data are sent to cluster server；The cluster server screens the XDR data according to preset field, and carries out processing to the XDR data after screening and obtain text data, and the convergence table of preset kind is generated according to the text data；Application server analyzes Internet service quality according to the convergence table.The system is for executing the above method.Internet service mass analysis method and system provided by the invention based on XDR, text data is obtained since can the XDR data after screening be carried out with processing, and the convergence table of preset kind is generated according to text data, Internet service quality is analyzed according to the convergence table, to improve the analysis efficiency to Internet service quality.
Description
Technical field
The present invention relates to Internet technical fields, and in particular to a kind of Internet service mass analysis method based on XDR
And system.
Background technology
In mobile internet era, Internet service quality increasingly attracts attention.Internet service quality includes mainly
Video traffic rate, browse service rate, instant messaging service success rate and game service when user is experienced using 4G cell phone
Success rate etc..
The analysis data majority of prefectures and cities' corporate internet performance assessment criteria is the service behaviour in 4A safety control platforms at present
To make to obtain on center, 200T or more can reach for the daily data volume of provincial 4A safety control platforms, data volume is very big,
It is met using rush hour in 4A safety control platforms, what can be run is very slow, is consumed from 4A safety control platform garbled datas
When can be long.Poor in timeliness is presented in 4A safety control platform data, and platform latest data is delayed 1 day, and the extraction of data arranges
Analysis needs whole manual operation, carries out finishing analysis for example, by using EXCEL tools, this finishing analysis process needs 2 hours
More than, shot-drilling degree is inadequate under data, such as user's dimension data and other dimension data onrelevants, working efficiency are relatively low.It is external
Data indicate the information very abundant of (External Data Representation, hereinafter referred to as XDR) data source, but to it
Utilization rate largely rests on the statistical analysis on basis less than 10%.
Therefore, how to propose a kind of method, XDR data can be utilized, improve the analysis efficiency to Internet service quality,
As industry important topic urgently to be resolved hurrily.
Invention content
For the defects in the prior art, the present invention provide a kind of Internet service mass analysis method based on XDR and
System.
On the one hand, the present invention proposes a kind of Internet service mass analysis method based on XDR, including：
It stores change server and obtains XDR data, and the XDR data are sent to cluster server；
Cluster server screens the XDR data according to preset field, and to the XDR data after screening into
Row processing obtains text data, and the convergence table of preset kind is generated according to the text data；
Application server analyzes Internet service quality according to the convergence table.
On the other hand, the present invention provides a kind of Internet service quality analysis system based on XDR, including：
Change server is stored, cluster server is sent to for obtaining XDR data, and by the XDR data；
Cluster server, for being screened to the XDR data according to preset field, and to the XDR after screening
Data carry out processing and obtain text data, and the convergence table of preset kind is generated according to the text data；
Application server, for being analyzed Internet service quality according to the convergence table.
Internet service mass analysis method and system provided by the invention based on XDR, after can be to screening
XDR data carry out processing and obtain text data, and the convergence table of preset kind is generated according to text data, according to the convergence table
Internet service quality is analyzed, to improve the analysis efficiency to Internet service quality.
Description of the drawings
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is this hair
Some bright embodiments for those of ordinary skill in the art without creative efforts, can be with root
Other attached drawings are obtained according to these attached drawings.
Fig. 1 is the flow diagram of Internet service mass analysis method of the one embodiment of the invention based on XDR；
Fig. 2 is the structural schematic diagram of one embodiment of the invention Internet service quality analysis system.
Specific implementation mode
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with attached in the embodiment of the present invention
Figure, technical solution in the embodiment of the present invention are explicitly described, it is clear that described embodiment is a part of the invention
Embodiment, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art are not making wound
The every other embodiment obtained under the premise of the property made labour, shall fall within the protection scope of the present invention.
Fig. 1 is the flow diagram of Internet service mass analysis method of the one embodiment of the invention based on XDR, such as Fig. 1
It is shown, the Internet service mass analysis method provided by the invention based on XDR, including：
S101, storage change server obtain XDR data, and the XDR data are sent to cluster server；
Specifically, storage change server can obtain XDR data, and the XDR data can derive from data acquisition clothes
The bottom signaling decoding that business device obtains；Then the XDR data got are sent to cluster by the storage change server
Server carries out subsequent processing.
For example, the XDR data sources are in the bottom signaling decoding of Bo Ruide data acquisition servers, and these bottoms are believed
Decoding is enabled then to be obtained from the acquisition of S1-U and S1-MME network interfaces.The data that the Bo Ruide data acquisition servers obtain
Data sharing is carried out by Nokia's kafka cluster servers.The storage change server passes through the Nokia kafka collection
Group's server obtains the XDR data.
S102, the cluster server screen the XDR data according to preset field, and to described in after screening
XDR data carry out processing and obtain text data, and the convergence table of preset kind is generated according to the text data；
Specifically, the cluster server is according to preset field, such as IP address, element name etc., to the XDR numbers of acquisition
According to being screened, wherein the preset field may come from the field specification of setting.The cluster server is then to screening
The XDR data afterwards carry out processing and obtain text data, and convergence table is generated further according to the text data.Wherein, the remittance
Poly- table be it is pre-defined according to actual demand, the convergence table can be business dimension table, network element dimension table, URL dimension tables,
User data dimension table.
For example, the user data dimension table may include Subscriber Number, SGW, APP group, uplink packet number, downstream packets
Number, TCP uplinks number of dropped packets, TCP downlinks number of dropped packets, access times, number of success, Access Success Rate, flow, downloading rate, when
Long and time delay.The content that the user data dimension table includes can be configured according to actual needs, and the embodiment of the present invention is not
It limits.
For example, the cluster server may be used Hadoop cluster servers, the Hadoop clusters refer to by
A series of software ecospheres of the distributed system architecture and foundation of Apache funds club exploitation on this framework, such as
Storm and distributed file system (Hadoop Distributed File System, hereinafter referred to as HDFS).After screening
The XDR data carry out processing and Storm may be used, and Storm is a distributed, fault-tolerant real time computation system, ensure
Each message can be handled, and speed is quickly, per second to handle millions of message.Storm can will locate
XDR Data Integrations after reason are at the text data.The text data passes through Hadoop cluster servers after overcompression
I/O tools upload to HDFS and are stored, and the convergence table is generated for post-processing.Storm can be by text data elder generation
It is stored in the Hadoop cluster server datas caching, on the one hand can accelerate the speed for receiving the text data, favorably
It is handled in real time in XDR data, on the other hand avoids the text data amount received excessive, be uploaded directly into HDFS
Cause HDFS clients unstable.
S103, application server analyze Internet service quality according to the convergence table.
Specifically, application server can be analyzed Internet service quality information according to the convergence table.For example, with institute
It states convergence table and develops application program such as network performance real-time monitor (RTM) as data source, the net to monitored object can be passed through
Network performance real time monitoring index compares and analyzes, and obtains abnormal achievement data in time.It will be appreciated that the application service
Device can inquire the convergence table.
Internet service mass analysis method provided by the invention based on XDR, due to can be to the XDR data after screening
It carries out processing and obtains text data, and generate the convergence table of preset kind according to text data, according to the convergence table to interconnection
Network service quality is analyzed, to improve the analysis efficiency to Internet service quality.
On the basis of the above embodiments, further, the cluster server carries out the XDR data after screening
Processing obtains text data：
The cluster server carries out data backfill and/or conversion to the XDR data after screening, to obtain the text
Notebook data.
Specifically, the cluster server, can be to the XDR data after the XDR data after receiving screening
Carry out data backfill and/or conversion.Data backfill include the cluster server find out it is related to the preset field
Data, such as XDR data after screening include IP address, but without the corresponding IP address ownership place of IP address, institute
It states cluster server and stores whole IP address and its corresponding IP address ownership place, the cluster server can be according to institute
It states IP address and is finding out the corresponding IP address ownership place of the IP address, then by the IP address and corresponding IP address
Ownership place is associated, and it includes just IP address information of home location to be backfilled in XDR data by the data.The data conversion packet
It includes after the cluster server is converted the preset field and is exporting, for example, certain preset fields are metric pure
Number format, and be actually needed output be it is hexadecimal, the cluster server can be corresponding by the preset field
Decimal data is converted into hexadecimal data.The cluster server will pass through data backfill and/or transformed data are whole
Synthesis text data, and be stored into the cluster server data caching, for subsequent processing.It will be appreciated that in order to save
Memory space will can again store after the text data compression.
For example, Hadoop cluster servers can utilize storm to receive data, and carry out the backfill and/or conversion of data.
Storm need in data backfill and/or transfer process frequently reading and the relevant data of the preset field, above-mentioned and institute
Stating the relevant data of preset field can be stored in Redis, and Redis is for system data dictionary and frequently using the slow of data
It deposits, such as mobile phone terminal categorical data, ENB titles, Redis is a high performance key-value database, reading and writing data
It can be very high.
Internet service mass analysis method provided by the invention based on XDR, due to can be to the XDR data after screening
It carries out processing and obtains text data, and generate the convergence table of preset kind according to the text data, according to the convergence table pair
Internet service quality is analyzed, to improve the analysis efficiency to Internet service quality.By the XDR data after screening
Data backfill and/or conversion are carried out, the text data is obtained, is conducive to improve subsequently to the treatment effeciency of data.
On the basis of the various embodiments described above, further, the remittance that preset kind is generated according to the text data
Poly- table includes：
The cluster server according to the text data generates the convergence table or in real time according to the text data
The convergence table is generated offline.
Specifically, the time granularity of data needed for analysis of the cluster server according to progress Internet service quality,
The convergence table is generated in real time based on the text data or generates the convergence table offline.For example, for 5 minutes monitoring numbers
According to the cluster server needs to generate the convergence table in real time；For with the data of hour, day, Zhou Jinhang statistics, the collection
Group's server can generate the convergence table offline.
For example, Hadoop cluster servers can be handled the text data in real time using Storm, described in generation
The convergence table of preset kind, Storm is counted mainly for the KPI of small grain size, such as 5 minutes monitoring datas.The Hadoop collection
Group's server can be inquired and handled to the HDFS files stored using Spark, generate the convergence table of preset kind, and will
The convergence table generated imported into ORACLE databases.Spark is an advanced DAG enforcement engine, supports loop-around data
Stream and memory calculate, and can efficiently, rapidly inquire the text data.Spark is mainly for hour grain size statistics.It is described
Hadoop cluster servers can carry out non real-time inquiry to the text data that HDFS is stored using Hive and handle, described in generation
Table is converged, the convergence table can directly export display or imported into ORACLE databases.Hive is to be based on Hadoop clusters
A Tool for Data Warehouse, the data file of structuring can be mapped as to a database table, and simple sql is provided and is looked into
Function is ask, sql sentences can also be converted to MapReduce tasks and run.Hive long, resource consumptions for the calculating time
Big calculating, as day, weekly granularity count.Hive is larger relative to the data volume that Spark is handled and query time is relatively long.
Internet service mass analysis method provided by the invention based on XDR, due to can be to the XDR data after screening
It carries out processing and obtains text data, and generate the convergence table of preset kind according to the text data, according to the convergence table pair
Internet service quality is analyzed, to improve the analysis efficiency to Internet service quality.Temporally to text data
Granularity divides into processing and processed offline in real time, further increases the analysis efficiency of Internet service quality.
On the basis of the various embodiments described above, further, the application server is according to the convergence table to internet
Quality of service carries out analysis：
The application server obtains the convergence table corresponding with the monitored object according to monitored object, based on described
The network performance real time monitoring index of monitored object obtains network performance real time monitoring achievement data, and root in the convergence table
Achievement data is monitored in real time according to the network performance to analyze monitored object progress network performance in real time；Wherein, the net
Network performance real time monitoring index is pre-defined according to the monitored object.
Specifically, the application server obtains and the monitoring according to monitored object, such as cell or core net SGW
The corresponding convergence table of object includes network performance real time monitoring achievement data, the application clothes in the convergence table
Business device acquires network performance real time monitoring achievement data according to the networked-induced delay energy monitor control index in the convergence table,
And network performance is carried out to monitored object according to the networked-induced delay energy monitor control index data and is analyzed in real time.Wherein, the net
Network real-time performance monitor control index is pre-defined according to the monitored object.The networked-induced delay energy monitor control index can root
It is configured according to actual needs, the present embodiment is not limited.
It is analyzed in real time for example, carrying out network performance to A cells, the networked-induced delay energy monitor control index may include 5 points
DNS success rates, DNS time delays, TCP success rates, TCP time delays, GET success rates, GET flows, GET rates, GET time delays in clock,
POST success rates, POST flows, POST rates, POST time delays, and the normality threshold model of above-mentioned each monitor control index can be set
It encloses.The convergence table corresponding with the A cells is customized to A cells, the convergence table includes above-mentioned each monitor control index.Institute
State the convergence that generation in real time after cluster server handles XDR data includes network performance real time monitoring achievement data
Table.The application server, which is searched according to the networked-induced delay energy monitor control index in the convergence table, described arrives each monitoring
Achievement data, and each monitor control index data are judged whether in normal threshold range, if some monitor control index is super
Go out normal threshold range, can send a warning message.
Internet service mass analysis method provided by the invention based on XDR, due to can be to the XDR data after screening
It carries out processing and obtains text data, and generate the convergence table of preset kind according to the text data, according to the convergence table pair
Internet service quality is analyzed, to improve the analysis efficiency to Internet service quality.Monitored object is carried out
Network performance is analyzed in real time, is conducive to find Network Abnormal in time.
On the basis of the various embodiments described above, further, the application server is according to the convergence table to internet
Quality of service carries out analysis：
The application server obtains the convergence table corresponding with the type of service according to type of service, based on described
The internet index of type of service obtains internet achievement data in the convergence table, and according to the internet achievement data
The type of service is analyzed in real time；Wherein, the internet index is pre-defined according to the type of service.
Specifically, the application server obtains and the industry according to type of service, such as video traffic or browse service
The corresponding convergence table of service type includes the internet achievement data with the type of service, institute in the convergence table
It states application server and internet achievement data, and the internet is acquired in the convergence table according to the internet index
Achievement data analyzes the type of service in real time.Wherein, the internet index is advance according to the type of service
Definition.The internet index can be configured according to actual needs, and the present embodiment is not limited.
For example, being analyzed in real time video traffic, the internet index of the video traffic may include in 5 minutes
Flow, downloading rate and Access Success Rate.Convergence table corresponding with the video traffic, the convergence table are customized to video traffic
It include above-mentioned each internet index.It includes internet that the cluster server generates in real time after handling XDR data
The convergence table of achievement data.The application server finds according to internet index in the convergence table described each
Internet achievement data, and whether each internet achievement data is judged in normal threshold range, if some is interconnected
Net index exceeds normal threshold range, can send a warning message；Or the application server is by the described each of acquisition
Internet achievement data carries out ring ratio or analysis on year-on-year basis with same period historical internet achievement data respectively, such as ring ratio can be with
It is that current internet achievement data and the internet achievement data of the previous day are compared, described can be current mutual on year-on-year basis
Networking achievement data is compared with the internet achievement data before a week, if the variation of some internet index is super
Go out given threshold range, can send a warning message.The given threshold is configured according to actual conditions, the embodiment of the present invention
It does not limit.
Internet service mass analysis method provided by the invention based on XDR, due to can be to the XDR data after screening
It carries out processing and obtains text data, and generate the convergence table of preset kind according to the text data, according to the convergence table pair
Internet service quality is analyzed, to improve the analysis efficiency to Internet service quality.Type of service is carried out
Analysis in real time is conducive to the exception for finding type of service in time.
On the basis of the various embodiments described above, further, the application server is according to the convergence table to internet
Quality of service carries out analysis：
The application server obtains customer complaint information, when the customer complaint information includes Subscriber Number and complains
Between；
The application server obtains the convergence table corresponding with the Subscriber Number according to the Subscriber Number, is based on
The complaint time searches abnormal signaling content in the convergence table；
The application server analyzes the original of customer complaint according to the abnormal signaling content and default complaining type
Cause.
Specifically, the application server can get customer complaint information, and the customer complaint information includes user
Number and complaint time.The customer complaint information can be provided by customer service department, and then backstage personnel are by the calling information
Batch imports the application server.The application server obtains corresponding with the Subscriber Number according to the Subscriber Number
The convergence table, the convergence table include the corresponding signaling content of the Subscriber Number, such as IP address, nearest arrearage
Then time recalls preset time according to the complaint time, abnormal signaling content is searched in the convergence table.If looked into
Find the abnormal signaling content, the application server is according to the abnormal signaling content in default complaining type
The reason of with customer complaint.Wherein, the type is preset, and each complaining type corresponds at least one user and throws
The reason of telling.Wherein, the preset time is configured according to actual conditions, and the embodiment of the present invention does not limit.
For example, net is can not enter in the complaint of user's first, it is 13510061008 to complain number, and the complaints time is 2017.1.2,9:
05:00, the application server searches the corresponding convergence table according to 13510061008, recalls 2 according to the complaint time
Minute, obtained in the convergence table user's first in 2017.1.2,9:03:13510061008 signaling content when 00,
Assuming that the application server judges to know the IP address of user as arrearage IP address, and the arrearage time is recently
2017.1.2 9:03:17, then the complaint reason of user can be matched in preset complaining type-Problem of Tuition Dues：Arrearage is used
Family.It will be understood that the application server can carry out batch processing to customer complaint, and export handling result.
Fig. 2 is the structural schematic diagram of one embodiment of the invention Internet service quality analysis system, as shown in Fig. 2, this hair
The Internet service quality analysis system based on XDR of bright offer includes storage change server 201,202 and of cluster server
Application server 203, wherein：
The XDR data are sent to cluster server by storage change server 201 for obtaining XDR data；Cluster
Server 202 for being screened to the XDR data according to preset field, and to the XDR data after screening at
Reason obtains text data, and the convergence table of preset kind is generated according to the text data；Application server 203 is used for according to institute
Convergence table is stated to analyze Internet service quality.
Specifically, storage change server 201 can obtain XDR data, and the XDR data can derive from data and acquire
The bottom signaling decoding of server；Then the XDR data got are sent to cluster by the storage change server 201
Server 202 carries out subsequent processing.
Cluster server 202 sieves the XDR data of acquisition according to preset field, such as IP address, element name etc.
Choosing, wherein the preset field may come from the field specification of setting.Cluster server 202 is then to described in after screening
XDR data carry out processing and obtain text data, and convergence table is generated further according to the text data.Wherein, the convergence table is root
It is pre-defined according to actual demand, the convergence table can be business dimension table, network element dimension table, URL dimension tables, user data
Dimension table.
Application server 203 can be analyzed Internet service quality information according to the convergence table.For example, with the remittance
Poly- table develops application program such as network performance real-time monitor (RTM) as data source, can pass through the internetworking to monitored object
Index can be monitored in real time to compare and analyze, obtain abnormal achievement data in time.It will be appreciated that the application server can
To inquire the convergence table.
Internet service quality analysis system provided by the invention based on XDR, due to can be to the XDR data after screening
It carries out processing and obtains text data, and generate the convergence table of preset kind according to text data, according to the convergence table to interconnection
Network service quality is analyzed, to improve the analysis efficiency to Internet service quality.
On the basis of the above embodiments, further, cluster server 202 includes data cleansing module, wherein：
The data cleansing module is used to carry out data backfill and/or conversion to the XDR data after screening, to obtain
The text data.
Specifically, the data cleansing module, can be to the XDR numbers after the XDR data after receiving screening
According to progress data backfill and/or conversion.The data backfill includes that data cleansing module 2021 is found out and the preset field
The XDR data after relevant data, such as screening include IP address, but without the corresponding IP address ownership of IP address
Ground, the data cleansing module store whole IP address and its corresponding IP address ownership place, the data cleansing module
The corresponding IP address ownership place of the IP address can be being found out according to the IP address, then by the IP address and right
The IP address ownership place answered is associated, and it includes just IP address information of home location to be backfilled in XDR data by the data.It is described
Data conversion includes being exported after the data cleansing module is converted the preset field, for example, certain preset fields
Metric cardinar number word format, and output is actually needed be it is hexadecimal, the data cleansing module can will be described
The corresponding decimal data of preset field is converted into hexadecimal data.The data cleansing module will pass through data backfill and/
Or transformed Data Integration is at text data, and be stored into the cluster server data caching, for subsequent processing.It can manage
Solution, in order to save memory space, will can again store after the text data compression.
Internet service quality analysis system provided by the invention based on XDR, due to can be to the XDR data after screening
It carries out processing and obtains text data, and generate the convergence table of preset kind according to the text data, according to the convergence table pair
Internet service quality is analyzed, to improve the analysis efficiency to Internet service quality.By the XDR data after screening
Data backfill and/or conversion are carried out, the text data is obtained, is conducive to improve subsequently to the treatment effeciency of data.
On the basis of the various embodiments described above, further, cluster server 202 includes real-time processing module and offline place
Module is managed, wherein：
The real-time processing module is used to generate the convergence table in real time according to the text data；The processed offline mould
Block is used to generate the convergence table offline according to the text data of storage.
Specifically, described real-time according to the difference of the time granularity of data needed for the analysis for carrying out Internet service quality
Processing module generates the convergence table in real time based on the text data or the processed offline module generates the remittance offline
Poly- table.For example, for 5 minutes monitoring datas, the real-time processing module generates the convergence table in real time；For with hour, day,
The data of Zhou Jinhang statistics, the processed offline module can generate the convergence table offline.
Internet service quality analysis system provided by the invention based on XDR, due to can be to the XDR data after screening
It carries out processing and obtains text data, and generate the convergence table of preset kind according to the text data, according to the convergence table pair
Internet service quality is analyzed, to improve the analysis efficiency to Internet service quality.Temporally to text data
Granularity divides into processing and processed offline in real time, further increases the analysis efficiency of Internet service quality.
On the basis of the various embodiments described above, further, the application server 203 monitors in real time including network performance
Module, wherein：
Network performance real-time monitoring module is used to obtain the convergence corresponding with the monitored object according to monitored object
Table, the network performance real time monitoring index based on the monitored object obtain network performance real time monitoring in the convergence table and refer to
Data are marked, and achievement data is monitored in real time according to the network performance, monitored object progress network performance is analyzed in real time；
Wherein, the network performance real time monitoring index is pre-defined according to the monitored object.
Specifically, the network performance real-time monitoring module is obtained according to monitored object, such as cell or core net SGW
The convergence table corresponding with the monitored object includes network performance real time monitoring achievement data in the convergence table,
The network performance real-time monitoring module acquires network according to the networked-induced delay energy monitor control index in the convergence table
Performance monitors achievement data in real time, and carries out network performance to monitored object according to the networked-induced delay energy monitor control index data
Analysis in real time.Wherein, the networked-induced delay energy monitor control index is pre-defined according to the monitored object.The network is real
When performance monitoring index can be configured according to actual needs, the present embodiment is not limited.
Internet service quality analysis system provided by the invention based on XDR, due to can be to the XDR data after screening
It carries out processing and obtains text data, and generate the convergence table of preset kind according to the text data, according to the convergence table pair
Internet service quality is analyzed, to improve the analysis efficiency to Internet service quality.Monitored object is carried out
Network performance is analyzed in real time, is conducive to find Network Abnormal in time.
The embodiment of Internet service quality analysis system provided by the invention specifically can be used for executing above-mentioned each method
The process flow of embodiment, details are not described herein for function, is referred to the detailed description of above method embodiment.
One of ordinary skill in the art will appreciate that：Realize that all or part of step of above method embodiment can pass through
The relevant hardware of program instruction is completed, and program above-mentioned can be stored in a computer read/write memory medium, the program
When being executed, step including the steps of the foregoing method embodiments is executed；And storage medium above-mentioned includes：ROM, RAM, magnetic disc or light
The various media that can store program code such as disk.
Finally it should be noted that：The above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；Although
Present invention has been described in detail with reference to the aforementioned embodiments, it will be understood by those of ordinary skill in the art that：It still may be used
With technical scheme described in the above embodiments is modified or equivalent replacement of some of the technical features；
And these modifications or replacements, various embodiments of the present invention technical solution that it does not separate the essence of the corresponding technical solution spirit and
Range.
Claims (10)
1. a kind of Internet service mass analysis method based on XDR, which is characterized in that including：
It stores change server and obtains XDR data, and the XDR data are sent to cluster server；
The cluster server screens the XDR data according to preset field, and to the XDR data after screening into
Row processing obtains text data, and the convergence table of preset kind is generated according to the text data；
Application server analyzes Internet service quality according to the convergence table.
2. according to the method described in claim 1, it is characterized in that, the cluster server is to the XDR data after screening
Carrying out processing acquisition text data includes：
The cluster server carries out data backfill and/or conversion to the XDR data after screening, to obtain the textual data
According to.
3. according to the method described in claim 1, it is characterized in that, the remittance for generating preset kind according to the text data
Poly- table includes：
The cluster server according to the text data generate in real time the convergence table or according to the text data it is offline
Generate the convergence table.
4. method according to any one of claims 1 to 3, which is characterized in that the application server is according to the convergence
Table carries out analysis to Internet service quality：
The application server obtains the convergence table corresponding with the monitored object according to monitored object, is based on the monitoring
The network performance real time monitoring index of object obtains network performance real time monitoring achievement data in the convergence table, and according to institute
Network performance real time monitoring achievement data is stated to analyze monitored object progress network performance in real time；Wherein, the internetworking
It is pre-defined according to the monitored object that index can be monitored in real time.
5. method according to any one of claims 1 to 3, which is characterized in that the application server is according to the convergence
Table carries out analysis to Internet service quality：
The application server obtains the convergence table corresponding with the type of service according to type of service, is based on the business
The internet index of type obtains internet achievement data in the convergence table, and according to the internet achievement data to institute
Type of service is stated to be analyzed in real time；Wherein, the internet index is pre-defined according to the type of service.
6. method according to any one of claims 1 to 3, which is characterized in that the application server is according to the convergence
Table carries out analysis to Internet service quality：
The application server obtains customer complaint information, and the customer complaint information includes Subscriber Number and complains the time；
The application server obtains the convergence table corresponding with the Subscriber Number according to the Subscriber Number, based on described
The time is complained to search abnormal signaling content in the convergence table；
The reason of application server analyzes customer complaint according to the abnormal signaling content and default complaining type.
7. a kind of Internet service quality analysis system based on XDR, which is characterized in that including：
Change server is stored, cluster server is sent to for obtaining XDR data, and by the XDR data；
Cluster server, for being screened to the XDR data according to preset field, and to the XDR data after screening
It carries out processing and obtains text data, and generate the convergence table of preset kind according to the text data；
Application server, for being analyzed Internet service quality according to the convergence table.
8. system according to claim 1, which is characterized in that the cluster server includes data cleansing module, wherein：
The data cleansing module, for carrying out data backfill and/or conversion to the XDR data after screening, to obtain
State text data.
9. system according to claim 1, which is characterized in that the cluster server includes real-time processing module and offline
Processing module, wherein：
The real-time processing module, for generating the convergence table in real time according to the text data；
The processed offline module, for generating the convergence table offline according to the text data of storage.
10. method according to claim 1 or 2, which is characterized in that the application server includes that network performance is supervised in real time
Module is controlled, wherein：
Network performance real-time monitoring module, for obtaining the convergence table corresponding with the monitored object according to monitored object,
Network performance real time monitoring index based on the monitored object obtains network performance real time monitoring index in the convergence table
Data, and achievement data is monitored in real time according to the network performance, monitored object progress network performance is analyzed in real time；Its
In, the network performance real time monitoring index is pre-defined according to the monitored object.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710076723.3A CN108430067A (en) | 2017-02-13 | 2017-02-13 | A kind of Internet service mass analysis method and system based on XDR |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710076723.3A CN108430067A (en) | 2017-02-13 | 2017-02-13 | A kind of Internet service mass analysis method and system based on XDR |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108430067A true CN108430067A (en) | 2018-08-21 |
Family
ID=63155037
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710076723.3A Pending CN108430067A (en) | 2017-02-13 | 2017-02-13 | A kind of Internet service mass analysis method and system based on XDR |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108430067A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109379757A (en) * | 2018-11-30 | 2019-02-22 | 中盈优创资讯科技有限公司 | A kind of single user method for diagnosing faults and device based on narrowband internet of things service |
| CN112134846A (en) * | 2020-08-21 | 2020-12-25 | 宜通世纪科技股份有限公司 | Method, system, device and medium for analyzing signaling data of communication network |
| CN113542203A (en) * | 2020-04-21 | 2021-10-22 | 中国移动通信集团贵州有限公司 | Video service DPI identification method and server |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7092398B2 (en) * | 2000-06-12 | 2006-08-15 | Amdocs (Israel) Ltd. | System, method and computer program product for charging for competitive IP-over-wireless service |
| CN1956583A (en) * | 2005-10-29 | 2007-05-02 | 华为技术有限公司 | Method for recording and output call journal information and application and system |
| CN101754253A (en) * | 2008-12-02 | 2010-06-23 | 中国移动通信集团甘肃有限公司 | General packet radio service (GPRS) end-to-end performance analysis method and system |
| CN102571402A (en) * | 2010-12-30 | 2012-07-11 | 中兴通讯股份有限公司 | Method and system for analyzing whole-process call loss |
| CN102932198A (en) * | 2012-07-09 | 2013-02-13 | 北京中创信测科技股份有限公司 | Signaling monitoring device for realizing PS domain distributed architecture |
| WO2013040777A1 (en) * | 2011-09-22 | 2013-03-28 | 华为技术有限公司 | Method for obtaining international mobile subscriber identity, base station, and user equipment |
| CN103237303A (en) * | 2013-03-29 | 2013-08-07 | 北京中创信测科技股份有限公司 | User-based encryption supporting system and user-based encryption supporting device for monitoring 3G (3rd-generation) networks |
| CN105208575A (en) * | 2014-06-30 | 2015-12-30 | 中兴通讯股份有限公司 | Information processing method of network interface signaling monitoring and apparatus thereof |
| CN105279257A (en) * | 2015-10-15 | 2016-01-27 | 珠海世纪鼎利科技股份有限公司 | Normal distribution-based internet big data mining method and system |
| CN105337753A (en) * | 2014-08-06 | 2016-02-17 | 中国移动通信集团广东有限公司 | Method and device for monitoring Internet real quality |
-
2017
- 2017-02-13 CN CN201710076723.3A patent/CN108430067A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7092398B2 (en) * | 2000-06-12 | 2006-08-15 | Amdocs (Israel) Ltd. | System, method and computer program product for charging for competitive IP-over-wireless service |
| CN1956583A (en) * | 2005-10-29 | 2007-05-02 | 华为技术有限公司 | Method for recording and output call journal information and application and system |
| CN101754253A (en) * | 2008-12-02 | 2010-06-23 | 中国移动通信集团甘肃有限公司 | General packet radio service (GPRS) end-to-end performance analysis method and system |
| CN102571402A (en) * | 2010-12-30 | 2012-07-11 | 中兴通讯股份有限公司 | Method and system for analyzing whole-process call loss |
| WO2013040777A1 (en) * | 2011-09-22 | 2013-03-28 | 华为技术有限公司 | Method for obtaining international mobile subscriber identity, base station, and user equipment |
| CN102932198A (en) * | 2012-07-09 | 2013-02-13 | 北京中创信测科技股份有限公司 | Signaling monitoring device for realizing PS domain distributed architecture |
| CN103237303A (en) * | 2013-03-29 | 2013-08-07 | 北京中创信测科技股份有限公司 | User-based encryption supporting system and user-based encryption supporting device for monitoring 3G (3rd-generation) networks |
| CN105208575A (en) * | 2014-06-30 | 2015-12-30 | 中兴通讯股份有限公司 | Information processing method of network interface signaling monitoring and apparatus thereof |
| CN105337753A (en) * | 2014-08-06 | 2016-02-17 | 中国移动通信集团广东有限公司 | Method and device for monitoring Internet real quality |
| CN105279257A (en) * | 2015-10-15 | 2016-01-27 | 珠海世纪鼎利科技股份有限公司 | Normal distribution-based internet big data mining method and system |
Non-Patent Citations (2)
| Title |
|---|
| 吴栩欣等: ""基于S1-MME/S1-U信令的LTE网络生态分析系统及应用"", 《电信工程技术与标准化》 * |
| 高艳等: ""VoLTE信令采集及性能测试分析"", 《电信科学》 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109379757A (en) * | 2018-11-30 | 2019-02-22 | 中盈优创资讯科技有限公司 | A kind of single user method for diagnosing faults and device based on narrowband internet of things service |
| CN113542203A (en) * | 2020-04-21 | 2021-10-22 | 中国移动通信集团贵州有限公司 | Video service DPI identification method and server |
| CN113542203B (en) * | 2020-04-21 | 2022-06-28 | 中国移动通信集团贵州有限公司 | Video service DPI identification method and server |
| CN112134846A (en) * | 2020-08-21 | 2020-12-25 | 宜通世纪科技股份有限公司 | Method, system, device and medium for analyzing signaling data of communication network |
| CN112134846B (en) * | 2020-08-21 | 2023-04-18 | 宜通世纪科技股份有限公司 | Method, system, device and medium for analyzing signaling data of communication network |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11704490B2 (en) | Log sourcetype inference model training for a data intake and query system | |
| CN105677842A (en) | Log analysis system based on Hadoop big data processing technique | |
| CN103209087B (en) | Distributed information log statistical processing methods and system | |
| CN107070890A (en) | Flow data processing device and communication network major clique system in a kind of communication network major clique system | |
| WO2022087565A1 (en) | Streaming synthesis of distributed traces from machine logs | |
| CN109710731A (en) | A kind of multidirectional processing system of data flow based on Flink | |
| CN108268529B (en) | Data summarization method and system based on business abstraction and multi-engine scheduling | |
| CN114338746B (en) | Analysis and early warning method and system for data collection of Internet of things equipment | |
| CN111782692B (en) | Frequency control method and device | |
| CN113312376B (en) | Method and terminal for real-time processing and analysis of Nginx logs | |
| CN107317838A (en) | A kind of astronomical metadata archiving method and system based on stream data processing framework | |
| CN108430067A (en) | A kind of Internet service mass analysis method and system based on XDR | |
| CN104486116A (en) | Multidimensional query method and multidimensional query system of flow data | |
| CN102026228B (en) | Statistical method and equipment for communication network performance data | |
| WO2017000592A1 (en) | Data processing method, apparatus and system | |
| CN112506887B (en) | Vehicle terminal CAN bus data processing method and device | |
| CN114510708A (en) | Real-time data warehouse construction and anomaly detection method, device, equipment and product | |
| KR101736382B1 (en) | Ems server and log data management method thereof | |
| CN111049898A (en) | Method and system for realizing cross-domain architecture of computing cluster resources | |
| CN116506300A (en) | Website traffic data statistics method and system | |
| CN114168672B (en) | Log data processing method, device, system and medium | |
| CN108959041B (en) | Method for transmitting information, server and computer readable storage medium | |
| CN115525603A (en) | Storage statistics method and device, computer readable storage medium and AI device | |
| CN113407491A (en) | Data processing method and device | |
| CN110716909A (en) | Commercial system based on data analysis management |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180821 |
|
| RJ01 | Rejection of invention patent application after publication |