CN109462514B

CN109462514B - XDR data quality evaluation method, device and computer readable storage medium

Info

Publication number: CN109462514B
Application number: CN201710794928.5A
Authority: CN
Inventors: 张洋; 马键; 张欢; 孙金霞; 葛澍; 孔松; 常晶
Original assignee: China Mobile Communications Group Co Ltd; China Mobile Communications Ltd Research Institute
Current assignee: China Mobile Communications Group Co Ltd; China Mobile Communications Ltd Research Institute
Priority date: 2017-09-06
Filing date: 2017-09-06
Publication date: 2020-11-20
Anticipated expiration: 2037-09-06
Also published as: CN109462514A

Abstract

The invention provides an XDR data quality evaluation method, an XDR data quality evaluation device and a computer readable storage medium, relates to the technical field of communication, and aims to improve the accuracy of XDR data quality evaluation. The XDR data quality evaluation method comprises the following steps: obtaining XDR data quality calculation parameters; determining an XDR data quality evaluation parameter according to the XDR data quality calculation parameter; and acquiring a data quality evaluation result of the XDR of the manufacturer according to the data quality evaluation parameters of the XDR. The embodiment of the invention can improve the accuracy of evaluating the quality of the XDR data.

Description

XDR data quality evaluation method, device and computer readable storage medium

Technical Field

The present invention relates to the field of communications technologies, and in particular, to an XDR (External Data Representation) Data quality evaluation method, apparatus, and computer readable storage medium.

Background

In order to ensure user experience, a signaling plane of a unified DPI (Deep Packet Inspection) system records control and feedback information (original code stream) between a network and a user, and is used for analyzing the problems that the user cannot surf the internet, the internet experience is poor and the like. Because of the large amount and variety of the control information, the unified DPI system converts each piece of control information into 1 piece of XDR (External Data Representation) information, that is, only the key fields in the control and feedback information are extracted. Each XDR is uniquely identified by an XDR ID (identification) and a time. For example, a user internet display page cannot be displayed, and network control information such as a network refusal user access code and a refusal reason code for analyzing poor user experience is recorded in the XDR corresponding to the unified DPI system.

In the prior art, the quality evaluation of XDR data is carried out by adopting a content consistency detection method. However, in the process of implementing the present invention, the inventors found that the existing method for performing XDR data quality evaluation has low accuracy.

Disclosure of Invention

In view of the above, the present invention provides a method, an apparatus and a computer readable storage medium for evaluating XDR data quality, so as to improve accuracy of evaluating XDR data quality.

In order to solve the above technical problem, in a first aspect, an embodiment of the present invention provides an XDR data quality evaluation method, including:

obtaining XDR data quality calculation parameters;

determining an XDR data quality evaluation parameter according to the XDR data quality calculation parameter;

acquiring a data quality evaluation result of the XDR of the manufacturer according to the data quality evaluation parameters of the XDR;

the XDR data quality calculation parameters comprise a synthetic XDR generated according to a factory original code stream; or the XDR data quality calculation parameter comprises a manufacturer XDR; or the XDR data quality calculation parameters comprise a synthetic XDR generated according to a factory original code stream and the factory XDR.

When the XDR data quality calculation parameter comprises a synthetic XDR generated according to a factory original code stream, the XDR data quality evaluation parameter comprises an original code stream repeated reporting rate;

the determining the XDR data quality evaluation parameter according to the XDR data quality calculation parameter comprises the following steps:

acquiring the quantity of synthetic XDRs generated according to the original code stream of the manufacturer within preset time and the quantity of synthetic XDRs repeatedly generated according to the original code stream of the manufacturer according to the XDR ID;

calculating the sum of the quantity of the synthetic XDR generated according to the factory original code stream and the quantity of the synthetic XDR repeatedly generated according to the factory original code stream;

and taking the quotient of the quantity of the synthetic XDR repeatedly generated according to the original code stream of the manufacturer and the sum as the repeated reporting rate of the original code stream.

When the XDR data quality calculation parameter comprises a manufacturer XDR, the XDR data quality evaluation parameter comprises a manufacturer XDR repeated reporting rate;

acquiring the quantity of XDRs reported by a manufacturer in a preset time and the quantity of XDRs repeatedly reported by the manufacturer according to the XDR ID;

calculating the sum of the quantity of the XDR reported by the manufacturer and the quantity of the XDR repeatedly reported by the manufacturer;

and taking the quotient of the quantity of the XDR repeatedly reported by the manufacturer and the sum as the XDR repeated reporting rate of the manufacturer.

When the XDR data quality calculation parameters comprise a synthetic XDR generated according to a factory original code stream and the factory XDR, the XDR data quality evaluation parameters comprise an XDR synthetic success rate;

obtaining a first number of synthetic XDRs having target XDR IDs in synthetic XDRs generated from a factory original codestream and a second number of XDRs having target XDR IDs in the factory XDRs in a predetermined time for each target XDR ID, and comparing the first number with the second number;

obtaining the number of different comparison results as the comparison result, and taking the number as the deviation number;

and taking the quotient of the deviation number and the quantity of the synthetic XDR generated according to the original code stream of the manufacturer in the preset time as the synthetic success rate of the XDR.

When the XDR data quality calculation parameters comprise a synthetic XDR generated according to a factory original code stream and the factory XDR, the XDR data quality evaluation parameters comprise XDR accuracy;

acquiring a first synthetic XDR with the same XDR ID and a first quantity of XDR of a first manufacturer for the synthetic XDR in a preset time and the XDR reported by the manufacturer;

comparing each field of said first synthetic XDR and said first vendor XDR;

acquiring a second number of correct XDRs of each field according to the comparison result;

taking the quotient of the second quantity and the first quantity as the XDR accuracy.

When the XDR data quality calculation parameters comprise a synthetic XDR generated according to a factory original code stream and the factory XDR, the XDR data quality evaluation parameters comprise an XDR deviation rate;

comparing each field of said first synthetic XDR and said first vendor XDR;

calculating the difference between the first number and the second number, and taking the difference as the deviation number;

taking the quotient of the deviation number and the first number as the XDR deviation ratio.

When the XDR data quality calculation parameter comprises a synthetic XDR generated according to a factory original code stream and the factory XDR, the XDR data quality evaluation parameter comprises an XDR field integrity rate;

acquiring a first synthetic XDR with the same XDR ID and a third quantity of XDR of a first manufacturer for the synthetic XDR in a preset time and the XDR reported by the manufacturer;

according to the third quantity, calculating the integrity rate of the user information field;

according to the third quantity, calculating the integrity rate of the user position information field;

and calculating the integrity rate of the XDR field according to the integrity rate of the user information field and the integrity rate of the user position information field.

Wherein the calculating the integrity rate of the user information field according to the third number comprises:

obtaining the XDR quantity with an empty IMSI field of the international mobile subscriber identity, taking the quotient of the XDR quantity with the empty IMSI field and the third quantity as a first parameter, and calculating the difference between 1 and the first parameter;

obtaining the XDR number with the empty IMEI field, taking the quotient of the XDR number with the empty IMEI field and the third number as a second parameter, and calculating the difference between 1 and the second parameter;

obtaining the XDR quantity with the empty MSISDN field of the international subscriber identity of the mobile station, taking the quotient of the XDR quantity with the empty MSISDN field and the third quantity as a third parameter, and calculating the difference between 1 and the third parameter;

and taking the average value of the difference between 1 and the first parameter, the difference between 1 and the second parameter and the difference between 1 and the third parameter as the integrity rate of the user information field.

Wherein, according to the third number, calculating the integrity rate of the user location information field comprises:

acquiring the XDR quantity with a null cell information CELLID field, taking the quotient of the XDR quantity with the null cell information CELLID field and the third quantity as a fourth parameter, and calculating the difference between 1 and the fourth parameter;

acquiring the quantity of XDRs with empty LON fields, taking the quotient of the quantity of XDRs with empty LON fields and the third quantity as a fifth parameter, and calculating the difference between 1 and the fifth parameter;

acquiring the quantity of XDRs with empty LAT fields, taking the quotient of the quantity of XDRs with empty LAT fields and the third quantity as a sixth parameter, and calculating the difference between 1 and the sixth parameter;

and taking the average value of the difference between 1 and the fourth parameter, the difference between 1 and the fifth parameter and the difference between 1 and the sixth parameter as the integrity rate of the user position information field.

Wherein the calculating the XDR field integrity rate according to the integrity rate of the user information field and the integrity rate of the user location information field includes:

and taking the average value of the integrity rate of the user information field and the integrity rate of the user position information field as the XDR field integrity rate.

When the XDR data quality calculation parameters comprise a synthetic XDR generated according to a factory original code stream and the factory XDR, the XDR data quality evaluation parameters comprise XDR key field accuracy;

acquiring a fourth quantity of first synthetic XDR and first manufacturer XDR with the same XDR ID for the synthetic XDR in the preset time and the XDR reported by the manufacturer;

and calculating the accuracy of the user information field according to the fourth quantity.

Wherein, according to the fourth quantity, calculating the accuracy of the user information field comprises:

obtaining the XDR quantity with correct IMSI field filling, and taking the quotient of the XDR quantity with correct IMSI field filling and the fourth quantity as the IMSI field filling accuracy;

acquiring the XDR quantity with correct IMEI field filling, and taking the quotient of the XDR quantity with correct IMEI field filling and the fourth quantity as the IMEI field filling accuracy;

and acquiring the MSISDN field filled with the correct XDR quantity, and filling the MSISDN field with the quotient of the correct XDR quantity and the fourth quantity as the MSISDN field filling accuracy.

In a second aspect, an embodiment of the present invention further provides an XDR data quality evaluation apparatus, including:

the acquisition module is used for acquiring XDR data quality calculation parameters;

the computing module is used for determining an XDR data quality evaluation parameter according to the XDR data quality computing parameter;

the evaluation module is used for acquiring a data quality evaluation result of the XDR of the manufacturer according to the XDR data quality evaluation parameter;

In a third aspect, an embodiment of the present invention further provides an electronic device, including a memory, a processor, a transceiver, and a computer program stored in the memory and executable on the processor; the steps in the method of the first aspect are implemented when the computer program is executed by the processor.

In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium for storing a computer program, where the computer program is implemented to implement the steps in the method according to the first aspect when executed by a processor.

The technical scheme of the invention has the following beneficial effects:

in the embodiment of the invention, the XDR data quality evaluation parameter is obtained according to the XDR data quality calculation parameter, so that the data quality of the XDR of a manufacturer is evaluated. The XDR data quality calculation parameters comprise a synthetic XDR generated according to a factory original code stream; or the XDR data quality calculation parameter comprises a manufacturer XDR; or the XDR data quality calculation parameter comprises a synthetic XDR generated according to the original code stream of the manufacturer and the XDR of the manufacturer, so that the obtained XDR data quality evaluation parameter can evaluate the XDR of the manufacturer more comprehensively, and the accuracy of evaluating the XDR data quality is improved.

Drawings

FIG. 1 is a flow chart of an XDR data quality evaluation method according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of an XDR data quality evaluation apparatus according to an embodiment of the present invention;

fig. 3 is a schematic diagram of an electronic device according to an embodiment of the invention.

Detailed Description

The following detailed description of embodiments of the present invention will be made with reference to the accompanying drawings and examples. The following examples are intended to illustrate the invention but are not intended to limit the scope of the invention.

As shown in fig. 1, the XDR data quality evaluation method according to the embodiment of the present invention includes:

step 101, obtaining XDR data quality calculation parameters.

And 102, determining an XDR data quality evaluation parameter according to the XDR data quality calculation parameter.

And 103, acquiring a data quality evaluation result of the XDR of the manufacturer according to the data quality evaluation parameters of the XDR.

And evaluating the data quality of the XDR of the manufacturer according to the obtained XDR data quality evaluation parameters to obtain an evaluation result.

In the embodiment of the invention, the detection of the completeness and the accuracy of XDR data can be effectively carried out mainly through the detection of the synthetic success rate of XDR, the detection of the accuracy of XDR, the detection of the completeness of XDR, the repeated detection of XDR key fields, original code streams and the repeated detection of XDR. The detailed implementation of the above detection will be described below.

First, repeated reporting detection of original code stream

And (4) repeatedly detecting the original code stream, and calculating according to whether the original code stream has repeated reports. The repeated reporting rate of the original code stream is high, which causes inaccurate statistical results, so that repeated data needs to be removed as much as possible.

Here, the number of synthetic XDRs generated from the factory original code stream and the number of synthetic XDRs repeatedly generated from the factory original code stream within a predetermined time are obtained according to the XDR ID, the sum of the number of synthetic XDRs generated from the factory original code stream and the number of synthetic XDRs repeatedly generated from the factory original code stream is calculated, and then the quotient of the number of synthetic XDRs repeatedly generated from the factory original code stream and the sum is used as the original code stream repeated reporting rate.

In the embodiment of the present invention, the predetermined time period may refer to a period of time within the start and end time of a certain communication flow.

Specifically, according to the starting time and the ending time of a certain communication flow, the XDR ID searches the XDR quantity synthesized by the original code stream and the XDR quantity repeatedly synthesized by the original code stream, then,

the repeated reporting rate of the original code stream is the number of XDRs (X-ray data reduction) repeatedly generated by the original code stream/(the number of XDRs generated by the original code stream + the number of XDRs repeatedly generated by the original code stream).

Second, the XDR of the manufacturer is repeatedly reported and detected

And (4) carrying out repeated reporting detection on the XDR of the manufacturer to calculate whether the XDR of the manufacturer exists repeated reporting. The high repeated reporting rate of the XDR of the manufacturer can cause inaccurate statistical results, so that repeated data needs to be removed as much as possible. Herein, the number of XDRs reported by a manufacturer and the number of XDRs repeatedly reported by the manufacturer are obtained within a predetermined time according to the XDR ID, the sum of the number of XDRs reported by the manufacturer and the number of XDRs repeatedly reported by the manufacturer is calculated, and then the quotient of the number of XDRs repeatedly reported by the manufacturer and the sum is used as the XDR repeated reporting rate of the manufacturer.

Specifically, according to the starting time and the ending time of a certain communication process, the XDRID searches the XDR quantity reported by the manufacturer and the XDR quantity repeatedly reported by the manufacturer, then,

the XDR reporting rate is the XDR amount reported repeatedly by the manufacturer/(XDR amount reported by the manufacturer + XDR amount reported repeatedly by the manufacturer).

Third, XDR synthesis success rate detection

The high and low synthetic success rate of the XDR represents the quantitative accuracy of the synthetic XDR generated according to the original code stream of a manufacturer.

Here, for each target XDR ID, a first number of synthesized XDRs having the target XDR ID among the synthesized XDRs generated from the factory raw codestream and a second number of XDRs having the target XDRID among the factory XDRs are obtained within a predetermined time, and the first number and the second number are compared to obtain a number of comparison results whose comparison results are different, the number is taken as a deviation number, and a quotient of the deviation number and the number of synthesized XDRs generated from the factory raw codestream within the predetermined time is taken as an XDR synthesis success rate. Wherein the target XDR ID may be any XDR ID.

The offset number is SUM (offset value of XDR number corresponding to XDRID), wherein the offset value of XDR number corresponding to XDRID needs to consider time dimension, XDR of the same XDR ID found in time T is considered as one XDR, and recommended value of T is within [ -3s, +3s ]. Then, the deviation ratio is the deviation number/the number of XDRs generated by the original code stream.

For example, the following table is given as an example:

for a certain XDR1, the XDR ID of the synthesized XDR generated by the original code stream is A, the XDR ID reported by the DPI manufacturer is A, the quantity of the XDR ID and the XDR ID is equal, and the deviation value is 0. For a certain XDR2, the XDR ID generated by the original code stream is 0, the XDR ID reported by the DPI manufacturer is B, the quantity of the XDR ID and the XDR ID is different, and the deviation value is 1. For a certain XDR3, the XDRID generated by the original code stream is C, the XDR ID reported by the DPI manufacturer is C, the quantity of the XDR ID and the quantity of the XDR ID are equal, and the deviation value is unchanged. For a certain XDR4, the XDR ID generated by the original code stream is D, the XDRID reported by the DPI manufacturer is 0, the quantity of the XDR ID and the quantity of the XDRID are different, and the deviation value is added by 1 and is 2.

Therefore, the deviation ratio is 2/3.

Fourth, XDR accuracy detection

Here, the XDR accuracy or XDR deviation ratio may be used as an index for measuring the XDR accuracy. The XDR accuracy or the XDR deviation rate represents the accuracy of the content of the synthetic XDR generated according to the original code stream of the manufacturer.

Taking XDR accuracy as an example, for a synthesized XDR within a predetermined time and an XDR reported by a manufacturer, obtaining a first number of first synthesized XDRs and first manufacturer XDRs having the same XDR ID, and comparing each field of the first synthesized XDR and the first manufacturer XDR. And acquiring a second quantity of the correct XDR of the comparison result of each field, and taking the quotient of the second quantity and the first quantity as the XDR accuracy.

Taking the XDR deviation rate as an example, for the synthetic XDR in a preset time and the XDR reported by a manufacturer, acquiring a first quantity of a first synthetic XDR and a first manufacturer XDR with the same XDR ID, comparing each field of the first synthetic XDR and the first manufacturer XDR, and acquiring a second quantity of the XDR of which the comparison result of each field is correct. Calculating the difference between the first quantity and the second quantity, taking the difference as the deviation number, and taking the quotient of the deviation number and the first quantity as the XDR deviation rate.

Specifically, a synthetic XDR generated by an original code stream is matched with an XDR of a manufacturer, and an intersection XDR is found according to the start time and the end time of a certain communication flow. For each XDR, there is a time tolerance, which is time T, within which XDR found to have the same XDR ID are considered as the number of XDR to be compared, with Trecommended values within [ -3s, +3s ].

And calculating the XDR quantity, deviation number, deviation rate and XDR field accuracy of the DPI manufacturer in the XDR with completely correct fields reported by the DPI manufacturer in the compared XDR.

The XDR field accuracy rate reported by the DPI manufacturer that the fields in the XDR are completely correct is equal to SUM (in the intersection, the number of all correct XDRs in all field inspection results corresponding to the XDRs)/the number of XDRs to be compared.

And (3) calculating the deviation rate, namely the compared XDR quantity-the XDR quantity with the completely correct DPI manufacturer field: the deviation ratio is the number of deviations/compared XDRs.

The field detection is divided into two cases:

case 1: if there is a corresponding IE (field) in the synthesized XDR generated by the original code stream, the fields in the XDR reported by the manufacturer and the fields in the synthesized XDR generated by the original code stream must be completely consistent to be considered to be correct;

case 2: if there is no corresponding IE (field) in the synthesized XDR generated by the original code stream, judging whether the field in the XDR reported by the manufacturer is correct according to the size or the type of the field according to the type of the field.

In case 2, the size or type of the value of the field is compared with a predetermined value or type to determine whether it is correct.

For example, assume that a field a exists in an XDR reported by a manufacturer, and the field a does not exist in a synthesized XDR generated by an original codestream. According to the setting, the value of the field a needs to be larger than B, and actually, the value in the field a is smaller than B, and the corresponding comparison result of the field a is an error.

Five, XDR integrity detection

XDR integrity is calculated mainly for XDR user information field (IMSI (International Mobile Subscriber Identity)/IMEI (International Mobile Equipment Identity)/MSISDN (Mobile station International ISDN Number)), and user location information (CELLID/LON/LAT (latitude)). The lower the number of empty fields of a particular field of interest, the better the focus on a particular user. Higher XDR field integrity represents a greater amount of information that can be provided for upper layer applications.

Herein, for a synthesized XDR and an XDR reported by a manufacturer within a predetermined time, a third number of first synthesized XDRs and first manufacturer XDRs having the same XDR ID is obtained, a completion rate of a user information field is calculated according to the third number, a completion rate of a user location information field is calculated according to the third number, and a completion rate of the XDR field is calculated according to the completion rate of the user information field and the completion rate of the user location information field.

Taking the calculation of the integrity of the user information field as an example, acquiring the XDR quantity with the empty IMSI field, taking the quotient of the XDR quantity with the empty IMSI field and the third quantity as a first parameter, and calculating the difference between 1 and the first parameter; acquiring the XDR number with an empty IMEI field, taking the quotient of the XDR number with the empty IMEI field and the third number as a second parameter, and calculating the difference between 1 and the second parameter; acquiring the XDR quantity with an empty MSISDN field, taking the quotient of the XDR quantity with the empty MSISDN field and the third quantity as a third parameter, and calculating the difference between 1 and the third parameter; and taking the average value of the difference between 1 and the first parameter, the difference between 1 and the second parameter and the difference between 1 and the third parameter as the integrity rate of the user information field.

Taking the calculation of the integrity rate of the user location information field as an example, acquiring the XDR quantity of the cell information CELLID field which is empty, taking the quotient of the XDR quantity of the cell information CELLID field which is empty and the third quantity as a fourth parameter, and calculating the difference between 1 and the fourth parameter; acquiring the quantity of XDRs with empty LON fields, taking the quotient of the quantity of XDRs with empty LON fields and the third quantity as a fifth parameter, and calculating the difference between 1 and the fifth parameter; acquiring the quantity of XDRs with empty LAT fields, taking the quotient of the quantity of XDRs with empty LAT fields and the third quantity as a sixth parameter, and calculating the difference between 1 and the sixth parameter; and taking the average value of the difference between 1 and the fourth parameter, the difference between 1 and the fifth parameter and the difference between 1 and the sixth parameter as the integrity rate of the user position information field.

Then, an average value of the integrity rate of the user information field and the integrity rate of the user location information field is taken as the XDR field integrity rate.

Specifically, a synthetic XDR generated by an original code stream is matched with an XDR reported by a manufacturer, and an intersection XDR is found according to the start time and the end time of a certain communication flow. For each XDR, there is a time tolerance, which is time T, within which the XDR (as compared by XDRID) is considered to be the corresponding XDR, with recommended values of T [ -3s, +3s ].

Here, the XDR user information field (IMSI/IMEI/MSISDN), user location information (CELLID/LON/LAT), and XDR field integrity calculations are performed, where:

empty IMSI number — SUM (XDR with empty IMSI field)

Empty IMEI number (SUM (XDR with empty IMEI field)) number

Empty MSISDN number (SUM (XDR) number with empty MSISDN field)

Number of empty CELLIDs (SUM (XDR with empty CELLID field) number

Empty LON number (SUM (XDR with LON field empty) number

Number of empty LATs (SUM (XDR with empty LAT field)

Then, the XDR field integrity calculation: the XDR field integrity rate is AVE (empty field rate of 1-XDR), wherein the empty field rate of XDR takes the following values:

number of empty IMSIs/number of compared XDRs; number of empty IMEIs/number of compared XDRs; number of empty MSISDNs/number of XDRs compared; number of empty CELLIDs/number of compared XDRs; number of empty LONs/number of XDRs compared; number of empty LATs/number of XDRs compared.

That is, the XDR field integrity rate ═ AVE ((1-number of empty IMSIs/number of XDRs compared) + (1-number of empty IMEIs/number of XDRs compared) + (1-number of empty MSISDNs/number of XDRs compared) + (1-number of empty CELLIDs/number of XDRs compared) + (1-number of empty LONs/number of XDRs compared) + (1-number of empty LATs/number of XDRs compared)).

Six, XDR key field detection

The XDR key field detection mainly aims at the accuracy of XDR key fields (IMSI/IMEI/MSISDN) to be calculated. The higher the accuracy of the key fields, the more accurate the focus on a particular user. The greater the value of providing utility to the upper layer applications.

Herein, for the synthesized XDR and the XDR reported by the manufacturer within a predetermined time, a fourth number of the first synthesized XDR and the first manufacturer XDR having the same XDR ID is obtained, and an accuracy rate of calculating the user information field is calculated based on the fourth number.

Specifically, obtaining the correct XDR quantity filled in the IMSI field, and taking the quotient of the correct XDR quantity filled in the IMSI field and the fourth quantity as the IMSI field filling accuracy; acquiring the XDR quantity with correct IMEI field filling, and taking the quotient of the XDR quantity with correct IMEI field filling and the fourth quantity as the IMEI field filling accuracy; and acquiring the MSISDN field filled with the correct XDR quantity, and filling the MSISDN field with the quotient of the correct XDR quantity and the fourth quantity as the MSISDN field filling accuracy.

Calculate the accuracy of DPI vendor XDR key fields (IMSI/IMEI/MSISDN) in the intersection:

IMSI field accuracy ═ SUM (IMSI filled correct XDR) number/intersection XDR number

IMEI field accuracy SUM (IMEI filled correct XDR) quantity/intersection XDR quantity

MSISDN field accuracy ═ SUM (MSISDN populated correct XDR) number/intersection XDR number.

Wherein, the IMSI/IMEI/MSISDN filling is correctly divided into two cases

The field detection is divided into two cases:

Compared with the traditional dial testing scheme, the method can be used for detecting the XDR synthesis success rate of the unified DPI system, and the capability of analyzing original code streams of different unified DPI system manufacturers into XDR can be compared.

Compared with the traditional dial testing scheme which can only simulate partial flows, the method can compare all fields of all flows of all signaling interfaces, and has wider inspection range; the embodiment carries out integrity detection on the user information and the position information, and can effectively improve the completeness of upper-layer application; according to the embodiment, the accuracy detection is carried out on the user information, and the accuracy and reliability of the upper layer application in the user association can be guaranteed.

As shown in fig. 2, the XDR data quality evaluation apparatus according to the embodiment of the present invention includes:

an obtaining module 201, configured to obtain an XDR data quality calculation parameter; a calculating module 202, configured to determine an XDR data quality evaluation parameter according to the XDR data quality calculation parameter; the evaluation module 203 is used for obtaining a data quality evaluation result of the manufacturer XDR according to the XDR data quality evaluation parameters; the XDR data quality calculation parameters comprise a synthetic XDR generated according to a factory original code stream; or the XDR data quality calculation parameter comprises a manufacturer XDR; or the XDR data quality calculation parameters comprise a synthetic XDR generated according to a factory original code stream and the factory XDR.

Wherein, when the XDR data quality calculation parameter includes a synthesized XDR generated according to a factory raw code stream, the calculation module 202 may include:

a first obtaining submodule, configured to obtain, according to an XDR ID, a number of synthesized XDRs generated according to the manufacturer original code stream within a predetermined time and a number of synthesized XDRs repeatedly generated according to the manufacturer original code stream;

the first calculation submodule is used for calculating the sum of the quantity of the synthetic XDR generated according to the factory original code stream and the quantity of the synthetic XDR repeatedly generated according to the factory original code stream;

and the second calculation submodule is used for taking the quotient of the quantity of the synthetic XDR repeatedly generated according to the original code stream of the manufacturer and the sum as the repeated reporting rate of the original code stream.

Wherein, when the XDR data quality calculation parameter includes a manufacturer XDR, the calculation module 202 may include:

the third calculation submodule is used for acquiring the quantity of the XDR reported by the manufacturer in preset time and the quantity of the XDR repeatedly reported by the manufacturer according to the XDR ID;

a fourth calculating submodule, configured to calculate a sum of the number of XDRs reported by the manufacturer and the number of XDRs repeatedly reported by the manufacturer;

and the fifth calculation submodule is used for taking the quotient of the quantity of the XDR repeatedly reported by the manufacturer and the sum as the XDR repeated reporting rate of the manufacturer.

When the XDR data quality calculation parameter includes a synthesized XDR generated according to a factory raw code stream and the factory XDR, the calculation module 202 may include:

a first comparison sub-module, configured to, for each target XDR ID, obtain, within a predetermined time, a first number of synthesized XDRs having the target XDR ID in the synthesized XDRs generated from the factory original code stream, and a second number of XDRs having the target XDR ID in the factory XDRs, and compare the first number with the second number;

a sixth calculation submodule, configured to obtain the number of comparison results that are different, where the number is used as a deviation number;

and the seventh calculation submodule is used for taking the quotient of the deviation number and the quantity of the synthetic XDR generated according to the original code stream of the manufacturer in the preset time as the synthetic success rate of the XDR.

a second obtaining submodule, configured to obtain, for a synthesized XDR within a predetermined time and an XDR reported by a manufacturer, a first number of first synthesized XDRs and a first manufacturer XDR having a same XDR ID;

a second comparison submodule for comparing each field of the first synthetic XDR and the first manufacturer XDR;

the third obtaining submodule is used for obtaining a second number of correct XDRs of the comparison result of each field;

an eighth calculation submodule for taking a quotient of the second number and the first number as an XDR accuracy.

a fourth obtaining submodule, configured to obtain, for the synthesized XDR and the XDR reported by the manufacturer within the predetermined time, a first number of first synthesized XDRs and a first number of first manufacturer XDRs that have the same XDR ID;

a third comparison sub-module for comparing each field of the first synthesized XDR and the first manufacturer XDR;

a fifth obtaining submodule, configured to obtain a second number of correct XDRs for each field;

a ninth calculating submodule for calculating a difference between the first number and the second number, the difference being taken as a deviation number;

a tenth calculation submodule for taking the quotient of the deviation number and the first number as the XDR deviation ratio.

a sixth obtaining submodule, configured to obtain, for the synthesized XDR within the predetermined time and the XDR reported by the manufacturer, a third number of first synthesized XDRs and first manufacturer XDRs that have the same XDR ID;

the eleventh calculating submodule is used for calculating the integrity rate of the user information fields according to the third quantity;

a twelfth calculating submodule, configured to calculate a completeness rate of the user location information field according to the third quantity;

and the thirteenth calculating submodule is used for calculating the integrity rate of the XDR field according to the integrity rate of the user information field and the integrity rate of the user position information field.

Specifically, the thirteenth calculating sub-module is configured to use an average of the integrity rate of the user information field and the integrity rate of the user location information field as the XDR field integrity rate.

Wherein the eleventh calculation sub-module may include:

a first obtaining unit, configured to obtain an XDR number for which an IMSI field of an international mobile subscriber identity is empty, take a quotient of the XDR number for which the IMSI field is empty and the third number as a first parameter, and calculate a difference between 1 and the first parameter;

a second obtaining unit, configured to obtain an XDR number that an IMEI field of the international mobile equipment is empty, take a quotient of the XDR number that the IMEI field is empty and the third number as a second parameter, and calculate a difference between 1 and the second parameter;

a third obtaining unit, configured to obtain an XDR number of an MSISDN field of the mobile station international subscriber identity, and calculate a difference between 1 and the third parameter by using a quotient of the XDR number of the MSISDN field with a null and the third number as the third parameter;

and the calculating unit is used for taking the average value of the difference between 1 and the first parameter, the difference between 1 and the second parameter and the difference between 1 and the third parameter as the integrity rate of the user information field.

Wherein the twelfth computation submodule may include:

a first obtaining unit, configured to obtain an XDR number that a cell information CELLID field is empty, take a quotient of the XDR number that the cell information CELLID field is empty and the third number as a fourth parameter, and calculate a difference between 1 and the fourth parameter;

a second obtaining unit, configured to obtain the number of XDRs whose LON fields are empty, take a quotient of the number of XDRs whose LON fields are empty and the third number as a fifth parameter, and calculate a difference between 1 and the fifth parameter;

a third acquiring unit configured to acquire the number of XDRs for which the LAT field is empty, and calculate a difference between 1 and a sixth parameter by taking a quotient of the number of XDRs for which the LAT field is empty and the third number as the sixth parameter;

and the calculating unit is used for taking the average value of the difference between 1 and the fourth parameter, the difference between 1 and the fifth parameter and the difference between 1 and the sixth parameter as the integrity rate of the user position information field.

a seventh obtaining submodule, configured to obtain, for the synthesized XDR within the predetermined time and the XDR reported by the manufacturer, a fourth number of first synthesized XDRs and first manufacturer XDRs having the same XDR ID;

and the fourteenth calculating submodule is used for calculating the accuracy of the user information field according to the fourth quantity.

Specifically, the fourteenth computing submodule includes:

a first obtaining unit, configured to obtain the XDR number that the IMSI field is filled with correctly, and use a quotient of the XDR number that the IMSI field is filled with correctly and the fourth number as an IMSI field filling accuracy;

a second obtaining unit, configured to obtain the XDR number with the correct IMEI field filling, and use a quotient between the XDR number with the correct IMEI field filling and the fourth number as an IMEI field filling accuracy;

and a third obtaining unit, configured to obtain the correct XDR number filled in the MSISDN field, and use a quotient of the correct XDR number and the fourth number filled in the MSISDN field as the MSISDN field filling accuracy.

The working principle of the device according to the invention can be referred to the description of the method embodiment described above.

As shown in fig. 3, an embodiment of the present invention provides an electronic device, including: a processor 300 for reading the program in the memory 320, and executing the following processes:

obtaining XDR data quality calculation parameters;

the XDR data quality calculation parameters comprise a synthetic XDR generated according to a factory original code stream; or the XDR data quality calculation parameter comprises a manufacturer XDR; or the XDR data quality calculation parameters comprise a synthetic XDR generated according to a factory original code stream and the factory XDR;

a transceiver 310 for receiving and transmitting data under the control of the processor 300.

Where in fig. 3, the bus architecture may include any number of interconnected buses and bridges, with various circuits being linked together, particularly one or more processors represented by processor 300 and memory represented by memory 320. The bus architecture may also link together various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art, and therefore, will not be described any further herein. The bus interface provides an interface. The transceiver 310 may be a number of elements including a transmitter and a transceiver providing a means for communicating with various other apparatus over a transmission medium. The processor 300 is responsible for managing the bus architecture and general processing, and the memory 320 may store data used by the processor 300 in performing operations.

The processor 300 is responsible for managing the bus architecture and general processing, and the memory 320 may store data used by the processor 300 in performing operations.

The processor 300 is further configured to read the computer program and perform the following steps of obtaining, according to an XDR ID, a number of synthetic XDRs generated according to a factory original code stream within a predetermined time and a number of synthetic XDRs repeatedly generated according to the factory original code stream when the XDR data quality calculation parameter includes a synthetic XDR generated according to the factory original code stream; calculating the sum of the quantity of the synthetic XDR generated according to the factory original code stream and the quantity of the synthetic XDR repeatedly generated according to the factory original code stream; and taking the quotient of the quantity of the synthetic XDR repeatedly generated according to the original code stream of the manufacturer and the sum as the repeated reporting rate of the original code stream.

When the XDR data quality calculation parameter comprises a manufacturer XDR, acquiring the quantity of XDRs reported by the manufacturer within preset time and the quantity of XDRs repeatedly reported by the manufacturer according to an XDR ID; calculating the sum of the quantity of the XDR reported by the manufacturer and the quantity of the XDR repeatedly reported by the manufacturer; and taking the quotient of the quantity of the XDR repeatedly reported by the manufacturer and the sum as the XDR repeated reporting rate of the manufacturer.

The processor 300 is further configured to read the computer program, and perform the steps of obtaining, for each target XDR ID, a first number of synthesized XDRs having the target XDR ID among the synthesized XDRs generated from the factory original codestream, and a second number of XDRs having the target XDR ID among the factory XDRs, and comparing the first number with the second number, when the XDR data quality calculation parameter includes the synthesized XDRs generated from the factory original codestream and the factory XDRs; obtaining the number of different comparison results as the comparison result, and taking the number as the deviation number; and taking the quotient of the deviation number and the quantity of the synthetic XDR generated according to the original code stream of the manufacturer in the preset time as the synthetic success rate of the XDR.

The processor 300 is further configured to read the computer program, and perform the steps of obtaining a first synthesized XDR and a first number of first manufacturer XDRs having the same XDR ID for the synthesized XDR and an XDR reported by a manufacturer within a predetermined time, when the XDR data quality calculation parameter includes the synthesized XDR generated from an original code stream of the manufacturer and the manufacturer XDR; comparing each field of said first synthetic XDR and said first vendor XDR; acquiring a second number of correct XDRs of each field according to the comparison result; taking the quotient of the second quantity and the first quantity as the XDR accuracy.

The processor 300 is further configured to read the computer program, and perform the steps of obtaining a first synthesized XDR and a first number of first manufacturer XDRs having the same XDR ID for the synthesized XDR and an XDR reported by a manufacturer within a predetermined time, when the XDR data quality calculation parameter includes the synthesized XDR generated from an original code stream of the manufacturer and the manufacturer XDR; comparing each field of said first synthetic XDR and said first vendor XDR; acquiring a second number of correct XDRs of each field according to the comparison result; calculating the difference between the first number and the second number, and taking the difference as the deviation number; taking the quotient of the deviation number and the first number as the XDR deviation ratio.

The processor 300 is further adapted to read the computer program and perform the following steps:

when the XDR data quality calculation parameters comprise a synthetic XDR generated according to a factory original code stream and the factory XDR, acquiring a first synthetic XDR with the same XDR ID and a third quantity of the first factory XDR for the synthetic XDR in a preset time and the XDR reported by the factory; according to the third quantity, calculating the integrity rate of the user information field; according to the third quantity, calculating the integrity rate of the user position information field; and calculating the integrity rate of the XDR field according to the integrity rate of the user information field and the integrity rate of the user position information field.

when the XDR data quality calculation parameter comprises a synthetic XDR generated according to a factory original code stream and the factory XDR, acquiring a first synthetic XDR with the same XDR ID and a fourth quantity of the first factory XDR for the synthetic XDR in a preset time and the XDR reported by the factory; and calculating the accuracy of the user information field according to the fourth quantity.

Furthermore, a computer-readable storage medium of an embodiment of the present invention stores a computer program executable by a processor to implement:

obtaining XDR data quality calculation parameters;

comparing each field of said first synthetic XDR and said first vendor XDR;

In the several embodiments provided in the present application, it should be understood that the disclosed method and apparatus may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be physically included alone, or two or more units may be integrated into one unit. The integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.

The integrated unit implemented in the form of a software functional unit may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium and includes several instructions to enable a computer device (which may be a personal computer, a server, or a network device) to execute some steps of the transceiving method according to various embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.

While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined in the appended claims.

Claims

1. An XDR data quality evaluation method is characterized by comprising the following steps:

obtaining XDR data quality calculation parameters;

or the XDR data quality calculation parameter comprises a manufacturer XDR, and the XDR data quality evaluation parameter comprises a manufacturer XDR repeated reporting rate;

when or the XDR data quality calculation parameter comprises a synthetic XDR generated according to a factory original code stream and the factory XDR, the XDR data quality evaluation parameter comprises an XDR synthetic success rate, an XDR accuracy rate, an XDR deviation rate, an XDR field integrity rate or an XDR key field accuracy rate.

2. The method according to claim 1, wherein determining XDR data quality evaluation parameters from the XDR data quality calculation parameters comprises:

3. The method according to claim 1, wherein determining XDR data quality evaluation parameters from the XDR data quality calculation parameters comprises:

4. The method according to claim 1, wherein determining XDR data quality evaluation parameters from the XDR data quality calculation parameters comprises:

5. The method according to claim 1, wherein determining XDR data quality evaluation parameters from the XDR data quality calculation parameters comprises:

comparing each field of said first synthetic XDR and said first vendor XDR;

6. The method according to claim 1, wherein determining XDR data quality evaluation parameters from the XDR data quality calculation parameters comprises:

comparing each field of said first synthetic XDR and said first vendor XDR;

7. The method according to claim 1, wherein determining XDR data quality evaluation parameters from the XDR data quality calculation parameters comprises:

8. The method of claim 7, wherein calculating the integrity rate of the user information field according to the third number comprises:

9. The method of claim 7, wherein calculating the integrity rate of the user location information field according to the third number comprises:

10. The method of claim 7, wherein the calculating the XDR field integrity rate according to the integrity rate of the user information field and the integrity rate of the user location information field comprises:

11. The method according to claim 1, wherein determining XDR data quality evaluation parameters from the XDR data quality calculation parameters comprises:

12. The method of claim 11, wherein calculating an accuracy rate for calculating the user information field according to the fourth quantity comprises:

13. An XDR data quality evaluation apparatus, comprising:

when the XDR data quality calculation parameter comprises a synthetic XDR generated according to a factory original code stream, the XDR data quality evaluation parameter comprises an original code stream repeated reporting rate; or the XDR data quality calculation parameter comprises a manufacturer XDR, and the XDR data quality evaluation parameter comprises a manufacturer XDR repeated reporting rate; or when the XDR data quality calculation parameter comprises a synthetic XDR generated according to a factory original code stream and the factory XDR, the XDR data quality evaluation parameter comprises an XDR synthetic success rate, an XDR accuracy rate, an XDR deviation rate, an XDR field integrity rate or an XDR key field accuracy rate.

14. An electronic device comprising a memory, a processor, a transceiver, and a computer program stored on the memory and executable on the processor; characterized in that the processor, when executing the computer program, implements the steps in the method according to any one of claims 1 to 12.

15. A computer-readable storage medium for storing a computer program, wherein the computer program, when executed by a processor, implements the steps in the method of any one of claims 1 to 12.