CN103796220A - Method and device for assessing wireless data service carrying efficiency - Google Patents
Method and device for assessing wireless data service carrying efficiency Download PDFInfo
- Publication number
- CN103796220A CN103796220A CN201210429883.9A CN201210429883A CN103796220A CN 103796220 A CN103796220 A CN 103796220A CN 201210429883 A CN201210429883 A CN 201210429883A CN 103796220 A CN103796220 A CN 103796220A
- Authority
- CN
- China
- Prior art keywords
- community
- data service
- record
- zhong
- busy
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention discloses a method for assessing wireless data service carrying efficiency. The method is characterized by collecting user original data on interfaces between core network network elements; screening out cells, of which data service multiplexing degree is lower than a first data service multiplexing degree threshold, from wireless network statistics to serve as idle cells of the data service; analyzing collected user original data and determining content transmission average delay of each cell in the idle cells; and determining wireless data service carrying efficiency of each cell in non-idle cells according to the content transmission average delay of each cell in the idle cells. The invention also discloses a device for assessing the wireless data service carrying efficiency. With the scheme in the invention, the actual use perception of the user can be accurately assessed, the assessment of the wireless data service carrying efficiency of each cell in the non-idle cells is realized, and the influence of the core network side, inter-operator interface load and website servers on the wireless data service carrying efficiency is fully taken into consideration.
Description
Technical field
The present invention relates to the assessment technology of load-carrying efficiency in mobile communication system, relate in particular to a kind of method and apparatus of assessing wireless data service load-carrying efficiency.
Background technology
In mobile communication system, wireless data service resource is distributed the method that adopts the one or more wireless channels of multiuser multiplexing or code channel at present.In GSM network, terminal is being sent after data service application, and base station controller (BSC) is according to type of user terminal, and the class rank of terminal is come to user assignment radio channel resource, and current most terminals belong to class10 rank.When BSC detects new terminal application access and during without vacant wireless channel, new terminal and original terminal time-sharing multiplex is set, jointly use identical radio channel resource.In the time that the multiplexing terminal of same wireless channel is more, the reusing degree value of each terminal affiliated subdistrict is high, otherwise the reusing degree of each terminal affiliated subdistrict is low.When the wireless data traffic that produces when identical wireless channel is larger, the wireless data service load-carrying efficiency of each terminal affiliated subdistrict is high, otherwise the wireless data service load-carrying efficiency of each terminal affiliated subdistrict is low.
Because BSC in gsm system comes for terminal distribution radio channel resource according to terminal type, rather than come for terminal distribution radio channel resource according to the size of wireless data service packet, therefore, the wireless data service load-carrying efficiency difference that different business produces is very large, suppose that terminal is the rank of class=10, 2 up channels of the highest support, can use 4 down channels and 1 up channel simultaneously, or can use 3 down channels and 2 up channels simultaneously, as terminal is used as QQ, the instant message class business such as Fetion, the data volume of heartbeat packet demand is very little, BSC distributes 4 down channels according to terminal type, because reality generation flow is less, the wireless data service load-carrying efficiency of described terminal affiliated subdistrict is extremely low, and for example terminal is used the background business such as FTP download, P2P downloading service, because its request for data amount is very large, and be continuous packet, BSC distributes after 4 down channels according to terminal type equally, owing to producing, flow is very large, and the wireless data service load-carrying efficiency of described terminal affiliated subdistrict is very high, also, as used the interaction services such as web page browsing, data upload, BSC distributes after wireless channel, and the data traffic of generation is higher, and the wireless data data service load-carrying efficiency of terminal affiliated subdistrict is higher.
If guarantee that user uses the perception of wireless data service, need to reasonably plan wireless data service load-carrying efficiency, can not pursue simply the actual use perception of having ignored user compared with high load-carrying efficiency.But, because the inhomogeneity wireless data service difference of user's application is very large, be difficult to wireless data service load-carrying efficiency to set according to a unified thresholding.At present judge that the rational method of wireless data service load-carrying efficiency is to be sorted out and gathered by webmaster statistical indicator, mean value according to statistics does basic judgement to the load-carrying efficiency reasonability of the whole communities of existing network, show that the each community of existing network increases or reduces optimizing and revising of wireless channel, ensures user's use perception.
At present the appraisal procedure of wireless data service load-carrying efficiency is not considered the type of service under each community, from the closely-related average every user rate of user awareness and TBF reusing degree index, the reasonability of data service bearer efficiency is analyzed.
Be below the explanation of ASSOCIATE STATISTICS index:
1, descending enhanced data rates for gsm evolution technology (EGPRS, Enhanced Data Rate forGSM Evolution) every time slot throughput (Trf_236):
Formula is:
Wherein, EGPRS ACK DL payload data in (kilobits) represents that EGPRS confirms down load packet (unit: kb); EGPRS ACK DL time for data transfer (sec) represents that EGPRS confirms the downlink data transmission time (unit: second);
2, every time slot TBF number (tbf_38c):
Formula is:
Wherein, aver_tbfs_per_tsl_dl_sum represents that the TBF carrying on average descending every time slot counts summing value; Aver_tbds_per_tsl_dl_den*100 represents the TBF average carrying on descending every time slot;
3, user on average occupies timeslot number:
Formula is:
Wherein, alloc_1_TSL_DL+alloc_2_TSL_DL*2+...+alloc_8_TSL_DL*8 represents that descending every user assignment takies time slot sum; Alloc_1_TSL_DL+alloc_2_TSL_DL+...+alloc_8_TSL_DL represents descending time slot allotment;
4, average every user rate:
Average every user rate=Trf_236* user on average occupies timeslot number/Tbf_38c;
The appraisal procedure of analyzing wireless data service load-carrying efficiency by statistical indicator below:
First, the wireless data service load-carrying efficiency of the statistics all communities of the whole network, be Packet Data Channel (PDCH, Packet Data Channel) load-carrying efficiency and two indexs of average every user rate, the PDCH load-carrying efficiency of each community and two indexs of average every user rate are labeled on figure, as shown in Figure 1, from the graph of a relation of PDCH load-carrying efficiency and average every user rate, can find out, average every user rate reduces with the rising of PDCH load-carrying efficiency, average every user rate is if reach 80kbps, 100kbps and 120kbps, corresponding PDCH load-carrying efficiency index respectively will be at 5.02kbps/tsl, 3.72kbps/tsl and below 2.87kbps/tsl.
Secondly, PDCH load-carrying efficiency and the Temporary Block Flow (TBF of the statistics all communities of the whole network, Temporary Block Flow) reusing degree index, as shown in Figure 2, from the graph of a relation of PDCH load-carrying efficiency and TBF reusing degree, can find out, PDCH load-carrying efficiency raises with the rising of TBF reusing degree, if require PDCH load-carrying efficiency index at 5.02kbps/tsl, 3.72kbps/tsl with below 2.87kbps/tsl, corresponding TBF reusing degree index is less than respectively 4.04tbf/tsl, 2.46tbf/tsl and 1.56tbf/tsl.
Finally, by the above correlation analysis to PDCH load-carrying efficiency, average every user rate and these three indexs of TBF reusing degree, can draw to draw a conclusion: be not less than 80kbps if meet average every user rate, TBF reusing degree will must be lower than 5.02kbps/ time slot lower than 4.04, PDCH load-carrying efficiency so; Be not less than 100kbps if meet average every user rate, TBF reusing degree will must be lower than 3.72kbps/ time slot lower than 2.46, PDCH load-carrying efficiency so; Be not less than 120kbps if meet average every user rate, TBF reusing degree will must be lower than 2.87kbps/ time slot lower than 1.56, PDCH load-carrying efficiency so.
As shown in table 1.
| Average every user rate | PDCH load-carrying efficiency | TBF reusing degree |
| ＞80kbps | ＜5.02kbps/tsl | ＜4.04tbf/tsl |
| ＞100kbps | ＜3.72kbps/tsl | ＜2.46tbf/tsl |
| ＞120kbps | ＜2.87kbps/tsl | ＜1.56tbf/tsl |
Table 1
At present, the method for the measurement wireless data service busy that producer provides is mainly with reference to indexs such as TBF reusing degree, congestion ratios, determines a thresholding according to empirical value, then judges whether community exceedes thresholding and optimize and revise accordingly.There is larger disadvantage in the balancing method of producer, is difficult to weigh user's use perception according to indexs such as TBF reusing degree, congestion ratios, optimizes and revises rear very difficult assessment effect of optimization.
Mentioned above that PDCH load-carrying efficiency, average every user rate, three indexs of TBF reusing degree are associated to the appraisal procedure that the method for assessment wireless data service load-carrying efficiency provides than producer is more reasonable, and still, this appraisal procedure still exists following defect:
1, the method can only obtain the mean value of the whole network community statistical indicator, and this value cannot instruct actual network optimization analysis and regulation;
2, the thresholding being marked by statistical indicator mean value, the community that exceedes PDCH load-carrying efficiency=5.02kbps/ time slot is a lot, in the actual network optimization is adjusted, cannot adjust to filtering out qualified each community;
There is very large difference in the actual use of the average every user rate 3, drawing according to statistics and user perception, if TBF reusing degree is lower than 4.04, PDCH load-carrying efficiency must be lower than 5.02kbps/ time slot, can meet Mean Speed and be not less than 80kbps, but in actual use, user uses the instant message class business such as QQ, its bandwidth demand to data volume is very little, do not need 80kbps, but actual use procedure but presents the very slow situation of speed;
4, current wireless data service load-carrying efficiency appraisal procedure, only be confined to the statistics of wireless network side, core-network side, intercarrier interface load, Website server are not considered, thus, be difficult to analog subscriber and use the actual impression in business procedure, if data service is because Website server hangs over other operators slowly, each service request all must be through the port between operator, due to network element link is many or operator between the port high reason of loading must increase the time delay of data service; If Website server load is too high, must cause websites response time delay to increase, also can increase the time delay of usage data business.
Traditional means filters out data service reusing degree Gao community from wireless network side statistics, sign wireless data service is busy, but reusing degree can not accurately reflect user's true use perception, wireless data service load-carrying efficiency that can not accurate evaluation community, therefore, foundation is provided can not to actual optimizing and revising.
Summary of the invention
In view of this, main purpose of the present invention is to provide a kind of method and apparatus of assessing wireless data service load-carrying efficiency, can the actual use of accurate evaluation user perception, realize the assessment of the wireless data service load-carrying efficiency of Zhong Ge community, Dui Feixian community.
For achieving the above object, technical scheme of the present invention is achieved in that
A kind of method of assessing wireless data service load-carrying efficiency provided by the invention, the method comprises:
Gather the user's initial data on core network element interface;
From wireless network statistics, filter out data service reusing degree lower than the community of the first data service reusing degree thresholding as data service Xian community;
Resolve the user's initial data gathering, determine the content delivery average delay of Zhong Ge community, not busy community; According to the content delivery average delay of Zhong Ge community, not busy community, determine the data service load-carrying efficiency of Zhong Ge community, Fei Xian community.
In such scheme, described core network element interface is gn interface.
In such scheme, described user's initial data comprises: the record of the website log failure of the beginning and ending time of each data service, the source IP address of each data service, the object IP address of each data service, the type of service of each data service, the Serving cell of each data service, each data service, the websites response time delay of each data service exceed the record of threshold value and the propagation delay time of each data service.
In such scheme, the method also comprises: the second data service reusing degree thresholding N2 and the 3rd data service reusing degree thresholding N3 are set, from wireless network statistics, filter out and meet data service reusing degree and be greater than N1 and be less than N2 community, as data service Fei Mang community; From wireless network statistics, filter out and meet data service reusing degree and be greater than N2 and be less than N3 community, as data service Mang community.
In such scheme, user's initial data that described parsing gathers, determines the content delivery average delay of Zhong Ge community, not busy community, for:
Parse the record that the record of website log failure of the Serving cell of each data service in user's initial data of collection, the propagation delay time of each data service, each data service and the websites response time delay of each data service exceed threshold value, determine that Serving cell belongs to the data service of not busy community, reject and in not busy community, there is the data service that the record of website log failure and websites response time delay exceed the record of threshold value, add up the propagation delay time of data service remaining in not busy community, obtain the content delivery average delay of Zhong Ge community, not busy community.
In such scheme, determine that Serving cell belongs to the data service of Fei Mang community, reject and there is the data service that the record of website log failure and websites response time delay exceed the record of threshold value in Fei Mang community, according to the transmission delay of remaining data service after rejecting, count the content delivery time delay of Zhong Ge community, Fei Mang community; And/or
Determine that Serving cell belongs to the data service of busy community, reject and in busy community, there is the data service that the record of website log failure and websites response time delay exceed the record of threshold value, according to the transmission delay of remaining data service after rejecting, count the content delivery time delay of Zhong Ge community, busy community.
In such scheme, the method also comprises: parse after the record of the website log failure of each data service in user's initial data of collection, according to described error on the face of the record code, filter out the record that causes website log failure due to content server reason, to content server ownership, producer submits optimization request to.
In such scheme, the method also comprises: parse after the record of the website log failure of each data service in user's initial data of collection, according to described error on the face of the record code, filter out the record that causes website log failure due to terminal and content server negotiation problem, to content server ownership, producer submits optimization request to.
In such scheme, the method also comprises: the websites response time delay that parses each data service in user's initial data of collection exceedes the record of threshold value, according to the websites response time delay in described record, filter out the longest website of websites response time delay, detect the longest reason of described websites response time delay, process according to described reason.
In such scheme, described according to the content delivery average delay of Zhong Ge community, not busy community, determine the data service load-carrying efficiency of Zhong Ge community, Fei Xian community, for: first content propagation delay time thresholding M1 is set, the content delivery average delay of Zhong Ge community, Yi Xian community is radix, when the content delivery average delay that the content delivery time delay of Zhong community, Huo Feimang community, Dang Mang community exceedes Zhong Ge community, not busy community reaches M1, during the data service load-carrying efficiency of determining Zhong community, Huo Feimang community, described busy community is; In the time not reaching M1, determine that the data service load-carrying efficiency of Zhong community, Huo Feimang community, described busy community is low.
In such scheme, the method also comprises: second content propagation delay time thresholding M2 is set, when the content delivery average delay that the content delivery time delay of Zhong community, Huo Feimang community, Dang Mang community exceedes Zhong Ge community, not busy community reaches M2, determine that the data service load-carrying efficiency of Zhong community, Huo Feimang community, described busy community is for high.
A kind of device of assessing wireless data service load-carrying efficiency provided by the invention, this device comprises: data acquisition module, cell classification module, parsing module, data service load-carrying efficiency determination module; Wherein,
Data acquisition module, for gathering the user's initial data on core network element interface, notice parsing module;
Cell classification module, for filter out from wireless network statistics data service reusing degree lower than the community of the first data service reusing degree thresholding as data service Xian community;
Parsing module, for resolving user's initial data of collection, determines the content delivery average delay of Zhong Ge community, not busy community;
Data service load-carrying efficiency determination module, for according to the content delivery average delay of Zhong Ge community, not busy community, determines the data service load-carrying efficiency of Zhong Ge community, Fei Xian community.
In such scheme, described cell classification module specifically for the first data service reusing degree thresholding N1 is set, filters out and meets data service reusing degree and be greater than zero and be less than N1 community, as data service Xian community from wireless network statistics.
In such scheme, described cell classification module, also for the second data service reusing degree thresholding N2 and the 3rd data service reusing degree thresholding N3 are set, from wireless network statistics, filter out and meet data service reusing degree and be greater than N1 and be less than N2 community, as data service Fei Mang community; From wireless network statistics, filter out and meet data service reusing degree and be greater than N2 and be less than N3 community, as data service Mang community.
In such scheme, described parsing module, specifically for parsing the Serving cell of each data service in user's initial data of collection, the propagation delay time of each data service, the record of the website log failure of each data service, exceed the record of threshold value with the websites response time delay of each data service, determine that Serving cell belongs to the data service of not busy community, reject and in not busy community, there is the data service that the record of website log failure and websites response time delay exceed the record of threshold value, add up the propagation delay time of data service remaining in not busy community, obtain the content delivery average delay of Zhong Ge community, not busy community.
In such scheme, described parsing module, also for determining that Serving cell belongs to the data service of Fei Mang community, reject and there is the data service that the record of website log failure and websites response time delay exceed the record of threshold value in Fei Mang community, according to the transmission delay of remaining data service after rejecting, count the content delivery time delay of Zhong Ge community, Fei Mang community; And/or
Described parsing module, also for determining that Serving cell belongs to the data service of busy community, reject and in busy community, there is the data service that the record of website log failure and websites response time delay exceed the record of threshold value, according to the transmission delay of remaining data service after rejecting, count the content delivery time delay of Zhong Ge community, busy community.
In such scheme, described parsing module, also for parsing after the record of website log failure of the each data service of user's initial data of collection, according to described error on the face of the record code, filter out the record that causes website log failure due to content server reason, to content server ownership, producer submits optimization request to.
In such scheme, described parsing module, also for parsing after the record of website log failure of the each data service of user's initial data of collection, according to described error on the face of the record code, filter out the record that causes website log failure due to terminal and content server negotiation problem, to content server ownership, producer submits optimization request to.
In such scheme, described parsing module, also exceed the record of threshold value for parsing the websites response time delay of the each data service of user's initial data of collection, according to the websites response time delay in described record, filter out the longest website of websites response time delay, detect the longest reason of described websites response time delay, process according to described reason.
In such scheme, described data service load-carrying efficiency determination module, specifically for first content propagation delay time thresholding M1 is set, the content delivery average delay of Zhong Ge community, Yi Xian community is radix, when the content delivery average delay that the content delivery time delay of Zhong community, Huo Feimang community, Dang Mang community exceedes Zhong Ge community, not busy community reaches M1, during the data service load-carrying efficiency of determining Zhong community, Huo Feimang community, described busy community is; In the time not reaching M1, determine that the data service load-carrying efficiency of Zhong community, Huo Feimang community, described busy community is low.
In such scheme, described data service load-carrying efficiency determination module, also for second content propagation delay time thresholding M2 is set, when the content delivery average delay that the content delivery time delay of Zhong community, Huo Feimang community, Dang Mang community exceedes Zhong Ge community, not busy community reaches M2, determine that the data service load-carrying efficiency of Zhong community, Huo Feimang community, described busy community is for high.
The invention provides a kind of method and apparatus of assessing wireless data service load-carrying efficiency, gather the user's initial data on core network element interface; From wireless network statistics, filter out data service reusing degree lower than the community of the first data service reusing degree thresholding as data service Xian community; Resolve the user's initial data gathering, determine the content delivery average delay of Zhong Ge community, not busy community; According to the content delivery average delay of Zhong Ge community, not busy community, determine the data service load-carrying efficiency of Zhong Ge community, Fei Xian community; So, can the actual use of accurate evaluation user perception, realize the assessment of the wireless data service load-carrying efficiency of Zhong Ge community, Dui Feixian community, taken into full account core-network side, intercarrier interface load, the impact of Website server on wireless data service load-carrying efficiency.
Accompanying drawing explanation
Fig. 1 be in prior art PDCH load-carrying efficiency and average every user rate be related to schematic diagram;
Fig. 2 be in prior art PDCH load-carrying efficiency and TBF reusing degree be related to schematic diagram;
Fig. 3 is the method flow schematic diagram of assessment wireless data service load-carrying efficiency provided by the invention;
Fig. 4 is the block diagram of each websites response time delay in embodiment of the present invention Zhong Xian community, Fei Mang community, busy community;
Fig. 5 is the response delay of each data service and the block diagram of propagation delay time in embodiment of the present invention Zhong Xian community, Fei Mang community, busy community;
Fig. 6 is the apparatus structure schematic diagram of assessment wireless data service load-carrying efficiency provided by the invention.
Embodiment
Basic thought of the present invention is: gather the user's initial data on core network element interface; From wireless network statistics, filter out data service reusing degree lower than the community of the first data service reusing degree thresholding as data service Xian community; Resolve the user's initial data gathering, determine the content delivery average delay of Zhong Ge community, not busy community; According to the content delivery average delay of Zhong Ge community, not busy community, determine the data service load-carrying efficiency of Zhong Ge community, Fei Xian community.
Below by drawings and the specific embodiments, the present invention is described in further detail.
The present invention realizes a kind of method of assessing wireless data service load-carrying efficiency, and as shown in Figure 3, the method comprises following step:
Step 101, gathers the user's initial data on core network element interface;
Described core network element interface is generally gn interface, described gn interface is Serving GPRS Support Node (SGSN, Service GPRS Supporting Node) with data service core net webmaster (GGSN, Gateway GPRS Supporting Node) network element between interface;
Described user's initial data comprises: the record of the website log failure of the beginning and ending time of each data service, the source IP address of each data service, the object IP address of each data service, the type of service of each data service, the Serving cell of each data service, each data service, the websites response time delay of each data service exceed the record of threshold value and the propagation delay time of each data service etc.
Step 102, from wireless network statistics, filter out data service reusing degree lower than the community of the first data service reusing degree thresholding as data service Xian community;
Concrete, the first data service reusing degree thresholding N1 is set, from wireless network statistics, filter out and meet data service reusing degree and be greater than zero and be less than N1 community, as data service Xian community; Like this, data service reusing degree is greater than N1 community, is data service Fei Xian community;
This step also comprises: the second data service reusing degree thresholding N2 and the 3rd data service reusing degree thresholding N3 are set, filter out and meet data service reusing degree and be greater than N1 and be less than N2 community, as data service Fei Mang community from wireless network statistics; From wireless network statistics, filter out and meet data service reusing degree and be greater than N2 and be less than N3 community, as data service Mang community;
Described N1, N2, N3 value can be set according to network actual conditions, as: in the western GSM equipment of promise, the descending reusing degree limiting value of wireless data service is 9, and wireless channel at most can multiplexing 9 Temporary Block Flow TBF, in the western GSM equipment of promise, N1=2, N2=7, N3=9 can be set;
This step also comprises: add up the indexs such as not busy community, Fei Mang community, the average T BF reusing degree of Zhong Ge community, busy community, the equivalent telephone traffic of data, GPRS flow, EGPRS flow, high coding ratio; Table 2 has provided that a kind of wireless data service reusing degree is high, the statistics list of Ji Mang community; Table 3 has provided in a kind of wireless data service reusing degree, the statistics list of Ji Feimang community.
Table 2
Table 3
Wireless data service reusing degree is low, data service Fei Mang community is similar to the above, repeats no more.
Step 103, resolves the user's initial data gathering, and determines the content delivery average delay of Zhong Ge community, not busy community;
Concrete, parse the record that the record of website log failure of the Serving cell of each data service in user's initial data of collection, the propagation delay time of each data service, each data service and the websites response time delay of each data service exceed threshold value, determine that Serving cell belongs to the data service of not busy community, reject and in not busy community, there is the data service that the record of website log failure and websites response time delay exceed the record of threshold value, add up the propagation delay time of data service remaining in not busy community, obtain the content delivery average delay of Zhong Ge community, not busy community;
This step also comprises: determine that Serving cell belongs to the data service of Fei Mang community, reject and there is the data service that the record of website log failure and websites response time delay exceed the record of threshold value in Fei Mang community, according to the transmission delay of remaining data service after rejecting, count the content delivery time delay of Zhong Ge community, Fei Mang community;
This step also comprises: determine that Serving cell belongs to the data service of busy community, reject and in busy community, there is the data service that the record of website log failure and websites response time delay exceed the record of threshold value, according to the transmission delay of remaining data service after rejecting, count the content delivery time delay of Zhong Ge community, busy community;
This step also comprises: parse after the record of the website log failure of each data service in user's initial data of collection, according to described error on the face of the record code, filter out the record that causes website log failure due to content server reason, to content server ownership, producer submits optimization request to, and table 4 has provided the record that causes website log failure due to content server reason.
| Error code | The frequency | Account for wrong ratio | Reason |
| 502 | 721063 | 46％ | Server error response |
| 500 | 425591 | 27％ | Server internal cause mistake |
| 503 | 278435 | 18％ | Server is unreachable, may safeguard or fault |
| 408 | 13582 | 1％ | Server acknowledge is overtime |
Table 4
This step also comprises: parse after the record of the website log failure of each data service in user's initial data of collection, according to described error on the face of the record code, filter out the record that causes website log failure due to terminal and content server negotiation problem, submit optimization request to content server ownership producer, table 5 has provided the record that causes website log failure due to terminal and content server negotiation problem.
| Error code | The frequency | Account for wrong ratio | Reason |
| 404 | 1472094 | 78％ | Can not find server |
| 403 | 211540 | 11％ | Without authorizing denied access |
| 400 | 168036 | 9％ | In request, there is the syntax error that does not meet http protocol |
| 416 | 18110 | 1％ | Terminal request is limited |
| 422 | 12597 | 1％ | Need again verify |
Table 5
This step also comprises: the websites response time delay that parses each data service in user's initial data of collection exceedes the record of threshold value, according to the websites response time delay in described record, filter out the longest website of websites response time delay, detect the longest reason of described websites response time delay, process according to described reason, that is: detect described website and whether be not yet incorporated into Internet data center of operator (IDC), in the time being not yet incorporated into IDC, carry out the introducing of IDC content; In the time introducing IDC, check server load, performance, interface bandwidth of described website etc.; Fig. 4 provides the block diagram of each websites response time delay in Liao Xian community, Fei Mang community, busy community, and wherein, the not busy community of expression that the busy community of expression that oblique line is filled, the expression Fei Mang community of putting filling, vertical line are filled, can find out, everybody response delay is the longest.
Service class classification according to 3GPP to data service, is divided into: background classes, interactive class, Streaming Media, real-time conversational class, and in this step, in actual use procedure, user rejects the propagation delay time record of the lower background classes data service of delay requirement; Because the data volume of instant message class demand is very little, propagation delay time is generally shorter, and this step is rejected the propagation delay time record of instant message class data service; Due to Streaming Media, in real time conversational class business is little, this step is not considered; Like this, the propagation delay time of a data service propagation delay time for interactive class data service described in this step.
Step 104: according to the content delivery average delay of Zhong Ge community, not busy community, determine the data service load-carrying efficiency of Zhong Ge community, Fei Xian community;
Concrete, first content propagation delay time thresholding M1 is set, the content delivery average delay of Zhong Ge community, Yi Xian community is radix, when the content delivery average delay that the content delivery time delay of Zhong community, Huo Feimang community, Dang Mang community exceedes Zhong Ge community, not busy community reaches M1, the data service load-carrying efficiency of determining Zhong community, Huo Feimang community, described busy community can guarantee user's use perception in being substantially; In the time not reaching M1, determine that the data service load-carrying efficiency of Zhong community, Huo Feimang community, described busy community is low;
This step also comprises: second content propagation delay time thresholding M2 is set, when the content delivery average delay that the content delivery time delay of Zhong community, Huo Feimang community, Dang Mang community exceedes Zhong Ge community, not busy community reaches M2, determine that the data service load-carrying efficiency of Zhong community, Huo Feimang community, described busy community, for high, can not guarantee user's use perception.
Described M1 is less than M2.
Fig. 5 provides the response delay of each data service and the block diagram of propagation delay time in Liao Xian community, Fei Mang community, busy community, wherein, the not busy community of expression of the busy community of expression that oblique line is filled, the expression Fei Mang community that point is filled, vertical line filling, take UC propagation delay time as example, M1=50% can be set, M2=100%, that is:
If the content delivery time delay of Zhong community, Huo Feimang community, busy community exceedes the content delivery average delay less than 50% of Zhong Ge community, not busy community, think and can guarantee that user uses perception, the wireless data service load-carrying efficiency of Zhong community, Huo Feimang community, described busy community is low;
If exceeding the content delivery average delay of Zhong Ge community, not busy community, the content delivery time delay of Zhong community, Huo Feimang community, busy community reaches 50%, but do not exceed 100%, in thinking that the wireless data service load-carrying efficiency of Zhong community, Huo Feimang community, described busy community is, substantially can guarantee that user uses perception, need to pay close attention to;
If exceeding the content delivery average delay of Zhong Ge community, not busy community, the content delivery time delay of Zhong community, Huo Feimang community, busy community reaches 100%, think that the wireless data service load-carrying efficiency of Zhong community, Huo Feimang community, described busy community is height, affect user and used perception, needed to optimize the radio channel resource that increases community.
In order to realize said method, the present invention also provides a kind of device of assessing wireless data service load-carrying efficiency, and as shown in Figure 6, this device comprises: data acquisition module 61, cell classification module 62, parsing module 63, data service load-carrying efficiency determination module 64; Wherein,
Parsing module 63, for resolving user's initial data of collection, determines the content delivery average delay of Zhong Ge community, not busy community;
Data service load-carrying efficiency determination module 64, for according to the content delivery average delay of Zhong Ge community, not busy community, determines the data service load-carrying efficiency of Zhong Ge community, Fei Xian community.
Described cell classification module 62 specifically for the first data service reusing degree thresholding N1 is set, filters out and meets data service reusing degree and be greater than zero and be less than N1 community, as data service Xian community from wireless network statistics;
Described cell classification module 62, also for the second data service reusing degree thresholding N2 and the 3rd data service reusing degree thresholding N3 are set, from wireless network statistics, filter out and meet data service reusing degree and be greater than N1 and be less than N2 community, as data service Fei Mang community; From wireless network statistics, filter out and meet data service reusing degree and be greater than N2 and be less than N3 community, as data service Mang community;
Described parsing module 63, specifically for parsing the Serving cell of each data service in user's initial data of collection, the propagation delay time of each data service, the record of the website log failure of each data service, exceed the record of threshold value with the websites response time delay of each data service, determine that Serving cell belongs to the data service of not busy community, reject and in not busy community, there is the data service that the record of website log failure and websites response time delay exceed the record of threshold value, add up the propagation delay time of data service remaining in not busy community, obtain the content delivery average delay of Zhong Ge community, not busy community,
Described parsing module 63, also for determining that Serving cell belongs to the data service of Fei Mang community, reject and there is the data service that the record of website log failure and websites response time delay exceed the record of threshold value in Fei Mang community, according to the transmission delay of remaining data service after rejecting, count the content delivery time delay of Zhong Ge community, Fei Mang community; And/or
Described parsing module 63, also for determining that Serving cell belongs to the data service of busy community, reject and in busy community, there is the data service that the record of website log failure and websites response time delay exceed the record of threshold value, according to the transmission delay of remaining data service after rejecting, count the content delivery time delay of Zhong Ge community, busy community;
Described parsing module 63, also for parsing after the record of website log failure of the each data service of user's initial data of collection, according to described error on the face of the record code, filter out the record that causes website log failure due to content server reason, to content server ownership, producer submits optimization request to;
Described parsing module 63, also for parsing after the record of website log failure of the each data service of user's initial data of collection, according to described error on the face of the record code, filter out the record that causes website log failure due to terminal and content server negotiation problem, to content server ownership, producer submits optimization request to;
Described parsing module 63, also exceed the record of threshold value for parsing the websites response time delay of the each data service of user's initial data of collection, according to the websites response time delay in described record, filter out the longest website of websites response time delay, detect the longest reason of described websites response time delay, process according to described reason;
Described data service load-carrying efficiency determination module 64, specifically for first content propagation delay time thresholding M1 is set, the content delivery average delay of Zhong Ge community, Yi Xian community is radix, when the content delivery average delay that the content delivery time delay of Zhong community, Huo Feimang community, Dang Mang community exceedes Zhong Ge community, not busy community reaches M1, the data service load-carrying efficiency of determining Zhong community, Huo Feimang community, described busy community can guarantee user's use perception in being substantially; In the time not reaching M1, determine that the data service load-carrying efficiency of Zhong community, Huo Feimang community, described busy community is low;
Described data service load-carrying efficiency determination module 64, also for second content propagation delay time thresholding M2 is set, when the content delivery average delay that the content delivery time delay of Zhong community, Huo Feimang community, Dang Mang community exceedes Zhong Ge community, not busy community reaches M2, determine that the data service load-carrying efficiency of Zhong community, Huo Feimang community, described busy community is for high, can not guarantee user's use perception, described M1 is less than M2.
The present invention uses the end-to-end whole process of carrying out of wireless data service to consider from user, analyze each link that may affect wireless data service use perception, a kind of method of assessing wireless data service load-carrying efficiency proposing from the angle of the actual use of analog subscriber perception.The method is by the performance of the analyzing total knot network index to time delay, thereby build user and use the associated of perception and network index, distinguish division to affecting the situation that time delay that user's usage data business shows grows, grade as unsuccessful in website log is to show that invalid link or webpage do not exist after very long wait to user; It is long that the Website server of not introducing the IDC of China Mobile can show websites response time delay; Website server load is too high or core net load is too high or wireless side community wireless data service load-carrying efficiency is too high all can cause user to use in business procedure, presenting longer time delay.The reason that causes user's usage data service delay to increase is classified, and IDC does not introduce website submit applications and introduces; The proposition dilatation suggestion that Website server is loaded too high; Optimize and revise suggestion by the higher also proposition of the core network element such as SGSN, GGSN, fire compartment wall load, last, can filter out by the too high wireless area that uses time delay to grow of causing of wireless side community wireless data service supporting effect.Finally reach the accurate whether reasonably object of cell-level wireless data service load-carrying efficiency that judges, can be used as the accurate foundation that the network optimization is adjusted.At present, because the data volume of Gn mouth image data is excessive, cause this assessment to be difficult for carrying out, in view of the built vertical data business signaling monitoring system of current China Mobile, can regularly gather Gn mouth data, first after image data, IDC does not introduce, the high problems such as height of loading with core-network side network element of Website server load can be located substantially, afterwards, regularly image data, reject above reason, the problem that selective analysis is increased by the too high time delay causing of wireless side wireless data service load-carrying efficiency, all can accurate evaluation wireless side community wireless data service load-carrying efficiency after each collection, actual network optimization is instructed.The method proves after pilot is implemented, and assesses accuracy and can reach more than 90%.
The above, be only preferred embodiment of the present invention, is not intended to limit protection scope of the present invention.
Claims (21)
1. a method of assessing wireless data service load-carrying efficiency, is characterized in that, the method comprises:
Gather the user's initial data on core network element interface;
From wireless network statistics, filter out data service reusing degree lower than the first data service reusing degree thresholding N1 community as data service Xian community;
Resolve the user's initial data gathering, determine the content delivery average delay of Zhong Ge community, not busy community; According to the content delivery average delay of Zhong Ge community, not busy community, determine the data service load-carrying efficiency of Zhong Ge community, Fei Xian community.
2. method according to claim 1, is characterized in that, described core network element interface is gn interface.
3. method according to claim 2, it is characterized in that, described user's initial data comprises: the record of the website log failure of the beginning and ending time of each data service, the source IP address of each data service, the object IP address of each data service, the type of service of each data service, the Serving cell of each data service, each data service, the websites response time delay of each data service exceed the record of threshold value and the propagation delay time of each data service.
4. method according to claim 3, it is characterized in that, the method also comprises: the second data service reusing degree thresholding N2 and the 3rd data service reusing degree thresholding N3 are set, from wireless network statistics, filter out and meet data service reusing degree and be greater than N1 and be less than N2 community, as data service Fei Mang community; From wireless network statistics, filter out and meet data service reusing degree and be greater than N2 and be less than N3 community, as data service Mang community.
5. method according to claim 4, is characterized in that, user's initial data that described parsing gathers is determined the content delivery average delay of Zhong Ge community, not busy community, for:
Parse the record that the record of website log failure of the Serving cell of each data service in user's initial data of collection, the propagation delay time of each data service, each data service and the websites response time delay of each data service exceed threshold value, determine that Serving cell belongs to the data service of not busy community, reject and in not busy community, there is the data service that the record of website log failure and websites response time delay exceed the record of threshold value, add up the propagation delay time of data service remaining in not busy community, obtain the content delivery average delay of Zhong Ge community, not busy community.
6. method according to claim 5, it is characterized in that, determine that Serving cell belongs to the data service of Fei Mang community, reject and there is the data service that the record of website log failure and websites response time delay exceed the record of threshold value in Fei Mang community, according to the transmission delay of remaining data service after rejecting, count the content delivery time delay of Zhong Ge community, Fei Mang community; And/or
Determine that Serving cell belongs to the data service of busy community, reject and in busy community, there is the data service that the record of website log failure and websites response time delay exceed the record of threshold value, according to the transmission delay of remaining data service after rejecting, count the content delivery time delay of Zhong Ge community, busy community.
7. according to the method described in claim 5 or 6, it is characterized in that, the method also comprises: parse after the record of the website log failure of each data service in user's initial data of collection, according to described error on the face of the record code, filter out the record that causes website log failure due to content server reason, to content server ownership, producer submits optimization request to.
8. according to the method described in claim 5 or 6, it is characterized in that, the method also comprises: parse after the record of the website log failure of each data service in user's initial data of collection, according to described error on the face of the record code, filter out the record that causes website log failure due to terminal and content server negotiation problem, to content server ownership, producer submits optimization request to.
9. according to the method described in claim 5 or 6, it is characterized in that, the method also comprises: the websites response time delay that parses each data service in user's initial data of collection exceedes the record of threshold value, according to the websites response time delay in described record, filter out the longest website of websites response time delay, detect the longest reason of described websites response time delay, process according to described reason.
10. according to the method described in claim 5 or 6, it is characterized in that, described according to the content delivery average delay of Zhong Ge community, not busy community, determine the data service load-carrying efficiency of Zhong Ge community, Fei Xian community, for: first content propagation delay time thresholding M1 is set, the content delivery average delay of Zhong Ge community, Yi Xian community is radix, when the content delivery average delay that the content delivery time delay of Zhong community, Huo Feimang community, Dang Mang community exceedes Zhong Ge community, not busy community reaches M1, during the data service load-carrying efficiency of determining Zhong community, Huo Feimang community, described busy community is; In the time not reaching M1, determine that the data service load-carrying efficiency of Zhong community, Huo Feimang community, described busy community is low.
11. methods according to claim 10, it is characterized in that, the method also comprises: second content propagation delay time thresholding M2 is set, when the content delivery average delay that the content delivery time delay of Zhong community, Huo Feimang community, Dang Mang community exceedes Zhong Ge community, not busy community reaches M2, determine that the data service load-carrying efficiency of Zhong community, Huo Feimang community, described busy community is for high, described M1 is less than M2.
Assess the device of wireless data service load-carrying efficiency for 12. 1 kinds, it is characterized in that, this device comprises: data acquisition module, cell classification module, parsing module, data service load-carrying efficiency determination module; Wherein,
Data acquisition module, for gathering the user's initial data on core network element interface, notice parsing module;
Cell classification module, for filter out from wireless network statistics data service reusing degree lower than the community of the first data service reusing degree thresholding as data service Xian community;
Parsing module, for resolving user's initial data of collection, determines the content delivery average delay of Zhong Ge community, not busy community;
Data service load-carrying efficiency determination module, for according to the content delivery average delay of Zhong Ge community, not busy community, determines the data service load-carrying efficiency of Zhong Ge community, Fei Xian community.
13. devices according to claim 12, it is characterized in that, described cell classification module, specifically for arranging the first data service reusing degree thresholding N1, from wireless network statistics, filter out and meet data service reusing degree and be greater than zero and be less than N1 community, as data service Xian community.
14. devices according to claim 13, it is characterized in that, described cell classification module, also for the second data service reusing degree thresholding N2 and the 3rd data service reusing degree thresholding N3 are set, from wireless network statistics, filter out and meet data service reusing degree and be greater than N1 and be less than N2 community, as data service Fei Mang community; From wireless network statistics, filter out and meet data service reusing degree and be greater than N2 and be less than N3 community, as data service Mang community.
15. devices according to claim 12, it is characterized in that, described parsing module, specifically for parsing the Serving cell of each data service in user's initial data of collection, the propagation delay time of each data service, the record of the website log failure of each data service, exceed the record of threshold value with the websites response time delay of each data service, determine that Serving cell belongs to the data service of not busy community, reject and in not busy community, there is the data service that the record of website log failure and websites response time delay exceed the record of threshold value, add up the propagation delay time of data service remaining in not busy community, obtain the content delivery average delay of Zhong Ge community, not busy community.
16. devices according to claim 14, it is characterized in that, described parsing module, also for determining that Serving cell belongs to the data service of Fei Mang community, reject and there is the data service that the record of website log failure and websites response time delay exceed the record of threshold value in Fei Mang community, according to the transmission delay of remaining data service after rejecting, count the content delivery time delay of Zhong Ge community, Fei Mang community; And/or
Described parsing module, also for determining that Serving cell belongs to the data service of busy community, reject and in busy community, there is the data service that the record of website log failure and websites response time delay exceed the record of threshold value, according to the transmission delay of remaining data service after rejecting, count the content delivery time delay of Zhong Ge community, busy community.
17. according to the device described in claim 15 or 16, it is characterized in that, described parsing module, also for parsing after the record of website log failure of the each data service of user's initial data of collection, according to described error on the face of the record code, filter out the record that causes website log failure due to content server reason, to content server ownership, producer submits optimization request to.
18. according to the device described in claim 15 or 16, it is characterized in that, described parsing module, also for parsing after the record of website log failure of the each data service of user's initial data of collection, according to described error on the face of the record code, filter out the record that causes website log failure due to terminal and content server negotiation problem, to content server ownership, producer submits optimization request to.
19. according to the device described in claim 15 or 16, it is characterized in that, described parsing module, also exceed the record of threshold value for parsing the websites response time delay of the each data service of user's initial data of collection, according to the websites response time delay in described record, filter out the longest website of websites response time delay, detect the longest reason of described websites response time delay, process according to described reason.
20. according to the device described in claim 15 or 16, it is characterized in that, described data service load-carrying efficiency determination module, specifically for first content propagation delay time thresholding M1 is set, the content delivery average delay of Zhong Ge community, Yi Xian community is radix, when the content delivery average delay that the content delivery time delay of Zhong community, Huo Feimang community, Dang Mang community exceedes Zhong Ge community, not busy community reaches M1, during the data service load-carrying efficiency of determining Zhong community, Huo Feimang community, described busy community is; In the time not reaching M1, determine that the data service load-carrying efficiency of Zhong community, Huo Feimang community, described busy community is low.
21. devices according to claim 20, it is characterized in that, described data service load-carrying efficiency determination module, also for second content propagation delay time thresholding M2 is set, when the content delivery average delay that the content delivery time delay of Zhong community, Huo Feimang community, Dang Mang community exceedes Zhong Ge community, not busy community reaches M2, determine that the data service load-carrying efficiency of Zhong community, Huo Feimang community, described busy community is for high, described M1 is less than M2.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210429883.9A CN103796220B (en) | 2012-11-01 | 2012-11-01 | A kind of method and apparatus for assessing wireless data service load-carrying efficiency |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210429883.9A CN103796220B (en) | 2012-11-01 | 2012-11-01 | A kind of method and apparatus for assessing wireless data service load-carrying efficiency |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103796220A true CN103796220A (en) | 2014-05-14 |
| CN103796220B CN103796220B (en) | 2018-03-23 |
Family
ID=50671402
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210429883.9A Active CN103796220B (en) | 2012-11-01 | 2012-11-01 | A kind of method and apparatus for assessing wireless data service load-carrying efficiency |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103796220B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104994540A (en) * | 2015-05-15 | 2015-10-21 | 北京联合大学 | Method for measuring the wireless carrying efficiency of packet data service |
| CN105828354A (en) * | 2015-01-05 | 2016-08-03 | 中国移动通信集团浙江有限公司 | LTE network service downlink rate estimation method and LTE network service downlink rate estimation device |
| CN107360180A (en) * | 2017-08-01 | 2017-11-17 | 上海斐讯数据通信技术有限公司 | A kind of portal authentication method and system based on radio reception device monitoring |
| CN108650038A (en) * | 2018-05-08 | 2018-10-12 | 商派软件有限公司 | The method and system of regional network quality is judged with the retransmission rate of data packet |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201163806Y (en) * | 2008-01-04 | 2008-12-10 | 福建先创电子有限公司 | Intelligent city wireless network resource sharing system |
| US20110170412A1 (en) * | 2010-01-11 | 2011-07-14 | Krishna Ramadas | Radio access network load and condition aware traffic shaping control |
| CN102186203A (en) * | 2011-04-02 | 2011-09-14 | 华为技术有限公司 | Method, device and system for determining data service channel number |
| CN102404753A (en) * | 2010-09-13 | 2012-04-04 | 中国移动通信集团河南有限公司 | Method and device for dilatation early alarming of wireless region |
-
2012
- 2012-11-01 CN CN201210429883.9A patent/CN103796220B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201163806Y (en) * | 2008-01-04 | 2008-12-10 | 福建先创电子有限公司 | Intelligent city wireless network resource sharing system |
| US20110170412A1 (en) * | 2010-01-11 | 2011-07-14 | Krishna Ramadas | Radio access network load and condition aware traffic shaping control |
| CN102404753A (en) * | 2010-09-13 | 2012-04-04 | 中国移动通信集团河南有限公司 | Method and device for dilatation early alarming of wireless region |
| CN102186203A (en) * | 2011-04-02 | 2011-09-14 | 华为技术有限公司 | Method, device and system for determining data service channel number |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105828354A (en) * | 2015-01-05 | 2016-08-03 | 中国移动通信集团浙江有限公司 | LTE network service downlink rate estimation method and LTE network service downlink rate estimation device |
| CN105828354B (en) * | 2015-01-05 | 2019-06-14 | 中国移动通信集团浙江有限公司 | A kind of appraisal procedure and device of LTE network business downstream rate |
| CN104994540A (en) * | 2015-05-15 | 2015-10-21 | 北京联合大学 | Method for measuring the wireless carrying efficiency of packet data service |
| CN104994540B (en) * | 2015-05-15 | 2018-04-24 | 北京联合大学 | The measuring method of Packet data service radio bearer efficiency |
| CN107360180A (en) * | 2017-08-01 | 2017-11-17 | 上海斐讯数据通信技术有限公司 | A kind of portal authentication method and system based on radio reception device monitoring |
| CN108650038A (en) * | 2018-05-08 | 2018-10-12 | 商派软件有限公司 | The method and system of regional network quality is judged with the retransmission rate of data packet |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103796220B (en) | 2018-03-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105992228B (en) | A kind of expansion method of wireless network, device and electronic equipment | |
| CN109996285B (en) | Network congestion control method, device, equipment and medium | |
| CN103298035B (en) | A kind of jamming control method and device | |
| CN106911517B (en) | Method and system for positioning end-to-end problem of mobile internet | |
| CN103796220A (en) | Method and device for assessing wireless data service carrying efficiency | |
| JP2009135916A (en) | Method and system for managing information | |
| CN108023836B (en) | Resource allocation method and access network equipment | |
| US11438462B2 (en) | Method and apparatus for information exchange in online charging | |
| CN104301161A (en) | Computing method, computing device and communication system for business quality index | |
| CN107943697A (en) | Problem distribution method, device, system, server and computer-readable storage medium | |
| CN106714223B (en) | Method and device for establishing base station energy consumption model | |
| CN102316483B (en) | A kind of EVDO system ensures the method and device of applied business QoS | |
| CN107371179A (en) | Measurement result report method, measurement result method of reseptance, relevant device and system | |
| CN103347270B (en) | Policy control method, equipment and system | |
| CN103096386B (en) | Data business flow control method based on signaling analyzing | |
| CN104468152A (en) | Network transmission method and device | |
| CN103222297A (en) | Data acquisition and processing application method, system and corresponding equipment thereof | |
| CN1860734A (en) | Method and apparatus for network throughput measurement | |
| CN104105206A (en) | TD-SCDMA network carrier wave adjusting method, device and system | |
| CN101212771A (en) | Load control method, device and system | |
| JP7213339B2 (en) | Data transmission method and device | |
| CN104581744A (en) | Method and device for achieving network planning | |
| CN107846702A (en) | Strengthen the resource allocation method of Physical Downlink Control Channel | |
| CN106793093A (en) | A kind of method for processing business and device | |
| CN113891336B (en) | Communication network frequency-reducing network-exiting method, device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |