FI128641B

FI128641B - Network test tool

Info

Publication number: FI128641B
Application number: FI20185888A
Authority: FI
Inventors: Henri Karikallio; Jussi Nieminen; Pekka Pussinen
Original assignee: Elisa Oyj
Priority date: 2018-10-23
Filing date: 2018-10-23
Publication date: 2020-09-30
Also published as: FI20185888A; FI20185888A1

Abstract

A network test tool for testing operation of cells of a communication network. The network test tool is a test application executable by a processor of a general purpose mobile communication device (102), the general purpose mobile communication device (102) being operable in cells of said communication network. The test application interacts with open interfaces of the general purpose mobile communication device (102) to identify that the general purpose mobile communication device (102) is connected to a target cell and to monitor Performance of the target cell, monitors geographic location of said general purpose mobile communication device (102), and monitors and records performance of the target cell when geographic location of said general purpose mobile communication device (102) is within a predefined test area.

Description

NETWORK TEST TOOL TECHNICAL FIELD

[0001] The present application generally relates to network test tools.

BACKGROUND

[0002] This section illustrates useful background information without admission of any technique described herein representative of the state of the art.

[0003] In general, a communication network is formed of a plurality of cells. The cells have a certain coverage area and a base station of a cell may serve users located in the coverage area of the cell. Communication network development is an ongoing process and new base stations and cells are continuously brought up and/or old base stations and cells may be repaired or replaced with new ones. Before taking a new or repaired base station or cell into use, there is a need to test operation of the base station or cell. Dedicated test devices are commonly used for this purpose.

[0004] Now a different approach has been taken into network testing.

SUMMARY

[0005] Various aspects of examples of the invention are set out in the claims.

[0006] According to a first example aspect of the present invention, there is provided a network test tool for testing operation of cells of a communication network. The network test tool is a test application executable by a processor of a general purpose mobile communication device, the general purpose mobile 00 communication device being operable in cells of said communication network. The N test application is configured to 2 interact with open interfaces of the general purpose mobile communication N device to identify that the general purpose mobile communication device is E connected to a target cell and to monitor performance of the target cell, < monitor geographic location of said general purpose mobile communication LO device, and to < monitor and record performance of the target cell when geographic location of said general purpose mobile communication device is within a predefined test area. 1

[0007] The test application may be a computer program product stored on a non-transitory memory medium.

[0008] In an embodiment, the test application is configured to prevent said recording of performance of the target cell when geographic location of said general purpose mobile communication device is outside the predefined test area.

[0009] In an embodiment, the test application is configured to provide real- time visualization of the geographical location of the general purpose mobile communication device and the predefined test area.

[0010] In an embodiment, the test application is configured to receive a test configuration, the test configuration comprising at least identification of the target cell and the predefined test area.

[0011] In an embodiment, the test configuration further comprises instructions relating to the monitoring and recording of performance of the target cell.

[0012] In an embodiment, the test application is configured to receive the test configuration embedded in a QR (quick response) code.

[0013] In an embodiment, the test application is configured to receive the test configuration embedded in an URL (uniform resource locator).

[0014] In an embodiment, the test configuration is compressed and/or encoded for delivery.

[0015] In an embodiment, the test application is configured to automatically report said recorded performance of the target cell.

[0016] In an embodiment, the test application is configured to periodically start and stop said recording of performance of the target cell.

[0017] In an embodiment, the test application is configured to continue said 00 recording of performance of the target cell until predefined criteria are fulfilled.

N [0018] In an embodiment, the predefined criteria comprises reaching of 50- 2 90% of maximum throughput of the cell.

Q [0019] In an embodiment, the predefined criteria comprises obtaining E recorded performance from a plurality of locations within the predefined test area.

< [0020] According to a second example aspect of the present invention, there LO is provided a method for testing operation of cells of a communication network, the < method comprising interacting with open interfaces of a general purpose mobile communication device operable in cells of said communication network to identify (404) that 2the general purpose mobile communication device is connected to a target cell and to monitor performance of the target cell, monitoring geographic location of said general purpose mobile communication device, and monitor and record performance of the target cell when geographic location of said general purpose mobile communication device is within a predefined test area.

[0021] Different non-binding example aspects and embodiments of the present invention have been illustrated in the foregoing. The embodiments in the foregoing are used merely to explain selected aspects or steps that may be utilized in implementations of the present invention. Some embodiments may be presented only with reference to certain example aspects of the invention. It should be appreciated that corresponding embodiments may apply to other example aspects as well.

BRIEF DESCRIPTION OF THE DRAWINGS

[0022] For a more complete understanding of example embodiments of the present invention, reference is now made to the following descriptions taken in connection with the accompanying drawings in which:

[0023] Fig. 1 shows an example network test arrangement according to an embodiment;

[0024] Fig. 2 shows an apparatus according to an embodiment;

[0025] Fig. 3 shows a map view according to an embodiment; and

[0026] Fig. 4 shows a flow diagram illustrating an example method according 00 to certain embodiment.

& 2 DETAILED DESCRIPTON OF THE DRAWINGS N [0027] Example embodiments of the present invention and its potential E advantages are understood by referring to Figs. 1 through 4 of the drawings. In this < document, like reference signs denote like parts or steps.

LO [0028] In an embodiment of the invention there is provided a network test < tool implemented as a test application executable by a processor of a general purpose mobile communication device. The general purpose mobile communication device needs to be operable in cells of the target communication network that is 3being tested, but dedicated test devices are not needed. The use of general purpose mobile communication devices provides an inexpensive and easily accessible test arrangement.

[0029] Fig. 1 shows an example network test arrangement according to an embodiment. The arrangement comprises a base station 103 that is being tested, a test person 101, a mobile device 102 of the test person, a network documentation system 104, a test server 105 and a reporting server 106. The base station 103 is part of a wireless network that may be for example one of a WLAN, GSM/GPRS, CDMA, WCDMA, LTE (Long Term Evolution), 4G, or 5G network. The mobile device 102 is operable to communicate through the base station 103 and other base stations of the network. The test server 105 and the reporting server 106 are connected to communication networks and may be reached through the base station

103. The network documentation system 104 may be connected to communication networks, too, but this is not mandatory for operation of the embodiments of the invention.

[0030] The mobile device 102 comprises a test tool application configured to employ open interfaces of the mobile device 102 to implement monitoring of performance of the base station 103 to perform testing of the base station 103.

[0031] The network testing in the arrangement of Fig. 1 operates as follows:

[0032] Phase 11: Test configuration is generated on the basis of base station configuration information stored in the network documentation system 104. The test configuration comprises at least information about target cells to be tested and geographical test area to be tested. The test area may depend on antenna directions and antenna height for example. Additionally the test configuration may 00 comprise information about the performance metrics that are to be monitored and N information about predefined criteria that needs to be fulfilled in the testing. The test 2 configuration may for example comprise instructions to monitor and record data N transmission speed and/or to log one or more of the following: model of the mobile E device, IMEI of the mobile device, serial number of the mobile device, location of the < mobile device, serving cell identifier, neighbour cell identifiers, changes in location LO and data transmission state. > [0033] The predefined criteria may comprise for example reaching of certain percentage of maximum throughput of a cell and/or obtaining performance metrics from a plurality of locations within the test area. The percentage may be for example 4

55%, 60%, 75%, 80% or some other value e.g. between 50-90%. The number of required locations where the performance metrics are obtained may be for example 5, 10 or 20. Still further the test configuration may define addresses of the test server 105 and the reporting server 106.

[0034] In an embodiment the test configuration is valid for a predefined period of time, for example 1-3 days or 1-2 weeks. Invalid test configuration does not work.

[0035] Phase 12: The test configuration is conveyed to the mobile device

102. The test configuration may be conveyed embedded in a QR code or some other two dimensional code (e.g. a barcode), that is read into the mobile device 102, or embedded in an URL accessed by the mobile device. The test configuration may be compressed and encoded for delivery.

[0036] Phase 13: The test tool application performs the tests according to the test configuration. The test tool is configured to monitor and record performance of the target cell of the base station 103 when geographic location of the mobile device 102 is within the test area defined in the test configuration. The test tool identifies that the mobile device 102 is connected to the target cell before recording the performance. The test tool may be configured to periodically start and stop said recording of the performance even within the test area, but this is not mandatory. In an embodiment the performance is monitored for 20, 25, 30, 60 or 120 seconds at a time before stopping the test for a while. The tests may comprise contacting a dedicated test server 105 and downloading data from the test server, phase 14. The communication between the mobile device 102 and the test server 105 goes through the target cell of the base station 103 and thereby tests throughput of the target cell.

00 The use of dedicated test server 105 provides that other users do not disturb and N possibly limit throughput of the data download.

2 [0037] The test tool may provide real-time visualization of the geographical N location of the mobile device and the test area to guide the test person 101 to a E desired location. In an embodiment, the testing phase continues until the predefined < criteria defined in the test configuration are fulfilled. When the criteria are fulfilled for LO one cell of the base station 103, the process may move to testing next cell.

< [0038] Phase 15: When the tests are complete for one or more cells (depending on the test configuration), the test results are sent to the reporting server 106 for further processing. The communication between the mobile device 102 andthe reporting server 105 may go through the target cell of the base station 103, but also some other connection may be used between the mobile device 102 and the reporting server 105. The reporting phase and the testing phase may be performed automatically without requiring human interaction. The only requirement for the test person 101 is to take the mobile device to desired location and to move within the test area. That is, the testing is made very simple for the test person.

[0039] It is to be noted that the arrangement shown in Fig. 1 is only one example implementation and that alternative implementations are possible, too. For example, the source of the test configuration may be some other system instead of the network documentation system 104. Likewise the test server 105 may not be needed in some types of tests and/or the tests may connect to some other server instead of a dedicated test server. Still further, the reporting server may not be mandatory in all implementations. For example, the test results may be stored in the mobile device 102 and the results may be collected from the mobile device 102 in a later stage.

[0040] Fig. 2 shows an apparatus 102 according to an embodiment. The apparatus 20 is for example a general purpose mobile communication device. The apparatus 20 can be used for implementing embodiments of the invention. That is, with suitable configuration the apparatus 20 is suited for operating for example as the mobile device 102 of Fig. 1.

[0041] The general structure of the apparatus 20 comprises a processor 21, and a memory 22 coupled to the processor 21. The apparatus 20 further comprises software 23 stored in the memory 22 and operable to be loaded into and executed in the processor 21. The software 23 may comprise one or more software modules and 00 can be in the form of a computer program product. Further there is a test tool N application 24 stored in the memory 22. The test tool 24 is operable to be loaded into 2 and executed in the processor 21. Further, the apparatus 20 comprises a N communication interface 25 coupled to the processor 21.

E [0042] The processor 21 may comprise, e.g., a central processing unit < (CPU), a microprocessor, a digital signal processor (DSP), a araphics processing LO unit, or the like. Fig. 2 shows one processor 21, but the apparatus 20 may comprise < a plurality of processors.

[0043] The memory 22 may be for example a non-volatile or a volatile memory, such as a read-only memory (ROM), a programmable read-only memory 6

(PROM), erasable programmable read-only memory (EPROM), a random-access memory (RAM), a flash memory, a data disk, an optical storage, a magnetic storage, a smart card, or the like. The apparatus 20 may comprise a plurality of memories. The memory 22 may be constructed as a part of the apparatus 20 or it may be inserted into a slot, port, or the like of the apparatus 20 by a user.

[0044] The communication interface 25 implements data transmission to and from the apparatus 20. The communication interface comprises a wireless interface such as a WLAN, GSM/GPRS, CDMA, WCDMA, LTE (Long Term Evolution), 4G, or 5G radio module. In an embodiment the communication interface 25 is compatible with the target network that is to be tested with the test tool 24 and the test tool 24 is configured to employ open interfaces of the communication interface 25 to implement testing of the network. Further the apparatus 20 comprises a user interface (not shown) for providing interaction with a user of the apparatus. The user interface may comprise a display and a keyboard or a touch display, for example.

[0045] A skilled person appreciates that in addition to the elements shown in Fig. 2, the apparatus 20 may comprise other elements, such as microphones, displays, as well as additional circuitry such as memory chips, application-specific integrated circuits (ASIC), other processing circuitry for specific purposes and the like.

[0046] Fig. 3 shows a map view 300 according to an embodiment. The shown map view is one example implementation of a real-time visualization of the geographical location of the mobile device and the test area. The map view 300 may guide the test person to desired location during the tests. The map view of Fig. 3 shows a base station 103 and three cells 31, 32, and 33. In the shown example, the 00 cell 32 is the target cell to be tested. It is to be noted that also other cells 31 and 33 N may be tested in a later phase. The map view shows three different locations 35, 36 2 and 37 of a test tool (i.e. a mobile device running the test tool application) in vicinity N of the base station 103. Locations 35 and 36 are outside the target test area and E therefore performance is not recorded. Location 37 is within the test area and there < the performance is monitored and recorded provided that it is identified that the LO mobile device is connected to the target cell 32. < [0047] Fig. 4 shows a flow diagram illustrating an example method according to certain embodiment. The method may be implemented in a general purpose mobile communication device. In an example embodiment, the method is 7implemented in apparatus 101 of Fig. 1 or apparatus 20 of Fig. 2. The method is implemented in a processor and do not require human interaction. It is to be noted that the method may however provide output that may be further processed by humans. It is to be noted that performing all phases of the flow chart is not mandatory and that the shown order of phases is not restrictive. Alternatively the phases may be performed in different order.

[0048] The method comprises following phases:

[0049] Phase 401: Test configuration is received. The test configuration is received for example embedded in a QR code or in an URL address.

[0050] Phase 402: Testing of target cell defined in the test configuration is started. The method starts to monitor network operation through open interfaces provided in the apparatus.

[0051] Phase 403: It is checked whether current location is within a test area defined in the test configuration. The location may be obtained for example from a GPS module of the apparatus. If the location is not within the test area, the test does not start and the process may return to phase 402 to wait for the desired location.

[0052] Phase 404: It is checked whether the apparatus is connected to the target cell. Open interfaces provided in the apparatus are used for obtaining this information. If the apparatus is not connected to the target cell, the test does not start and the process may return to phase 402 until the apparatus is connected to the target cell.

[0053] If the location is within the test area and the apparatus is connected to the target cell, the process proceeds to phase 405 to monitor and record performance of the target cell.

00 [0054] The testing continues until predefined criteria defined in the test N configuration are reached. In phase 406 it is checked if testing of the cell is 2 completed. If testing is not completed, the process may return to phases 402-405 to N continue testing the target cell. E [0055] The predefined criteria may comprise for example reaching of certain < percentage of maximum throughput of a cell and/or obtaining performance metrics LO from a plurality of locations within the test area. The percentage may be for example < 55%, 60%, 75%, 85% or some other value e.g. between 50-90%. The number of required locations where the performance metrics are obtained may be for example 5, 10 or 20. 8

[0056] If the tests are completed for the target cell, it is checked in phase 407 if the test configuration comprises other cells. If other cells are not defined, the process stops in phase 409 and the test results are reported.

[0057] If the test configuration comprises instructions for testing other cells, the process proceeds to next cell in phase 408. The next cell is set as target cell and tested according to phases 402-407.

[0058] In connection with the example embodiment of Fig. 1 it was disclosed that the test configuration comprises instructions to monitor and record data transmission speed and/or to log one or more of the following: model of the mobile device, IMEI of the mobile device, serial number of the mobile device, location of the mobile device, serving cell identifier, neighbour cell identifiers, changes in location and data transmission state. Additionally or alternatively the test configuration may comprise instructions to monitor and record one or more of the following: location area code, FTP upload performance, success of handover events, success of a call to emergency number, UDP packetloss count, DNS response time, DNS success ratio, results of a HTTP GET query, results of iPerf measurements, results of ping function, call setup time, and call drop rate. It is to be noted that any desired subset of these may be taken depending on how extensive testing of the cell is needed.

[0059] Without in any way limiting the scope, interpretation, or application of the claims appearing below, a technical effect of one or more of the example embodiments disclosed herein is providing a robust and easy to use test tool. In an embodiment a test person only needs to open the test tool application and to follow the instructions to move to the test area and within the test area. Everything else may be automatically performed. In some implementations the test person may need 00 to take some other actions, though. The test person may for example read in the test N configuration, press start testing button, initiate a call to an emergency number 2 and/or take some other action. N [0060] Yet another technical effect of one or more of the example E embodiments disclosed herein is ability to easily test actual physical setup of the < target cell and base station. By requiring over 50% throughput and requiring results LO from a plurality of locations within the predefined test area it is possible to verify that < cabling between base station antenna and other parts of the base station has been correctly coupled as it is likely that with incorrect cabling it is not possible to fulfill these criteria and thus errors in cabling can be detected and operation of 9beamforming can be verified. Conventional base station testing is usually unable to detect such errors.

[0061] If desired, the different functions discussed herein may be performed in a different order and/or concurrently with each other. Furthermore, if desired, one or more of the before-described functions may be optional or may be combined.

[0062] Although various aspects of the invention are set out in the independent claims, other aspects of the invention comprise other combinations of features from the described embodiments and/or the dependent claims with the features of the independent claims, and not solely the combinations explicitly set out in the claims.

[0063] It is also noted herein that while the foregoing describes example embodiments of the invention, these descriptions should not be viewed in a limiting sense. Rather, there are several variations and modifications, which may be made without departing from the scope of the present invention as defined in the appended claims.

00

O N O - N

I a a 00 00 00

LO 00

O N

Claims

1. A network test tool for testing operation of cells of a communication network, wherein the network test tool is a test application (24) executable by a processor of a general purpose mobile communication device (102), the general purpose mobile communication device (102) being operable in cells of said communication network, and wherein the test application is configured to interact with open interfaces of the general purpose mobile communication device (102) to identify (404) that the general purpose mobile communication device (102) is connected to a target cell and to monitor performance of the target cell, and to monitor (403) geographic location of said general purpose mobile communication device (102), wherein the test application (24) is configured to implement a test by guiding a test person to move to a predefined test area and to move within the test area during the test with the general purpose mobile communication device (102); and automatically monitoring and recording (405) performance of the target cell when geographic location of said general purpose mobile communication device (102) is within the predefined test area and the general purpose mobile communication device (102) is connected to the target cell, and continuing said recording of performance of the target cell until predefined criteria of the test are fulfilled (406), wherein said predefined criteria of the test comprises obtaining recorded performance o from a plurality of locations within the predefined test area.

O

N 3 2. The network test tool of claim 1, wherein the test application (24) is configured N to prevent said recording of performance of the target cell when geographic location E of said general purpose mobile communication device (102) is outside the predefined 2 test area.

2 S

3. The network test tool of any preceding claim, wherein the test application (24) is configured to provide real-time visualization (300) of the geographical location (35- 11

37) of the general purpose mobile communication device and the predefined test area (32).

4. The network test tool of any preceding claim, wherein the test application (24) is configured to receive (401) a test configuration, the test configuration comprising at least identification of the target cell and the predefined test area.

5. The network test tool of claim 4, wherein the test configuration further comprises instructions relating to the monitoring and recording of performance of the target cell.

6. The network test tool of claim 4 or 5, wherein the test application (24) is configured to receive (401) the test configuration embedded in a QR code.

7. The network test tool of claim 4 or 5, wherein the test application (24) is configured to receive (401) the test configuration embedded in an URL.

8. The network test tool of any preceding claim, wherein the test application (24) is configured to automatically report (409) said recorded performance of the target cell.

9. The network test tool of any preceding claim, wherein the test application (24) is configured to periodically start and stop said recording of performance of the target cell.

10. The network test tool of any preceding claim, wherein said predefined criteria o comprises reaching of 50-90% of maximum throughput of the cell.

& 3 11. The network test tool of any preceding claim, wherein said predefined criteria comprises reaching over 50% of maximum throughput of the cell.

= a a 12. The network test tool of any preceding claim, wherein said predefined criteria LO comprises reaching over 50% of maximum throughput of the cell in combination with S requiring recorded performance from a plurality of locations within the predefined test area to verify correct base station cabling. 12

13. The network test tool of any preceding claim, wherein said predefined criteria comprises requiring recorded performance from at least 5 locations.

14. A method for testing operation of cells of a communication network, the method comprising interacting with open interfaces of a general purpose mobile communication device (102) operable in cells of said communication network to identify (404) that the general purpose mobile communication device (102) is connected to a target cell and to monitor performance of the target cell, monitoring (403) geographic location of said general purpose mobile communication device, and implementing a test by guiding a test person to move to a predefined test area and to move within the test area during the test with the general purpose mobile communication device (102); and automatically monitoring and recording (405) performance of the target cell when geographic location of said general purpose mobile communication device is within the predefined test area and the general purpose mobile communication device (102) is connected to the target cell, and continuing said recording of performance of the target cell until predefined criteria of the test are fulfilled (406), wherein said predefined criteria of the test comprises obtaining recorded performance from a plurality of locations within the predefined test area. o

15. The method of claim 14, further comprising preventing said recording of N performance of the target cell when geographic location of said general purpose 3 mobile communication device (102) is outside the predefined test area.

N j > 2

N 13