CN112954725B - Test method, communication system and NB-IoT device - Google Patents

Test method, communication system and NB-IoT device Download PDF

Info

Publication number
CN112954725B
CN112954725B CN202110185522.3A CN202110185522A CN112954725B CN 112954725 B CN112954725 B CN 112954725B CN 202110185522 A CN202110185522 A CN 202110185522A CN 112954725 B CN112954725 B CN 112954725B
Authority
CN
China
Prior art keywords
test
iot
iot device
network
sdr
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110185522.3A
Other languages
Chinese (zh)
Other versions
CN112954725A (en
Inventor
袁小燕
王继辉
杨杨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Goodix Technology Co Ltd
Original Assignee
Shenzhen Goodix Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Goodix Technology Co Ltd filed Critical Shenzhen Goodix Technology Co Ltd
Priority to CN202110185522.3A priority Critical patent/CN112954725B/en
Publication of CN112954725A publication Critical patent/CN112954725A/en
Application granted granted Critical
Publication of CN112954725B publication Critical patent/CN112954725B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W24/00—Supervisory, monitoring or testing arrangements
    • H04W24/06—Testing, supervising or monitoring using simulated traffic
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W24/00—Supervisory, monitoring or testing arrangements
    • H04W24/10—Scheduling measurement reports ; Arrangements for measurement reports
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00—Reducing energy consumption in communication networks
    • Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks

Abstract

The embodiment of the application provides a testing method, a communication system and an NB-IoT device, wherein the testing method is applied to a plurality of NB-IoT devices, the plurality of NB-IoT devices are connected with SDR equipment, and the testing method comprises the following steps: each NB-IoT device accesses at least one of a plurality of NB-IoT service cells simulating an existing network and runs a test case loaded thereon to interact with a simulation application server so as to test the NB-IoT device; wherein the NB-IoT serving cell emulating an existing network is a serving cell formed by loading network configuration parameters onto the SDR device. The embodiment of the application effectively realizes the automatic test of the NB-IoT device.

Description

Test method, communication system and NB-IoT device
Technical Field
The embodiment of the application relates to the technical field of testing, in particular to a testing method, a communication system and an NB-IoT device.
Background
NB-IoT (Narrow Band Internet of Things ) is an emerging technology in the field of internet of things, supporting cellular data connectivity of low power devices over wide area networks. Due to the advantages of wide coverage, multiple connections, low power consumption, low module cost and the like of the NB-IoT technology, the technology is widely applied to the fields of intelligent meter reading, intelligent parking, intelligent home, intelligent cities, intelligent production and the like in the future, and in order to ensure the quality of the NB-IoT device, the NB-IoT device is generally required to be tested.
When testing NB-IoT devices, each test requires a tester to manually perform the entire test process, resulting in lower test efficiency and higher labor and time costs of the test; therefore, how to automatically test NB-IoT devices is a challenge.
Disclosure of Invention
In view of the foregoing, one of the technical problems addressed by the embodiments of the present application is to provide a testing method, a communication system and an NB-IoT device for overcoming or alleviating the above-mentioned drawbacks of the prior art.
In a first aspect, embodiments of the present application provide a test method applied to a number of NB-IoT devices connected to an SDR device, the test method comprising:
each NB-IoT device accesses at least one of a plurality of NB-IoT service cells simulating an existing network and runs a test case loaded thereon to interact with a simulation application server so as to test the NB-IoT device;
wherein the NB-IoT serving cell emulating an existing network is a serving cell formed by loading network configuration parameters onto the SDR device.
Optionally, in an embodiment of the present application, the NB-IoT serving cell of the analog current network has a set signal transmission frequency to act as a signal path for the NB-IoT device to interact with the analog application server.
Optionally, in an embodiment of the present application, the network configuration parameter is determined according to a network configuration parameter of an existing network, and is stored in a network configuration library, so that at least one of adding and deleting the network configuration parameter is performed through the network configuration library, where the network configuration parameter of the existing network is extracted from an existing network log.
Optionally, in an embodiment of the present application, if there are multiple test cases loaded on the same NB-IoT device, when each NB-IoT device runs the test cases loaded thereon, the test cases run sequentially according to the running order configured by the multiple test cases.
Optionally, in an embodiment of the present application, before each NB-IoT device accesses at least one of NB-IoT service cells of the plurality of analog current networks and runs the test case loaded thereon to interact with the analog application server, the method further includes:
a plurality of test cases are loaded onto the NB-IoT device according to the running sequence of the configuration under the control of a case command sequence, and a plurality of network configuration parameters are loaded onto the SDR device under the control of a configuration command sequence;
Wherein at least one of the use case command sequence and the configuration command sequence is generated by a network element controller.
Optionally, in an embodiment of the present application, before each NB-IoT device accesses at least one of NB-IoT service cells of the plurality of analog current networks and runs the test case loaded thereon to interact with the analog application server, the method further includes: and adjusting the test case loaded on the NB-IoT and/or adjusting the network configuration parameters loaded on the SDR device according to at least one of the running states of the SDR device and the NB-IoT device monitored by the network element controller.
Optionally, in an embodiment of the present application, the operation state of the SDR device is monitored by the network element controller remotely logging in to the SDR device through SSH; the operating state of the NB-IoT device is monitored by the network element controller accessing the NB-IoT device through a remote application programming interface, the operating state of the NB-IoT device comprising at least one of an operating state of the NB-IoT device on an eNodeB side and an operating state of the NB-IoT device on an MME side.
Optionally, in an embodiment of the present application, the test method further includes: and performing at least one of a network restoration test and a fault location test on the NB-IoT device according to the adjusted test case and/or the network configuration parameters.
Optionally, in an embodiment of the present application, the test case is stored on a database server, and the test method further includes:
abstracting the NB-IoT device, the simulation application server, and the database server into objects, and encapsulating test behaviors executed by the objects in a test process into an action primitive set;
packaging the action primitive set into a keyword, and generating the test case by assembling the keyword, wherein the keyword is used for controlling the execution of the test behavior;
and forming a test sleeve by a plurality of test cases according to the running sequence of the configuration.
Optionally, in an embodiment of the present application, a plurality of the test suites form a test suite list, and the test suite list includes variables used by test cases to construct different test cases based on different variables and the same test behavior.
Optionally, in an embodiment of the present application, the test suite list further includes at least one of an enabling configuration of the test suite and a number of times the test suite is repeatedly run to control running of the test case on the NB-IoT device through the test suite list, wherein the number of times the test suite is repeatedly run includes a number of times of re-running after the test suite is failed to run.
Optionally, in an embodiment of the present application, the test case has a correspondence with the network configuration parameter; correspondingly, the test method further comprises the steps of: and loading the test cases onto a plurality of NB-IoT devices and loading the network configuration parameters onto the SDR device according to the correspondence.
Optionally, in an embodiment of the present application, each NB-IoT device runs a test case loaded thereon, including: each NB-IoT device runs a test case loaded on the device according to a test control configuration, wherein the test control configuration comprises AT least one of a fixed-time running and a failure running times of the test case, automatic restarting of the NB-IoT device after an AT command is hung up, and stopping of a test after restarting of the NB-IoT device is failed.
Optionally, in an embodiment of the present application, an equal number of NB-IoT devices are accessed on NB-IoT serving cells of each of the emulated current networks.
Optionally, in an embodiment of the present application, the NB-IoT devices have the same hardware resources and firmware resources, and the NB-IoT serving cells simulating the current network are different, so as to perform network compatibility testing on the NB-IoT devices.
Optionally, in an embodiment of the present application, several of the NB-IoT devices have the same hardware resources and different firmware resources to perform firmware contrast testing at least on the NB-IoT devices.
Optionally, in an embodiment of the present application, the test method further includes: the NB-IoT device repeatedly runs test cases loaded thereon to perform firmware stability testing on the NB-IoT device.
Optionally, in an embodiment of the present application, a number of the NB-IoT devices are connected to the SDR device through a power splitter, such that a number of the NB-IoT devices interact with the analog application server through the same power splitter.
Optionally, in an embodiment of the present application, the test method further includes: and generating a test report according to a set test statistics item, wherein the test statistics item comprises at least one of the number of times of restarting the NB-IoT device, whether the NB-IoT device is hung up or not, test time delay and the success rate of repeated operation of the test case.
Optionally, in an embodiment of the present application, the test method further includes: generating a test report according to the set test classification item, wherein the test classification item comprises generating the test report based on the NB-IoT device or generating the test report based on the network configuration parameter.
In a second aspect, embodiments of the present application provide a communication system, which includes an SDR device and a plurality of NB-IoT devices, wherein the plurality of NB-IoT devices are connected to the SDR device, and the NB-IoT devices are configured to perform the testing method described in any embodiment of the present application.
In a third aspect, embodiments of the present application provide an NB-IoT device comprising a memory having stored thereon a computer executable program and a processor running the computer executable program to perform the test method described in any of the embodiments of the present application.
In the test scheme provided by the embodiment of the application, the test scheme is applied to a plurality of NB-IoT devices, the plurality of NB-IoT devices are connected with SDR equipment, each NB-IoT device is accessed to at least one of a plurality of NB-IoT service cells simulating the current network, and a test case loaded on the test case is operated to interact with a simulation application server so as to test the NB-IoT devices; the network configuration parameters are loaded to the SDR equipment to form the service cell, so that the automatic test of the NB-IoT device is effectively realized, the test efficiency is improved, and the labor cost and the time cost are reduced.
Drawings
Some specific embodiments of the present application will be described in detail below by way of example and not by way of limitation with reference to the accompanying drawings. The same reference numbers will be used throughout the drawings to refer to the same or like parts or portions. Those skilled in the art will appreciate that the drawings are not necessarily drawn to scale. In the accompanying drawings:
FIG. 1 is a schematic diagram of a communication system according to an embodiment of the present application;
FIG. 2 is a schematic diagram of a communication system according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of a communication system according to an embodiment of the present application;
FIG. 4 is a schematic diagram of a communication system according to an embodiment of the present application;
fig. 5 is a flow chart of a test method according to an embodiment of the present application.
Detailed Description
It is not necessary for any of the embodiments of the present application to be practiced with all of the advantages described above.
In order to better understand the technical solutions in the embodiments of the present application, the following descriptions will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only some embodiments of the present application, but not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the embodiments of the present application shall fall within the scope of protection of the embodiments of the present application.
In the scheme provided by the embodiment of the application, the application is applied to a plurality of NB-IoT devices, the plurality of NB-IoT devices are connected with SDR equipment, each NB-IoT device accesses at least one of a plurality of NB-IoT service cells simulating the current network and runs a test case loaded on the test case to interact with a simulation application server (for example, the simulation application server receives first test data sent by the NB-IoT device and sends second test data to the NB-IoT device) so as to test the NB-IoT device; the network configuration parameters are loaded to the SDR equipment to form the service cell, so that the automatic test of the NB-IoT device is effectively realized, the test efficiency is improved, and the labor cost and the time cost are reduced.
Specific implementations of embodiments of the present application are further described below with reference to the accompanying drawings of embodiments of the present application.
FIG. 1 is a schematic diagram of a communication system according to an embodiment of the present application; as shown in fig. 1, in this application scenario, the communication system includes: an SDR (Software Defined Radio ) device and a number of NB-IoT devices connected to the SDR device, each of the NB-IoT devices accessing at least one of a number of NB-IoT service cells emulating an existing network and running test cases loaded thereon to interact with an emulation application server to test the NB-IoT devices; wherein the NB-IoT serving cell emulating an existing network is a serving cell formed by loading network configuration parameters onto the SDR device.
In particular, in an embodiment, the NB-IoT device may include at least one of an NB-IoT chip or an NB-IoT terminal. Further, the analog application server may be formed on the SDR device by way of software, for example. Of course, in other embodiments, the simulation application server may be arranged separately.
Specifically, in an embodiment, the NB-IoT serving cell of the analog present network has a set signal transmission frequency to act as a signal path for the NB-IoT device to interact with the analog application server.
Specifically, in an embodiment, the network configuration parameters are determined according to network configuration parameters of the current network and stored in a network configuration library, so that at least one of adding and deleting the network configuration parameters is performed through the network configuration library, wherein the network configuration parameters of the current network are extracted from a current network log.
In particular, the present network includes, but is not limited to, the present network of China Mobile, china Unicom, china telecom. In an embodiment, a tester may collect current network logs of each operator in each place, and automatically extract network configuration parameters of the current network from the current network logs to form the network configuration library, or add the network configuration parameters of the current network to the existing network configuration library by means of manual addition.
Optionally, in an embodiment, the network configuration parameter includes, but is not limited to, at least one of: access network configuration parameters, core network related network configuration parameters, etc.; the access class network configuration parameters include parameters related to MIB (Master Information Block ), SIB (System Information Blocks, system information block), MSG4 (instruction based on random access instruction), and the core network related network configuration parameters include parameters related to PSM (Power Saving Mode ), eDRX (Extended Discontinuous Reception, extended discontinuous reception mode). It should be noted that this is only an example and is not a unique limitation of the network configuration parameters.
Optionally, in an embodiment, if there are multiple test cases loaded on the same NB-IoT device, when each NB-IoT device runs the test cases loaded thereon, the NB-IoT device runs sequentially according to the running order configured by the multiple test cases, thereby improving the construction efficiency of the complex test cases and ensuring the comprehensiveness and reliability of the automated test. Specifically, a plurality of the test cases are loaded onto the NB-IoT device in the running order of the configuration under control of a case command sequence. Here, the configured operation order includes a predetermined operation order, or a random operation order.
Optionally, in an embodiment, the plurality of network configuration parameters are loaded onto the SDR device under the control of a configuration command sequence, so that the construction efficiency of the network configuration parameters is improved, and the comprehensiveness and reliability of the automatic test are ensured.
Optionally, in an embodiment, at least one of the use case command sequence and the configuration command sequence is generated by a network element controller.
Further, in an embodiment, the network element controller may be configured on a test host such that a plurality of the test cases are loaded onto the NB-IoT device and a plurality of the network configuration parameters are loaded onto the SDR device based on the network element controller of the test host.
Further, in an embodiment, the network configuration library may also be provided on the test host, and the network configuration parameters to be loaded on the SDR device by the test host may be sent to the SDR device. Here, it should be noted that the network configuration library is not limited to being only set on the test host, for example, may also be set on the SDR device, so that when the network configuration parameters are loaded, the network configuration parameters may be obtained locally on the SDR device.
Optionally, in an embodiment, an interface for loading network configuration parameters is provided on the SDR device, and the network element controller loads the network configuration parameters onto the interface so as to realize loading the network configuration parameters onto the SDR device.
Optionally, in an embodiment, the network element controller may be further configured to initiate a service simulating an NB-IoT service cell of the current network, and simulate a test log copy of the NB-IoT service cell of the current network to coordinate testing of the NB-IoT device.
Further, in an embodiment, the network element controller monitors at least one of the SDR device and the NB-IoT device, so that the test case loaded onto the NB-IoT device and/or the network configuration parameters loaded onto the SDR device may be adjusted according to at least one of the monitored operational states of the SDR device and the NB-IoT device. Here, the adjustment of the test cases and the network configuration parameters may be performed in particular by a network element controller.
Specifically, in an embodiment, the running state of the SDR device is monitored by the network element controller remotely logging in the SDR device through SSH (Secure Shell); the operating state of the NB-IoT device is monitored by the network element controller accessing the NB-IoT device through a remote application programming interface (RAPI, remote Application Programming Interface), the operating state of the NB-IoT device comprising at least one of an operating state of the NB-IoT device on an eNodeB (Evolved Node B) side and an operating state of the NB-IoT device on an MME (Mobility Management Entity ) side. In addition, the network element controller can monitor the test signaling of the NB-IoT device and construct an abnormal message on the NB-IoT device to purposefully interfere with the test process, so that the comprehensiveness and reliability of the automatic test are ensured, and the automatic test of the NB-IoT device is effectively realized.
Specifically, in an embodiment, at least one of a network restoration test and a fault location test is performed on the NB-IoT device according to the adjusted test case and/or the network configuration parameter. In other words, the NB-IoT device runs the adjusted test case, and interacts with the simulation application server through the NB-IoT service cell formed by the SDR device loaded with the adjusted network configuration parameters to perform at least one of a network restoration test and a fault location test on the NB-IoT device, where the network restoration test includes, for example, reproducing a network scene when the NB-IoT device fails (but). Alternatively, the fault location test is such that the NB-IoT device fails on the eNodeB (Evolved Node B) side or the NB-IoT device fails on the MME (Mobility Management Entity ) side.
Optionally, in an embodiment, the test host is connected to the NB-IoT devices and the SDR device in a wired manner, respectively, such as the test host is connected to the NB-IoT devices in a wired manner through a USB HUB.
Optionally, in an embodiment, a User Equipment (UE) controller is disposed on the test host, and when the NB-IoT device is connected to the test host through the USB HUB, for example, the NB-IoT device is specifically connected to an AT (Attention) serial port on the test host, and the UE controller dynamically identifies the NB-IoT device that has been plugged into the USB HUB through a hot plug event, so as to determine the NB-IoT device that actually participates in the test.
Further, in an embodiment, the UE controller may virtualize the AT serial port as an IP address, facilitating browsing NB-IoT devices currently connected to the test host through web page input AT instructions.
Optionally, in an embodiment, a number of the NB-IoT devices are connected with the SDR device by wire or wirelessly. Optionally, in an embodiment, a plurality of NB-IoT devices are connected to the SDR device through a radio frequency line to implement the wired manner; or, a plurality of NB-IoT devices are connected with the SDR device through antennas to realize the wireless mode.
Here, it should be noted that the test host and the network element controller are not the only and necessary means for implementing loading and adjusting the test cases and the network configuration parameters.
Optionally, in an embodiment, the test case has a correspondence with the network configuration parameter; correspondingly, the test cases are loaded onto a plurality of NB-IoT devices and the network configuration parameters are loaded onto the SDR device according to the corresponding relations, so that network compatibility testing is comprehensively conducted.
Further, in an embodiment, through at least one of the monitored running states of the SDR device and the NB-IoT device, the correspondence between the test case and the network configuration parameter may be further adjusted, so that flexibility of the test case in participating in the test process and construction efficiency of the complex test case are increased.
Optionally, in an embodiment, each NB-IoT device runs a test case loaded thereon, including: each NB-IoT device runs the test case loaded on the device according to the test control configuration, wherein the test control configuration comprises AT least one of fixed-time running and failure running times of the test case, automatic restarting of the NB-IoT device after the AT command is suspended and stopping of the test after the restarting of the NB-IoT device fails, so that the targeted test of the NB-IoT device is effectively realized.
Optionally, in an embodiment, an equal number of NB-IoT devices are accessed on each NB-IoT serving cell of the analog current network, so that an excessive number of NB-IoT devices accessed on the NB-IoT serving cells of the analog current network is avoided, and an insufficient number of NB-IoT devices accessed on the NB-IoT serving cells of the analog current network is avoided, resulting in network congestion occurring in the SDR device, and improving the testing efficiency of the NB-IoT devices.
Optionally, in an embodiment, the access of the NB-IoT devices to the NB-IoT serving cells of the emulated current network may be controlled by AT instructions such that an equal number of the NB-IoT devices are accessed on the NB-IoT serving cells of each emulated current network.
Of course, in other embodiments, the number of NB-IoT devices accessed on different NB-IoT serving cells may also be made different, depending on the needs of the application scenario.
Optionally, in an embodiment, the NB-IoT serving cells of one analog current network have one signal transmission frequency, so that the NB-IoT serving cells of the plurality of analog current networks have a plurality of signal transmission frequencies, thereby ensuring that co-channel interference does not occur when the NB-IoT device accesses the NB-IoT serving cells to interact with the analog application service, and ensuring the accuracy of the test.
It should be noted here that, in an embodiment, each NB-IoT serving cell simulating the current network may also have at least two signal transmission frequencies to perform the anti-co-channel interference performance test on the NB-IoT device.
Optionally, in an embodiment, the NB-IoT devices have the same hardware resources and firmware resources, and the NB-IoT serving cells emulating the current network are different for network compatibility testing of the NB-IoT devices. Specifically, for example, the same test case is run on a plurality of NB-IoT devices, the NB-IoT service cells of the plurality of analog present networks have different signal transmission frequencies and further form different signal paths to form different NB-IoT service cells of the plurality of analog present networks, and the NB-IoT devices interact with the analog application server through different signal paths.
Optionally, in an embodiment, several NB-IoT devices have the same hardware resources and different firmware resources to perform firmware contrast testing, including firmware performance, firmware quality, etc., on at least the NB-IoT devices, so that comprehensive testing of NB-IoT devices is effectively achieved. At this point, the test cases running on several of the NB-IoT devices are preferably identical to effectively conduct the firmware contrast test.
Optionally, in an embodiment, the NB-IoT device repeatedly runs test cases loaded thereon to perform firmware stability testing on the NB-IoT device. Preferably, the firmware resources on the NB-IoT device remain unchanged while the test case loaded thereon is repeatedly run. Specifically, the NB-IoT device may repeatedly run the test cases loaded thereon according to the set number of times the test cases are repeatedly executed, and the time interval for the test cases to be repeatedly executed, so as to perform the firmware stability test on the NB-IoT device.
Further, in an embodiment, the communication system may further include a firmware library, where a plurality of firmware resources are stored in the firmware library, and the firmware resources are managed by the firmware library, including operations such as adding, deleting, and checking.
Further, when the communication system includes the test host, the firmware library may be configured on the test host. In other embodiments, the firmware library may also be configured on the SDR device; alternatively, the firmware library is configured on another database server.
Optionally, in an embodiment, the firmware resources on the NB-IoT devices are upgraded, such as under control of a test host, including upgrading a portion of the NB-IoT devices' firmware resources or upgrading firmware resources of all the NB-IoT devices so that several of the NB-IoT devices have the same hardware resources but different firmware resources.
In the embodiment of the application, due to the use of the SDR device, compared with the testing scheme based on the comprehensive tester/GCF (Global Certification Forum, global authentication forum) final tester in the prior art, network configuration parameters can be flexibly loaded on the SDR device to form an NB-IoT service cell simulating the current network, and each NB-IoT device can interact with the simulation application server through the NB-IoT service cell simulating the current network during testing, so that the automation testing of the NB-IoT device is realized. In addition, the testing cost is reduced compared with the high price of the comprehensive tester/GCF final tester. Moreover, compared with the prior art that only consistency test (such as radio frequency consistency) can be performed by using a comprehensive tester/GCF final tester, in the embodiment of the application, because network configuration parameters can be flexibly loaded on SDR equipment, a plurality of NB-IoT service cells simulating the current network can be formed, so that the testing range is wider, and the comprehensiveness of testing is ensured.
FIG. 2 is a schematic diagram of a communication system according to an embodiment of the present application; as shown in fig. 2, in this embodiment, the test cases are stored on a database server, and for this purpose, in this embodiment, the NB-IoT device, the simulation application server, and the database server are abstracted into objects, and test behaviors executed by the objects in the test process are packaged into an action primitive set (ActionWords); packaging the action primitive set into a keyword (KeyWords), and generating the Test Case (Test Case) by assembling the keyword, wherein the keyword is used for controlling the execution of the Test behavior; and forming a test sleeve by a plurality of test cases according to the running sequence of the configuration. Such as a robot file.
Optionally, in an embodiment, an automated test platform may be disposed on the test host, and the abstraction, packaging, generation of the test suite, and the like may be implemented based on the automated test platform. The type of the automated test platform is not particularly limited, and for example, the automated test platform can be an automated test platform built based on robotframe work, so that a tester can conveniently control the operation of the communication system based on the automated test platform on the test host.
Further, in an embodiment, a control script for controlling the operation of the communication system is configured based on the automated test platform, and the automated operation of the communication system is controlled by operating the control script, including the automatic loading and operation of the test case, the automatic loading of the network configuration parameters, and the like, so that the efficiency of the automated test is further improved.
In this embodiment, the analog application server is a user datagram protocol (UDP, user Datagram Protocol) server, and the database server is an Over-the-Air Technology (OTA) server.
Optionally, in an embodiment, the plurality of test suites form a test suite list, where the test suite list includes variables used by test cases to construct different test cases based on different variables and the same test behavior, and when the data-driven automatic test can be implemented, the construction efficiency of the complex test cases is further improved.
Optionally, in an embodiment, the test suite list further includes at least one of an enabling configuration of the test suite and a number of times the test suite is repeatedly run to control running of the test case on the NB-IoT device through the test suite list, wherein the number of times the test suite is repeatedly run includes a number of times the test suite is re-run after running fails.
Alternatively, in one embodiment, the test suite may be quickly configured by an excel table to make up a test suite list.
Optionally, in an embodiment, the plurality of test case lists form a test case management file, where the test case management file includes a correspondence between the test case list and the network configuration parameters, and because the test case list includes a test case, the test case includes a test case, a correspondence between the test case and the network configuration parameters is established, and decoupling of the network configuration parameters and the test case is implemented, so that the same network configuration parameter has a correspondence with different test cases, or the same test case has a correspondence with different network configuration parameters, thereby increasing the integrity of the test.
Fig. 3 is a schematic structural diagram of a communication system according to an embodiment of the present application; as shown in fig. 3, in this embodiment, the apparatus further includes a power divider, where a plurality of NB-IoT devices are connected to the SDR device through the power divider, so that a plurality of NB-IoT devices interact with the analog application server through the same power divider.
Optionally, in an embodiment, the power divider has a signal input channel and a plurality of signal output channels, the SDR device is connected to the signal input channel, and one signal output channel is connected to one NB-IoT device, so that a plurality of NB-IoT devices are connected to the same SDR device, so that parallel testing of a plurality of NB-IoT devices is achieved, and meanwhile, cost of implementing automatic testing of a communication system is reduced and architecture of the communication system is simplified.
In addition, if several NB-IoT devices have the same hardware resources and firmware resources, by the solution provided in the embodiment of the present application, since multiple test cases and multiple network configuration parameters can be loaded at the same time, it is equivalent to implementing parallel testing on the same NB-IoT device, so that testing efficiency is improved, and whether quality of the NB-IoT device meets requirements, such as whether the quality meets an industrial level standard or a consumer level standard, can be quickly tested.
Optionally, when the SDR device and the NB-IoT devices are connected through a radio frequency line, one end of the radio frequency line is connected to one signal output channel of the power divider, and the other end is connected to one NB-IoT device. When the SDR device passes through an antenna and a plurality of NB-IoT devices, an antenna is arranged on each signal output channel, and the antenna is also arranged on the NB-IoT devices.
Further, on the basis of the foregoing embodiment, the test host may further generate a test report according to a set test statistics item, where the test statistics item includes at least one of a number of times the NB-IoT device is restarted, whether the NB-IoT device is suspended, a test delay, and a success rate of the repeated operation of the test case.
Further, on the basis of the foregoing embodiment, the test host may further generate a test report according to a set test classification item, where the test classification item includes generating the test report based on the NB-IoT device or generating the test report based on the network configuration parameter. Generating the test report in units of the NB-IoT device when the generation of the test report is performed based on the NB-IoT device; and when the test report is generated based on the network configuration parameters, generating the test report by taking the network configuration parameters as units.
Further, in an embodiment, upon generating the test report, the test host gathers data generated during testing of the NB-IoT device and the SDR device, such as test logs, to form the test report according to the set test statistics and/or the set test classification.
Further, in an embodiment, the test report is automatically sent to the tester for checking by means of mail, so that the tester can conveniently locate the BUG of the NB-IoT device, and the corresponding test case and network configuration parameters when the BUG appears, further facilitate reproduction of the BUG, and further provide a solution. When the NB-IoT device is improved according to the solution, the test can be performed again based on the test case, network configuration parameters to verify if the solution is valid, thus quickly and effectively solving the found BUG.
FIG. 4 is a schematic diagram of a communication system according to an embodiment of the present application; as shown in fig. 4, in this embodiment, the communication system includes a test master, an SDR device, a test host, and a plurality of NB-IoT devices. The test master controller can be connected with the SDR device and the test host in a wired or wireless way, so long as the control of the test master controller on the SDR device and the test host can be realized. The test master is configured to control the test host to load the test cases onto a number of the NB-IoT devices for operation and to load the network configuration parameters onto the SDR device to form a number of NB-IoT serving cells emulating an existing network.
In this embodiment, the test master may control the test host to generate a test report. Alternatively, the test report is generated directly by the test master rather than the test host.
In other embodiments, the test master may be omitted. In addition, the database server, the firmware library and the network configuration library can be directly arranged on the test host. Furthermore, firmware libraries as well as network configuration libraries may also be included in the database server.
Here, it should be noted that, in the embodiment of the present application, the number of the test master, the test host, and the SDR devices is not particularly limited; in addition, the number of the NB-IoT devices to be tested is not particularly limited if the plurality of NB-IoT devices are referred to as a set of NB-IoT devices to be tested.
FIG. 5 is a flow chart of a testing method according to an embodiment of the present application; as shown in fig. 5, it applies to several NB-IoT devices, several of which are connected with SDR devices, the test method comprising:
s501, each NB-IoT device accesses at least one of NB-IoT service cells of a plurality of analog current networks;
s502, running a test case loaded thereon to interact with a simulation application server to test the NB-IoT device;
wherein the NB-IoT serving cell emulating an existing network is a serving cell formed by loading network configuration parameters onto the SDR device.
Optionally, in a test method embodiment, the NB-IoT serving cell of the analog current network has a set signal transmission frequency to act as a signal path for the NB-IoT device to interact with the analog application server.
Optionally, in an embodiment of the test method, the network configuration parameter is determined according to a network configuration parameter of the current network, and the network configuration parameter is stored in a network configuration library, so that at least one of adding and deleting the network configuration parameter is performed through the network configuration library, where the network configuration parameter of the current network is extracted from a current network log.
Optionally, in an embodiment of the test method, if there are multiple test cases loaded on the same NB-IoT device, when each NB-IoT device runs the test cases loaded on the NB-IoT device, the NB-IoT device runs sequentially according to the running sequence configured by the multiple test cases, thereby improving the construction efficiency of the complex test cases and ensuring the comprehensiveness and reliability of the automated test.
Optionally, in a test method embodiment, before each NB-IoT device accesses at least one of NB-IoT service cells of the plurality of simulated current networks and runs the test cases loaded thereon to interact with the simulated application server, the method further includes:
a plurality of test cases are loaded onto the NB-IoT device according to the running sequence of the configuration under the control of a case command sequence, and a plurality of network configuration parameters are loaded onto the SDR device under the control of a configuration command sequence;
wherein at least one of the use case command sequence and the configuration command sequence is generated by a network element controller.
Optionally, in a test method embodiment, before each NB-IoT device accesses at least one of NB-IoT service cells of the plurality of simulated current networks and runs the test cases loaded thereon to interact with the simulated application server, the method further includes: and adjusting the test case loaded on the NB-IoT and/or adjusting the network configuration parameters loaded on the SDR device according to at least one of the running states of the SDR device and the NB-IoT device monitored by the network element controller. Here, the adjustment of the test cases and the network configuration parameters may be performed in particular by a network element controller.
Optionally, in a test method embodiment, the operation state of the SDR device is monitored by the network element controller remotely logging in the SDR device through SSH; the running state of the NB-IoT device is monitored by the network element controller through a remote application programming interface to access the NB-IoT device, the running state of the NB-IoT device comprises at least one of the running state of the NB-IoT device on the eNodeB side and the running state of the NB-IoT device on the MME side, the integrity and the reliability of the automatic test are guaranteed, and the automatic test of the NB-IoT device is effectively achieved.
Optionally, in an embodiment of the test method, the test method further includes: and performing at least one of a network restoration test and a fault location test on the NB-IoT device according to the adjusted test case and/or the network configuration parameters.
Optionally, in an embodiment of the test method, the test case is stored on a database server, and the test method further includes:
abstracting the NB-IoT device, the simulation application server, and the database server into objects, and encapsulating test behaviors executed by the objects in a test process into an action primitive set;
Packaging the action primitive set into a keyword, and generating the test case by assembling the keyword, wherein the keyword is used for controlling the execution of the test behavior;
and forming a test sleeve by a plurality of test cases according to the running sequence of the configuration.
Optionally, in an embodiment of the test method, a plurality of test suites form a test suite list, where the test suite list includes variables used by test cases, so as to construct different test cases based on different variables and the same test behavior, and when data-driven automatic test can be implemented, the construction efficiency of complex test cases is further improved.
Optionally, in a test method embodiment, the test suite list further includes at least one of an enabling configuration of the test suite and a number of times the test suite is repeatedly run to control running of the test case on the NB-IoT device through the test suite list, wherein the number of times the test suite is repeatedly run includes a number of times the test suite is re-run after running fails.
Optionally, in an embodiment of a test method, the test case has a correspondence with the network configuration parameter; correspondingly, the test method further comprises the steps of: and loading the test cases onto a plurality of NB-IoT devices and loading the network configuration parameters onto the SDR device according to the correspondence so as to comprehensively perform network compatibility testing.
Optionally, in a test method embodiment, each NB-IoT device runs a test case loaded thereon, including: each NB-IoT device runs the test case loaded on the device according to the test control configuration, wherein the test control configuration comprises AT least one of fixed-time running and failure running times of the test case, automatic restarting of the NB-IoT device after the AT command is suspended and stopping of the test after the restarting of the NB-IoT device fails, so that the targeted test of the NB-IoT device is effectively realized.
Optionally, in an embodiment of the test method, an equal number of NB-IoT devices are connected to each NB-IoT serving cell of the analog current network, so that an excessive number of NB-IoT devices connected to the NB-IoT serving cells of the analog current network is avoided, and an insufficient number of NB-IoT devices connected to the NB-IoT serving cells of the analog current network is avoided, which results in network congestion of SDR devices and affects the test efficiency of the NB-IoT devices.
Optionally, in a test method embodiment, the NB-IoT devices have the same hardware resources and firmware resources, and the NB-IoT serving cells simulating the current network are different to perform the network compatibility test on the NB-IoT devices. Specifically, for example, the same test case is run on a plurality of NB-IoT devices, the NB-IoT service cells of the plurality of analog present networks have different signal transmission frequencies and further form different signal paths to form different NB-IoT service cells of the plurality of analog present networks, and the NB-IoT devices interact with the analog application server through different signal paths.
Optionally, in an embodiment of the testing method, the NB-IoT devices have the same hardware resources and different firmware resources, so that at least the NB-IoT devices are subjected to firmware contrast testing, including firmware performance, firmware quality, and the like, so that comprehensive testing of the NB-IoT devices is effectively achieved, and quality of the NB-IoT devices is guaranteed to reach industrial standards. At this point, the test cases running on several of the NB-IoT devices are preferably identical to effectively conduct the firmware contrast test.
Optionally, in an embodiment of the test method, the test method further includes: the NB-IoT device repeatedly runs test cases loaded thereon to perform firmware stability testing on the NB-IoT device. Preferably, the firmware resources on the NB-IoT device remain unchanged while the test case loaded thereon is repeatedly run. Specifically, the NB-IoT device may repeatedly run the test cases loaded thereon according to the set number of times the test cases are repeatedly executed, and the time interval for the test cases to be repeatedly executed, so as to perform the firmware stability test on the NB-IoT device.
Optionally, in a test method embodiment, a number of the NB-IoT devices are connected with the SDR device through a power splitter, such that a number of the NB-IoT devices interact with the analog application server through the same power splitter.
Optionally, in an embodiment of the test method, the test method further includes: and generating a test report according to a set test statistics item, wherein the test statistics item comprises at least one of the number of times of restarting the NB-IoT device, whether the NB-IoT device is hung up or not, test time delay and the success rate of repeated operation of the test case.
Optionally, in an embodiment of the test method, the test method further includes: generating a test report according to the set test classification item, wherein the test classification item comprises generating the test report based on the NB-IoT device or generating the test report based on the network configuration parameter. Generating the test report in units of the NB-IoT device based on the generation of the test report by the NB-IoT device; and when the test report is generated based on the network configuration parameters, the test report is generated by taking the network configuration parameters as units.
Embodiments of the present application also provide an NB-IoT device comprising a memory having stored thereon a computer executable program and a processor running the computer executable program to perform the test method of any of the embodiments of the present application.
Thus, particular embodiments of the present subject matter have been described. Other embodiments are within the scope of the following claims. In some cases, the actions recited in the claims can be performed in a different order and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may be advantageous.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises an element.
In this specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from the other embodiments. In particular, for system embodiments, since they are substantially similar to method embodiments, the description is relatively simple, as relevant to see a section of the description of method embodiments.
The foregoing is merely exemplary of the present application and is not intended to limit the present application. Various modifications and changes may be made to the present application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc. which are within the spirit and principles of the present application are intended to be included within the scope of the claims of the present application.

Claims (19)

1. A method of testing applied to a number of NB-IoT devices connected to an SDR device, the method comprising:
each NB-IoT device accesses at least one of a plurality of NB-IoT service cells simulating an existing network and runs a test case loaded thereon to interact with a simulation application server so as to test the NB-IoT device;
the NB-IoT serving cell simulating the existing network is a serving cell formed by loading network configuration parameters onto the SDR device, and the simulation application server is formed on the SDR device in a software mode;
the NB-IoT devices have the same hardware resources and firmware resources, and the NB-IoT service cells simulating the current network are different so as to perform network compatibility testing on the NB-IoT devices;
Several of the NB-IoT devices have the same hardware resources and different firmware resources to perform a firmware contrast test on at least the NB-IoT devices, the firmware contrast test comprising: firmware performance, firmware quality;
the NB-IoT device repeatedly runs test cases loaded thereon to perform firmware stability testing on the NB-IoT device.
2. The testing method of claim 1, wherein the NB-IoT serving cell of the analog present network has a set signaling frequency to act as a signaling pathway for the NB-IoT device to interact with the analog application server.
3. The test method according to claim 1 or 2, wherein the network configuration parameters are determined according to network configuration parameters of an existing network and stored in a network configuration library, so as to at least one of add and delete the network configuration parameters through the network configuration library, wherein the network configuration parameters of the existing network are extracted from an existing network log.
4. The testing method of claim 1 or 2, wherein if there are multiple test cases loaded on the same NB-IoT device, each NB-IoT device executes the test cases loaded thereon, the test cases are executed sequentially in an execution order configured by the multiple test cases.
5. The testing method of claim 4, wherein before each of the NB-IoT devices accesses at least one of a number of NB-IoT service cells that simulate an existing network and runs test cases loaded thereon to interact with a simulated application server, further comprising:
a plurality of test cases are loaded onto the NB-IoT device according to the running sequence of the configuration under the control of a case command sequence, and a plurality of network configuration parameters are loaded onto the SDR device under the control of a configuration command sequence;
wherein at least one of the use case command sequence and the configuration command sequence is generated by a network element controller.
6. The testing method of claim 5, wherein before each of the NB-IoT devices accesses at least one of a number of NB-IoT service cells that simulate an existing network and runs test cases loaded thereon to interact with a simulated application server, further comprising: and adjusting the test case loaded on the NB-IoT and/or adjusting the network configuration parameters loaded on the SDR device according to at least one of the running states of the SDR device and the NB-IoT device monitored by the network element controller.
7. The method of testing as defined in claim 6, wherein the operational status of the SDR device is monitored by the network element controller remotely logging in to the SDR device via SSH; the operating state of the NB-IoT device is monitored by the network element controller accessing the NB-IoT device through a remote application programming interface, the operating state of the NB-IoT device comprising at least one of an operating state of the NB-IoT device on an eNodeB side and an operating state of the NB-IoT device on an MME side.
8. The test method according to claim 6 or 7, characterized in that the test method further comprises: and performing at least one of a network restoration test and a fault location test on the NB-IoT device according to the adjusted test case and/or network configuration parameters.
9. The test method according to claim 1 or 2, wherein the test cases are stored on a database server, the test method further comprising:
abstracting the NB-IoT device, the simulation application server, and the database server into objects, and encapsulating test behaviors executed by the objects in a test process into an action primitive set;
packaging the action primitive set into a keyword, and generating the test case by assembling the keyword, wherein the keyword is used for controlling the execution of the test behavior;
And forming a test sleeve by a plurality of test cases according to the running sequence of the configuration.
10. The method of testing of claim 9, wherein a plurality of said test suites form a test suite list, said test suite list including variables used by test cases to construct different ones of said test cases based on different ones of said variables and the same test behavior.
11. The test method of claim 10, wherein the test suite list further includes at least one of an enabling configuration of the test suite, a number of times the test suite is re-run to control the operation of the test case on the NB-IoT device via the test suite list, wherein the number of times the test suite is re-run includes a number of times the test suite is re-run after the test suite fails to operate.
12. The test method according to claim 1 or 2, wherein the test case has a correspondence with the network configuration parameter; correspondingly, the test method further comprises the steps of: and loading the test cases onto a plurality of NB-IoT devices and loading the network configuration parameters onto the SDR device according to the correspondence.
13. The test method of claim 1 or 2, wherein each NB-IoT device runs test cases loaded thereon, comprising: each NB-IoT device runs a test case loaded on the device according to a test control configuration, wherein the test control configuration comprises AT least one of a fixed-time running and a failure running times of the test case, automatic restarting of the NB-IoT device after an AT command is hung up, and stopping of a test after restarting of the NB-IoT device is failed.
14. The test method of claim 1 or 2, wherein an equal number of NB-IoT devices are accessed on NB-IoT serving cells of each of the analog present networks.
15. The testing method of claim 1 or 2, wherein a number of the NB-IoT devices are connected to the SDR device through a power splitter such that a number of the NB-IoT devices interact with the analog application server through the same power splitter.
16. The test method according to claim 1 or 2, characterized in that the test method further comprises: and generating a test report according to a set test statistics item, wherein the test statistics item comprises at least one of the number of times of restarting the NB-IoT device, whether the NB-IoT device is hung up or not, test time delay and the success rate of repeated operation of the test case.
17. The test method according to claim 1 or 2, characterized in that the test method further comprises: generating a test report according to the set test classification item, wherein the test classification item comprises generating the test report based on the NB-IoT device or generating the test report based on the network configuration parameter.
18. A communication system comprising an SDR device and a number of NB-IoT devices connected to the SDR device, the NB-IoT devices configured to perform the test method of any of claims 1-17.
19. An NB-IoT device comprising a memory having a computer executable program stored thereon and a processor that runs the computer executable program to perform the test method of any of claims 1-17.
CN202110185522.3A 2021-02-10 2021-02-10 Test method, communication system and NB-IoT device Active CN112954725B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110185522.3A CN112954725B (en) 2021-02-10 2021-02-10 Test method, communication system and NB-IoT device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110185522.3A CN112954725B (en) 2021-02-10 2021-02-10 Test method, communication system and NB-IoT device

Publications (2)

Publication Number Publication Date
CN112954725A CN112954725A (en) 2021-06-11
CN112954725B true CN112954725B (en) 2023-08-01

Family

ID=76245628

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110185522.3A Active CN112954725B (en) 2021-02-10 2021-02-10 Test method, communication system and NB-IoT device

Country Status (1)

Country Link
CN (1) CN112954725B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114125919A (en) * 2021-11-16 2022-03-01 上海移远通信技术股份有限公司 Test method and device

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104981985A (en) * 2012-11-30 2015-10-14 科诺索斯公司 Methods and systems for a distributed radio communications network
CN209215492U (en) * 2018-09-29 2019-08-06 金卡智能集团股份有限公司 A kind of NB-IoT signal test system
CN110808861A (en) * 2019-11-07 2020-02-18 高新兴物联科技有限公司 Single terminal test configuration method, device and platform thereof
CN210295490U (en) * 2019-06-12 2020-04-10 江苏艾什顿科技有限公司 NB-IoT training experiment box
US10681506B1 (en) * 2018-04-19 2020-06-09 Tango Tango, Inc. System and method for push-to-talk over cellular integration with software defined radio
CN211046956U (en) * 2019-12-26 2020-07-17 中移物联网有限公司 Network parameter acquisition equipment and system
CN111954251A (en) * 2020-08-21 2020-11-17 深圳市晨北科技有限公司 Network testing method, device, equipment and medium

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10367764B2 (en) * 2009-12-22 2019-07-30 Cyara Solutions Pty Ltd System and method for automated contact center agent workstation testing
US10845453B2 (en) * 2012-08-03 2020-11-24 Polte Corporation Network architecture and methods for location services
CN104333486B (en) * 2014-10-31 2018-07-17 大唐移动通信设备有限公司 A kind of network element device test system and method
CN107947907B (en) * 2017-11-24 2020-11-03 北京泰德东腾通信技术有限公司 Method and system for testing consistency of non-access stratum security modes of narrow-band internet of things terminal
WO2019191318A1 (en) * 2018-03-27 2019-10-03 Polte Corporation Network architecture and methods for location services
CN111225383B (en) * 2018-11-27 2023-04-28 中国移动通信集团设计院有限公司 Method and device for testing NB-IoT terminal
CN110289683A (en) * 2019-06-12 2019-09-27 上海大学 Micro-capacitance sensor network transmission performance monitoring system and implementation method based on NB-IOT

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104981985A (en) * 2012-11-30 2015-10-14 科诺索斯公司 Methods and systems for a distributed radio communications network
US10681506B1 (en) * 2018-04-19 2020-06-09 Tango Tango, Inc. System and method for push-to-talk over cellular integration with software defined radio
CN209215492U (en) * 2018-09-29 2019-08-06 金卡智能集团股份有限公司 A kind of NB-IoT signal test system
CN210295490U (en) * 2019-06-12 2020-04-10 江苏艾什顿科技有限公司 NB-IoT training experiment box
CN110808861A (en) * 2019-11-07 2020-02-18 高新兴物联科技有限公司 Single terminal test configuration method, device and platform thereof
CN211046956U (en) * 2019-12-26 2020-07-17 中移物联网有限公司 Network parameter acquisition equipment and system
CN111954251A (en) * 2020-08-21 2020-11-17 深圳市晨北科技有限公司 Network testing method, device, equipment and medium

Also Published As

Publication number Publication date
CN112954725A (en) 2021-06-11

Similar Documents

Publication Publication Date Title
US11507450B2 (en) Systems and methods to reprogram mobile devices via a cross-matrix controller to port connection
US10548033B2 (en) Local portable test systems and methods
CN109218139B (en) Gateway test system
CN109559583B (en) Fault simulation method and device
US10158552B2 (en) Device profile-driven automation for cell-based test systems
CN104978263A (en) Mobile terminal application program test method and mobile terminal application program test system
US20180049054A1 (en) Cloud-based services for management of cell-based test systems
CN109683997B (en) Method for accessing application program interface through sandbox, sandbox and sandbox equipment
CN106776346B (en) Test method and device of CCMTS (China center testing System) equipment
CN104809045A (en) Operation method and device of monitoring script
CN112954725B (en) Test method, communication system and NB-IoT device
CN103746879A (en) Testing system and method for consistency of IPv6 (Internet Protocol Version 6) protocol
CN110764036B (en) Intelligent distribution transformer terminal test method and system
CN110928795A (en) Stability test method and device for upgrading storage system
CN105245379A (en) Method and device for testing network management system through simulating SNMP (simple network management protocol) network element
CN105515804A (en) Apparatus and method for fixing client system errors
WO2014075471A1 (en) Integrated application generating system and method for internet of things terminal
CN110198222A (en) A kind of distribution power automation terminal plug and play test method and test main website
CN112867044A (en) Base station simulation test terminal, test method and device
CN105095063A (en) Application program testing method, apparatus and system
CN115442266A (en) Gateway performance testing method and device, storage medium and electronic device
CN110750453A (en) HTML 5-based intelligent mobile terminal testing method, system, server and storage medium
US20130165099A1 (en) Enhanced System and Method for Custom Programming of Large Groups of Phones Without Requiring Additional Equipment
CN111541589B (en) Method, device and equipment for testing expansion module interface of intelligent terminal
CN109960646B (en) Application testing method and terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant