KR20060098679A - A system for checking a system in communication system and system method thereof - Google Patents

Abstract

The present invention relates to a verification system for a communication device and an operation method thereof, and the system of the present invention includes a plurality of simulators performing the same functions as the actual system environment, verification equipment to be verified in the system environment, the simulator and The ATE connected to the SUT for TCP / IP communication and testing the SUT for compliance in a simulation environment, a database server storing the test results, and an IP of the DB server. And a configuration unit configured to set an address and control information for controlling the ATE. The system operation method of the present invention is a first step of setting an abnormal test scenario (Test Scenario) and a test case between simulators in an ATE environment program in advance and storing them in a database server; And a second process of calling the stored test scenario and the test case and applying the same to the actual system under test (SUT) and verifying the stored test scenario and the test case, and storing the simulation result.

Simulator, ATE, GUI, SUT

Description

System and method for system verification in communication system {A SYSTEM FOR CHECKING A SYSTEM IN COMMUNICATION SYSTEM AND SYSTEM METHOD THEREOF}

1 is a physical diagram showing an automated system verification system according to the present invention

2 is a logical view of a system verification automation system of the present invention.

3 is a diagram illustrating in detail a system interface unit for interworking with the ATE;

4-10 illustrate an ATE environment program for invoking, setting up, editing, and saving test scenarios.

11 is an actual test configuration using the ATE according to the present invention

The present invention relates to a verification system for communication equipment and an operation method thereof, and more particularly, to a method for verifying a system using an automated test engine (ATE).

In general, in a communication system, when new equipment and systems are developed, system verification is performed for the communication system. In the system verification environment, the system is tested by connecting various simulators that operate in the same way as the actual system. In the system verification environment, the simulator provides a simulation or emulation function for a standardized system or a standardized test. This general system verification method will provide excellent verification capabilities for standardized and formalized test methods. However, in the non-standardized and unstructured tests of the system verification method, the limited machine (Machine) is limited to the system verification. In addition, in the case of system verification that requires repetition, a human error may occur because a developer or a verifier needs to perform a test. That is, in the abnormal system verification, the system verification error rate is lowered due to the above reason.

Accordingly, an object of the present invention is to provide a test verification automation system and a verification method accordingly, which minimizes an error rate for an abnormal situation when verifying a system of communication equipment.

Another object of the present invention is to provide a test verification automation system and a verification method accordingly, in which the system directly verifies when an environment requiring repetition is required when verifying a system of communication equipment.

The present invention for achieving the above-described system is a TCP / IP communication is connected to the simulator and the SUT, a plurality of simulators and verification equipment to be verified in the system environment performing the same function as the actual system environment, Set up the ATE for testing whether the SUT is suitable for a simulation environment, a database server for storing the test result, an IP address of the DB server, and control information for controlling the ATE. Characterized in that it is configured with a configuration (Configuration) to.

The ATE is an interface unit for inputting and outputting data between the simulators and the ATE, a launcher for driving an actual test with the simulator, a graphical user interface for displaying simulation environment settings and menus with the simulator. (Graphic User Interface: GUI) is characterized in that the configuration.

The interface unit includes a data server handler (DB Server Handler) for data transmission and reception with the DB server, a network handler for data input and output with the simulator, and a handler for data input and output with the SUT. It is characterized by.

The system verification method of the present invention for achieving the above-mentioned is to set the abnormal test scenario (Test Scenario) and test case between the simulator in the ATE environment program in advance and store it in the database (Data Base) server And a second process of calling the stored test scenarios and test cases and applying the same to a system under test (SUT) and verifying them, and a third process of storing the simulation results. It is done.

The first process includes a process of logging in to the ATE environment program and a process of creating, editing, and storing a flowchart to set a test scenario for driving a simulation.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. In describing the present invention, when it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted.

In the present description, the system verification automation system of the present invention will first be described, and then, as an example, a system verification method will be described.

1 is a physical diagram illustrating a system verification automation system 100 according to the present invention.

Referring to FIG. 1, the system verification automation system 100 of the present invention includes a plurality of simulators 110, equipment 101 to be verified in the system, and an automated test engine (ATE) 130. It is configured with. The devices are connected to an Internet Protocol (IP) 120 network, and a communication method between the devices communicates using a Transmission Control Protocol (TCP / IP).

The plurality of simulators 110 are instruments that are configured with various device simulators for system configuration and perform the same functions as the actual system environment. In FIG. 1, the simulators 110 illustrate apparatuses required for system configuration. Since the types of the simulators 110 are already known, a description thereof will be omitted. Next, the system under test (SUT) 101 in the system may be represented by a soft switch (SS) or a wireless soft switch (WSS).

Finally, an automated test engine (ATE) 130 is connected to the plurality of simulators 110 and the verification equipment 101 to perform TCP / IP communication. Accordingly, the ATE 130 receives a test result between the verification equipment 101 and the simulators 110 by using TCP / IP communication to a database server (not shown) provided in advance. Will be saved.

Next, an internal configuration diagram between the ATE 130 and the simulators 110 will be described with reference to FIG. 2.

2 is a diagram illustrating an internal configuration logically configuring the system verification automation system of the present invention. Here, the reference numeral used in FIG. 2 is the same reference numeral when the same device used in FIG.

Referring to FIG. 2, the ATE 130 is a graphical user interface (GUI) representing an interface unit 205 connecting to various simulators 110 and a simulation environment with the simulators 110 ( 203). Here, the GUI 203 provides a flow chart and test results for test cast generation, execution, and result determination using test scenarios of the individual simulators 110.

The configuration unit 201 is connected to the ATE 130. In addition, the configuration unit 201 sets advance information between the DB server 207 and the individual simulators 110 for the individual simulators 110 and the ATE 130 environment. The dictionary information is IP address information for the SUT 101 and the DB server 207 to be driven.

Finally, the DB server 207 stores various statistical values such as the results shown in the ATE 130, that is, a test scenario, a test case, a test log, and a test history. And manage the simulators 110.

In detail, the system verification automation system of the present invention sets the IP address of the SUT 101 and the control environment of the ATE 130 from the configuration unit 201, and the ATE 130 sets the respective simulators ( 110 and the actual test result between the WUT which is the SUT 101 is stored in the DB server 207.

FIG. 3 is a diagram illustrating a configuration of a system interface unit 205 for interworking with the ATE 130 in FIG. 2.

Referring to FIG. 3, each device has handlers that perform functions related to data transmission and reception. First, the configuration unit 201 sets an IP address and an ATE configuration to the ATE-GUI 203, the builder 305, and the runner 307 through a config file handler 301. Send information about The ATE-GUI 203 shows a result of setting and editing a test scenario through an ATE-GUI environment setting program so that an operator can check it. The builder 305 functions to create a test environment for the verification equipment 101 from the control information received from the config file handler 301. In addition, the executor 307 drives a simulation of each simulator 110 and the verification equipment, that is, the WSS 101, receives a simulation result from each simulator 110, and stores the simulation result in the DB server 207. In charge.

Next, the network handler 311 checks the connection and abnormality of the simulator 110 and is responsible for processing a command received from the executor 307. The network handler 311 connects through the TCP / IP communication between the simulators 110.

Like the network handler 311, the WSS handler 313 also checks the connection and abnormality of the WSS 110 and processes a command received from the executor 307. The WSS handler 313 and the WSS 101 are connected through TCP / IP communication.

As described above, the system verification automation system 100 of the present invention calls, sets, and edits a test scenario through an ATE configuration program before testing the verification equipment 101, and stores the test scenario in the DB server 207 and actually verifies it. By applying the equipment 101, even in an abnormal state (Ebnormal) can be efficiently verified.

And the system verification automation system 100 of the present invention is largely divided into individual simulator drive form and multi simulator drive form. The individual simulator driving mode performs system verification by calling and executing a scenario provided by the DB server after activating the GUI for the individual simulator, and the multi simulator driving type is synchronized by a test case generated in advance using ATE. Heterogeneous simulators provide various types of test functions.

The system verification automation system 100 should first establish a test scenario by accessing the ATE environment setting program. Next, a method of calling, setting, editing, and storing a test scenario through the ATE configuration program will be described with reference to FIGS. 4 to 10.

4 to 10, the operator first logs in to the ATE configuration program by inputting a user ID and a password from a client on which a GUI for ATE is installed. Then, various symbols 401 for generating a test case appear as shown in FIG. 4. The symbols 401 are elements representing a function for the operator to test and generate and edit a flowchart for a process required by the operator using the symbols 401. Then, after calling the test scenario for driving the simulator, the necessary changes are stored in the DB server 207 after editing. In this process, FIG. 5 shows a test scenario edit window using ATE, and FIG. 6 shows a configuration edit window.

7 is a diagram illustrating a process of providing a criterion for performing the next step through the state analysis of the current step when executing the test case of the individual simulator in the system verification automation system 100 of the present invention. That is, FIG. 7 shows a process of determining whether or not to perform the set threshold.

8 is a diagram illustrating a process of checking various timer settings and a state of a simulator back-end server when the test case is executed and providing the same to the operator. In the process illustrated in FIG. 8, the test result is stored as a file.

9 is a diagram illustrating a process of creating, managing, and executing a batch file for batch execution of a plurality of test cases requiring repeatability, persistence, and a long time.

10 is a diagram illustrating a process of performing a function of providing a log and statistics of a test case result executed by the ATE to the DB server 207 and providing the operator.

Next, a detailed operation related to actual test case execution using the ATE will be described next with reference to FIG. 11.

11 illustrates a test configuration between the Short Message Center (SMC) simulator 501 and a mobile station (MS) 503 using ATE.

Referring to FIG. 11, the server information for the ATE server and the SMC back-end (not shown) is preset in the DB server 207. In addition, a test scenario to be performed must also exist in the DB server 207, and if necessary, modification and storage of the test scenario of the simulator can be performed. The DB server 207 provides a scenario to be run in each simulator and a test case file (.tfd) to be executed in the ATE. The test scenario is inquired and changed using a GUI for a development simulator and an ATE client. And since it is possible to store and provide various types of test environment according to the operator and at the same time through the execution history, log (Log) and statistics collection of the test case is stored and managed in the DB server 207 as a result.

   Log in at the ATE client terminal and call and execute a test case consisting of an origin / incoming test scenario to be executed in the simulator. At this time, the actual execution is in charge of the server for the simulator.

  If a message is edited and transmitted by the calling mobile terminal, it is delivered to the SMC simulator 501, and the delivered message is delivered to the called mobile terminal. Shows the result of the scenario test execution in the form of Pass or Fail and saves the execution result in a file (.trs), and displays the Pass or Fail in the result file and fails. If is also provided, the reason (Fail).

In addition, ATE and Network Element (NE) and Periodic Healthy Check can be used during test case execution to determine connectivity. Therefore, network failure, System Under Test, The test result reflects the abnormality of SUT) or the failure of simulator running test scenario in the test result.If a specific NE continuously performs abnormally, it stops executing the test case and restarts the NE. Will be done.

Meanwhile, in the detailed description of the present invention, specific embodiments have been described, but various modifications are possible without departing from the scope of the present invention. Therefore, the scope of the present invention should not be limited to the described embodiments. It should be determined not only by the scope of the following claims, but also by those equivalent to the scope of the claims.

As described above, the present invention secures a systematic and automated test environment using the ATE environment, thereby minimizing verification error rate by scalability, flexibility, and versatile system verification, and the result obtained by the present invention is used for verification of all developed products. This is possible.

Claims (5)

In the system verification system for communication equipment, A number of simulators that perform the same functions as the actual system environment, Verification equipment to verify in the system environment (System Under Test: SUT), The automated test engine (ATE) connected to the simulator and the SUT to perform a Transmission Control Protocol / Internet Protocol (TCP / IP) communication and testing the SUT for compliance in a simulation environment. and, A database server for storing the test results; And a configuration unit configured to set an IP address of the DB server and control information for controlling the ATE. The method of claim 1, wherein the ATE is An interface unit for inputting / outputting data between the simulators and the ATE; A runner for driving an actual test with the simulator, And a Graphical User Interface (GUI) unit for displaying simulation environment settings and menus with the simulator.  The method of claim 2, wherein the interface unit, A data server handler (DB Server Handler) for transmitting and receiving data with the DB server, A network handler for inputting / outputting data from the simulator; And a handler for inputting and outputting data to and from the SUT. In the system verification method for communication equipment, The first process of setting up abnormal test scenarios and test cases between simulators in an automated test engine (ATE) environment program and storing them in a database server and, A second process of calling the stored test scenarios and test cases and applying the same to an actual verification equipment (System Under Test: SUT); And a third process of storing the simulation result. The method of claim 4, wherein the first process comprises: Logging in to the ATE environment program; And generating, editing, and storing a flowchart in order to set a test scenario for driving a simulation.

Images