KR101354007B1 - Interfacing system synchronizing a time process of a simulation system and a test system based on simulation time and test method for simulation model - Google Patents

Abstract

The present invention relates to an inter-system connecting configuration and a method for testing a simulation model, wherein the configuration includes a discrete event-based simulation system progressing simulation time in an ASAP method, and a test system physically separated from the simulation system and controlling the simulation system and a system to be tested to conduct a test. The simulation system has a test clock interface module for managing the timer of the test system. The test system has a test clock manager module including a timer management queue for synchronization with the simulation time. The test clock manager module is connected to the test clock interface module. Thus, the progress of time between the simulation system and the test system can be synchronized on the basis of the simulation time. [Reference numerals] (10) Test system; (11) Test case; (12) Test execution management module; (13,23) Operating system; (14) Test clock manager; (20) Simulation system; (21) Simulation model; (22) Simulation kernel; (24) Test clock interface

Description

 INTERFACING SYSTEM SYNCHRONIZING A TIME PROCESS OF A SIMULATION SYSTEM AND A TEST SYSTEM BASED ON SIMULATION TIME AND TEST METHOD FOR SIMULATION MODEL }

The present invention relates to a system interworking configuration and a simulation model test method consisting of a test system and a simulation system, and more particularly, a time progress in a physically separated test system and an AS Soon As Possible (ASAP) method. The present invention relates to a method of performing a simulation model test by interworking configuration based on simulation time between discrete event-based simulation systems.

When testing a simulation model, a test system 10 including a test execution management module 12 and a test case 11 and a discrete event-based simulation system including a simulation model 21 (hereinafter referred to as a 'simulation system') A simulation model test method in which the 20 is physically separated is widely used as shown in FIG. 11.

This approach enables more efficient and accurate testing by standardizing test-related resources (test execution management, interfaces, test cases, etc.) and minimizing dependencies on simulation models.

However, in such a test configuration, when time synchronization is not performed between the test system and the simulation system, a time interval between the test system and the simulation system is different, so that a problem such as timeout time management may occur, and thus normal test execution may not be possible. Therefore, time synchronization between the test system and the simulation system is essential for more accurate and efficient simulation testing.

FIG. 12 illustrates the time synchronization problem between the test system 10 and the simulation system 20 in three cases in terms of synchronization. In the interworking between the test system 10 and the simulation system 20, the test system 10 transmits the message A and receives a response through the message B from the simulation system 20 within 1 second to satisfy the protocol conformance. Assuming that the test is performed for 1, if the 1 second time interval of the test system 10 and the 1 second time interval of the simulation system 20 are not the same, it is impossible to perform the test. If the test system 10 does not receive a response message B within one second of its own thinking, the test system 10 determines that the test has failed, and the simulation system 20 transmits the response message B within one second of its own thinking. This is because it is determined to be successful.

In the case of FIG. 12A, both systems are synchronized and tested at the same time interval, but in the case of FIG. 12B, the test system 10 is slower than the simulation system 20. In the situation, the test succeeds because message B is received within 1 second when the test system 10 is judged based on the time of the test system 10, but the test fails because the message B was sent after 1 second when the time of the simulation system 20 is viewed. Done. Similarly, in the case of FIG. 12C, the test system 10 progresses faster than the simulation system 20, so that the test in this situation is determined by the test system 10 time. When received, the test fails, but based on the time of the simulation system 20, the test succeeds because the message B was sent within 1 second. Therefore, when the simulation model test through the interworking between the two systems, the normal test can be performed only when the time between the test system 10 and the simulation system 20 is synchronized.

In order to solve this problem, conventionally, a test system is operated in real time, and the test target system is also operated in real time to solve the problem. Even when the test target system is a simulation system, the above-mentioned problem is solved by operating the simulation kernel to maintain the simulation execution speed in real time as shown in FIG. 12A only when the simulation execution speed is faster than the real time. However, such a solution has to give up the advantage of speeding up the test when the simulation can be performed faster than real time, and it is impossible to test a complex simulation whose simulation speed is slower than real time.

The problem to be solved by the present invention is to synchronize different time domains between a test system that operates based on a real time clock and a simulation system that operates based on a simulation clock when performing a simulation test in an environment where the test system and the simulation system are physically separated. It is to provide a system-to-system interworking configuration and simulation model test method.

The present invention for achieving the above object is a discrete event-based simulation system for performing the simulation time progress in an ASAP method and a test system that is physically separated from the simulation system, and performs the test by controlling the simulation system and the test target system In the simulation model test interlock configuration comprising a, the simulation system includes a test clock interface module for timer management of the test system, the test system includes a test clock manager module including a timer management queue for synchronization with the simulation time In addition, the test clock manager module is interlocked with the test clock interface module, characterized in that to synchronize the time progress of the simulation system and the test system based on the simulation time

Preferably, the test system includes a test case and a test execution management module for executing and managing the test case.

Preferably, the simulation system is characterized in that it comprises a simulation model for performing a specific simulation required, and a simulation kernel for generating and controlling a schedule control command for controlling the simulation model, and collect and manage the simulation results.

In order to achieve the above object, the present invention provides a simulation interworking test method between a physically separated test system and a discrete event-based simulation system,

A test clock manager receives a timer registration request for a simulation event from a test execution management module, and stores information related to the timer based on the time of the test system in a timer management queue. Sending a request to the test clock interface module on the simulation system to request timer registration on the simulation system; And when the test clock interface module receives the timer registration request from the test clock manager, obtains a current time from the simulation kernel, calculates a timeout period based on the simulation time, and registers the timer with the simulation kernel. It is characterized by synchronizing the time progress of the simulation system and the test system based on the simulation time.

Preferably, when the test execution management module receives an event result message from the simulation system before a registered timeout period, the test execution management module requests the test clock manager to cancel the timer. And upon receipt of the timer cancellation request, deleting information associated with the timer from the timer management queue.

Advantageously, if the test execution management module fails to receive an event result message from the simulation system before the registered timeout period, the simulation kernel forwarding a timeout event to a test clock interface; The test clock interface module receiving the timeout event, notifying a test clock manager of a timeout; A test clock manager notifying a test execution management module of occurrence of a timeout of a corresponding timer; And deleting, by the test clock manager, information related to the timer from the timer management queue.

Preferably, when the test clock manager deletes the timer from the timer management queue according to a timer cancellation request of a test execution management module, the test clock manager requests a cancellation of the corresponding timer to the test clock interface module. And the test clock interface module receiving the cancel request includes deleting a timer registered in the simulation kernel.

Preferably, the information related to the timer further includes the owner of the timer and parameter information enclosed at the timeout.

Preferably, the step of calculating the timeout period based on the simulation time and registering the timeout period with the simulation kernel timer may include registering the timeout event with the simulation kernel using the calculated timeout period. It features.

Preferably, the storing of information related to the timer by the test clock manager may include generating a timer identifier when a test clock manager is requested to register a timer for a simulation event from the test execution management module, and includes a timer identifier and an event owner. And storing the parameter in a timer management queue.

Preferably, the identifier is defined as an integer that is sequentially incremented every time a timer is registered from a test start time, and the test execution management module uses the timer identifier when the timer cancel request is made.

In the simulation model test linkage configuration according to the present invention, when using a simulation system that proceeds faster than real time, by performing the test faster than real time, it is possible to improve the test execution speed, and also to simulate a slower than the real-time simulation system Enable interlocked testing.

1 is a diagram illustrating an event management structure of a simulation system according to the present invention.
2 is a diagram illustrating a simulation performing procedure according to a real-time progression scheme.
FIG. 3 is a diagram illustrating a simulation performing procedure according to an ASAP time progress method when it is faster than real time.
4 is a diagram illustrating a simulation performing procedure according to an ASAP time progression method when it is slower than real time.
5 is a diagram illustrating an interlocking configuration between a test system and a simulation system for testing a simulation model according to the present invention.
6 illustrates a test system in accordance with the present invention.
7 shows a simulation system according to the invention.
8 is a diagram illustrating a time progress synchronization method between a test system 10 and a simulation system in a simulation model test method according to the present invention.
9 is a diagram illustrating a procedure of canceling a timer registered before timeout in a method of synchronizing time progress between a test system and a simulation system in a simulation model test method according to the present invention;
FIG. 10 is a diagram illustrating a timeout processing procedure in a time progress synchronization method between a test system and a simulation system in a simulation model test method according to the present invention.
11 is a diagram illustrating an interlocking configuration between a test system and a simulation system for a conventional simulation model test.
12 illustrates a time synchronization problem between a test system and a simulation system in terms of time intervals.

1 shows an event management structure of a simulation system according to the present invention. The simulation system sets the simulation time to zero at the start of the simulation, and the simulation kernel takes control of the simulation system to perform work. When the simulation kernel completes its work at the simulation time, it changes the simulation time from the event list to the time when the registered event occurs so that it occurs as soon as possible from the current simulation time. Then, events that need processing at the current simulation time are transferred to the model, and control of the simulation system is transferred to the model. The model handles the generated events and, when the processing is finished, transfers control of the simulation system back to the simulation kernel. The simulation time does not change while the model processes the event. The simulation kernel, which has been transferred to the control right, performs the above processing again, and the simulation time proceeds.

2 to 4 show contrasts between the ASAP time progress method and the real time progress method according to the present invention in the event progress method of the simulation system.

The real-time time progression method of FIG. 2 is a time progression method for progressing the simulation to a wall clock time and waits until the real time becomes the event processing time and processes the event before processing the event. When processing an event, it delays the simulation until the actual time becomes the event processing time, so that the time progress is performed so that the real time and the simulation time proceed at the same speed. In this real-time time-driven approach, simulations can be used for tests that run faster than real-time, but not for simulations where simulations run slower than real-time. In the test structure that interoperates between the current test system and the simulation system, such a real-time progress method is used, and thus, a test execution time cannot be performed faster than the real-time progress in the interlock test.

On the other hand, the ASAP time progression method shown in FIGS. 3 and 4 is a time progression method for performing the simulation as quickly as possible without removing the relationship between the real time and the simulation time, and all simulations except the special situation requiring the real time progression are performed in ASAP. Is done in a manner. In the time advance method of the ASAP method, the time progress in the simulation and the time progress in real time are different. FIG. 3 illustrates a case in which the ASAP method is used to perform a simulation that progresses faster than real time. In this case, the simulation time is faster than real time, and thus, the interworking test between the test system and the simulation system cannot be performed due to a time mismatch between the two systems. do. Meanwhile, FIG. 4 illustrates a case in which the simulation is performed in a ASAP manner because the simulation is complicated and slower than real time. In this case, the simulation time is slower than real time, and the interworking test between the test system and the simulation system is impossible due to the time mismatch between the two systems. However, in the present invention, in a simulation system in which time progress is performed by the ASAP method, the time progress of the test system is synchronized with the time progress of the simulation system, so that even when the simulation proceeds faster than real time, the interlock test is performed at a higher speed. In addition to enabling this, even if the simulation runs slower than real time, the interlock test time is slower than real time, but test execution is possible.

Hereinafter, with reference to Figure 5, the system and interlocking configuration for the simulation model test according to the present invention will be described in detail. 5 shows a simulation model test structure composed of a test system 10 and a simulation system 20 according to the present invention. The test system 10 according to the present invention includes a test case 11, a test execution management module 12 for managing the execution of the test case 11, and a test clock manager module 14 for synchronizing with the simulation time. do. The simulation system 20 according to the present invention includes a simulation model 21, a test clock interface module 24 and a simulation kernel 22 for timer management of the test system 11. In addition, the test system 10 and the simulation system 20 both include operating systems 13 and 23 for operating the respective systems. As shown in FIG. 5, the test clock manager module 14 of the test system 10 is interlocked with the test clock interface module 24 of the simulation system 10.

6 specifically illustrates a test system 10 according to the present invention. The test system 10 according to the present invention includes a plurality of test cases 11 and a test execution management module 12 for execution management of the plurality of test cases 11, and a test for synchronization with simulation time. A clock manager module 14 and an operating system 13. The test clock manager module 14 further includes a timer management queue 15, generates a timer identifier for each test case 11 as information related to timers of each of the plurality of test cases 11, and The timer identifier, the test case occurrence time, the timer owner, and the parameters are stored in the timer management queue 15. The test clock manager module 14 manages timers for events of the simulation system, and interworks with the test clock manager interface module 24 of the test system, and performs three functions as follows. First, when a timer registration request for a test system event is received from the test execution management module 12 as a timer registration function, a new timer identifier is assigned and then related information is stored and managed in the timer management queue 15. In addition, the registered registration information is transmitted to the test clock interface module 24 on the simulation system 20 by requesting registration of the timer on the simulation system 20. Second, when the test execution management module 12 receives the event result message of the simulation system 20 before the timeout time by the timer cancel function, the test clock manager module 14 cancels the timer of the test execution management module 12. Delete the timer as requested. Third, with the timeout notification function, the test clock manager module 14 notifies the test execution management module 12 of the timeout when the event of the simulation system 20 does not end within the timeout period.

7 illustrates the configuration of the simulation system 20 according to the present invention in detail. The simulation system 20 generates a simulation model 21, a schedule control command for the control of the simulation model 21, and generates a simulation control command and collects and manages simulation results of the simulation kernel 22 and the test system 10. A test clock interface module 24 and an operating system 23 for timer management are included. The test clock interface module 24 calculates a timeout time based on the simulation time, generates a timeout event, and sends identifier information for each timeout event and the timeout event to the simulation kernel 22. Save it. The test clock interface module 24 also includes a timer identifier and a simulation kernel 22 in the timer table to maintain a timer identifier to be passed to the test system when a timer cancels or timeout event occurs before each timer in the test system 10. ) Stores planned event identifier information. In addition, the test clock interface module 24 of the simulation system 20 is connected to the simulation kernel 22 to perform timer registration / minimum on the simulation system 22 and timeout time calculation based on the simulation time reference. In addition, the test clock interface module 24 measures the simulation time with respect to the request of the test clock manager module 14 and requests the test clock manager module 14 when the test clock manager module 14 reaches the requested time as the simulation time. It informs the arrival of the time.

8 illustrates a time progress synchronization method between the test system 10 and the simulation system 20 in the simulation model test method according to the present invention. As shown in Fig. 8, the test clock manager module 14 of the present invention operates as follows.

First, when the test clock manager module 14 receives a timer registration request for a simulation event from the test execution management module 12 in a situation in which the discrete event-based simulation system 20 operates in the ASAP method, the simulation system 20 In step S10, a specific timer identifier to be managed is generated and notified to the test execution management module 12, and the timer identifier event owner and the parameters are stored in the timer management queue 15. The timer registration request includes the owner timeout period of the timer and parameter information to be enclosed at the timeout. The parameter information may be in various forms and contents depending on the test case 11 and the test purpose. In addition, the timer identifier is defined as an integer that is sequentially incremented for each timer registration from the test start time, and the test execution management module 12 uses the timer identifier when canceling the timer before timeout. Next, the test clock manager module 14 performs a timer registration request by generating a timer registration request message including a generated timer identifier and a timeout period, and delivering the message to the test clock interface module 24 of the simulation system 20. (S20)

Next, when the test clock interface module 24 receives the timer registration message from the test clock manager module 14 of the test system 10, the test clock interface module 24 obtains the current simulation time from the simulation kernel 22, and then determines the time based on the simulation time. The timeout event is calculated and the timeout event is registered in the simulation kernel 22 using the same (S30). At this time, the test clock interface module 24 is configured in the timer table and the simulation kernel 22 in the timer table to maintain a timer identifier to be delivered to the test system 10 when the timer cancels before the timeout or when a timeout event occurs. Stores event identifier information.

ASAP-based discrete event-based simulation system equipped with this lightweight test clock interface protocol has a very small protocol overhead for test system and time synchronization, and eliminates unnecessary simulation delays. There is an advantage that can be maintained.

In FIG. 9, in the time progress synchronization method between the test system 10 and the simulation system 20 in the simulation model test method according to the present invention, a procedure (S50) of canceling a timer registered before a timeout is described. It is shown. The timer cancellation processing procedure registered before the timeout is used when the test execution management module 12 releases the previously registered timer when a situation such as normal test completion occurs during the test execution. Except for the above procedure, the remaining steps are the same as those shown in FIGS. 8 and 10, and the procedure for canceling the registered timer will be described in detail with reference to FIG. 9.

When the simulation system 20 notifies the event result before the timeout time for the registered timer arrives, the test execution management module 12 receives the timer identifier received from the test clock manager module 14 when registering the previous timer. The timer cancellation notification is transmitted to the test clock manager module 14, and a cancellation request for the corresponding timer is performed (S51).

Next, the test clock manager module 14 receiving the request for deleting the timer from the test execution management module 12 cancels the registered timer by deleting timer information having the same timer identifier from the timer management queue 15 (S52). )

Preferably, the test clock manager module 14 deletes the information of the timer from the timer management queue 15, and then, generates a timer deletion request message and transmits it to the test clock interface module 24. This deletion request is for avoiding unnecessary message transmission from the test clock interface module 24 when the timeout time of the corresponding timer arrives. Upon receiving the cancellation request, the test clock interface module 24 extracts an event identifier associated with the timer identifier from the timer table, cancels the timeout event scheduled in the simulation kernel 22 using the event identifier, and cancels from the timer table. Removes information about a used timer.

In FIG. 10, the timeout processing procedure S60 is shown in the time progress synchronization method between the test system and the simulation system in the simulation model test method according to the present invention. The remaining steps except for the above procedure are the same as those shown in FIGS. 8 and 9, and the timeout processing procedure will be described in detail with reference to FIG. 10 only.

When the requested timeout time elapses, the simulation kernel 22 transmits a timeout event to the test clock interface module 24 (S61).

Next, the test clock interface module 24 having received the timeout event extracts a timer identifier managed by the test system 10 from the timer table, generates a timer end notification message, and generates a test clock manager of the test system 10. Transfer to module 14 (S62).

Next, the test clock manager module 14 having received the timer end notification message receives a test execution management module that is the owner of the timer that matches the timer identifier described in the timer end notification message among the registered timers stored in the timer management queue 15. 12, the controller transmits the parameter information requested at the time of registering the timer (S63), and deletes the timer stored in the timer management queue 15 from the management queue (S64).

10: Test System 11: Test Case
12: Test Execution Management Module 13: Operating System
14: Test Clock Manager Module 15: Timer Management Queue
20: simulation system 21: simulation model
22: Simulation Kernel 23: Operating System
24: test clock interface module

Claims (11)

In the simulation model test system including a discrete event-based simulation system for performing the simulation time progress in the ASAP method and a test system that is physically separated from the simulation system, and controls the simulation system and the test target system to perform the test,
The simulation system includes a test clock interface module for timer management of a test system,
The test system includes a test clock manager module including a timer management queue for synchronizing with the simulation time,
The test clock manager module is linked with the test clock interface module to synchronize the time progress of the simulation system and the test system based on the simulation time. The method of claim 1,
The test system includes a test case and a test execution management module for executing and managing the test case. The method according to claim 1 or 2,
The simulation system includes a simulation model for performing a specific simulation required, and a simulation kernel for generating and controlling schedule control commands for controlling the simulation model, and collecting and managing simulation results. In the simulation interlocking test method between the physically separated test system and discrete event-based simulation system,
A test clock manager module receiving a timer registration request for a simulation event from a test execution management module, and storing information related to the timer based on a time of the test system in a timer management queue;
Sending, by the test clock manager module, the timer related information to a test clock interface module on a simulation system to request a timer registration on the simulation system;
When the test clock interface module receives the timer registration request from the test clock manager module, obtaining a current time from a simulation kernel, calculating a timeout period based on a simulation time, and registering the timer with the simulation kernel; Thereby synchronizing time progress of the simulation system and the test system based on the simulation time. The method according to claim 4,
When the test execution management module receives an event result message from the simulation system before a registered timeout period, the test execution management module requesting the test clock manager module to cancel a corresponding timer;
And when the test clock manager module receives the timer cancellation request, deleting information related to the timer from the timer management queue. The simulation between the physically separated test system and the discrete event-based simulation system. Interlock test method. The method according to claim 4,
If the test execution management module does not receive an event result message from the simulation system before the registered timeout period, the simulation kernel forwarding a timeout event to a test clock interface;
The test clock interface module receiving a timeout event, notifying a test clock manager module of a timeout;
Notifying, by the test clock manager module, of a timeout of a corresponding timer to a test execution management module;
And deleting, by the test clock manager module, information associated with a corresponding timer from the timer management queue, between the physically separated test system and the discrete event-based simulation system. The method according to claim 5,
The test clock manager module may delete the timer from the timer management queue in response to a timer cancellation request of a test execution management module.
Making, by the test clock manager module, a cancellation request for a corresponding timer to the test clock interface module; and
The test clock interface module receiving the cancellation request includes deleting a timer registered in a simulation kernel. The simulation interworking test method between the physically separated test system and the discrete event-based simulation system. The method according to claim 4,
The information related to the timer further includes simulation information between a physically separated test system and a discrete event-based simulation system, wherein the timer further includes information about the owner of the timer and parameters enclosed at the timeout. The method according to claim 5 or 6,
The step of calculating the timeout period based on the simulation time by the test clock interface module and registering it with the simulation kernel timer,
A simulation interworking test method between a physically separated test system and a discrete event based simulation system, wherein the timeout event is registered in the simulation kernel using the calculated timeout period. The method of claim 9,
The storing of the information related to the timer by the test clock manager module may include:
When the test clock manager module receives a timer registration request for a simulation event from the test execution management module, a timer identifier is generated, and the timer identifier, an event owner, and parameters are stored in a timer management queue. Simulation interlocking test method between the test system separated into discrete and event-based simulation system. The method of claim 10,
The identifier is defined as an integer that is sequentially incremented at each timer registration starting from a test start time, and the test execution management module uses the timer identifier when the timer is canceled. Simulation linkage test method between simulation systems.

Images