KR102570747B1 - Test apparatus and test method - Google Patents

Abstract

The disclosed invention relates to a test device and a test method, and relates to a test device and a test method provided to simultaneously evaluate verification contents for various purposes.
A test method for evaluating a vehicle infotainment system according to an aspect may determine initial conditions of test cases, determine similarity in purpose between test cases having the same initial condition among the test cases, and simultaneously verify test cases having similar objectives. It includes determining test cases and simultaneously verifying test cases that are capable of concurrent verification.

Description

Test device and test method {TEST APPARATUS AND TEST METHOD}

The invention relates to a test device and a test method, and the invention relates to a test device and a test method prepared to simultaneously evaluate verification contents for various purposes.

The vehicle infotainment system is a general term for the entertainment and information systems that can be enjoyed in the vehicle. refers to a device or technology.

The vehicle's infotainment system undergoes a test process to ensure that each function operates properly before being applied to the vehicle. As the vehicle model and destination increase, the cost and time required for the test increases exponentially. Recently, an automated test device has been introduced to overcome this problem.

Conventional automated test devices of infotainment systems are designed to execute automated evaluation for a single verification purpose, so it is structurally difficult to simultaneously evaluate multi-purpose verification contents.

One aspect is to provide a test device and a test method prepared to simultaneously evaluate test cases according to preset criteria. Specifically, it is intended to provide a test device and a test method prepared to simultaneously or sequentially evaluate test cases based on the similarity of test case objectives and the influence of conditions between test cases.

A test method for evaluating a vehicle infotainment system according to an aspect may determine initial conditions of test cases, determine similarity in purpose between test cases having the same initial condition among the test cases, and simultaneously verify test cases having similar objectives. It includes determining test cases and simultaneously verifying test cases that can be concurrently verified.

Also, determining the purpose similarity of the test cases includes determining the purpose similarity of the test cases based on the CAN signal names of the test cases.

In addition, determining the purpose similarity of the test cases determines that the purpose of the test cases included in a group having a higher priority among the preset groups is similar when there are a plurality of groups classified as having a similar purpose among the test cases. include that

Further, the method may further include determining an effect of an execution condition of test cases having different initial conditions among the test cases.

In addition, it may further include determining the impact of execution conditions of test cases having dissimilar purposes.

Also, determining the impact of the execution conditions of the test cases may include determining the impact of the execution conditions of the test cases based on a value defined in a CAN signal name for the test cases.

In addition, if there is no effect on the execution conditions of the test cases, it may include determining test cases that do not affect the execution conditions as test cases that can be concurrently verified, and executing simultaneous verification of the test cases that can be concurrently verified. there is.

In addition, if the execution conditions of the test cases have an influence, it may include determining the test cases that have an effect on the execution conditions as test cases to be independently verified, and sequentially verifying the test cases to be independently verified. .

In addition, for the test cases classified based on the impact of the execution conditions of the test cases, the process of executing simultaneous verification of test cases that can be concurrently verified and the process of sequentially verifying test cases to be independently verified are simultaneously performed. can do.

In addition, the test case may include initial condition information, test procedure information, and expected result information.

Next, a test device that evaluates a vehicle infotainment system determines initial conditions of test cases, determines similarity in purpose between test cases having the same initial condition among test cases, and tests capable of simultaneously verifying test cases having similar purposes. a verification setting unit that determines cases; a verification execution unit that executes simultaneous verification of test cases determined to be capable of simultaneous verification; Includes a verification result integration unit that integrates verification results and provides them to the user.

Also, the verification setting unit may include determining purpose similarity of the test cases based on the CAN signal names of the test cases.

In addition, when there are a plurality of groups classified as having similar purposes among test cases, the verification setting unit may determine that test cases included in a group having a higher priority among preset groups have similar purposes.

In addition, the verification setting unit may determine the influence of execution conditions of test cases having different initial conditions among the test cases.

In addition, the verification setting unit may determine the influence of execution conditions of test cases having dissimilar purposes.

In addition, the verification setting unit may include determining the influence of execution conditions of test cases based on value values defined in CAN signal names for the test cases.

In addition, the verification setting unit determines test cases that have no influence on the execution conditions as test cases that can be concurrently verified, if there is no influence on the execution conditions of the test cases, and the verification execution unit determines the simultaneous verification of the test cases that can be concurrently verified. Verification can be run.

In addition, if the verification setting unit has an effect on the execution conditions of the test cases, the test cases having an effect on the execution conditions are determined as test cases to be independently verified, and the verification execution unit sequentially sets the test cases to be independently verified. may include verification.

In addition, the verification execution unit simultaneously performs simultaneous verification of test cases that can be simultaneously verified and sequential verification of test cases to be independently verified for test cases classified based on the impact of execution conditions of the test cases. can be done

In addition, the test case may include initial condition information, test procedure information, and expected result information.

According to the test apparatus and test method according to one aspect, it is possible to effectively reduce the time and cost required for evaluation by simultaneously evaluating test cases according to preset criteria. At the same time, as the number of evaluation methods increases, the effect will be maximized.

1 is a diagram showing the internal configuration of a vehicle.
2 is a diagram illustrating an AVN terminal provided in a vehicle.
3 is a diagram illustrating a cluster unit provided in a vehicle.
4 is a diagram illustrating a head-up display area provided in a vehicle.
5 is a diagram schematically illustrating a method of transmitting and receiving signals using a CAN communication protocol.
6 is a conceptual diagram of a test device according to an embodiment.
7 is a flowchart of a test method according to an embodiment.
8 illustrates an example of a process of verifying test cases using the test method according to FIG. 7 .
9 is a flowchart of a test method according to another embodiment.
10 illustrates an example of a process of verifying test cases using the test method according to FIG. 9 .

Like reference numbers designate like elements throughout the specification. This specification does not describe all elements of the embodiments, and general content or overlapping content between the embodiments in the technical field to which the present invention pertains will be omitted.

Throughout the specification, when a part is said to be "connected" to another part, this includes not only the case of being directly connected but also the case of being indirectly connected, and indirect connection includes being connected through a wireless communication network. do.

In addition, when a certain component is said to "include", this means that it may further include other components without excluding other components unless otherwise stated.

Terms such as first and second are used to distinguish one component from another, and the components are not limited by the aforementioned terms.

Expressions in the singular number include plural expressions unless the context clearly dictates otherwise.

In each step, the identification code is used for convenience of description, and the identification code does not explain the order of each step, and each step may be performed in a different order from the specified order unless a specific order is clearly described in context. there is.

Hereinafter, embodiments of a test apparatus and method for evaluating a vehicle infotainment system according to the disclosed invention will be described in detail with reference to the accompanying drawings.

A test apparatus and method according to an embodiment relates to an automated verification technology of an infotainment system provided inside a vehicle. In-vehicle infotainment means an information system that can be enjoyed in a vehicle, and more specifically means an entertainment and information system that can be enjoyed in a vehicle. Therefore, prior to describing the present invention, an example of a vehicle infotainment system and a unit constituting a vehicle will be described.

1 is a diagram showing the internal configuration of a vehicle, FIG. 2 is a diagram showing an AVN terminal provided in the vehicle, FIG. 3 is a diagram showing a cluster unit provided in the vehicle, and FIG. 4 is a head-up display provided in the vehicle. It is a diagram showing the area.

Referring to FIG. 1 , an AVN (Audio Video Navigation) terminal 11 may be mounted on a center fascia, which is a central area of the dashboard 2 inside the vehicle 10 . The AVN terminal 11 is a device capable of performing audio, video, and navigation functions in an integrated manner. In addition to audio, video, and navigation functions, the AVN terminal 11 provides various vehicle-related control functions such as connection with external devices, air conditioning control in the vehicle, and lighting control in the vehicle. It is possible to directly perform functions such as displaying related screens and receiving commands from the user.

A speaker 11c capable of outputting sound may be provided inside the vehicle 10 . For example, they may be provided on the left door 4L and the right door 4R, respectively, and may also be provided on the rear seat side. The speaker 11c may output sound necessary for the AVN terminal 11 to perform an audio function, a video function, a navigation function, and the like.

A cluster unit 12 is provided in an area of the dashboard 2 adjacent to an area where the steering wheel 3 is provided. The cluster unit 12 displays various types of information related to driving of the vehicle, allowing the driver to view the cluster unit 12 and check necessary information without significantly diverging the driver's gaze from the front while driving.

Although not shown in the drawing, it is also possible that a head-up display unit is further provided on the dashboard 2 so that visual information provided to the driver is displayed on the windshield 1.

Referring to FIG. 2 , an image output from the head-up display unit may be displayed through the head-up display area 1a of the windshield 1 .

Referring to FIG. 3 , the AVN terminal 11 may include an AVN display 11a and an AVN input unit 11b. The AVN display 11a may display an audio screen, a video screen, a navigation screen, and the like, and may include a Liquid Crystal Display (LCD), a Light Emitting Diode (LED), a Plasma Display Panel (PDP), an Organic Light Emitting Diode (OLED), It may be implemented as a display device such as a cathode ray tube (CRT).

The AVN input unit 11b receives a user command for controlling the AVN terminal 11 . As shown in FIG. 3 , it is possible to implement a button type in an area adjacent to the AVN display 11a or a touch panel. When implemented as a touch panel, it is possible to configure a touch screen by being mounted on the front of the AVN display 11a.

Referring to FIG. 4 , the cluster unit 12 may be provided with a speed gauge 12c indicating the current speed of the vehicle 10 and an RPM gauge 12b indicating the RPM of the vehicle 10. In addition, the vehicle ( A cluster display 12a displaying information about 10) on a digital screen may be further provided.

The AVN terminal 11, the cluster unit 12, and the head-up display unit may share information by interworking with each other. For example, navigation information provided by the AVN terminal 11 may be transmitted to the cluster unit 12 or the head-up display unit and visually displayed on the cluster display 12a or the head-up display area 1a. To this end, necessary signals may be exchanged with each other through the vehicle's internal communication protocol.

The disclosed invention determines the purpose similarity of test cases based on the name of a CAN signal in an internal communication protocol of a vehicle in order to simultaneously and automatically evaluate test cases having a similar purpose among vehicle infotainment systems. Therefore, prior to describing the present invention, a method for transmitting and receiving signals using the CAN communication protocol will be briefly described.

5 is a diagram schematically illustrating a method of transmitting and receiving signals using a CAN communication protocol.

Examples of vehicle internal communication protocols include, but are not limited to, CAN (Controller Area Network), LIN (Local Interconnection Network), FlexRay, Ethernet, and the like. However, in the embodiments to be described later, for convenience of description, the description will be limited to using the CAN communication protocol.

When internal communication of a vehicle is performed using CAN communication, as shown in FIG. 5, a plurality of units (U_1, U_2, U_3) transmit a CAN signal to one CAN bus (BUS) or transmit a necessary CAN signal. can request Each unit may include an Electronic Control Unit (ECU) that controls the operation of the unit, a CAN controller that generates a CAN signal to be transmitted, and a CAN driver that transmits the CAN signal to the CAN bus or receives the CAN signal from the CAN bus. . Here, each unit may serve as a node in CAN communication, and the CAN signal may be transmitted in the form of a message.

Hereinafter, an embodiment of a test apparatus and method for evaluating a vehicle infotainment system according to the above description will be described in detail.

6 is a conceptual diagram of a test device 100 according to an embodiment.

Referring to FIG. 6 , the test apparatus 100 for evaluating a vehicle infotainment system according to an embodiment includes a verification setting unit 110, a verification execution unit 120, and a verification result integration unit 130. can include

The verification setting unit 110 determines initial conditions of test cases.

Hereinafter, in this specification, a test case is written for multi-purpose simultaneous verification of various units in a vehicle, and may include initial condition information, test procedure information, and expected result information. Here, the initial condition of the test case is a condition that must be satisfied in advance when verifying units to be evaluated, and may mean a condition commonly preceded to verify various units.

According to the present invention, redundant operations are performed at one time and only unique operations are performed simultaneously for highly efficient automated evaluation. To this end, it is necessary to identify redundant and unique operations of test cases. Some test cases have common initial conditions. After identifying the initial conditions of test cases with common initial conditions as redundant actions and identifying test procedures as unique actions, the redundant actions are performed at once and only unique actions are performed simultaneously. If it is performed, highly efficient automated evaluation may be possible. To this end, in the test apparatus 100 according to the disclosed invention, the verification setting unit 110 determines initial conditions of test cases once.

The verification setting unit 110 determines the purpose similarity of test cases having the same initial condition among the test cases. In this specification, that test cases have similar purposes means that the corresponding test cases have common vehicle environment factors. For example, vehicle environmental factors for a test case for the purpose of verifying a temperature-related factor of an air conditioner may include an air conditioning mode, wind strength, driver information, and passenger information. Accordingly, test cases having air conditioning mode, wind speed, driver information, and passenger information may be classified as test cases having similar purposes. In general, when test cases have similar objectives, they have the same initial conditions. However, having the same initial conditions does not necessarily mean that the test cases have similar objectives.

The purpose similarity of the test cases can be determined based on the CAN signal names for the test cases, and more specifically, based on the CAN signal names for the test cases having the same initial condition. Here, the CAN signal name may include control object information and control content information, and the value value defined in each CAN signal name may include detailed control content information on the control object. For example, if “Temp” is included in the CAN signal name, it can be determined that the purposes of the corresponding test cases are similar, and a detailed classification method will be described later.

When there are a plurality of test case groups classified as having similar objectives, the verification setting unit 110 may determine similarity of objectives among the test cases in a method described below. The verification setting unit 110 may determine that test cases included in a preset group among test cases having the same initial condition have similar purposes. Specifically, the verification setting unit 110 may determine that test cases included in a group having a higher priority among preset groups targeting test cases having the same initial condition have similar purposes. Here, a plurality of groups may be preset for the same initial condition, and different groups may be preset according to types of initial conditions. In addition, a plurality of groups for the same initial condition may have preset priorities for different groups.

The verification setting unit 110 may determine test cases classified as having similar purposes according to the above-described method as test cases capable of simultaneous verification. Subsequently, the verification executor 120 may perform simultaneous verification on test cases classified as having similar purposes, and the verification result integration unit 130 may integrate verification results and provide them to the user.

The verification result integration unit 130 may output a control signal to the AVN terminal 11 of the vehicle so that the verification result is provided through the display of the AVN terminal 11. Through this, verification results for test cases can be provided. Meanwhile, a method of providing a verification result to a user is not limited to the above-described examples, and should be broadly understood as a concept including all methods for allowing a user to perceive.

The test device 100 according to the disclosed invention identifies the initial conditions as redundant operations and simultaneously performs test procedures for test cases with similar purposes, thereby enabling automated evaluation with high efficiency.

Meanwhile, according to embodiments, the verification setting unit 110 may determine the influence of execution conditions of test cases. Specifically, the verification setting unit 110 determines the impact of execution conditions on test cases classified as having dissimilar initial conditions and test cases classified as having dissimilar purposes according to the design of the test apparatus 100. And, of course, it is possible to determine the effect of execution conditions on all test cases according to embodiments.

Hereinafter, in this specification, the meaning of the execution condition influence of test cases means a narrower concept than the purpose similarity of test cases. In other words, the case where execution conditions of test cases have influence means a case where it is difficult to simultaneously execute the corresponding test cases. In other words, when adjusting the wind strength of the air conditioner to high, medium, or low, it is difficult to simultaneously execute the upper, middle, and lower steps, and in this case, each test case can be classified as test cases having an influence between execution conditions. .

The verification setting unit 110 may determine the influence of execution conditions of test cases based on value values defined in CAN signal names of test cases. As described above, the CAN signal name may include control object information and control content information, and the value set in the CAN signal name may include detailed control content information on the control object. If the value values defined in the CAN signal names of the test cases have a linear relationship, the verification setting unit 110 classifies the corresponding test cases as test cases that have an effect on the execution conditions, and determines the remaining test cases to the execution conditions. It can be classified as non-impact test cases.

The verification setting unit 110 may determine test cases having independent purposes as test cases capable of simultaneous verification. In this case, the verification execution unit 120 executes simultaneous verification on test cases classified as having no effect on the execution conditions, and the verification result integration unit 130 integrates verification results and provides them to the user. .

Meanwhile, if the verification setting unit 110 has an influence on the execution conditions of the test cases, it may determine test cases having an influence on the execution conditions as test cases to be independently verified. Here, the meaning of verifying the test cases independently means that the test cases are not verified simultaneously. In this case, the verification executor 120 sequentially executes verification on the test cases to be independently verified, and the verification result integration unit 130 integrates verification results and provides them to the user.

The test device 100 according to the disclosed invention distinguishes between cases where the execution conditions of the test cases have an effect and cases where the execution conditions of the test cases are not affected, and even when the purpose is dissimilar, the test procedures of the test cases that do not affect the execution conditions can be performed at the same time. By allowing it to be performed, highly efficient automated evaluation was performed.

Above, the configuration of the test apparatus 100 according to an embodiment has been described. Hereinafter, for better understanding, a test method according to an embodiment will be described in more detail with reference to the accompanying drawings.

7 is a flowchart of a test method according to an embodiment, and FIG. 8 illustrates an example of a process of verifying test cases by the test method according to FIG. 7 . 7 and 8 are examples of test methods for evaluating test cases based on similarity of purpose between test cases.

Referring to FIG. 7 , the test method according to an embodiment determines initial conditions of test cases (200), and determines similarity in purpose between test cases having the same initial condition (210, 220). , A process of determining test cases with similar purposes as test cases capable of simultaneous verification (240), developing an automation script for the test cases (250), and simultaneously verifying the test cases based on the developed automation script ( 260). In addition, a process of determining test cases whose initial conditions are not the same as test cases to be verified independently is further included (270).

Hereinafter, an embodiment of the invention will be described by taking a case in which test cases are prepared as shown in [Table 1] as an example.

division CAN Signal Name Information included value value Test Case 1 (TS1) DATC_DrTempDispF Initial condition (A), test procedure (TA1), expected result (a1) Test Case 2 (TS2) DACT_PsTempDispC Initial condition (A), test procedure (TA2), expected result (a2) Test Case 3 (TS3) DACT_DrTempDispC Initial condition (A), test procedure (TA3), expected result (a3) Test Case 4 (TS4) DACT_AutoDefogBlink Initial condition (A), test procedure (TA4), expected result (a4) Test Case 5 (TS5) DACT_MainBlowerDisp Initial condition (A), test procedure (TA5), expected result (a5) v1=0x1: 0 level Test Case 6 (TS6) DACT_MainBlowerDisp Initial condition (A), test procedure (TA6), expected result (a6) v2=0x2: 1 level Test Case 7 (TS7) DACT_MainBlowerDisp Initial condition (A), test procedure (TA7), expected result (a7) v3=0x3: 2 levels Test Case 8 (TS8) AMP_HFVolumeStep Initial condition (B), test procedure (TB1), expected result (b1) Test Case 9 (TS9) HU_AVM_CameraOff Initial condition (C), test procedure (TC1), expected result (c1)

Referring to FIG. 7 , a step of first determining initial conditions of test cases (200) and classifying test cases having the same initial condition among the test cases (210) is performed. The verification setting unit 110 analyzes the test cases to determine initial conditions of the test cases, and classifies test cases having the same initial conditions among the test cases.

Referring to [Table 1] and FIG. 8, the verification setting unit 110 determines the initial conditions of the test cases for test cases 1 to 9, and test cases 1 to 7 with the same initial condition as A among the test cases. can be classified.

Next, a process of determining purpose similarity of test cases classified as having the same initial condition among the test cases is performed (220). The verification setting unit 110 may determine purpose similarity of test cases based on the CAN signal name.

Referring to [Table 1] and FIG. 8, the verification setting unit 110 may classify test cases 1 to 3, which commonly include “Temp” among test cases 1 to 7, into a group having a similar purpose, and “MainBlower Test cases 5 and 7, which commonly include ", can be classified into groups with similar goals.

There is no particular problem when the group classified as having a similar purpose is a single group, but when there are two or more groups classified as having a similar purpose as in the above example, a process described below may be additionally performed.

The verification setting unit 110 may determine that test cases included in a group having a higher priority among preset groups targeting test cases having the same initial condition have similar purposes.

For example, CAN signal names for test cases 1 to 7 start with "DATC", which correspond to test cases for verifying an air conditioner and each have the same initial condition A. In this case, the group for the initial condition A may be previously set to groups related to the air conditioner, for example, the purpose of verifying the temperature related factor (first group), the purpose of verifying the wind strength related factor (second group), and the like. If a word such as "Temp" is included in the CAN signal name, it can be classified for the purpose of verifying a temperature-related factor, and if a word such as "MainBlower" is included in the CAN signal name, it can be classified for the purpose of verifying a factor related to wind strength. .

The first group and the second group may have priority over other groups according to a certain criterion. For example, the first group may be set to have priority over the second group according to the intention of the designer, and according to an embodiment, when the number of test cases belonging to a specific group, for example, the first group is large, Group 1 may be set to have priority over Group 2.

The verification setting unit 110 determines the purpose similarity of test cases based on a group having a high priority. In this embodiment, for convenience of explanation, the case in which the first group is set to have a higher priority than the second group will be described as an example, and in this case, the test case including "Temp" in common. 1 to 3 are classified into groups having the same initial conditions and similarities in purpose.

Next, a process of determining test cases that are determined to have similar purposes as test cases capable of simultaneous verification is performed (240). Referring to FIG. 8 , the verification setting unit 110 may determine test cases 1 to 3 having similar purposes as test cases capable of simultaneous verification.

Next, an automated script development step for the test cases (250) and a step of simultaneously verifying the test cases are performed (260). Referring to FIG. 8 , the verification execution unit 120 develops automation scripts for test cases 1 to 3 and simultaneously verifies the test cases based on the developed automation scripts. The verification execution unit 120 identifies the initial conditions A for test cases 1 to 3 as redundant operations based on the developed automation script, identifies the test procedures for test cases 1 to 3 as unique operations, and then performs the redundant operation. , the initial condition A is executed at once, and the test procedures for test cases 1 to 3, which are unique operations, are simultaneously performed.

Next, a step of integrating verification results of test cases to be verified and providing them to the user may be performed. Referring to FIG. 8 , the verification result integration unit 130 may integrate verification results for test cases 1 to 3 and provide the verification results to the user.

Meanwhile, test cases determined to have dissimilar purposes may be independently determined as test cases to be verified (270).

Next, a test method according to another embodiment will be described.

9 is a flowchart of a test method according to another embodiment, and FIG. 10 illustrates an example of a process of verifying test cases by the test method according to FIG. 9 . 9 and 10 relate to a test method further including a process of evaluating test cases based on the influence of execution conditions of the test cases.

Referring to FIG. 9 , the test method according to an embodiment determines the effect of execution conditions of test cases in the process described in FIG. A process of determining test cases without test cases as test cases capable of concurrent verification (290), developing an automation script for the test cases (300), and simultaneously verifying the test cases based on the developed automation script (310) ). In order to help understand the test method according to the present embodiment, the embodiment of the present invention will be described by taking an example of a case in which test cases are prepared as shown in [Table 1] exemplified above.

Referring to FIG. 9 , first, initial conditions of test cases are determined (200), and test cases having the same initial condition are classified (210). The verification setting unit 110 analyzes the test cases to determine initial conditions of the test cases, and classifies test cases having the same initial conditions and test cases having different initial conditions among the test cases.

Referring to [Table 1] and FIG. 10, the verification setting unit 110 determines the initial conditions of the test cases for test cases 1 to 9, and test cases 1 to 7 with the same initial condition as A among the test cases. , and other test cases 8 and 9 can be classified as initial conditions B and C, respectively, among the test cases.

Next, a process of determining purpose similarity of test cases classified as having the same initial condition among the test cases is performed (220). The verification setting unit 110 may determine the purpose similarity of the test cases based on the CAN signal name. Hereinafter, descriptions overlapping with those previously described in FIGS. 7 and 8 in relation to the process of determining the similarity of purpose of the test cases will be omitted.

As described above, test cases 1 to 3 determined to be similar in purpose are determined as test cases capable of simultaneous verification (240). Subsequently, an automated script development step for the corresponding test cases (250) and a step of simultaneously verifying the test cases are performed (260). When the verification of the test cases is completed, a step of integrating the verification results and providing them to the user is performed, and descriptions overlapping with those described above will be omitted.

Test cases 4 to 7, which are determined to have dissimilar purposes, are provided to a process of determining the impact of execution conditions of the test cases (280).

In addition, test cases 9 and 9 determined to have different initial conditions are also provided to the process of determining the impact of the execution conditions of the test cases (280).

Determining the influence of execution conditions of test cases may be performed based on value values defined in CAN signal names of test cases (280). Hereinafter, details related to determining the influence of execution conditions of test cases are the same as those described above, and redundant descriptions will be omitted.

For better understanding, an example of determining the impact of execution conditions of test cases is as follows. Referring to [Table 1] and FIG. 10, first, the verification setting unit 110 determines the impact of the execution conditions of test cases 4 to 9. The verification setting unit 110 classifies test cases 5 to 7 in which the value values have a linear relationship based on the value values defined in the CAN signal names of the test cases as test cases that have an effect on the execution conditions of the test cases and the remaining test cases 4, 8, and 9 can be classified as test cases that do not affect the execution condition.

Next, a step of determining the possibility of simultaneous verification of the test cases based on the influence of execution conditions of the test cases is performed. First, test cases that do not affect execution conditions are determined as test cases that can be verified concurrently (290). Referring to FIG. 10 , the verification setting unit 110 determines test cases 4, 8, and 9, which have no influence on the execution conditions, as test cases capable of concurrent verification.

Subsequently, an automation script development step for test cases determined to be capable of simultaneous verification (300) and a step of simultaneously verifying the test cases are performed (310). Referring to FIG. 10 , the verification execution unit 120 develops automation scripts for test cases 4, 8, and 9, and simultaneously verifies the test cases based on the developed automation scripts. In this embodiment, test cases 4, 8, and 9 have different initial conditions as A, B, and C, respectively, so the verification setting unit 110 performs each test together with the initial conditions for test cases 4, 8, and 9. By identifying the procedures as unique operations, the verification execution unit 120 simultaneously performs the initial conditions and test procedures (A-TS4, B-TS8, and C-TS9) for test cases 4, 8, and 9, which are unique operations. can do.

Subsequently, a step of integrating the verification results of the test cases to be verified and providing them to the user is performed. Referring to FIG. 10 , the verification result integration unit 130 may integrate verification results for test cases 4, 8, and 9 and provide the verification results to the user. In this case, the verification result integration unit 130 integrates the previously performed verification results for test cases 1 to 3 and the verification results for test cases 5 to 7 described later, and integrates the verification results for test cases 1 to 9. and provide it to the user.

Meanwhile, test cases that have an effect on execution conditions are determined as independently verifiable test cases (320). Referring to FIG. 10 , the verification setting unit 110 determines test cases 5 to 7, which have an effect on the execution condition, as tests that can be independently verified, and can be set to be sequentially verified. In this case, the verification setting unit 110 sets the verification order of the test cases so that the verification process in which test cases 5 to 7 are sequentially verified is performed simultaneously with the step of verifying test cases 4, 8, and 9 simultaneously. A test method capable of high-efficiency automated evaluation can be provided.

Subsequently, an automation script development step for test cases determined to be independently verifiable (330) and a step of sequentially verifying the test cases are performed (340). Referring to FIG. 10 , the verification execution unit 120 develops automation scripts for test cases 5 to 7 and sequentially verifies test cases 5 to 7 based on the developed automation scripts. In this embodiment, test cases 5 to 7 each have the same initial condition as A, so the verification setting unit 110 identifies the initial condition A as a redundant operation and identifies the test procedure as a unique operation, so that the verification execution unit ( 120) may execute test procedures TS5, TS6 and TS7 sequentially after executing initial condition A.

Subsequently, a step of integrating the verification results of the test cases to be verified and providing them to the user is performed. Referring to FIG. 10 , the verification result integration unit 130 may integrate verification results for test cases 5 to 7 and provide the verification results to the user. In this case, the verification result integration unit 130 may integrate the verification results of test cases 1 to 4, 8, and 9 together as described above, and may provide the integrated verification results of test cases 1 to 9 to the user. there is.

As above, the disclosed embodiments have been described with reference to the accompanying drawings. Those skilled in the art to which the present invention pertains will understand that the present invention can be implemented in a form different from the disclosed embodiments without changing the technical spirit or essential features of the present invention. The disclosed embodiments are illustrative and should not be construed as limiting.

10: vehicle
11: AVN terminal
100: test device
110: verification setting unit
120: verification execution unit
130: verification result integration unit

Claims (20)

A test method for evaluating a vehicle infotainment system,
determine the initial conditions of the test cases,
Among the test cases, the purpose similarity of the test cases having the same initial condition is determined;
Determine the impact of execution conditions of test cases with similar objectives,
Determine test cases with similar objectives and test cases with dissimilar objectives and no effect on the execution conditions as test cases capable of simultaneous verification,
A test method comprising simultaneously verifying test cases capable of simultaneous verification. According to claim 1,
Judging the purpose similarity of the test cases,
A test method comprising determining purpose similarity of test cases based on CAN signal names for the test cases. According to claim 1,
Judging the purpose similarity of the test cases,
And if there are a plurality of groups classified as having similar purposes among the test cases, determining that test cases included in a group having a higher priority among preset groups have similar purposes. According to claim 1,
The test method further comprising determining an effect of an execution condition of test cases having different initial conditions among the test cases. delete The method of any one of claims 1 and 4,
Determining the impact of the execution conditions of the test cases,
And determining the impact of execution conditions of the test cases based on value values defined in CAN signal names for the test cases. delete According to claim 1,
If the test cases have an effect on the execution conditions, determine the test cases that have an effect on the execution conditions as test cases to be verified independently;
A test method comprising sequentially verifying the test cases to be independently verified. According to claim 8,
For the test cases classified based on the impact of the execution conditions of the test cases,
A test method that simultaneously performs the simultaneous verification of test cases capable of concurrent verification and the sequential verification of test cases to be independently verified. According to claim 1,
The test case is
A test method that includes initial condition information, test procedure information, and expected result information. In a test device for evaluating a vehicle infotainment system,
a verification setting unit that determines initial conditions of test cases, determines similarity in purpose of test cases having the same initial condition among the test cases, and determines test cases having similar objectives as test cases that can be simultaneously verified;
a verification execution unit that executes simultaneous verification of the test cases determined to be capable of the simultaneous verification;
A verification result integration unit that integrates the verification results and provides them to the user;
The verification setting unit,
A test device that determines the impact of execution conditions of test cases having similar objectives. According to claim 11,
The verification setting unit,
A test device comprising determining purpose similarity of test cases based on CAN signal names for the test cases. According to claim 11,
The verification setting unit,
When a plurality of groups are classified as having similar purposes among the test cases, a test device that determines that test cases included in a group having a higher priority among preset groups have similar purposes. According to claim 11,
The verification setting unit,
A test device for determining the influence of execution conditions of test cases having different initial conditions among the test cases.
delete According to any one of claims 11 and 14,
The verification setting unit,
And determining the impact of execution conditions of the test cases based on value values defined in CAN signal names for the test cases. According to claim 16,
The verification setting unit,
If there is no effect on the execution conditions of the test cases, determining test cases that do not affect the execution conditions as test cases that can be simultaneously verified,
The verification execution unit,
A test device that executes simultaneous verification of test cases capable of simultaneous verification. According to claim 17,
The verification setting unit,
If the test cases have an effect on the execution conditions, determine the test cases that have an effect on the execution conditions as test cases to be verified independently;
The verification execution unit,
A test device comprising sequentially verifying the test cases to be independently verified. According to claim 18,
The verification execution unit,
For the test cases classified based on the impact of the execution conditions of the test cases,
A test device that simultaneously performs the simultaneous verification process of test cases capable of simultaneous verification and the process of sequentially verifying the test cases to be independently verified. According to claim 11,
The test case is
A test rig containing initial condition information, test procedure information, and expected result information.

Images