WO2023104121A1

WO2023104121A1 - Testing method and apparatus for test case, and electronic device and storage medium

Info

Publication number: WO2023104121A1
Application number: PCT/CN2022/137350
Authority: WO
Inventors: 刘三兵
Original assignee: 北京罗克维尔斯科技有限公司
Priority date: 2021-12-09
Filing date: 2022-12-07
Publication date: 2023-06-15
Also published as: CN115437336A

Abstract

A testing method and apparatus for a test case, and an electronic device and a storage medium. The method comprises: acquiring corresponding test data according to test requirement information (101); then, converting the test data into a test case on the basis of test steps in a control policy file (102), wherein the control policy file includes test categories of the test data, and operating or execution parameters required to be executed by the test steps under each test category; and executing the test case to obtain a test result (103).

Description

Test method and device, electronic equipment and storage medium of test case

Cross References to Related Applications

This application is based on a Chinese patent application with application number 202111501555.0 and a filing date of December 9, 2021, and claims the priority of this Chinese patent application. The entire content of this Chinese patent application is hereby incorporated by reference into this application.

technical field

The present disclosure relates to the technical field of vehicles, and in particular to a test method and device, electronic equipment and a storage medium for a test case.

Background technique

The current vehicle remote monitoring platform will monitor the status of vehicle driving data, driving track records and vehicle fault status, and analyze the driving behavior of the driver. For example, when the driver remotely controls the vehicle through the control software (APP or remote platform), including but not limited to the opening and closing control of the vehicle, air conditioning control, window control, engine torque control and engine start and stop control.

At present, the test method can only test the driver's driving behavior, but with the continuous advancement of electrification and intelligence of vehicles, the traditional manual test method can no longer meet the rapid iterative test requirements.

Contents of the invention

The disclosure provides a test method and device for a test case, electronic equipment and a storage medium.

According to an embodiment of the present disclosure, a test method for a test case is provided, including:

Obtain the corresponding test data according to the test requirement information;

The test data is converted into a test case based on the test steps in the control strategy file, wherein the control strategy file contains the test category of the test data and the operation or execution parameters to be executed by the test step under each test category;

Execute the test case to obtain the test result.

In an embodiment of the present disclosure, the converting the test data into test cases based on the test steps in the control strategy file specifically includes:

classifying the test categories of the test data according to the test requirement information;

According to the test category, the operations or execution parameters to be executed by the corresponding test steps are searched from the control strategy file.

In an embodiment of the present disclosure, converting the test data into test cases based on the test steps in the control strategy file includes:

generating test steps from the test data based on the control strategy file, and describing the test steps based on natural language;

Determining the action or execution parameters for the execution of each test step from the control strategy file;

Convert the executed operations or execution parameters of each natural language-based test step into an executable test case.

In an embodiment of the present disclosure, obtaining corresponding test data according to the test requirement information includes:

Acquiring the test data from the vehicle operation data or the actual vehicle test data according to the test requirement information;

The test data is stored in a data warehouse file, and the corresponding relationship between the data warehouse file and the vehicle identification is recorded.

In an embodiment of the present disclosure, the execution of the test case to obtain the test result includes:

Importing the corresponding data warehouse file into the automated test system based on the vehicle identification;

Reading the test case based on the automated test system;

Execute the test case in the data warehouse file to obtain the test result.

In an embodiment of the present disclosure, after the execution of the test case to obtain the test result, the method further includes:

Verifying the test result according to the target result in the test requirement information;

If it is determined that the target result is consistent with the test result, then it is determined that the generated test case is correct;

If it is determined that the target result is inconsistent with the test result, then determine that the generated test case is incorrect, and output the test failure item, the occurrence time of the test failure item and the vehicle identification;

Exporting the running data of the whole vehicle within a preset time including the occurrence time point of the test failure item, and linking it with the test case.

According to another embodiment of the present disclosure, a test device for a test case is provided, including:

The acquisition unit is used to acquire corresponding test data according to the test requirement information;

A conversion unit for converting the test data into test cases based on the test steps in the control strategy file, wherein the control strategy file contains the test categories of the test data and the operations to be performed by the test steps under each test category or execution parameters;

The execution unit is used to execute the test case to obtain the test result.

In an embodiment of the present disclosure, the conversion unit includes:

A division module, configured to divide the test categories of the test data according to the test requirement information;

A search module, configured to search the operation or execution parameters of the corresponding test steps from the control strategy file according to the test category.

In an embodiment of the present disclosure, the conversion unit further includes:

A generating module, configured to generate test steps from the test data based on the control strategy file, and the test steps are described based on natural language;

A determination module, configured to determine the execution operation or execution parameters of each test step from the control strategy file;

The conversion module is used to convert the executed operation or execution parameter of each test step described based on natural language into an executable test case.

In an embodiment of the present disclosure, the acquisition unit includes:

The first acquisition module is used to obtain the test data from the vehicle running data or the actual vehicle test data according to the test requirement information;

The first storage module is configured to store the test data in a data bin file, and record the correspondence between the data bin file and the vehicle identification.

In an embodiment of the present disclosure, the execution unit includes:

An import module, configured to import the corresponding data warehouse file into the automated test system based on the vehicle identification;

A reading module, configured to read the test case based on the automated test system;

An execution module, configured to execute the test case in the data warehouse file to obtain the test result.

In an embodiment of the present disclosure, the device further comprises:

a verification unit, configured to verify the test result according to the target result in the test requirement information after the execution unit executes the test case to obtain the test result;

a first determination unit, configured to determine that the generated test case is correct when the verification unit determines that the target result is consistent with the test result;

A second determining unit, configured to determine that the generated test case is incorrect when it is determined that the target result is inconsistent with the test result;

an output unit, configured to output the test failure item, the occurrence time of the test failure item, and the vehicle identification;

The processing unit is configured to export the vehicle running data within a preset time including the occurrence time point of the test failure item, and link it with the test case.

According to another embodiment of the present disclosure, an electronic device is provided, including:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein,

The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can perform the method described in the preceding aspect.

According to another embodiment of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause the computer to execute the method described in the preceding aspect.

According to another embodiment of the present disclosure, a computer program product is provided, including a computer program, the computer program implements the method as described in the preceding aspect when executed by a processor.

According to another embodiment of the present disclosure, a computer program is provided, the computer program includes computer program code, and when the computer program code is run on a computer, it causes the computer to execute the method described in the preceding aspect.

The test method and device, electronic equipment, and storage medium of the test case provided by the present disclosure, after obtaining the corresponding test data according to the test requirement information, convert the test data into a test case based on the test steps in the control strategy file, wherein, The control strategy file includes test categories of test data and operations or execution parameters to be executed in test steps under each test category, and the test cases are executed to obtain test results. Compared with related technologies, the embodiments of the present disclosure can generate and execute test cases by controlling the test categories recorded in the strategy file and the operations or execution parameters to be executed by the test steps under each test category, thereby improving the test efficiency of the test cases.

It should be understood that what is described in this section is not intended to identify key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will be readily understood through the following description.

Description of drawings

The accompanying drawings are used to better understand the present solution, and do not constitute a limitation to the present disclosure. in:

FIG. 1 is a schematic flow diagram of a test method for a test case provided by an embodiment of the present disclosure;

FIG. 2 is a frame diagram of a test system for a test case provided by an embodiment of the present disclosure;

FIG. 3 is a flow framework schematic diagram of a test method for a test case provided by an embodiment of the present disclosure;

FIG. 4 is a schematic structural diagram of a test device for a test case provided by an embodiment of the present disclosure;

FIG. 5 is a schematic structural diagram of a test device for another test case provided by an embodiment of the present disclosure;

Fig. 6 is a schematic block diagram of an example electronic device 400 provided by an embodiment of the present disclosure.

Detailed ways

Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

The test method, device, electronic device and storage medium of the test cases of the embodiments of the present disclosure are described below with reference to the accompanying drawings.

In related technologies, the test method can only analyze the driving behavior of the driver. For example, when the driver remotely controls the vehicle through control software (Application, APP or remote platform), including but not limited to Open and close lock control, air conditioning control, window control, engine torque control and engine start and stop control. However, with the continuous advancement of electrification and intelligence of vehicles, traditional testing methods can no longer meet the needs of rapid iterative testing.

In the embodiment of the present disclosure, by controlling the test categories containing test data in the strategy file and the operations or execution parameters to be executed by the test steps under each test category, the diversity of test case generation is improved, and the entire test can be shortened by the automated test method. Reduce the time for vehicle testing and improve the efficiency of vehicle testing.

An embodiment of the present disclosure provides a test method for a test case, as shown in FIG. 1 , including: 101-103.

101: Obtain corresponding test data according to the test requirement information.

The implementation of the embodiment of the present disclosure is carried out in the test system of the test case. For ease of understanding, please refer to FIG. 2. FIG. 2 is a schematic structural diagram of a test system of a test case provided by the embodiment of the present disclosure, including: data platform , data conversion system, automated testing platform, test case development platform, data post-processing platform and result display platform.

This step involves the data platform in Figure 2, which mainly receives the vehicle operation data from the remote data monitoring platform and the local operation data uploaded through the preset interface. When there is a test requirement, the data can be screened directly from the data platform according to the test requirement information, which provides at least one of the time period, vehicle driving area, vehicle identification, signal segment and version of the vehicle control system The test requirement information is an empirical value, which needs to be determined according to different test application scenarios, which is not limited in the embodiments of the present disclosure.

In the data conversion system shown in Figure 2, due to the relatively large amount of real test data, it is necessary to process the signal capture time, sampling accuracy, and signal timing according to the test requirement information of the test case and the requirements of the test scenario to ensure When the data is reliable, the operating pressure of the automated test platform is the least.

102: Convert the test data into test cases based on the test steps in the control strategy file.

The control strategy file includes test categories of test data and operations or execution parameters to be executed by test steps under each test category. The test categories and the operations or execution parameters to be executed in the test steps under each test category include but are not limited to the following:

1) State jump or logic test: trigger conditions need to be combined according to the AND or NOR of the signal and the state jump, and the expected result can be judged and confirmed after a specific time delay.

2) Continuous judgment of the continuous signal: It is necessary to continuously judge the rate of change of the continuous signal of the vehicle to ensure that the signal continues to increase or decrease within the specified time, and develop the corresponding change rate checking function according to the requirements, which can realize the above logic test.

3) Memory and comparison of signals: It is necessary to record the value of a certain signal of the whole vehicle at a certain moment, read the signal value again after the vehicle has been running for a period of time, and perform mathematical operations on the values of the two states to verify Whether the requirements of the control strategy are met.

4) Calculation of multi-dimensional table lookup: Different operating conditions of the whole vehicle correspond to different multi-dimensional tables, and corresponding multi-dimensional check functions are developed to dynamically query signal values in different states to meet the test requirements of control strategies.

5) Sleep state judgment: It is necessary to make a comprehensive judgment on the message sending and receiving information, static current and sleep command of the whole vehicle to judge the current state of the vehicle control system.

6) State memory before and after dormancy: many operating states and configuration information of the vehicle need to be recorded in the EEPROM chip, and the above information needs to be verified before and after the vehicle is dormant to ensure the consistency of the information before and after dormancy, and the cache reading function is developed. Access and compare configuration parameter information before and after hibernation, and test the consistency of configuration information.

It should be noted that the control strategy file is pre-defined. When there is a test requirement, the test category of the test data is divided according to the test requirement information, and the corresponding test category is searched from the control strategy file according to the test category. The operation or execution parameters of the test steps, that is, directly according to the test category of the test requirement information, it is enough to find the matching test category and the operation or execution parameters of the test steps under each test category from the control strategy file. This step is applied to the test case development platform in Figure 2.

103: Execute the test case to obtain a test result.

This step is applied to the automated test platform of the system shown in Figure 2. In a specific application, in order to make the processing of the test processing resources more balanced, when executing the test case, first determine the processing resource according to the test category of the test case, and Allocate corresponding computing power space for it, so that the execution of test cases can be more balanced, and the efficiency of test testing can be improved.

The system shown in Figure 2 also includes a post-data data platform and a result display platform. The data post-processing platform needs to count the number of test case executions, the number of successful and failed test case executions, the identification of the test vehicle, and the time of test failure. Output, the result display platform is used to display the collected data.

In the test method of the test case provided by the embodiment of the present disclosure, after obtaining the corresponding test data according to the test requirement information, the test data is converted into a test case based on the test steps in the control strategy file, wherein, in the control strategy file Test categories including test data and operations or execution parameters to be executed in test steps under each test category, execute the test cases to obtain test results, and test the test results according to the target results in the test requirement information. Compared with related technologies, the embodiments of the present disclosure can generate and execute test cases by controlling the test categories recorded in the strategy file and the operations or execution parameters to be executed by the test steps under each test category, thereby improving the test efficiency of the test cases.

As a further refinement of step 102, when converting the test data into test cases based on the test steps in the control strategy file, it is also necessary to generate test steps based on the test data based on the control strategy file, and the test steps are based on Describe in natural language, determine the execution operation or execution parameters of each test step from the control strategy file, and convert the execution operation or execution parameters of each test step based on natural language description into an executable test case.

Since the control strategy file is described in natural language and cannot be directly recognized and run by the machine, it is necessary to convert the control strategy file described in natural language into a script file (test case). In order to facilitate the execution of test cases, the converted test cases should at least include the state definitions of initial conditions, trigger conditions and expected results, which are all recorded in the control strategy file.

It can be seen from the system shown in Figure 2 that the data sources of the data platform include remote operation data and local test data. Based on the different data sources, the corresponding processing methods also have data.

As the first feasible way of the embodiment of the present disclosure, when the data source of the data platform is remote operation data: obtaining the corresponding test data according to the test requirement information specifically includes: obtaining the said test data from the vehicle operation data according to the test requirement information. Test data, storing the test data in a cloud data warehouse file, and recording the corresponding relationship between the data warehouse file and the vehicle identification. The method of generating test cases based on remote running data is automated testing of online data.

In practical applications, the data warehouse file is used to store the test data of the vehicle. As an implementation method of the embodiment of the present disclosure, each vehicle identifier corresponds to the data warehouse file one by one. As another implementation method of the embodiment of the disclosure, The data warehouse file also contains multiple sub-files, which can establish the correspondence between each vehicle ID and a sub-file. Specifically, the embodiment of the present disclosure does not limit the form of storing the test data in the data warehouse file.

As the second feasible way of the embodiment of the present disclosure, when the data source of the data platform is local test data, obtaining the corresponding test data according to the test requirement information specifically includes: obtaining the test data from the actual vehicle test data according to the test requirement, and the actual The vehicle test data is the data uploaded through the preset interface, and the test data is stored in the cloud data warehouse file. Automatic testing of offline data can be realized when uploading data through the preset interface.

For the upload method through the preset interface, there are differences in the specific implementation process from the online method, including the way of classifying the test categories, user scenarios and function failure scenarios settings include:

1) Meter display category: It is necessary to verify the message signals related to the meter display in the actual vehicle test data, and check whether there is any flashing phenomenon of the meter signal.

2) Fault triggering category: It is necessary to verify the message signals related to fault diagnosis in the real vehicle test data, and check whether there are faults that the driver does not perceive or recognize.

In order to clarify two test modes of the test system of the test case, ie online test and offline test, as shown in FIG. 3 , FIG. 3 shows a schematic diagram of a test flow of a test case provided by an embodiment of the present disclosure.

It should be noted that, according to different scenarios, either the first implementation method or the second implementation method can be executed, or, when the test case cannot be tested in the first implementation method, the second implementation method can be executed . The specific embodiments of the present disclosure do not limit this.

Based on the foregoing two implementation methods, it can be seen that the test data may be manually input by the user, or may not be manually input by the user, so that the test case generation test method is more flexible and can meet different needs of users.

In the specific implementation process, regardless of whether the data source of the test case is remote running data or local test data, when the test case is executed to obtain the test result, the implementation method adopted is the same, specifically: first, based on the vehicle identification, the corresponding The data warehouse file is imported into the automated test system, secondly, the test case is read based on the automated test system, and finally, the test case is executed in the data warehouse file. Since the original data is stored in the data warehouse file, executing the test case in the data warehouse file can improve the correctness of its operation.

In order to ensure the correctness of executing the test case, after the test case is executed to obtain the test result, the verification of the test result also needs to be performed, specifically including: verifying the test result according to the target result in the test requirement information, if If it is determined that the target result is consistent with the test result, then it is determined that the generated test case is correct, if it is determined that the target result is inconsistent with the test result, then it is determined that the generated test case is incorrect, and the output export test fails item, the occurrence time of the test failure item and the vehicle identification, export the vehicle running data within the preset time including the occurrence time point of the test failure item, and link it with the test case of the test failure. When the test result is False (the target result is inconsistent with the test result), the automated test system automatically derives the time and vehicle identification of the test failure item, and the test failure occurs within a fixed time before and after the data post-processing platform (for example The 10 minutes, 30 minutes, etc. including the test failure time point) of the whole vehicle running data are automatically exported and linked with the failed test case (or test result), so that the tester can test the wrong test case Check.

To sum up, in the test case test system, the data platform mainly receives or stores test data from remote platforms or locally, and the data conversion system filters and extracts specific time, specific area, specific number and Test data of a specific signal segment, and convert the test data into data warehouse files and store them on the cloud computing platform. The test case development platform needs to write and convert the current test requirement information into executable test cases according to different control logics according to the control strategy file. The automated testing platform imports test cases into data warehouse files for automated verification of control functions, and outputs test results. The data post-processing platform needs to output statistics on the number of test case executions, the number of successes and failures of use case execution, the number of test vehicles and the time of test failure. When the test result is False, it needs to automatically query the data platform to trigger the download of vehicle operation data. It can automatically test the control strategy of the whole vehicle to shorten the test time of the whole vehicle and improve the overall test efficiency. It can realize the automatic operation of the whole chain of the test system, the test methods of different control strategies, and the automatic test of online and offline data. .

Fig. 4 is a schematic structural diagram of a test device for a test case provided by an embodiment of the present disclosure, as shown in Fig. 4 , including:

An acquisition unit 31, configured to acquire corresponding test data according to the test requirement information;

The conversion unit 32 is used to convert the test data into test cases based on the test steps in the control strategy file, wherein the control strategy file contains the test categories of the test data and the operations to be performed by the test steps under each test category or execution parameters;

The execution unit 33 is configured to execute the test case to obtain a test result.

The test device of the test case provided by the present disclosure, after obtaining the corresponding test data according to the test requirement information, converts the test data into a test case based on the test steps in the control strategy file, wherein the control strategy file contains test The test category of the data and the operations or execution parameters to be executed in the test steps under each test category, the test case is executed to obtain the test result, and the test result is tested according to the target result in the test requirement information. Compared with related technologies, the embodiments of the present disclosure can generate and execute test cases by controlling the test categories recorded in the strategy file and the operations or execution parameters to be executed by the test steps under each test category, thereby improving the test efficiency of the test cases.

Further, in an implementation manner of this embodiment, as shown in FIG. 5 , the conversion unit 32 further includes:

A division module 321, configured to divide the test category of the test data according to the test requirement information before the conversion unit converts the test data into test cases based on the test steps in the control strategy file;

The search module 322 is configured to search the corresponding operation or execution parameter of the test step according to the test category from the control strategy file.

Further, in an implementation manner of this embodiment, as shown in FIG. 5 , the conversion unit 32 includes:

A generating module 323, configured to generate test steps from the test data based on the control strategy file;

Determining module 324, is used for determining the operation or execution parameter of the execution of each test step from the control strategy file;

The conversion module 325 is configured to convert the test data into the test case according to the execution operation or execution parameters of each test step.

Further, in an implementation manner of this embodiment, as shown in FIG. 5 , the acquiring unit 31 includes:

The first acquisition module 311 is configured to acquire the test data from the vehicle operation data or the actual vehicle test data according to the test requirement information;

The first storage module 312 is configured to store the test data in a cloud data warehouse file, and record the corresponding relationship between the data warehouse file and the vehicle identification.

Further, in an implementation manner of this embodiment, as shown in FIG. 5 , the execution unit 33 includes:

An import module 331, configured to import the corresponding data warehouse file into the automated test system based on the vehicle identification;

A reading module 332, configured to read the test case based on the automated test system;

An execution module 333, configured to execute the test case in the data warehouse file.

Further, in an implementation manner of this embodiment, as shown in FIG. 5 , the device further includes:

A verification unit 34, configured to verify the test result according to the target result in the test requirement information after the execution unit executes the test case to obtain the test result;

The first determination unit 35 is configured to determine that the generated test case is correct when the verification unit determines that the target result is consistent with the test result;

The second determining unit 36 is configured to determine that the generated test case is incorrect when it is determined that the target result is inconsistent with the test result;

An output unit 37, configured to output the test failure item, the occurrence time of the test failure item and the vehicle identification;

The processing unit 38 is configured to export the running data of the entire vehicle within a preset time period including the occurrence time point of the test failure item, and link it with the test case.

It should be noted that the foregoing explanations for the method embodiment are also applicable to the device of this embodiment, and the principles are the same, and are not limited in this embodiment.

According to the embodiments of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium, a computer program product, and a computer program.

FIG. 6 shows a schematic block diagram of an example electronic device 400 that may be used to implement embodiments of the present disclosure. Electronic device is intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other suitable computers. Electronic devices may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are by way of example only, and are not intended to limit implementations of the disclosure described and/or claimed herein.

As shown in Figure 6, the device 400 includes a computing unit 401, which can be loaded into a RAM (Random Access Memory, Random Access/ accesses the computer program in the memory) 403 to execute various appropriate actions and processes. In the RAM 403, various programs and data necessary for the operation of the device 400 can also be stored. The computing unit 401, ROM 402, and RAM 403 are connected to each other through a bus 404. An I/O (Input/Output, input/output) interface 405 is also connected to the bus 404 .

Multiple components in the device 400 are connected to the I/O interface 405, including: an input unit 404, such as a keyboard, a mouse, etc.; an output unit 407, such as various types of displays, speakers, etc.; a storage unit 408, such as a magnetic disk, an optical disk, etc. ; and a communication unit 409, such as a network card, a modem, a wireless communication transceiver, and the like. The communication unit 409 allows the device 400 to exchange information/data with other devices over a computer network such as the Internet and/or various telecommunication networks.

The computing unit 401 may be various general-purpose and/or special-purpose processing components having processing and computing capabilities. Some examples of computing unit 401 include but are not limited to CPU (Central Processing Unit, central processing unit), GPU (Graphic Processing Units, graphics processing unit), various dedicated AI (Artificial Intelligence, artificial intelligence) computing chips, various operating The computing unit of the machine learning model algorithm, DSP (Digital Signal Processor, digital signal processor), and any appropriate processor, controller, microcontroller, etc. The computing unit 401 executes the various methods and processes described above, such as the test method of the test case. For example, in some embodiments, a testing method of a test case may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 408 . In some embodiments, part or all of the computer program may be loaded and/or installed on the device 400 via the ROM 402 and/or the communication unit 409. When a computer program is loaded into RAM 403 and executed by computing unit 401, one or more steps of the methods described above may be performed. Alternatively, in other embodiments, the computing unit 401 may be configured in any other appropriate way (for example, by means of firmware) to execute the test methods of the aforementioned test cases.

Various implementations of the systems and technologies described above in this paper can be implemented in digital electronic circuit systems, integrated circuit systems, FPGA (Field Programmable Gate Array, Field Programmable Gate Array), ASIC (Application-Specific Integrated Circuit, application-specific integrated circuit) , ASSP (Application Specific Standard Product, dedicated standard product), SOC (System On Chip, system on a chip), CPLD (Complex Programmable Logic Device, complex programmable logic device), computer hardware, firmware, software, and/or realized in combination of them. These various embodiments may include being implemented in one or more computer programs executable and/or interpreted on a programmable system including at least one programmable processor, the programmable processor Can be special-purpose or general-purpose programmable processor, can receive data and instruction from storage system, at least one input device, and at least one output device, and transmit data and instruction to this storage system, this at least one input device, and this at least one output device an output device.

Program codes for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special purpose computer, or other programmable data processing devices, so that the program codes, when executed by the processor or controller, make the functions/functions specified in the flow diagrams and/or block diagrams Action is implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include electrical connections based on one or more wires, portable computer disks, hard disks, RAM, ROM, EPROM (Electrically Programmable Read-Only-Memory, Erasable Programmable Read-Only Memory) Or flash memory, optical fiber, CD-ROM (Compact Disc Read-Only Memory, portable compact disk read-only memory), optical storage device, magnetic storage device, or any suitable combination of the above.

To provide interaction with the user, the systems and techniques described herein can be implemented on a computer having a display device (e.g., a CRT (Cathode-Ray Tube) or LCD ( Liquid Crystal Display (LCD) monitor); and a keyboard and pointing device (such as a mouse or trackball) through which a user can provide input to a computer. Other kinds of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and can be in any form (including Acoustic input, speech input or, tactile input) to receive input from the user.

The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., as a a user computer having a graphical user interface or web browser through which a user can interact with embodiments of the systems and techniques described herein), or including such backend components, middleware components, Or any combination of front-end components in a computing system. The components of the system can be interconnected by any form or medium of digital data communication, eg, a communication network. Examples of communication networks include: LAN (Local Area Network, local area network), WAN (Wide Area Network, wide area network), the Internet, and blockchain networks.

A computer system may include clients and servers. Clients and servers are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also known as cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the problem of traditional physical host and VPS service ("Virtual Private Server", or "VPS") Among them, there are defects such as difficult management and weak business scalability. The server can also be a server of a distributed system, or a server combined with a blockchain.

It should be noted that artificial intelligence is a discipline that studies the use of computers to simulate certain human thinking processes and intelligent behaviors (such as learning, reasoning, thinking, planning, etc.), both at the hardware level and at the software level. Artificial intelligence hardware technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, and big data processing; artificial intelligence software technologies mainly include computer vision technology, speech recognition technology, natural language processing technology, and machine learning/depth Learning, big data processing technology, knowledge map technology and other major directions.

It should be noted that the above-mentioned explanations of the embodiment of the test method for the test case are also applicable to the test device, non-transitory computer-readable storage medium, electronic equipment, computer program product and computer program of the embodiment of the present disclosure, here No longer.

It should be understood that steps may be reordered, added or deleted using the various forms of flow shown above. For example, each step described in the present disclosure may be executed in parallel, sequentially, or in a different order, as long as the desired result of the technical solution disclosed in the present disclosure can be achieved, no limitation is imposed herein.

The specific implementation manners described above do not limit the protection scope of the present disclosure. It should be apparent to those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made depending on design requirements and other factors. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present disclosure shall be included within the protection scope of the present disclosure.

All the embodiments of the present disclosure can be implemented independently or in combination with other embodiments, which are all regarded as the scope of protection required by the present disclosure.

Claims

A test method for a test case, comprising:

Obtain the corresponding test data according to the test requirement information;

The test data is converted into a test case based on the test steps in the control strategy file, wherein the control strategy file contains the test category of the test data and the operation or execution parameters to be executed by the test step under each test category;

Execute the test case to obtain the test result.
The test method according to claim 1, wherein said converting the test data into test cases based on the test steps in the control strategy file specifically comprises:

classifying the test categories of the test data according to the test requirement information;

According to the test category, the operations or execution parameters to be executed by the corresponding test steps are searched from the control strategy file.
The test method according to claim 1 or 2, wherein converting the test data into test cases based on the test steps in the control strategy file comprises:

generating test steps from the test data based on the control strategy file, and describing the test steps based on natural language;

Determining the action or execution parameters for the execution of each test step from the control strategy file;

Convert the executed operations or execution parameters of each natural language-based test step into an executable test case.
The test method according to any one of claims 1 to 3, wherein obtaining corresponding test data according to the test requirement information comprises:

Acquiring the test data from the vehicle operation data or the actual vehicle test data according to the test requirement information;

The test data is stored in a data warehouse file, and the corresponding relationship between the data warehouse file and the vehicle identification is recorded.
The testing method according to claim 4, wherein said executing said test case to obtain a test result comprises:

Importing the corresponding data warehouse file into the automated test system based on the vehicle identification;

Reading the test case based on the automated test system;

Execute the test case in the data warehouse file to obtain the test result.
The test method according to any one of claims 1 to 5, wherein, after the execution of the test case to obtain the test result, the method further comprises:

Verifying the test result according to the target result in the test requirement information;

If it is determined that the target result is consistent with the test result, then it is determined that the generated test case is correct;

If it is determined that the target result is inconsistent with the test result, then determine that the generated test case is incorrect, and output the test failure item, the occurrence time of the test failure item and the vehicle identification;

Exporting the running data of the whole vehicle within a preset time including the occurrence time point of the test failure item, and linking it with the test case.
A test setup for a test case, comprising:

The acquisition unit is used to acquire corresponding test data according to the test requirement information;

A conversion unit for converting the test data into test cases based on the test steps in the control strategy file, wherein the control strategy file contains the test categories of the test data and the operations to be performed by the test steps under each test category or execution parameters;

The execution unit is used to execute the test case to obtain the test result.
The testing device according to claim 7, wherein said converting unit comprises:

A division module, configured to divide the test categories of the test data according to the test requirement information;

A search module, configured to search the operation or execution parameters of the corresponding test steps from the control strategy file according to the test category.
The test device according to claim 7 or 8, wherein the conversion unit further comprises:

A generating module, configured to generate test steps from the test data based on the control strategy file, and the test steps are described based on natural language;

A determination module, configured to determine the execution operation or execution parameters of each test step from the control strategy file;

The conversion module is used to convert the executed operation or execution parameter of each test step described based on natural language into an executable test case.
The testing device according to any one of claims 7 to 9, wherein the acquisition unit comprises:

A first acquisition module, configured to acquire the test data from the vehicle operation data or the actual vehicle test data according to the test requirement information;

The first storage module is configured to store the test data in a data bin file, and record the correspondence between the data bin file and the vehicle identification.
The testing device according to claim 10, wherein said execution unit comprises:

An import module, configured to import the corresponding data warehouse file into the automated test system based on the vehicle identification;

A reading module, configured to read the test case based on the automated test system;

An execution module, configured to execute the test case in the data warehouse file to obtain the test result.
The test device according to any one of claims 7 to 11, further comprising:

a verification unit, configured to verify the test result according to the target result in the test requirement information after the execution unit executes the test case to obtain the test result;

a first determination unit, configured to determine that the generated test case is correct when the verification unit determines that the target result is consistent with the test result;

A second determining unit, configured to determine that the generated test case is incorrect when it is determined that the target result is inconsistent with the test result;

an output unit, configured to output the test failure item, the occurrence time of the test failure item, and the vehicle identification;

The processing unit is configured to export the vehicle running data within a preset time including the occurrence time point of the test failure item, and link it with the test case.
An electronic device comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein,

The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can perform any one of claims 1-6. Methods.
A non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause the computer to execute the method according to any one of claims 1-6.
A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1-6.
A computer program, the computer program comprising computer program code, when the computer program code is run on a computer, it causes the computer to execute the method according to any one of claims 1-6.