CN113485914A

CN113485914A - Vehicle-mounted voice SDK testing method, device and system

Info

Publication number: CN113485914A
Application number: CN202110645582.9A
Authority: CN
Inventors: 马天泽
Original assignee: Mgjia Beijing Technology Co ltd
Current assignee: Mgjia Beijing Technology Co ltd
Priority date: 2021-06-09
Filing date: 2021-06-09
Publication date: 2021-10-08
Anticipated expiration: 2041-06-09
Also published as: CN113485914B

Abstract

The invention provides a vehicle-mounted voice SDK testing method, a device and a system, comprising the following steps: acquiring test information of the vehicle-mounted voice SDK to be tested; determining test case information according to the test information, wherein the test case information comprises test application information and test comparison information; sending the test application information to a test terminal; receiving test result information sent by the test terminal, and comparing the test result information with the test comparison information, wherein the test result information is generated by the test terminal according to the test callback and execution result of the vehicle-mounted voice SDK to be tested to the test application information; and generating a test report according to the comparison result. Therefore, the test callback of the test application information is tested based on the vehicle-mounted voice SDK, the test instructions cannot influence each other in the test process of the vehicle-mounted voice SDK, and the test stability of the vehicle-mounted voice SDK is improved.

Description

Vehicle-mounted voice SDK testing method, device and system

Technical Field

The invention relates to the technical field of vehicle voice, in particular to a vehicle-mounted voice SDK testing method, device and system.

Background

The vehicle-mounted voice system is an intelligent voice system for improving driving safety and enhancing driving experience, and can assist a driver to realize functions of voice navigation, voice music playing and the like. The in-vehicle voice system generally includes a client installed on a vehicle and a server operating in the cloud. The voice function test between the client and the cloud server is one of core links in the online Development process of vehicle-mounted voice SDK (software Development kit). When the voice function is tested, different voice audios are required to be input into the vehicle-mounted voice SDK, the vehicle-mounted voice SDK executes voice audio operation, an operation result is transmitted to the server at the cloud end, and the server at the cloud end determines whether the vehicle-mounted voice SDK is qualified or not according to the operation result.

In the prior art, a vehicle-mounted voice SDK testing method is that an instruction text set matched with an intelligent network connection terminal is determined according to the type of the intelligent network connection terminal; identifying corresponding instruction intentions according to the playing sequence of the instruction texts in the instruction text set, and determining intervals for reading the instruction texts in the instruction text set according to the interactive response duration of each instruction intention and the corresponding application; controlling to play each instruction text according to the interval so as to sequentially acquire playing voice corresponding to each instruction text, performing intention recognition on the playing voice and performing interactive processing with corresponding application according to an intention recognition result; and acquiring a processing result of interactive processing between the intention recognition result and the corresponding application, and comparing the processing result with a corresponding expected result to generate a test report. Since the test command playback depends on preset time intervals such as command playback time, system processing time, application response time, etc., in an actual voice dialog system, these times are usually dynamically changed due to system resources, network delay, etc. Therefore, in actual use, it cannot be guaranteed that the instructions can be played and executed in sequence according to the expected rhythm, and the stability of the vehicle-mounted voice SDK test is low.

Disclosure of Invention

In view of this, embodiments of the present invention provide a method, an apparatus, a storage medium, and an electronic device for testing a vehicle-mounted voice SDK, so as to solve the problem in the related art that a recognition accuracy of a voice instruction by a vehicle voice system is low.

In order to achieve the above object, in a first aspect of the embodiments of the present invention, a method for testing a vehicle-mounted voice SDK is provided, where the method is applied to a server, and the method includes:

acquiring test information of the vehicle-mounted voice SDK to be tested;

determining test case information according to the test information, wherein the test case information comprises test application information and test comparison information;

sending the test application information to a test terminal;

receiving test result information sent by the test terminal, and comparing the test result information with the test comparison information, wherein the test result information is generated by the test terminal according to the test callback and execution result of the vehicle-mounted voice SDK to be tested to the test application information;

and generating a test report according to the comparison result.

Optionally, the test information includes attribute information and test task information of the vehicle-mounted voice SDK to be tested;

the determining test application information according to the test information includes:

determining to-be-tested case information adapted to the to-be-tested vehicle-mounted voice SDK according to the attribute information;

and determining the test application information from the to-be-tested case information according to the test task information.

Optionally, the comparing the test result information with the test comparison information includes:

comparing a test callback sequence in the test result information with a comparison callback sequence in the test comparison information, wherein the test callback sequence is generated by the test terminal according to a receiving sequence of the test callback of the vehicle-mounted voice SDK to be tested to each test instruction;

comparing the identification execution result corresponding to each test callback in the test callback sequence with the comparison execution result corresponding to the comparison callback in the test comparison information;

the generating of the test report according to the comparison result comprises: and generating the test report according to the callback sequence comparison result and the execution identification comparison result.

In a second aspect of the embodiments of the present invention, a method for testing a vehicle-mounted voice SDK is provided, which is applied to a test terminal, and the method includes:

receiving test application information sent by a server;

testing the vehicle-mounted voice SDK to be tested according to the test application information;

receiving a test callback and an execution result of the vehicle-mounted voice SDK to be tested to the test application information, and generating test result information according to the test callback and the execution result;

and sending the test result information to the server.

Optionally, the testing the vehicle-mounted voice SDK to be tested according to the test application information includes:

sending a first test instruction to the vehicle-mounted voice SDK to be tested according to the test step in the test application information; and the number of the first and second electrodes,

under the condition that the test callback of the vehicle-mounted voice SDK to be tested aiming at the last test instruction in the test step is received, sending the next test instruction in the test step to the vehicle-mounted voice SDK to be tested;

and sequencing the received test callbacks according to the receiving sequence to obtain a test callback sequence.

setting the vehicle-mounted voice SDK to be tested according to the action test instruction in the test application information;

under the condition that the test callback of the vehicle-mounted voice SDK to be tested aiming at the action test instruction is received, inputting an audio test instruction in the test application information into the vehicle-mounted voice SDK to be tested;

generating test result information according to the test callback and the execution result, including:

and under the condition that the test callback of the vehicle-mounted voice SDK to be tested to the audio test instruction is received, generating the test result information according to the test callback of the action test instruction, the test callback of the audio test instruction and the audio execution result of the vehicle-mounted voice SDK to be tested to the audio test instruction.

Optionally, the test case information includes attribute information and test task information of the voice SDK to be tested;

the testing the vehicle-mounted voice SDK to be tested according to the testing application information comprises the following steps:

determining a standby test text adapted to the vehicle-mounted voice SDK to be tested according to the attribute information;

determining a test text from the to-be-used test texts according to the test task information;

and testing the vehicle-mounted voice SDK to be tested according to the test text.

In a third aspect of the embodiments of the present invention, a device for testing a vehicle-mounted voice SDK is provided, which is applied to a server, and includes:

the acquisition module is used for acquiring test information of the vehicle-mounted voice SDK to be tested;

the determining module is used for determining test case information according to the test information, wherein the test case information comprises test application information and test comparison information;

the first sending module is used for sending the test application information to a test terminal;

the first receiving module is used for receiving test result information sent by the test terminal and comparing the test result information with the test comparison information, wherein the test result information is generated by the test terminal according to the test callback and the execution result of the test application information by the vehicle-mounted voice SDK to be tested;

and the generating module is used for generating a test report according to the comparison result.

Optionally, the determining module is configured to determine, according to the attribute information, to-be-tested case information adapted to the to-be-tested vehicle-mounted voice SDK;

and determining the test application information from the to-be-tested case information according to test task information, wherein the test information comprises attribute information of the to-be-tested vehicle-mounted voice SDK and the test task information.

Optionally, the first receiving module is configured to:

and the generating module is used for generating the test report according to the callback sequence comparison result and the execution identification comparison result.

In a fourth aspect of the embodiments of the present invention, a device for testing a vehicle-mounted voice SDK is provided, where the device is applied to a test terminal, and the device includes:

the second receiving module is used for receiving the test application information sent by the server;

the test module is used for testing the vehicle-mounted voice SDK to be tested according to the test application information;

the third receiving module is used for receiving the test callback and the execution result of the vehicle-mounted voice SDK to be tested on the test application information and generating test result information according to the test callback and the execution result;

and the second sending module is used for sending the test result information to the server.

Optionally, the test module is configured to send a first test instruction to the vehicle-mounted voice SDK to be tested according to the test step in the test application information; and the number of the first and second electrodes,

Optionally, the test module is configured to set the vehicle-mounted voice SDK to be tested according to an action test instruction in the test application information;

the third receiving module is configured to, when receiving a test callback of the vehicle-mounted voice SDK to be tested for the audio test instruction, generate the test result information according to the test callback of the action test instruction, the test callback of the audio test instruction, and an audio execution result of the vehicle-mounted voice SDK to be tested for the audio test instruction.

Optionally, the testing module is configured to determine a standby test text adapted to the vehicle-mounted voice SDK to be tested according to the attribute information;

and testing the vehicle-mounted voice SDK to be tested according to the test text, wherein the test case information comprises the attribute information and the test task information of the voice SDK to be tested.

In a fifth aspect of the embodiments of the present invention, a vehicle-mounted voice SDK testing system is provided, including: a server and a test terminal, wherein,

the server is used for acquiring test information of the vehicle-mounted voice SDK to be tested; determining test case information according to the test information, wherein the test case information comprises test application information and test comparison information; sending the test application information to a test terminal;

the test terminal is used for receiving test application information sent by the server; testing the vehicle-mounted voice SDK to be tested according to the test application information; receiving a test callback and an execution result of the vehicle-mounted voice SDK to be tested to the test application information, and generating test result information according to the test callback and the execution result; and sending the test result information to the server.

The server is also used for receiving test result information sent by the test terminal and comparing the test result information with the test comparison information; and generating a test report according to the comparison result.

A sixth aspect of embodiments of the present invention provides a computer-readable storage medium, on which a computer program is stored, which when executed by a processor implements the steps of the method of any one of the first aspects, or which when executed by a processor implements the steps of the method of any one of the second aspects.

A seventh aspect of the embodiments of the present invention provides an electronic device, including:

a memory having a computer program stored thereon;

a processor for executing the computer program in the memory to perform the steps of the method of any one of the first aspects or to perform the steps of the method of any one of the first aspects.

The technical scheme can at least achieve the following technical effects:

the method comprises the steps of obtaining test information of a vehicle-mounted voice SDK to be tested; determining test case information according to the test information, wherein the test case information comprises test application information and test comparison information; sending the test application information to a test terminal; receiving test result information sent by the test terminal, and comparing the test result information with the test comparison information, wherein the test result information is generated by the test terminal according to the test callback and execution result of the vehicle-mounted voice SDK to be tested to the test application information; and generating a test report according to the comparison result. Therefore, the test callback of the test application information is tested based on the vehicle-mounted voice SDK, the test instructions cannot influence each other in the test process of the vehicle-mounted voice SDK, and the test stability of the vehicle-mounted voice SDK is improved.

Additional features and advantages of the invention will be set forth in the detailed description which follows.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.

FIG. 1 is a flow chart of an exemplary illustrated method for vehicle voice SDK testing;

FIG. 2 is a schematic diagram illustrating connection of a server to a test terminal according to an exemplary embodiment;

FIG. 3 is a flowchart illustrating an implementation of step S12 of FIG. 1 according to an exemplary illustration;

FIG. 4 is a flow chart illustrating another method for vehicle voice SDK testing according to an exemplary embodiment;

FIG. 5 is a flow chart illustrating a method for vehicle voice SDK testing according to an exemplary embodiment;

FIG. 6 is a flowchart illustrating an implementation of step S42 of FIG. 4, according to an example;

FIG. 7 is a flow chart illustrating another method for vehicle voice SDK testing according to an exemplary embodiment;

FIG. 8 is a block diagram of an in-vehicle voice SDK testing apparatus 700 according to an exemplary illustration;

FIG. 9 is a block diagram of an in-vehicle voice SDK testing device 100 according to an exemplary illustration;

FIG. 10 is a block diagram of an in-vehicle voice SDK testing system according to an exemplary illustration;

FIG. 11 is a block diagram illustrating an electronic device 800 in accordance with an exemplary embodiment;

fig. 12 is a block diagram illustrating an electronic device 1900 according to an example embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The technical features mentioned in the different embodiments of the invention described below can be combined with each other as long as they do not conflict with each other.

It should be noted that, in the present invention, the terms "first", "second", and the like in the description and the claims and in the drawings are used for distinguishing similar objects, and are not necessarily to be construed as describing a particular order or sequence. Likewise, the terms "S1421", "S4201", etc. are used to distinguish steps and are not necessarily to be construed as performing method steps in a particular order or sequence.

In the prior art, the test method of the vehicle-mounted voice SDK converts a text instruction to be tested into voice, and then plays the voice to the tested vehicle-mounted voice SDK by using a sound. If multiple testing sets are simultaneously performed or multiple vehicle-mounted voice SDKs are tested, multiple sound systems need to be prepared, but physical isolation is needed between different sound systems to avoid crosstalk interference. Thus, there is no scalability. Moreover, the voice quality acquired by the vehicle-mounted voice SDK is affected by propagation and terminal sound pickup, for example, by environmental noise, and does not meet the requirements of end-to-end testing, and the stability of the testing result cannot be guaranteed. In addition, the text instruction to be tested is converted into voice, the voice is synthetic voice, the voice is not real natural voice, the simulation degree of the use scene of a real user is poor, and the test simulation is insufficient.

In addition, the instruction text set must be stored on a PC physically connected to the test terminal through a USB cable, and log capture and analysis of the instruction execution results must be performed on this PC. The method is lack of flexibility, rapid iteration and deployment cannot be carried out on test cases, test logics and test programs, a plurality of sets of test systems in different environments and different purposes cannot be rapidly and horizontally expanded, and cloud computing resources cannot be utilized. And the test instruction playing depends on preset time intervals such as instruction playing time, system processing time, application response time and the like. In an actual voice dialog system, however, these times typically change dynamically due to system resources, network delays, and the like. Therefore, in actual use, the instructions cannot be guaranteed to be played and executed in sequence according to the expected rhythm, and the stability of the vehicle-mounted voice SDK test is low.

In view of the above, the present invention provides a method, an apparatus, a storage medium, and an electronic device for testing a vehicle-mounted voice SDK, so as to solve the problem of low stability of a test result of the vehicle-mounted voice SDK in the prior art, improve the stability of the vehicle-mounted voice SDK test, reduce influences of environmental noise, terminal sound pickup, and the like during the test process, and increase the iterability of the vehicle-mounted voice SDK test.

Fig. 1 is a flow chart illustrating a method for testing a vehicle voice SDK according to an exemplary embodiment, and referring to fig. 1, the method includes the following steps.

In step S11, test information of the car-borne voice SDK to be tested is acquired.

In step S12, test case information is determined according to the test information, where the test case information includes test application information and test comparison information.

In step S13, the test application information is sent to the test terminal.

In step S14, test result information sent by the test terminal is received, and the test result information is compared with the test comparison information, where the test result information is generated by the test terminal according to the test callback and execution result of the vehicle-mounted voice SDK to be tested to the test application information.

In step S15, a test report is generated according to the comparison result.

Referring to fig. 2, a server arranged in the cloud is configured with a cloud test program developed based on a TestNG test framework, and is deployed with a set of Appium services. And a test contact android application is installed on a test terminal in communication connection with the server, and the vehicle-mounted voice SDK to be tested can be integrated in the application. The test program of the server communicates with the test terminal by means of the Appium service, the test application information is sent to the test terminal, and the test contact application can start and initialize the vehicle-mounted voice SDK based on the test application information.

Specifically, the cloud test program is developed in the Java language based on the framework TestNG of the Java unit test. The program can be deployed on any cloud server with JDKs installed, and runs a test through a maven test command. The program comprises test application information and test comparison information, wherein the test application information is used for indicating the test terminal to test the vehicle-mounted voice SDK according to the test application information, and the test comparison information is used for comparing the execution result of the vehicle-mounted voice SDK on the test application information.

For example, a test case is called according to the test information, the test case comprises test application information and test comparison information, and the test application information is sent to a test terminal which is communicated with the server through the Appium service. And receives the test result information through the Appium service.

The Appium service is a framework for automated testing of applications on android, IOS platforms. The Appium service is a service process that may be deployed on any server or PC. The server deploying the Apium service and the test terminal can be connected through a network or a USB. The Appium service can provide an http-based interface to communicate with a server configured with a cloud test program, and can also communicate with a test terminal based on a specific protocol, for example, the uiautomation 2 under an android platform is in network communication, so as to remotely control the application on the test terminal.

The test contact application is an application running in a test terminal, for example, an android application running in a car machine or a mobile phone. The application may be remotely controlled by the appum service. The application only has a blank main page, when the page is activated, a series of test-related actions are executed according to parameters attached to the activation instruction, and the test results are written into a file after being received.

The vehicle-mounted voice SDK to be tested is connected with a test terminal network or a connecting line, is a software system for providing voice awakening, voice recognition, voice detection, semantic understanding, intelligent conversation and other voice functions, and comprises components such as jar packages, resource files, library files and the like which are installed on the test terminal, and a corresponding set of cloud services. The vehicle-mounted voice SDK to be tested can be integrated by android application, a series of interfaces are provided, and callback is called or processed by the application, so that the intelligent voice function is accessed. The vehicle-mounted voice to be tested SDK is integrated in a library-dependent manner in the test contact application. The test contact application can directly call each interface of the vehicle-mounted voice SDK to be tested.

In specific implementation, a cloud test program of the server is started through a maven test command, and a test Group and a test Profile are specified during starting. The cloud testing program loads testing application information and testing comparison information corresponding to all testing cases needing to be operated according to the testing information and the test Group of the vehicle-mounted voice SDK to be tested, calls an interface of the Apium service, and transmits the test Profile corresponding to the testing application information as a Group of parameters into the Apium service. The Apium service communicates with the test contact application on the test terminal according to the test Profile, activates the main page of the test contact application, and informs the test Profile of the test contact application.

Further, the test terminal provided with the test contact application initializes the vehicle-mounted voice SDK to be tested according to the test Profile in the activation process. The server also needs to push the audio files needed by the test cases to the test terminal through the Apdium service according to the test Group.

For example, if the server tests the voice SDK to be tested based on the previous function, if the audio file has no change, the audio file previously pushed to the test terminal may be continuously used without being pushed again, so as to reduce the signaling overhead. For example, the server pushes the audio file of "open window" to the test terminal during the first test, and during the second test, if the "open window" function of the vehicle-mounted voice SDK is still tested, the audio file of "open window" may not be sent, but only an instruction for starting the test is sent.

Furthermore, the server enters a dormant state after sending the test application information, the server is awakened when the dormant time reaches the preset time, and the test result information is actively pulled from the test terminal after the server is awakened, so that the power consumption of the server can be reduced. The sleep time length is determined according to the test time length of the test case set of the test application information. Optionally, the server is in a sleep state, and after receiving the test result information sent by the test terminal, the server is awakened based on the test result information.

The server can give a conclusion whether the vehicle-mounted voice SDK to be tested passes the test or not, a case list which does not pass the test and a specific position of a voice recognition error in the test report.

In practical application, the server can be connected with a plurality of test terminals to send different test application information to each test terminal, because the dialogues between the test terminals and the vehicle-mounted voice SDK to be tested are all through a network or a connecting line, audio test instructions and action test instructions input by the test terminals are all through a network or a connecting line, even if the test terminals are not isolated, the audio test instructions cannot influence each other, and the test can be carried out simultaneously without influencing each other. The voice quality obtained by the vehicle-mounted voice SDK is not influenced by environmental noise and the like due to propagation and terminal pickup, the requirements of end-to-end test are met, and the stability of the test result is guaranteed.

According to the technical scheme, the test information of the vehicle-mounted voice SDK to be tested is obtained; determining test case information according to the test information, wherein the test case information comprises test application information and test comparison information; sending test application information to a test terminal; receiving test result information sent by the test terminal, and comparing the test result information with test comparison information, wherein the test result information is generated by the test terminal according to the test callback and execution result of the vehicle-mounted voice SDK to be tested to the test application information; and generating a test report according to the comparison result. Therefore, the test callback of the test application information is tested based on the vehicle-mounted voice SDK, the test instructions cannot influence each other in the test process of the vehicle-mounted voice SDK, and the test stability of the vehicle-mounted voice SDK is improved.

Specifically, in one embodiment, the test information includes attribute information and test task information of the vehicle-mounted voice SDK to be tested;

fig. 3 is a flowchart illustrating an implementation of step S12 in fig. 1 according to an exemplary embodiment, and referring to fig. 3, in step S12, determining test application information according to the test information includes:

in step S121, the test case information adapted to the vehicle-mounted voice SDK to be tested is determined according to the attribute information.

In step S122, test application information is determined from the case information to be tested according to the test task information.

Specifically, since different vehicle-mounted voice SDKs have certain differences, for example, the test application information of the vehicle-mounted voice SDK may be different based on different operating systems. The server can determine the to-be-tested case information adapting to the to-be-tested vehicle-mounted voice SDK according to the attribute information of the to-be-tested vehicle-mounted voice SDK in the test information. For example, the dependency library of the server may store the application information to be tested in a classified manner according to the operating system of the vehicle-mounted voice SDK, and then select the test audio of the application information to be tested from the dependency library according to the attribute information of the vehicle-mounted voice SDK to be tested in the test information, where the test audio is real voice corresponding to the query text and recorded in advance on the real vehicle.

Further, the test task information may indicate the function of one or more vehicle-mounted voices per test. And determining the audio frequency for testing from the application information to be tested according to the function in the testing task information. In an example, the application information to be tested comprises test case sets corresponding to all functions, the test audio corresponding to the window opening is determined from the test audio of all functions according to the window opening function in the test task information, and the test application information of the test audio corresponding to the window opening is sent to the test terminal.

By adopting the technical scheme, the server can determine the test application information comprising the audio frequency for the test according to the attribute information and the test task information of the vehicle-mounted voice SDK to be tested in the test information, so that the use scene of a user can be simulated really, and the test simulation performance is high.

Specifically, in an embodiment, fig. 4 is a flowchart illustrating another vehicle-mounted voice SDK testing method according to an example, and referring to fig. 4, in step S14, comparing the test result information with the test comparison information includes:

in step S141, the test callback sequence in the test result information is compared with the comparison callback sequence in the test comparison information, and the test callback sequence is generated by the test terminal according to the receiving sequence of the test callback of each test instruction by the vehicle-mounted voice SDK to be tested.

In step S142, the identification execution result corresponding to each test callback in the test callback sequence is compared with the comparison execution result corresponding to the comparison callback in the test comparison information.

In step S15, a test report is generated according to the comparison result, which includes: in step S151, a test report is generated according to the callback sequence alignment result and the execution identification alignment result.

In specific implementation, the vehicle-mounted voice SDK test to be tested comprises two types of action test instructions and audio test instructions. The server determines an action test instruction and an audio test instruction according to the test information, for example, the server uses '0' to indicate that the test terminal inputs the test audio instruction to the vehicle-mounted voice SDK to be tested, and uses '1' to indicate that the test terminal calls a control of the vehicle-mounted voice SDK to be tested to execute a corresponding action.

Illustratively, the test callback sequence in the test result information is compared with the comparison callback sequence in the test comparison information, whether the time node of each test callback is consistent with the time node of the comparison callback in the test comparison information is determined, and whether the test instruction is sequentially played and executed according to the rhythm of the test step can be determined.

Further, whether the execution result of the vehicle-mounted voice SDK to be tested corresponding to each test callback is consistent with the comparison execution result of the corresponding comparison callback in the test comparison information is determined, and the callback is consistent but the execution result is wrong is avoided.

Further, the file execution result is compared, for example, whether or not "window open" is recognized when the recognition audio test instruction "air conditioner open" is executed.

By adopting the technical scheme, the test report can be generated according to the callback sequence and the execution result, and the flexibility of the vehicle-mounted voice SDK test is improved.

Based on the same inventive concept, an embodiment of the present invention further provides a vehicle-mounted voice SDK testing method, which is applied to a testing terminal, and fig. 5 is a flowchart illustrating the vehicle-mounted voice SDK testing method according to an example, where the method includes the following steps.

In step S41, the test application information sent by the server is received.

In step S42, the vehicle-mounted voice SDK to be tested is tested according to the test application information.

In step S43, a test callback and an execution result of the vehicle-mounted voice SDK to be tested on the test application information are received, and test result information is generated according to the test callback and the execution result.

In step S44, the test result information is sent to the server.

In specific implementation, the test callbacks and the execution results have a corresponding relationship, that is, each test callback corresponds to an execution result of the vehicle-mounted voice SDK to be tested on the test application information. And the server compares the test result information with the test comparison information to generate a test report.

Specifically, in an embodiment, fig. 6 is a flowchart for implementing step S42 in fig. 5 according to an exemplary implementation, and in step S42, the testing the vehicle-mounted voice SDK to be tested according to the test application information includes:

in step S421, a first test instruction is sent to the vehicle-mounted voice SDK to be tested according to the test step in the test application information.

In step S422, when a test callback of the vehicle-mounted voice SDK to be tested to the previous test instruction in the test step is received, the next test instruction in the test step is sent to the vehicle-mounted voice SDK to be tested.

In step S423, the received test callbacks are sorted according to the receiving order to obtain a test callback sequence.

Illustratively, three test steps are included in the test application information, the first test step being to close the window, the second test step being to turn on the air conditioner, and the third test step being to turn off the air conditioner. Firstly, the test terminal inputs a wake-up instruction to the vehicle-mounted voice SDK to be tested, and in this case, the first test instruction may be the wake-up instruction.

Further, the testing terminal inputs a testing instruction of closing the vehicle window to the vehicle-mounted voice SDK to be tested under the condition of receiving a testing callback of the vehicle-mounted voice SDK to be tested for the awakening instruction, inputs a testing instruction of opening the air conditioner to the vehicle-mounted voice SDK to be tested under the condition of receiving the testing callback of the vehicle-mounted voice SDK to be tested for the testing instruction of closing the vehicle window, and inputs a testing instruction of closing the air conditioner to the vehicle-mounted voice SDK to be tested under the condition of receiving the testing callback of the vehicle-mounted voice SDK to be tested for the testing instruction of opening the air conditioner. Therefore, the problem that the test failure is caused by the fact that the time for executing the test instruction does not meet the preset time due to system resources, network delay and other factors of the vehicle-mounted voice SDK to be tested can be solved.

Specifically, in an embodiment, fig. 7 is a flowchart illustrating another exemplary method for testing the vehicle-mounted voice SDK, where in step S42, the testing the vehicle-mounted voice SDK to be tested according to the test application information includes:

in step S4201, the vehicle-mounted voice SDK to be tested is set according to the action test instruction in the test application information.

In step S4202, when a test callback for the action test instruction by the vehicle-mounted voice SDK to be tested is received, the audio test instruction in the test application information is input to the vehicle-mounted voice SDK to be tested.

In step S43, generating test result information according to the test callback and the execution result, including:

in step S431, under the condition that the test callback of the to-be-tested vehicle-mounted voice SDK for the audio test instruction is received, test result information is generated according to the test callback of the action test instruction, the test callback of the audio test instruction, and the audio execution result of the to-be-tested vehicle-mounted voice SDK for the audio test instruction.

In specific implementation, the test terminal determines to input an audio test instruction to the vehicle-mounted voice SDK to be tested according to the type in the test application information, or calls a control of the vehicle-mounted voice SDK to be tested to execute a corresponding action. In one embodiment, the audio test command is specified by the query field and the action test command is specified by the method field and the method Params field. The execution step in each instruction has an execute By field indicating that the step is executed at the corresponding time node.

Illustratively, take the example of modifying the wake-up command of the voice-over-vehicle SDK and executing a test case that searches for "what is the weather today in beijing". The test case is defined in json format, as follows.

Specifically, each test case is generated by the server into a unique number ID and a description text. For example, the unique number ID of the test case is "2120005001", and the number ID can be used to determine corresponding test alignment information during the alignment process. The description text is "test case 1".

Further, the test terminal determines that the type is 1 in the test step, which is indicated as an action test instruction, determines that the method field is "change Awaken Word" and the method Params field is "Chilo whit", and calls the control of the vehicle-mounted voice SDK to be tested to modify the wake-up instruction, and modifies the wake-up instruction of the vehicle-mounted voice SDK to be tested to "Chilo whit".

Further, in the case that the "executeBy" is "onStart", the real person voice "hello whitish" stored in the dependency library in advance is called and input to the vehicle-mounted voice to be tested SDK to wake up the vehicle-mounted voice to be tested SDK.

Further, in a case where "executeBy" is "onasristingstarted", an audio test instruction having a type of 0 is input to the car-borne voice to be tested SDK, for example, real-person audio having a query field of "what weather today in beijing" is input to the car-borne voice to be tested SDK.

Further, under the condition that the 'executeBy' is 'on dialog Result', the test terminal calls a control of the vehicle-mounted voice SDK to be tested so as to end the input audio. For example: and inputting an action test instruction with a method field of 'finish' to the vehicle-mounted voice SDK to be tested, and determining a corresponding execution result by the test terminal. And receiving execution Results of vehicle-mounted voice SDK to be tested, namely ' onWakeUp ', your whitish ', ' onAsrListeningStarted ', ' onVadStarted ', ' onVadFinished ', ' on Asr Listening Stopped ', ' on Dialogue Result ' and ' Asr Results ', and the like, and comparing the execution Results with a comparison object ' call backs ' in the test comparison information to generate a corresponding test report.

Under the condition that the awakening instruction needs to be modified, only the change Awaken Word needs to be modified, and when other test instructions need to be modified, only the corresponding query field, method field and method Params field need to be modified, so that the test cases, test logics and test programs can be quickly iterated and deployed, a plurality of sets of test systems in different environments and different purposes can be quickly and horizontally expanded, and cloud computing resources can be fully utilized.

Specifically, in an embodiment, the test case information includes attribute information and test task information of the voice SDK to be tested;

testing the vehicle-mounted voice SDK to be tested according to the test application information, comprising the following steps:

determining a test text from the test texts to be tested according to the test task information;

In specific implementation, the test terminal may be based on the difference between different vehicle-mounted voice SDKs, for example, based on the difference between different operating systems, the test application information of the vehicle-mounted voice SDK may be different. And determining a standby test text adapted to the vehicle-mounted voice SDK to be tested according to the attribute information of the vehicle-mounted voice SDK to be tested in the test information. For example, the vehicle-mounted voice SDK is integrated and tested with the terminal in a manner of a dependency library, the dependency library may store the to-be-tested application information in a classified manner according to the operating system of the vehicle-mounted voice SDK, and then the to-be-tested application information is selected from the dependency library according to the attribute information of the to-be-tested vehicle-mounted voice SDK in the test information.

Further, the test task information may indicate the function of one or more vehicle-mounted voices per test. And determining a test text from the test texts to be tested according to the functions in the test task information. Exemplarily, the application information to be tested comprises test audio corresponding to all functions, the test audio is real person voice corresponding to query text and recorded in real vehicles in advance, according to the window opening function in the test task information, the test audio corresponding to the window opening function is determined from the test audio of all functions, and then the test audio of the window opening function is input into the vehicle-mounted voice to be tested SDK.

By adopting the technical scheme, the test application audio can be determined according to the attribute information and the test task information of the vehicle-mounted voice SDK to be tested in the test information, the use scene of a user can be truly simulated, and the test simulation is high.

Based on the same inventive concept, the invention further provides a vehicle-mounted voice SDK testing device 700, configured to execute the steps of the vehicle-mounted voice SDK testing method at the server side provided in the foregoing method embodiment, where the device 700 may implement the vehicle-mounted voice SDK testing method in a manner of software, hardware, or a combination of the two. Fig. 8 is a block diagram of an exemplary voice SDK testing apparatus 700, and referring to fig. 8, the apparatus 700 includes: an obtaining module 710, a determining module 720, a first transmitting module 730, a first receiving module 740 and a generating module 750.

The obtaining module 710 is configured to obtain test information of the vehicle-mounted voice SDK to be tested;

a determining module 720, configured to determine test case information according to the test information, where the test case information includes test application information and test comparison information;

a first sending module 730, configured to send test application information to the test terminal;

the first receiving module 740 is configured to receive test result information sent by the test terminal, and compare the test result information with test comparison information, where the test result information is generated by the test terminal according to a test callback and an execution result of the vehicle-mounted voice SDK to be tested to the test application information;

and a generating module 750, configured to generate a test report according to the comparison result.

Specifically, in an embodiment, the determining module 720 is configured to determine, according to the attribute information, to-be-tested case information adapted to the to-be-tested vehicle-mounted voice SDK;

and determining test application information from the to-be-tested case information according to the test task information, wherein the test information comprises attribute information and test task information of the to-be-tested vehicle-mounted voice SDK.

Specifically, in an embodiment, the first receiving module 740 is configured to:

comparing the test callback sequence in the test result information with the comparison callback sequence in the test comparison information, wherein the test callback sequence is generated by the test terminal according to the test callback sequence of each test instruction by the vehicle-mounted voice SDK to be tested according to the receiving sequence;

the generating module 750 is configured to generate a test report according to the callback sequence comparison result and the execution identification comparison result.

Based on the same inventive concept, the invention further provides a vehicle-mounted voice SDK testing device 100, which is used for executing the steps of the vehicle-mounted voice SDK testing method of the testing terminal provided by the above method embodiment, and the device 100 can implement the vehicle-mounted voice SDK testing method in a software, hardware or combination mode of the two. Fig. 9 is a block diagram of an exemplary voice SDK testing apparatus 100, and referring to fig. 9, the apparatus 100 includes: a second receiving module 110, a testing module 120, a third receiving module 130 and a second sending module 140.

The second receiving module 110 is configured to receive test application information sent by a server;

the test module 120 is configured to test the vehicle-mounted voice SDK to be tested according to the test application information;

the third receiving module 130 is configured to receive a test callback and an execution result of the vehicle-mounted voice SDK to be tested on the test application information, and generate test result information according to the test callback and the execution result;

and a second sending module 140, configured to send the test result information to the server.

Specifically, in an embodiment, the testing module 120 is configured to send a first testing instruction to the vehicle-mounted voice SDK to be tested according to the testing step in the testing application information; and the number of the first and second electrodes,

under the condition that a test callback of the vehicle-mounted voice SDK to be tested aiming at the last test instruction in the test step is received, sending the next test instruction in the test step to the vehicle-mounted voice SDK to be tested;

Specifically, in an embodiment, the testing module 120 is configured to set the vehicle-mounted voice SDK to be tested according to an action testing instruction in the testing application information;

under the condition that test call-back of the vehicle-mounted voice SDK to be tested for the action test instruction is received, inputting an audio test instruction in the test application information into the vehicle-mounted voice SDK to be tested;

the third receiving module 130 is configured to, when receiving a test callback of the vehicle-mounted voice SDK to be tested for the audio test instruction, generate test result information according to the test callback of the action test instruction, the test callback of the audio test instruction, and an audio execution result of the vehicle-mounted voice SDK to be tested for the audio test instruction.

Specifically, in an embodiment, the testing module 120 is configured to determine, according to the attribute information, a to-be-tested test text adapted to the vehicle-mounted voice SDK to be tested;

and testing the vehicle-mounted voice SDK to be tested according to the test text, wherein the test case information comprises attribute information and test task information of the voice SDK to be tested.

With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

It should be noted that, for convenience and brevity of description, the embodiments described in the specification all belong to the preferred embodiments, and the related parts are not necessarily essential to the present invention, for example, the second receiving module 110 and the third receiving module 130 may be independent devices or may be the same device when being implemented specifically, and the present invention is not limited thereto.

Based on the same inventive concept, the invention also provides a vehicle-mounted voice SDK testing system. Fig. 10 is a block diagram illustrating an in-vehicle voice SDK testing system according to an example, and referring to fig. 10, the in-vehicle voice SDK testing system includes: a server 200, a test terminal 300, wherein,

the server 200 is used for acquiring test information of the vehicle-mounted voice SDK to be tested; determining test case information according to the test information, wherein the test case information comprises test application information and test comparison information; transmitting test application information to the test terminal 300;

the test terminal 300 is configured to receive test application information sent by the server 200; testing the vehicle-mounted voice SDK to be tested according to the test application information; receiving test callback and execution results of the vehicle-mounted voice SDK to be tested on the test application information, and generating test result information according to the test callback and the execution results; the test result information is transmitted to the server 200.

The server 200 is further configured to receive test result information sent by the test terminal 300, and compare the test result information with the test comparison information; and generating a test report according to the comparison result.

With regard to the system in the above-described embodiment, the specific manner in which the server and the test terminal perform operations has been described in detail in the embodiment related to the method, and will not be elaborated upon here.

An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of any one of the vehicle-mounted voice SDK testing methods on the server side, or the computer program, when executed by the processor, implements the steps of any one of the vehicle-mounted voice SDK testing methods on the test terminal side.

An embodiment of the present invention further provides an electronic device, including:

a memory having a computer program stored thereon;

and the processor is used for executing the computer program in the memory to realize the steps of any vehicle-mounted voice SDK test method in the server side or the steps of any vehicle-mounted voice SDK test method in the test terminal side.

Fig. 11 is a block diagram illustrating an electronic device 800 in accordance with an example embodiment. The electronic device 800 may be configured as a test terminal. As shown in fig. 11, the electronic device 800 may include: a processor 810, a memory 820. The electronic device 800 may also include one or more of a multimedia component 830, an input/output (I/O) interface 840, and a communications component 850.

The processor 810 is configured to control the overall operation of the electronic device 800, so as to complete all or part of the steps in the above-mentioned vehicle-mounted voice SDK testing method. The memory 820 is used to store various types of data to support operation of the electronic device 800, such as instructions for any application or method operating on the electronic device 800 and application-related data, such as contact data, transmitted and received messages, pictures, audio, video, and the like. The Memory 820 may be implemented by any type of volatile or non-volatile Memory device or combination thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read-Only Memory (PROM), Read-Only Memory (ROM), magnetic Memory, flash Memory, magnetic disk, or optical disk. The multimedia components 830 may include a screen and an audio component. Wherein the screen may be, for example, a touch screen and the audio component is used for outputting and/or inputting audio signals. For example, the audio component may include a microphone for receiving external audio signals. The received audio signals may further be stored in the memory 820 or transmitted through the communication component 850. The audio assembly also includes at least one speaker for outputting audio signals. I/O interface 840 provides an interface between processor 810 and other interface modules, such as a keyboard, mouse, buttons, and the like. These buttons may be virtual buttons or physical buttons. The communication component 850 is used for wired or wireless communication between the electronic device 800 and other devices. Wireless Communication, such as Wi-Fi, bluetooth, Near Field Communication (NFC), 2G, 3G, 4G, NB-IOT, eMTC, or other 5G, etc., or a combination of one or more of them, which is not limited herein. The corresponding communication component 850 may thus include: Wi-Fi module, Bluetooth module, NFC module, etc.

In an exemplary embodiment, the electronic Device 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components for performing the above described SDK testing method.

In another exemplary embodiment, a computer readable storage medium comprising program instructions which, when executed by a processor, implement the steps of the above-described in-vehicle voice SDK testing method is also provided. For example, the computer readable storage medium may be the memory 820 described above that includes program instructions executable by the processor 810 of the electronic device 800 to perform the vehicle voice SDK testing method described above.

Fig. 12 is a block diagram illustrating an electronic device 1900 according to an example embodiment. The electronic device 1900 may be configured as a server, and referring to fig. 12, the electronic device 1900 includes a processor 1922, which may be one or more in number, and a memory 1932 for storing computer programs executable by the processor 1922. The computer program stored in memory 1932 may include one or more modules that each correspond to a set of instructions. Further, the processor 1922 may be configured to execute the computer program to perform the above-described in-vehicle voice SDK testing method.

Additionally, electronic device 1900 may also include a power component 1926 and a communication component 1950, the power component 1926 may be configured to perform power management of the electronic device 1900, and the communication component 1950 may be configured to enable communication, e.g., wired or wireless communication, of the electronic device 1900. In addition, the electronic device 1900 may also include input/output (I/O) interfaces 1958. The electronic device 1900 may operate based on an operating system, such as Windows Server, Mac OS XTM, UnixTM, LinuxTM, etc., stored in memory 1932.

In another exemplary embodiment, a computer readable storage medium comprising program instructions which, when executed by a processor, implement the steps of the above-described in-vehicle voice SDK testing method is also provided. For example, the computer readable storage medium may be the memory 1932 described above that includes program instructions that are executable by the processor 1922 of the electronic device 1900 to perform the vehicle voice SDK testing method described above.

In another exemplary embodiment, a computer program product is also provided, which contains a computer program executable by a programmable apparatus, the computer program having code portions for performing the above-mentioned in-vehicle voice SDK test method when executed by the programmable apparatus.

The preferred embodiments of the present invention have been described in detail with reference to the accompanying drawings, however, the present invention is not limited to the specific details of the above embodiments, and various simple modifications can be made to the technical solution of the present invention within the technical idea of the present invention, and these simple modifications are within the protective scope of the present invention.

It should be noted that the various technical features described in the above embodiments can be combined in any suitable manner without contradiction, and the invention is not described in any way for the possible combinations in order to avoid unnecessary repetition.

In addition, any combination of the various embodiments of the present invention is also possible, and the same should be considered as the content of the present invention as long as it does not depart from the gist of the present invention.

Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the invention, and such modifications and variations fall within the scope defined by the appended claims.

Claims

1. A vehicle-mounted voice SDK testing method is applied to a server and comprises the following steps:

acquiring test information of the vehicle-mounted voice SDK to be tested;

sending the test application information to a test terminal;

and generating a test report according to the comparison result.

2. The method of claim 1, wherein the test information includes attribute information and test task information of the vehicle-mounted voice to be tested SDK;

3. The method according to claim 1 or2, wherein the comparing the test result information with the test comparison information comprises:

4. A vehicle-mounted voice SDK testing method is applied to a testing terminal, and comprises the following steps:

receiving test application information sent by a server;

and sending the test result information to the server.

5. The method of claim 4, wherein the testing the vehicle-mounted voice to be tested SDK according to the test application information comprises:

6. The method of claim 4, wherein the testing the vehicle-mounted voice to be tested SDK according to the test application information comprises:

7. The method according to any one of claims 4 to 6, wherein the test case information includes attribute information and test task information of the voice to be tested SDK;

8. The vehicular voice SDK testing device is applied to a server and comprises the following components:

9. The vehicle-mounted voice SDK testing device is applied to a testing terminal and comprises the following components:

10. A vehicle-mounted voice SDK test system is characterized by comprising: a server and a test terminal, wherein,

the test terminal is used for receiving test application information sent by the server; testing the vehicle-mounted voice SDK to be tested according to the test application information; receiving a test callback and an execution result of the vehicle-mounted voice SDK to be tested to the test application information, and generating test result information according to the test callback and the execution result; sending the test result information to the server;

11. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method of any of claims 1 to 3 or which, when being executed by a processor, carries out the steps of the method of any of claims 4 to 7.

12. An electronic device, comprising:

a memory having a computer program stored thereon;

a processor for executing the computer program in the memory to carry out the steps of the method of any one of claims 1 to 3 or to carry out the steps of the method of any one of claims 4 to 7.