CN113763926A - Whole car voice interaction performance test system - Google Patents
Whole car voice interaction performance test system Download PDFInfo
- Publication number
- CN113763926A CN113763926A CN202111091030.4A CN202111091030A CN113763926A CN 113763926 A CN113763926 A CN 113763926A CN 202111091030 A CN202111091030 A CN 202111091030A CN 113763926 A CN113763926 A CN 113763926A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- voice
- simulation
- module
- instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 107
- 238000011056 performance test Methods 0.000 title claims description 24
- 238000012360 testing method Methods 0.000 claims abstract description 123
- 238000004088 simulation Methods 0.000 claims abstract description 99
- 238000004891 communication Methods 0.000 claims description 29
- 238000011156 evaluation Methods 0.000 claims description 23
- 238000002347 injection Methods 0.000 claims description 21
- 239000007924 injection Substances 0.000 claims description 21
- 230000007246 mechanism Effects 0.000 claims description 5
- 230000005236 sound signal Effects 0.000 claims description 3
- 230000005540 biological transmission Effects 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 14
- 238000000034 method Methods 0.000 description 12
- 230000006870 function Effects 0.000 description 10
- 230000008569 process Effects 0.000 description 7
- 230000008859 change Effects 0.000 description 4
- 238000013075 data extraction Methods 0.000 description 4
- 230000032683 aging Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 230000018109 developmental process Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000004044 response Effects 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000004883 computer application Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 238000004904 shortening Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/01—Assessment or evaluation of speech recognition systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Abstract
The application discloses a whole vehicle voice interaction performance testing system. The system comprises: the system comprises a virtual simulation platform, a voice instruction simulation module and a whole vehicle voice interaction module; the virtual simulation platform is used for operating a vehicle simulation model in the virtual simulation platform according to the test instruction so as to simulate a target working condition corresponding to a target test task; the voice instruction simulation module is used for generating a target voice control instruction according to the test instruction and broadcasting the target voice control instruction to the whole vehicle; the whole vehicle voice interaction module is used for responding to the received target voice control instruction, generating a vehicle control signal according to the target voice control instruction, and sending the vehicle control signal to the vehicle simulation model so as to control the vehicle simulation model to operate under the target working condition; the virtual simulation platform is also used for collecting the running parameters of the vehicle simulation model under the target working condition and sending the running parameters to the upper computer. The whole vehicle voice interaction performance under various working conditions can be tested, and the testing accuracy is improved.
Description
Technical Field
The embodiment of the application relates to the technical field of computer application, in particular to a complete vehicle voice interaction performance testing system.
Background
With the rapid development of the automobile industry and the continuous progress of the society, the voice interaction technology is more and more widely applied in the automobile field. The whole vehicle voice interaction system is a system which is built based on a voice interaction technology and is used for controlling a vehicle through a voice instruction. The vehicle can be controlled by the whole vehicle voice interaction system based on the voice instruction to provide services such as navigation service, telephone communication, audio-video entertainment and the like for the driver. The whole vehicle voice interaction system has wide application scenes in intelligent driving.
In the development process of vehicle products, the automatic test is rapidly and accurately carried out on the voice interaction performance of the whole vehicle, and the method has important significance for shortening the development period of the vehicle and improving the control quality of the vehicle.
Disclosure of Invention
The embodiment of the application provides a whole car voice interaction performance test system, can simulate multiple different operating modes automatically, test whole car voice interaction performance under different operating modes to reach the whole car voice interaction performance test accuracy degree purpose that improves.
In a first aspect, an embodiment of the present application provides a complete vehicle voice interaction performance test system, the system includes: the system comprises a virtual simulation platform, a voice instruction simulation module and a whole vehicle voice interaction module;
the virtual simulation platform is used for operating a vehicle simulation model in the virtual simulation platform according to a test instruction so as to simulate a target working condition corresponding to a target test task; the test instruction is generated by an upper computer according to the test sequence and the test parameters of the target test task;
the voice instruction simulation module is used for generating a target voice control instruction according to the test instruction and broadcasting the target voice control instruction to the whole vehicle;
the whole vehicle voice interaction module is in communication connection with the virtual simulation platform and is used for responding to the received target voice control instruction, generating a vehicle control signal according to the target voice control instruction and sending the vehicle control signal to the vehicle simulation model so as to control the vehicle simulation model to operate under the target working condition;
the virtual simulation platform is further used for collecting the operation parameters of the vehicle simulation model under the target working condition and sending the operation parameters to the upper computer, so that the upper computer can generate a whole vehicle voice interaction performance test report according to the evaluation parameters in the target test task and the vehicle operation parameters.
Optionally, the voice instruction simulation module includes: the system comprises a voice library, a noise library and a voice mixing module;
the voice mixing module is respectively in communication connection with the voice library and the noise library and is used for selecting a voice control instruction in the voice library according to the test instruction and mixing the selected voice control instruction with at least one type of noise in the noise library to obtain a target voice control instruction;
wherein the voice library comprises: at least one of a normative voice control instruction, a spoken voice control instruction, a dialogized voice control instruction, an aged voice control instruction, and an unexpected voice control instruction; the noise bank includes: at least one of vehicle driving noise, user spoken speech, and normative speech control commands.
Optionally, the virtual simulation platform includes: the system comprises a vehicle sensor signal simulation module and a fault injection module;
the vehicle sensor signal simulation module is in communication connection with the fault injection module and is used for simulating sensor signal faults generated by a control system of a vehicle under different working conditions;
and the fault injection module is used for injecting faults into the simulation signals of at least one type of vehicle sensor according to the test instruction so as to simulate different working conditions.
Optionally, the vehicle sensor signal simulation module includes at least one of: the system comprises an electric sensor signal simulation submodule, a bus sensor signal simulation submodule, a video sensor signal simulation submodule, a radar wave sensor signal simulation submodule and a satellite signal sensor signal simulation submodule.
Optionally, the system further includes: an audio and video acquisition module; the audio and video acquisition module is used for acquiring audio data or video data of the whole vehicle after the voice instruction simulation module broadcasts the target voice control instruction to the whole vehicle, and sending the audio data or the video data to the upper computer so that the upper computer can generate a test report of the voice interaction performance of the whole vehicle according to the evaluation parameters and the audio signals or the video signals.
Optionally, the virtual simulation platform further includes: the control system drives the signal acquisition module and the bus data acquisition module;
the control system driving signal acquisition module is in communication connection with the vehicle simulation model and is used for acquiring driving signals of the vehicle simulation model under a target working condition and sending the driving signals to the upper computer so that the upper computer can generate a finished vehicle voice interaction performance test report according to the driving signals and the evaluation parameters;
the bus data acquisition module is in communication connection with the vehicle simulation model and is used for acquiring bus signals of the vehicle simulation model under a target working condition and sending the bus signals to the upper computer, so that the upper computer generates a finished vehicle voice interaction performance test report according to the bus signals and the evaluation parameters.
Optionally, the vehicle simulation model includes: at least one of an engine model, a transmission model, a vehicle dynamics model, a driver model, and a traffic scenario model.
Optionally, the vehicle voice interaction module includes: at least one of a voice system, an information interaction control system, a power domain control system, a chassis domain control system, a vehicle body domain control system, an intelligent domain control system and a control system execution mechanism;
the voice system is in communication connection with the information interaction control system; the information interaction control system, the power domain control system, the chassis domain control system, the vehicle body domain control system and the intelligent domain control system are respectively in communication connection with the control system executing mechanism.
The system for testing the voice interaction performance of the whole vehicle comprises a virtual simulation platform, a voice instruction simulation module and a whole vehicle voice interaction module; simulating a target working condition corresponding to a target test task according to the test instruction through the virtual simulation platform, generating a target voice control instruction according to the test instruction through the voice instruction simulation module, and broadcasting the target voice control instruction to the whole vehicle; and generating a vehicle control signal according to the target voice control instruction through the whole vehicle voice interaction module, and controlling the vehicle simulation model to operate by the virtual simulation platform based on the target voice control instruction. The test system provided by the embodiment of the application can automatically simulate the test working condition, automatically acquire the test data and automatically compare the test result under various different working conditions including the faults of the whole vehicle system and other limit working conditions, has the advantages of high automation degree, short test period and working condition ergodicity, and can more comprehensively test the performance of the whole vehicle voice interaction system, thereby improving the accuracy of the test of the whole vehicle voice interaction performance.
Drawings
Fig. 1 is a schematic structural diagram of a vehicle voice interaction performance testing system according to an embodiment of the present application;
fig. 2 is a schematic structural diagram of a virtual simulation platform in a finished vehicle voice interaction performance test system according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of a voice simulation module in a finished vehicle voice interaction performance test system according to an embodiment of the present application;
FIG. 4 is a schematic structural diagram of a sensor signal simulation module and a fault injection module in a virtual simulation platform according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of a finished vehicle voice interaction module in a finished vehicle voice interaction performance test system according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of another entire vehicle voice interaction performance testing system according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of an audio and video acquisition module in a complete vehicle voice interaction performance test system according to an embodiment of the present application.
Detailed Description
The present application will be described in further detail with reference to the following drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be further noted that, for the convenience of description, only some of the structures related to the present application are shown in the drawings, not all of the structures.
Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the steps as a sequential process, many of the steps can be performed in parallel, concurrently or simultaneously. In addition, the order of the steps may be rearranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.
Example one
Fig. 1 is a schematic structural diagram of a vehicle voice interaction performance testing system according to an embodiment of the present application, where the embodiment is applicable to a situation of testing performance of the vehicle voice interaction system.
As shown in fig. 1, the entire vehicle voice interaction performance test system includes: the system comprises a virtual simulation platform 1, a voice instruction simulation module 2 and a whole vehicle voice interaction module 3.
The upper computer 5 generates a test instruction according to the test sequence and the test parameters of the target test task, and sends the test instruction to the virtual simulation platform 1 and the voice instruction simulation module 2. The virtual simulation platform 1 operates a vehicle simulation model 11 (not shown in fig. 1) in the virtual simulation platform according to a test instruction sent by the upper computer 5 to simulate a target working condition corresponding to a target test task. And the voice command simulation module 2 generates a target voice control command according to the test command sent by the upper computer 5 and broadcasts the target voice control command to the whole vehicle. The whole vehicle voice interaction module 3 is in communication connection with the virtual simulation platform 1, and the whole vehicle voice interaction module 3 is used for responding to a received target voice control instruction, generating a vehicle control signal according to the target voice control instruction, and sending the vehicle control signal to the vehicle simulation model 11 so as to control the vehicle simulation model 11 to operate under a target working condition. The virtual simulation platform 1 is used for collecting the running parameters of the vehicle simulation model 11 under the target working condition and sending the running parameters to the upper computer 5 so that the upper computer 5 can generate a finished vehicle voice interaction performance test report according to the evaluation parameters and the vehicle running parameters in the target test task.
Specifically, the upper computer 5 decomposes the test task pre-configured therein by the relevant technician into a test sequence, a test parameter and an evaluation parameter, and stores the test sequence, the test parameter and the evaluation parameter in a test sequence library, a test parameter library and an evaluation criterion database, respectively. The evaluation parameters are parameters for evaluating the voice interaction performance of the whole vehicle. The test sequence is a flow framework of a test task, the test task is associated with test working conditions, and different test working conditions correspond to different test sequences. The test parameters comprise test parameter variables and test parameter values, and the test parameters are used for determining the target working condition. The upper computer 5 responds to the test task execution instruction, determines a test sequence of the test task in the test sequence library, determines a test parameter of the test task in the test database, performs parameterization processing on the test sequence of the test task according to the test parameter to obtain a test instruction, and sends the test instruction to the virtual simulation platform and the voice instruction simulation module. The test task execution instruction may be generated by a control in the interactive interface actively triggered by the user, or may be automatically generated by the upper computer 5 when the execution condition of the test task is satisfied, for example, the execution time of the timing task is reached.
The upper computer 5 decomposes the test task into a test sequence, test parameters and evaluation parameters, reduces the coupling relation among the test sequence, the test parameters and the evaluation parameters, enables the test sequence to be combined with the test parameters and the evaluation parameters as required, and expands the applicability of the test sequence.
The virtual simulation platform 1 operates a vehicle simulation model in the virtual simulation platform according to the test instruction sent by the upper computer 5 to simulate a target working condition corresponding to a target test task. Wherein the target operating condition is one of the test operating conditions, the test operating condition including that the vehicle may be in all operating conditions after power-up. The test working conditions comprise the working conditions that the vehicle runs normally, runs at an overspeed, is collided or generates faults and the like. Optionally, the virtual simulation platform is a HiL (Hardware-in-the-Loop) simulation platform.
The vehicle simulation model is a software model which is constructed based on a computer technology and is used for simulating the real running state of the entity vehicle. As shown in fig. 2, a schematic structural diagram of a virtual simulation platform in a finished vehicle voice interaction performance testing system, in an optional embodiment, a vehicle simulation model 11 includes: at least one of an engine model 111, a gearbox model 112, a vehicle dynamics model 113, a driver model 114 and a traffic scenario model 115. The driver model 114 is used for simulating the driving behavior of the driver's vehicle, and the driver model can simulate the operations of steering wheel turning, accelerator pedal stepping, gear shifting operation, brake pedal stepping and the like. The traffic scene model is used for simulating different traffic scenes such as intersections, high-speed roads, urban roads and the like.
The voice command simulation module 2 is used for generating voice control commands with different types and different contents to simulate different users. The voice control instruction is used for reflecting the control intention of the user on the vehicle. For example, the content of the voice control command may be "please help me open the skylight".
The whole vehicle voice interaction module 3 is used for converting a target voice control instruction of a user plane into a vehicle control signal which can be identified by a vehicle control system. And the whole vehicle voice interaction module sends the vehicle control signal to the vehicle simulation model so as to realize the control of the vehicle simulation model under the target working condition.
In order to more fully test the influence of different types of voice control commands on the overall vehicle voice interaction performance, as shown in fig. 3, a schematic structural diagram of a voice simulation module in a system for testing overall vehicle voice interaction performance, in an alternative embodiment, the voice command simulation module 2 includes: a speech library 21, a noise library 22 and a speech mixing module 23; the voice mixing module 23 is respectively in communication connection with the voice library 21 and the noise library 22, and the voice mixing module 23 is configured to select a voice control instruction in the voice library according to the test instruction, and mix the selected voice control instruction with at least one noise in the noise library to obtain a target voice control instruction; wherein the voice library comprises: at least one of a normative voice control instruction, a spoken voice control instruction, a dialogized voice control instruction, an aged voice control instruction, and an unexpected voice control instruction; the noise bank includes: at least one of vehicle driving noise, user spoken speech, and normative speech control commands.
The standardized voice control instruction is a voice control instruction which is configured in a whole vehicle voice interaction module in advance and can be identified theoretically by the whole vehicle voice interaction module. The standardized voice control instruction has corresponding standardized requirements on the aspects of tone, content or speed and the like, and the specific content of the standardized voice control instruction is related to the whole vehicle interaction system to be tested, is not limited in the process and is determined according to the actual condition; the unexpected voice control instruction is a voice control instruction which is not pre-configured in the whole vehicle voice interaction module and can not be identified theoretically by the whole vehicle voice interaction module. The unexpected voice control instruction is different from the normalized voice control instruction in content, and the voice control instruction is consistent with the normalized voice control instruction in other aspects such as intonation and speed; the spoken voice control instruction is a normalized voice control instruction doped with spoken language; the dialogizing voice control instruction is a voice instruction obtained by dialogizing the standard voice control instruction, and can be used for simulating users in different regions to send out voice control instructions; the aging voice control instruction is a voice instruction obtained by aging the standard voice control instruction, and the aging voice control instruction can be used for simulating users of different ages to send out voice control instructions.
The standard voice control instruction in the noise library refers to a voice control instruction consistent with the content of the standard voice control instruction in the voice library. The method is used for simulating the situation that the normalized voice control command appears when a user talks after the user sends the voice control command.
Referring to fig. 2, a schematic structural diagram of a virtual simulation platform in a finished vehicle voice interaction performance test system is shown. In an optional embodiment, in order to accurately and comprehensively reflect the interaction performance of the whole vehicle, the performance of the whole vehicle interaction system needs to be tested under the limit working condition that the vehicle fails. The virtual simulation platform 1 further includes: a vehicle sensor signal simulation module 14 and a fault injection module 15;
the vehicle sensor signal simulation module 14 is in communication connection with the fault injection module 15, and the vehicle sensor signal simulation module 14 is used for simulating sensor signal faults generated by a control system of a vehicle under different working conditions; and the fault injection module 15 is used for injecting faults into the simulation signals of at least one type of vehicle sensors according to the test instructions so as to simulate different working conditions.
Referring to fig. 4, a schematic structural diagram of a sensor signal simulation module and a fault injection module in the virtual simulation platform is shown. To fully simulate the extreme conditions of vehicle failure, in an alternative embodiment, the vehicle sensor signal simulation module 14 includes at least one of: an electric sensor signal simulation submodule 141, a bus sensor signal simulation submodule 142, a video sensor signal simulation submodule 143, a radar wave sensor signal simulation submodule 144 and a satellite signal sensor signal simulation submodule 145.
Specifically, the electrical sensor signal simulation submodule 141 is in communication connection with the fault injection module 15, and all electrical faults of the vehicle, such as voltage, current, resistance, inductance, capacitance, pin short circuit, open circuit and the like, can be simulated through the fault injection submodule 15; the bus type sensor signal simulation submodule 142 is in communication connection with the fault injection module 15, and can simulate all bus type faults of the vehicle, such as bus data loss, data delay, abnormal signal value and the like, through the fault injection module 15; the video sensor signal simulation submodule 143 is in communication connection with the fault injection module 15, and can simulate all video faults of the vehicle, such as panoramic image video faults, intelligent camera video faults, high-precision map video faults, recorder video faults and the like, through the fault injection module 15; the radar wave sensor signal simulation submodule 144 is in communication connection with the fault injection module 15, and can simulate all radar wave faults of the vehicle, such as ultrasonic faults for parking radars, millimeter wave radar faults for driving assistance and intelligent driving, and the like, through the fault injection module 15; the satellite signal sensor signal simulation submodule 145 is in communication connection with the fault injection module 15, and all satellite signal faults of the vehicle, such as a satellite positioning signal fault for vehicle navigation and a satellite positioning signal fault for high-precision maps, can be simulated through the fault injection module 15.
As shown in fig. 5, in an alternative embodiment, the whole vehicle voice interaction module 3 includes: at least one of a voice system 31, an information interaction control system 32, a power domain control system 33, a chassis domain control system 34, a vehicle body domain control system 35, an intelligent domain control system 36 and a control system actuator 37.
Wherein, the voice system 31 is connected with the information interaction control system 32 in a communication way; the information interaction control system 32, the power domain control system 33, the chassis domain control system 34, the vehicle body domain control system 35 and the intelligent domain control system 36 are respectively in communication connection with a control system execution mechanism 37.
The control of multiple functions of the vehicle can be realized based on the voice control instruction, and specifically, the vehicle control signal is generated through one or more of the information interaction control system 32, the power domain control system 33, the chassis domain control system 34, the vehicle body domain control system 35 or the intelligent domain control system 36 according to the voice control instruction. The vehicle simulation model 11 is controlled by the control system actuator 37 to perform a corresponding function according to the vehicle control signal. For example, the vehicle body functions of vehicle speed change, skylight opening, vehicle steering or vehicle lane change and the like of the vehicle can be controlled, and the vehicle-mounted multimedia navigation system is controlled to provide information interaction services such as audio-video entertainment or navigation.
The whole vehicle voice interaction performance testing system provided by the embodiment of the application tests the voice interaction function on the whole vehicle system level, and determines the voice interaction function according to the response of the whole vehicle level. According to the embodiment of the application, the virtual simulation platform 1 is used for collecting the running parameters of the vehicle simulation model 11 under the target working condition and sending the running parameters to the upper computer 5 so that the upper computer 5 can generate a whole vehicle voice interaction performance test report according to the evaluation parameters and the vehicle running parameters in the target test task.
Specifically, the virtual simulation platform 1 acquires a finished automobile voice performance test result according to the driving signal, the bus signal and the evaluation parameter in the test task by acquiring the driving signal and the bus signal generated in the voice interaction control link of the finished automobile. As shown in fig. 2, in an optional embodiment, the virtual simulation platform 1 further includes: the control system drives the signal acquisition module 12 and the bus data acquisition module 13; the control system driving signal acquisition module 12 is in communication connection with the vehicle simulation model 11 and is used for acquiring a driving signal of the vehicle simulation model 11 under a target working condition and sending the driving signal to the upper computer 5, so that the upper computer 5 generates a finished vehicle voice interaction performance test report according to the driving signal and the evaluation parameters; the bus data acquisition module 13 is in communication connection with the vehicle simulation model 11 and is used for acquiring bus signals of the vehicle simulation model 11 under a target working condition and sending the bus signals to the upper computer 5, so that the upper computer 5 generates a test report of the voice interaction performance of the whole vehicle according to the bus signals and the evaluation parameters.
Generally, when the whole vehicle voice interaction module 3 is used for controlling the vehicle body functions, such as controlling the vehicle speed change, opening a skylight, steering or lane change of the vehicle, the driving signal and the bus signal generated in the voice interaction control link on the whole vehicle layer can be acquired. And realizing the evaluation of the voice interaction module based on the collected driving signals or bus signals. However, when the information interaction service is controlled by using the entire vehicle voice interaction module 3, since the information interaction service is provided by the vehicle-mounted multimedia navigation device configured on the vehicle, the driving signal and the bus signal generated in the internal link of the vehicle multimedia navigation device cannot be collected in the process of providing the information interaction service by the vehicle-mounted multimedia navigation device.
In order to comprehensively test the voice interaction function of the whole vehicle, as shown in fig. 6, in another schematic structural diagram of a voice interaction performance test system of the whole vehicle, the embodiment of the present application evaluates the voice interaction system of the whole vehicle according to the information interaction service response condition of the vehicle simulation model. Specifically, in an optional embodiment, the system further includes: an audio and video acquisition module 4; the audio and video acquisition module 4 is used for acquiring audio data or video data of the whole vehicle after the voice instruction simulation module 4 broadcasts the target voice control instruction to the whole vehicle, and sending the audio data or the video data to the upper computer 5, so that the upper computer 5 can generate a whole vehicle voice interaction performance test report according to the evaluation parameters and the audio signals or the video signals. Wherein, audio frequency and video acquisition module 4 and host computer 5 communication connection.
Optionally, as shown in fig. 7, in a schematic structural diagram of an audio and video acquisition module in a finished vehicle voice interaction performance test system, the audio and video acquisition module 4 includes: an audio capture module 41, an audio data extraction module 42, a video capture module 43, and a video data extraction module 44. Wherein, the audio acquisition module 41 is in communication connection with the audio data extraction module 42; the video capture module 43 is communicatively coupled to the video data extraction module 44.
It is worth noting that the audio/video acquisition module 4 is not only suitable for testing the condition that the whole vehicle voice interaction module 3 controls the vehicle information interaction function, but also suitable for testing the condition that the whole vehicle voice interaction module 3 controls other functions of the vehicle. Illustratively, when the skylight is controlled to be opened by the whole vehicle interaction system, video data can be acquired through the audio and video acquisition module, and the skylight opening condition in the video is combined with the driving signal and the bus signal to serve as the evaluation basis of the whole vehicle voice interaction performance.
The system for testing the voice interaction performance of the whole vehicle comprises a virtual simulation platform, a voice instruction simulation module and a whole vehicle voice interaction module; simulating a target working condition corresponding to a target test task according to the test instruction through the virtual simulation platform, generating a target voice control instruction according to the test instruction through the voice instruction simulation module, and broadcasting the target voice control instruction to the whole vehicle; and generating a vehicle control signal according to the target voice control instruction through the whole vehicle voice interaction module, and controlling the vehicle simulation model to operate by the virtual simulation platform based on the target voice control instruction. The test system provided by the embodiment of the application can automatically simulate the test working condition, automatically acquire the test data and automatically compare the test result under various different working conditions including the faults of the whole vehicle system and other limit working conditions, has the advantages of high automation degree, short test period and working condition ergodicity, and can more comprehensively test the performance of the whole vehicle voice interaction system, thereby improving the accuracy of the test of the whole vehicle voice interaction performance.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present application and the technical principles employed. It will be understood by those skilled in the art that the present application is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the application. Therefore, although the present application has been described in more detail with reference to the above embodiments, the present application is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present application, and the scope of the present application is determined by the scope of the appended claims.
Claims (8)
1. The utility model provides a whole car voice interaction capability test system which characterized in that, the system includes: the system comprises a virtual simulation platform, a voice instruction simulation module and a whole vehicle voice interaction module;
the virtual simulation platform is used for operating a vehicle simulation model in the virtual simulation platform according to a test instruction so as to simulate a target working condition corresponding to a target test task; the test instruction is generated by an upper computer according to the test sequence and the test parameters of the target test task;
the voice instruction simulation module is used for generating a target voice control instruction according to the test instruction and broadcasting the target voice control instruction to the whole vehicle;
the whole vehicle voice interaction module is in communication connection with the virtual simulation platform and is used for responding to the received target voice control instruction, generating a vehicle control signal according to the target voice control instruction and sending the vehicle control signal to the vehicle simulation model so as to control the vehicle simulation model to operate under the target working condition;
the virtual simulation platform is further used for collecting the operation parameters of the vehicle simulation model under the target working condition and sending the operation parameters to the upper computer, so that the upper computer can generate a whole vehicle voice interaction performance test report according to the evaluation parameters in the target test task and the vehicle operation parameters.
2. The system of claim 1, wherein the voice command simulation module comprises: the system comprises a voice library, a noise library and a voice mixing module;
the voice mixing module is respectively in communication connection with the voice library and the noise library and is used for selecting a voice control instruction in the voice library according to the test instruction and mixing the selected voice control instruction with at least one type of noise in the noise library to obtain a target voice control instruction;
wherein the voice library comprises: at least one of a normative voice control instruction, a spoken voice control instruction, a dialogized voice control instruction, an aged voice control instruction, and an unexpected voice control instruction; the noise bank includes: at least one of vehicle driving noise, user spoken speech, and normative speech control commands.
3. The system of claim 1, wherein the virtual simulation platform comprises: the system comprises a vehicle sensor signal simulation module and a fault injection module;
the vehicle sensor signal simulation module is in communication connection with the fault injection module and is used for simulating sensor signal faults generated by a control system of a vehicle under different working conditions;
and the fault injection module is used for injecting faults into the simulation signals of at least one type of vehicle sensor according to the test instruction so as to simulate different working conditions.
4. The system of claim 3, wherein the vehicle sensor signal simulation module comprises at least one of: the system comprises an electric sensor signal simulation submodule, a bus sensor signal simulation submodule, a video sensor signal simulation submodule, a radar wave sensor signal simulation submodule and a satellite signal sensor signal simulation submodule.
5. The system of claim 1, further comprising: an audio and video acquisition module;
the audio and video acquisition module is used for acquiring audio data or video data of the whole vehicle after the voice instruction simulation module broadcasts the target voice control instruction to the whole vehicle, and sending the audio data or the video data to the upper computer so that the upper computer can generate a test report of the voice interaction performance of the whole vehicle according to the evaluation parameters and the audio signals or the video signals.
6. The system of claim 1, wherein the virtual simulation platform further comprises: the control system drives the signal acquisition module and the bus data acquisition module;
the control system driving signal acquisition module is in communication connection with the vehicle simulation model and is used for acquiring driving signals of the vehicle simulation model under a target working condition and sending the driving signals to the upper computer so that the upper computer can generate a finished vehicle voice interaction performance test report according to the driving signals and the evaluation parameters;
the bus data acquisition module is in communication connection with the vehicle simulation model and is used for acquiring bus signals of the vehicle simulation model under a target working condition and sending the bus signals to the upper computer, so that the upper computer generates a finished vehicle voice interaction performance test report according to the bus signals and the evaluation parameters.
7. The system of claim 1, wherein the vehicle simulation model comprises: at least one of an engine model, a transmission model, a vehicle dynamics model, a driver model, and a traffic scenario model.
8. The system of claim 1, wherein the vehicle voice interaction module comprises: at least one of a voice system, an information interaction control system, a power domain control system, a chassis domain control system, a vehicle body domain control system, an intelligent domain control system and a control system execution mechanism;
the voice system is in communication connection with the information interaction control system; the information interaction control system, the power domain control system, the chassis domain control system, the vehicle body domain control system and the intelligent domain control system are respectively in communication connection with the control system executing mechanism.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111091030.4A CN113763926B (en) | 2021-09-17 | 2021-09-17 | Whole car voice interaction performance test system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111091030.4A CN113763926B (en) | 2021-09-17 | 2021-09-17 | Whole car voice interaction performance test system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113763926A true CN113763926A (en) | 2021-12-07 |
| CN113763926B CN113763926B (en) | 2024-03-15 |
Family
ID=78796112
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111091030.4A Active CN113763926B (en) | 2021-09-17 | 2021-09-17 | Whole car voice interaction performance test system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113763926B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114434466A (en) * | 2022-03-14 | 2022-05-06 | 交通运输部公路科学研究所 | Automobile intelligent cockpit performance evaluation simulation robot |
| CN114756007A (en) * | 2022-04-20 | 2022-07-15 | 中国第一汽车股份有限公司 | Evaluation method, device, equipment and storage medium |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160314224A1 (en) * | 2015-04-24 | 2016-10-27 | Northrop Grumman Systems Corporation | Autonomous vehicle simulation system |
| WO2018126935A1 (en) * | 2017-01-05 | 2018-07-12 | 阿里巴巴集团控股有限公司 | Voice-based interaction method and apparatus, electronic device, and operating system |
| CN108735215A (en) * | 2018-06-07 | 2018-11-02 | 爱驰汽车有限公司 | Interactive system for vehicle-mounted voice, method, equipment and storage medium |
| WO2019076234A1 (en) * | 2017-10-17 | 2019-04-25 | 广东工业大学 | Transparent monitoring method and system for intelligent workshop |
| CN110377006A (en) * | 2019-07-17 | 2019-10-25 | 中国第一汽车股份有限公司 | One kind is parked test macro and method |
| CN110970029A (en) * | 2018-09-28 | 2020-04-07 | 上海博泰悦臻电子设备制造有限公司 | Vehicle, vehicle-mounted equipment and vehicle-mounted voice interaction method based on voice semantic recognition |
| CN111883118A (en) * | 2020-07-09 | 2020-11-03 | 浙江吉利汽车研究院有限公司 | Vehicle control method and device based on personalized voice and storage medium |
| CN112099628A (en) * | 2020-09-08 | 2020-12-18 | 平安科技（深圳）有限公司 | VR interaction method and device based on artificial intelligence, computer equipment and medium |
| CN112859817A (en) * | 2021-01-21 | 2021-05-28 | 中国第一汽车股份有限公司 | Complete vehicle fault diagnosis test system |
-
2021
- 2021-09-17 CN CN202111091030.4A patent/CN113763926B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160314224A1 (en) * | 2015-04-24 | 2016-10-27 | Northrop Grumman Systems Corporation | Autonomous vehicle simulation system |
| WO2018126935A1 (en) * | 2017-01-05 | 2018-07-12 | 阿里巴巴集团控股有限公司 | Voice-based interaction method and apparatus, electronic device, and operating system |
| WO2019076234A1 (en) * | 2017-10-17 | 2019-04-25 | 广东工业大学 | Transparent monitoring method and system for intelligent workshop |
| CN108735215A (en) * | 2018-06-07 | 2018-11-02 | 爱驰汽车有限公司 | Interactive system for vehicle-mounted voice, method, equipment and storage medium |
| CN110970029A (en) * | 2018-09-28 | 2020-04-07 | 上海博泰悦臻电子设备制造有限公司 | Vehicle, vehicle-mounted equipment and vehicle-mounted voice interaction method based on voice semantic recognition |
| CN110377006A (en) * | 2019-07-17 | 2019-10-25 | 中国第一汽车股份有限公司 | One kind is parked test macro and method |
| CN111883118A (en) * | 2020-07-09 | 2020-11-03 | 浙江吉利汽车研究院有限公司 | Vehicle control method and device based on personalized voice and storage medium |
| CN112099628A (en) * | 2020-09-08 | 2020-12-18 | 平安科技（深圳）有限公司 | VR interaction method and device based on artificial intelligence, computer equipment and medium |
| CN112859817A (en) * | 2021-01-21 | 2021-05-28 | 中国第一汽车股份有限公司 | Complete vehicle fault diagnosis test system |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114434466A (en) * | 2022-03-14 | 2022-05-06 | 交通运输部公路科学研究所 | Automobile intelligent cockpit performance evaluation simulation robot |
| CN114756007A (en) * | 2022-04-20 | 2022-07-15 | 中国第一汽车股份有限公司 | Evaluation method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113763926B (en) | 2024-03-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113763926B (en) | Whole car voice interaction performance test system | |
| US10579512B2 (en) | Method and apparatus for testing software for autonomous vehicles | |
| CN106873397B (en) | Intelligent networking automobile hardware-in-loop acceleration loading simulation test system | |
| CN110794810B (en) | Method for carrying out integrated test on intelligent driving vehicle | |
| CN104614187B (en) | A kind of true driving cycle test device and method based on virtual vehicle | |
| CN112613169B (en) | Expected function safety analysis method for misoperation of automatic driving vehicle | |
| CN114047742B (en) | Intelligent piloting advanced driver assistance hardware in-loop test system and method | |
| CN113567778A (en) | Scene-based real-vehicle automatic testing method for vehicle-mounted information entertainment system | |
| CN116107288A (en) | Intelligent driving simulation test system and method thereof | |
| CN112698582A (en) | ADAS ECU simulation test method and system | |
| CN113867315B (en) | Virtual-real combined high-fidelity traffic flow intelligent vehicle test platform and test method | |
| CN113532884B (en) | Intelligent driving and ADAS system test platform and test method | |
| CN116361990A (en) | LTE-V2X-based HIL rack ADAS fusion test method and device | |
| CN115344939A (en) | Automatic driving virtual test system based on human, vehicle and environment modeling | |
| CN115145168A (en) | Simulation test system of automobile control unit | |
| CN112883500A (en) | Intelligent vehicle system early function safety assessment method based on fault injection | |
| CN213042144U (en) | Fusion test bench for automatic driving system | |
| CN115688481A (en) | Hardware-in-loop simulation test system and method for man-machine common-driving type vehicle | |
| CN113625594B (en) | Automatic driving simulation method and simulation system | |
| CN113539009A (en) | Remote driving training platform based on 5G | |
| CN116761999A (en) | Automatic driving test method, system, vehicle and storage medium | |
| CN111103869A (en) | Scene simulation system and method | |
| KR102643975B1 (en) | Crash simulation system and method based on virtual driving environment | |
| CN111832118B (en) | Simulation test system and method for driving assistance function | |
| CN116380495B (en) | Emission and energy consumption test method, system, equipment and medium based on digital twin |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |