CN114664286A - Detection system, method and device for vehicle-mounted voice interaction function - Google Patents
Detection system, method and device for vehicle-mounted voice interaction function Download PDFInfo
- Publication number
- CN114664286A CN114664286A CN202110116856.5A CN202110116856A CN114664286A CN 114664286 A CN114664286 A CN 114664286A CN 202110116856 A CN202110116856 A CN 202110116856A CN 114664286 A CN114664286 A CN 114664286A
- Authority
- CN
- China
- Prior art keywords
- voice
- vehicle
- matching
- matching result
- detection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 91
- 230000003993 interaction Effects 0.000 title claims abstract description 78
- 238000000034 method Methods 0.000 title claims abstract description 18
- 230000002452 interceptive effect Effects 0.000 claims abstract description 60
- 238000004519 manufacturing process Methods 0.000 claims abstract description 14
- 238000012015 optical character recognition Methods 0.000 claims description 7
- 238000012360 testing method Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000004088 simulation Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/01—Assessment or evaluation of speech recognition systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/28—Constructional details of speech recognition systems
- G10L15/30—Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Abstract
The invention provides a detection system, a method and a device for a vehicle-mounted voice interaction function, which relate to the technical field of electric vehicle detection, wherein the detection system for the vehicle-mounted voice interaction function comprises the following steps: the system comprises a main control device, a sound production device, a bus message detection device, a camera device and a voice acquisition device; the main control device is respectively connected with the sound production device, the voice acquisition device, the message detection device and the camera device; the voice device is used for sending a voice control instruction to the vehicle-mounted central control system; the bus message detection device is used for detecting a control message in a bus inside the vehicle; the camera device is used for collecting interactive contents displayed on the vehicle-mounted central control system; the voice acquisition device is used for acquiring feedback voice of the vehicle-mounted central control system; and the main control device is used for detecting the vehicle-mounted voice interaction function of the vehicle-mounted central control system according to the voice control instruction, the interaction content and the feedback voice. The scheme of the invention improves the detection accuracy of the vehicle-mounted voice interaction function.
Description
Technical Field
The invention belongs to the technical field of vehicle detection, and particularly relates to a system, a method and a device for detecting a vehicle-mounted voice interaction function.
Background
The vehicle-mounted voice assistant has become a standard function of an intelligent cabin of a vehicle, and when the function and the performance of the vehicle-mounted voice assistant are tested, the problem that the testing result is inaccurate due to the fact that the pronunciation of a tester is random or local accent exists in the tester can exist at present; and the test result has deviation due to less sample number of testers, and the coverage of the vehicle-mounted voice assistant to people in different regions and ages cannot be verified.
At present, a host is generally adopted to control a sound production device to produce sound so as to solve the problem of inaccurate detection result caused by sound production. However, an automatic testing device for the interactive function of the vehicle-mounted voice assistant is lacked, and the functionality cannot be accurately verified.
Disclosure of Invention
The embodiment of the invention aims to provide a system, a method and a device for checking a vehicle-mounted voice interaction function, so as to solve the problem of how to detect the vehicle-mounted voice interaction function in the prior art.
In order to achieve the above object, an embodiment of the present invention provides a detection system for a vehicle-mounted voice interaction function, including:
the system comprises a main control device, a sound production device, a bus message detection device, a camera device and a voice acquisition device;
the main control device is respectively connected with the sound production device, the voice acquisition device, the bus message detection device and the camera device;
the voice device is used for sending a voice control instruction to the vehicle-mounted central control system;
the bus message detection device is used for detecting a control message in a bus inside the vehicle;
the camera device is used for acquiring interactive contents displayed on the vehicle-mounted central control system;
the voice acquisition device is used for acquiring feedback voice of the vehicle-mounted central control system;
and the main control device is used for detecting the vehicle-mounted voice interaction function of the vehicle-mounted central control system according to the voice control instruction, the interaction content and the feedback voice.
Optionally, the system further comprises:
and the cloud server is connected with the main control device through a network and is used for identifying the feedback voice acquired by the voice acquisition device.
The embodiment of the invention also provides a method for detecting the vehicle-mounted voice interaction function, which is applied to the system for detecting the vehicle-mounted voice interaction function, and comprises the following steps:
controlling the sound generating device to send a voice control instruction to the vehicle-mounted central control system;
acquiring a control message detected by the bus message detection device, and matching the control message with a reference message corresponding to the voice control instruction to acquire a first matching result;
acquiring interactive contents acquired by the camera device, and matching the interactive contents with preset reference contents to acquire a second matching result;
acquiring feedback voice acquired by the voice acquisition device, and matching the feedback voice with reference voice corresponding to the voice control instruction to acquire a third matching result;
and judging whether the vehicle-mounted voice interaction function passes the detection or not according to the first matching result, the second matching result and the third matching result.
Optionally, receiving the control packet detected by the bus packet detection device, and matching the control packet with the reference packet corresponding to the voice control instruction to obtain a first matching result, including:
when the control message is the same as the reference message, obtaining the first matching result as matching passing;
and when the control message is different from the reference message, obtaining the first matching result as that the matching is not passed.
Optionally, the obtaining of the interactive content acquired by the camera device and the matching with the preset reference content to obtain a second matching result includes:
performing machine vision processing on the interactive content;
matching the interactive content after machine vision processing with the preset reference content through pattern matching, optical character recognition and color recognition;
when the interactive content is the same as the preset reference content, obtaining the second matching result as a matching pass;
and when the interactive content is different from the preset reference content, obtaining the second matching result as that the matching is not passed.
Optionally, the interactive content comprises at least one of:
icon content, animation content and text content.
Optionally, the obtaining of the feedback voice collected by the voice collecting device and the matching with the reference voice corresponding to the voice control instruction to obtain a third matching result includes:
performing character recognition on the feedback voice to obtain character sentences;
acquiring reference voice corresponding to the voice control instruction in a pre-stored database, wherein the reference voice comprises expected keywords;
matching the text sentences and the expected keywords through fuzzy matching;
when the matching value of the text statement and the expected keyword is greater than or equal to a preset threshold value, obtaining the third matching result as a matching pass;
and when the matching value of the text statement and the expected keyword is smaller than a preset threshold value, obtaining the third matching result as that the matching is failed.
Optionally, the method further comprises:
and uploading the feedback voice acquired by the voice acquisition device to a cloud server.
Optionally, determining whether the vehicle-mounted voice interaction function passes the detection according to the first matching result, the second matching result, and the third matching result, including:
and when the first matching result, the second matching result and the third matching result are matched, judging that the vehicle-mounted voice interaction function of the vehicle-mounted central control system passes detection.
The embodiment of the invention also provides a device for detecting the vehicle-mounted voice interaction function, which comprises:
the control module is used for controlling the sound generating device to send a voice control instruction to the vehicle-mounted central control system;
the first acquisition module is used for acquiring the control message detected by the bus message detection device and matching the control message with the reference message corresponding to the voice control instruction to acquire a first matching result;
the second acquisition module is used for acquiring the interactive content acquired by the camera device, and matching the interactive content with preset reference content to acquire a second matching result;
the third acquisition module is used for acquiring the feedback voice acquired by the voice acquisition device, and matching the feedback voice with the reference voice corresponding to the voice control instruction to acquire a third matching result;
and the judging module is used for judging whether the vehicle-mounted voice interaction function of the vehicle-mounted central control system passes the detection or not according to the first matching result, the second matching result and the third matching result.
The embodiment of the present invention further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and the program or the instruction, when executed by a processor, implements the steps of the method for detecting a vehicle-mounted voice interaction function according to any one of the above.
The technical scheme of the invention at least has the following beneficial effects:
in the above solution, the system for detecting the vehicle-mounted voice interaction function includes: the system comprises a main control device, a sound production device, a bus message detection device, a camera device and a voice acquisition device; the main control device is respectively connected with the sound production device, the voice acquisition device, the message detection device and the camera device; the sounding device is used for sending a voice control instruction to the vehicle-mounted central control system; the bus message detection device is used for detecting a control message in a bus inside the vehicle; the camera device is used for acquiring interactive contents displayed on the vehicle-mounted central control system; the voice acquisition device is used for acquiring feedback voice of the vehicle-mounted central control system; and the main control device is used for detecting the vehicle-mounted voice interaction function of the vehicle-mounted central control system according to the voice control instruction, the interaction content and the feedback voice, so that automatic detection is realized, and the detection accuracy of the vehicle-mounted voice interaction function is improved.
Drawings
FIG. 1 is a schematic diagram of a detection system for vehicle-mounted voice interaction function according to an embodiment of the present invention;
FIG. 2 is a flowchart of a method for detecting a vehicle-mounted voice interaction function according to an embodiment of the present invention;
FIG. 3 is a second flowchart of a method for detecting vehicle-mounted voice interaction function according to an embodiment of the present invention;
fig. 4 is a schematic diagram of a detection apparatus for a vehicle-mounted voice interaction function according to an embodiment of the present invention.
Detailed Description
To make the technical problems, technical solutions and advantages of the present invention more apparent, the following detailed description is given with reference to the accompanying drawings and specific embodiments.
The embodiment of the invention provides a system, a method and a device for detecting a vehicle-mounted voice interaction function, aiming at the problem of how to detect the vehicle-mounted voice interaction function in the prior art.
It should be noted that, in the embodiments and the following embodiments of the present invention, only the vehicle-mounted voice assistant disposed in the vehicle-mounted central control system is taken as an example, the vehicle-mounted voice assistant may also be disposed in the intelligent cockpit system, and has a vehicle-mounted voice interaction function, and the vehicle-mounted voice assistant includes voice acquisition, intelligent voice recognition and networking functions, can recognize a voice instruction, interacts with the entire vehicle, and controls a related vehicle controller to work, so as to implement voice interaction.
As shown in fig. 1, an embodiment of the present invention provides a system for detecting a vehicle-mounted voice interaction function, including:
the system comprises a main control device, a sound production device, a bus message detection device, a camera device and a voice acquisition device;
the main control device is respectively connected with the sound production device, the voice acquisition device, the bus message detection device and the camera device;
it should be noted that the master control device may be a host, and the host is externally provided with the sound generating device, the voice collecting device, the bus message detecting device, and the camera device.
The voice device is used for sending a voice control instruction to the vehicle-mounted central control system;
it should be noted that the sound generating device may be a simulated mouth, and the main control device controls the output of the synthesized voice, belonging to the simulated human voice, without deviation caused by physical discomfort or occasional pronunciation error. The sounding device can increase the number of the speakers by setting, can simulate enough sounds and cover different age groups and regional characteristics.
The bus message detection device is used for detecting a control message in a bus inside the vehicle;
in the embodiment of the invention, the bus message detection device has a CAN bus network simulation function, and the master control device is controlled to collect and detect the messages on the CAN bus of the whole vehicle and is used for verifying whether the control messages sent by the vehicle-mounted voice assistant after analyzing the voice control instruction are matched with the reference content.
The camera device is used for acquiring interactive contents displayed on the vehicle-mounted central control system;
in the embodiment of the invention, the camera device is used for collecting interactive contents displayed on the vehicle-mounted central control system, and the interactive contents comprise at least one of icon contents, dynamic effect contents and character contents. The camera device sends the collected interactive content to the main control device, and verifies whether the interactive content related to the vehicle-mounted voice assistant is matched with preset reference content or not by means of comprehensive detection means such as mode matching, optical character recognition and color recognition through machine vision processing.
It should be noted that the camera device may further adopt a machine vision system, where the machine vision system includes an industrial camera, an image acquisition card and upper computer machine vision software, and adopts detection means such as pattern matching, optical character recognition, color recognition, etc., and also adopts detection means such as region-of-interest setting, etc.
The voice acquisition device is used for acquiring feedback voice of the vehicle-mounted central control system;
in the embodiment of the invention, the voice device transmits the collected feedback voice to the main control device, and the main control device performs character recognition on the collected feedback voice to acquire character sentences; acquiring the reference voice corresponding to the voice control instruction in a pre-stored database, wherein the reference voice comprises expected keywords; and matching the text sentences with the expected keywords, wherein when the matching value of the text sentences and the expected keywords is greater than or equal to a preset threshold value, the feedback result representing the vehicle-mounted voice assistant is correct. And the preset threshold value is set according to the statistic value of the test result.
And the main control device is used for detecting the vehicle-mounted voice interaction function of the vehicle-mounted central control system according to the voice control instruction, the interaction content and the feedback voice.
In this embodiment of the present invention, the detection system of the vehicle-mounted voice interaction function includes: the system comprises a main control device, a sound production device, a bus message detection device, a camera device and a voice acquisition device; the main control device is respectively connected with the sound production device, the voice acquisition device, the message detection device and the camera device; the voice device is used for sending a voice control instruction to the vehicle-mounted central control system; the bus message detection device is used for detecting a control message in a bus inside the vehicle; the camera device is used for acquiring interactive contents displayed on the vehicle-mounted central control system; the voice acquisition device is used for acquiring feedback voice of the vehicle-mounted central control system; and the main control device is used for detecting the vehicle-mounted voice interaction function of the vehicle-mounted central control system according to the voice control instruction, the interaction content and the feedback voice, so that automatic detection is realized, and the detection accuracy of the vehicle-mounted voice interaction function is improved.
Optionally, the system for detecting the vehicle-mounted voice interaction function further includes:
and the cloud server is connected with the main control device through a network and is used for identifying the feedback voice acquired by the voice acquisition device.
In this embodiment, the voice collecting device sends the collected feedback voice to the main control device, and the main control device and the cloud server jointly realize complete recognition of the feedback voice.
As shown in fig. 2, an embodiment of the present invention further provides a method for detecting a vehicle-mounted voice interaction function, which is applied to a system for detecting a vehicle-mounted voice interaction function, and includes:
in the embodiment of the present invention, the following steps are described by taking the voice control command as "turn on the air conditioner" as an example.
It should be noted that the number of the speakers can be increased by setting the sound generating device, so that enough sounds can be simulated, different age groups and different regional characteristics can be covered, and the detection range of the vehicle-mounted voice assistant for voice recognition can be enlarged.
it should be noted that, after the vehicle-mounted voice assistant receives the voice control instruction of "turn on the air conditioner", the vehicle-mounted voice assistant sends a control message for controlling the turn on of the air conditioner to the air conditioner, and the bus message detection device detects the control message. And acquiring the control message, and matching the control message with the reference message corresponding to the voice control instruction to acquire a first matching result.
in the embodiment of the invention, after the vehicle-mounted voice assistant receives the voice control command of turning on the air conditioner, the vehicle-mounted voice assistant on the vehicle-mounted central control system is activated to display interactive contents related to the air conditioner, wherein the interactive contents comprise at least one of icon contents, dynamic effect contents and character contents. The camera device collects the interactive content. And acquiring the interactive content, and matching the interactive content with preset reference content to acquire a second matching result.
in the embodiment of the invention, when the second matching result is that the matching is passed and the control message corresponding to the voice control instruction is issued to the air conditioner, after the air conditioner is turned on, the vehicle-mounted voice assistant sends a feedback voice that the air conditioner is successfully turned on, and the voice collecting device collects the feedback voice. And acquiring the feedback voice, and matching the feedback voice with the reference voice corresponding to the voice control instruction to acquire a third matching result.
The embodiment of the invention sends a voice control instruction to the vehicle-mounted central control system by controlling the sound generating device; acquiring a control message detected by the bus message detection device, and matching the control message with a reference message corresponding to the voice control instruction to acquire a first matching result; acquiring interactive contents acquired by the camera device, and matching the interactive contents with preset reference contents to acquire a second matching result; acquiring feedback voice acquired by the voice acquisition device, and matching the feedback voice with reference voice corresponding to the voice control instruction to acquire a third matching result; and judging whether the vehicle-mounted voice interaction function passes the detection or not according to the first matching result, the second matching result and the third matching result, so that the vehicle-mounted voice interaction function of the vehicle-mounted central control system is detected, the aim of automatic detection is fulfilled, and the detection accuracy of the vehicle-mounted voice interaction function is improved.
According to the detection method for the vehicle-mounted voice interaction function, after the voice control instruction is sent out, whether the recognition and execution functions of the vehicle-mounted voice assistant pass or not is monitored through the bus message detection device, and the camera device and the voice acquisition device are used for further detection, so that the purposes of intelligent voice acquisition, detection and interaction are achieved.
Optionally, in step 202, obtaining the control packet detected by the bus packet detection apparatus, and matching the control packet with the reference packet corresponding to the voice control instruction to obtain a first matching result, including:
when the control message is the same as the reference message, obtaining the first matching result as a matching pass;
and when the control message is different from the reference message, obtaining the first matching result as that the matching is not passed.
In the embodiment of the invention, when the control message is the same as the reference message, the voice recognition and execution functions of the vehicle-mounted voice assistant are judged to pass.
It should be noted that the bus message detection device has a CAN bus network simulation function, and the bus message detection device CAN collect and detect messages on a CAN bus of the entire vehicle, and is used for verifying whether a control message sent by the vehicle-mounted voice assistant after analyzing the voice control instruction is matched with reference content.
Optionally, step 203: acquiring the interactive content acquired by the camera device, matching the interactive content with preset reference content, and acquiring a second matching result, wherein the second matching result comprises:
performing machine vision processing on the interactive content;
matching the interactive content after machine vision processing with the preset reference content through pattern matching, optical character recognition and color recognition;
when the interactive content is the same as the preset reference content, obtaining the second matching result as a matching pass;
and when the interactive content is different from the preset reference content, obtaining the second matching result as that the matching is not passed.
It should be noted that the above steps can also be performed by using a machine vision system, where the machine vision system includes an industrial camera, an image acquisition card and upper computer machine vision software, and performs detection by setting an area of interest in addition to detection means such as pattern matching, optical character recognition and color recognition.
Optionally, the interactive content comprises at least one of:
icon content, animation content and text content.
In the embodiment of the invention, the icon content comprises a vehicle-mounted voice assistant display icon, an air conditioner icon or an opened air conditioner icon; the dynamic effect content can display the action of waiting for an air conditioner to be turned on or comprises a dynamic icon of the vehicle-mounted voice assistant; the text content comprises that the vehicle-mounted voice assistant is activated, waits for an air conditioner to be turned on or the air conditioner is turned on, and the like.
Optionally, step 204: obtaining feedback voice collected by the voice collecting device, matching the feedback voice with reference voice corresponding to the voice control instruction, and obtaining a third matching result, wherein the third matching result comprises:
performing character recognition on the feedback voice to obtain character sentences;
acquiring reference voice corresponding to the voice control instruction in a pre-stored database, wherein the reference voice comprises expected keywords;
matching the text sentences and the expected keywords through fuzzy matching;
when the matching value of the text statement and the expected keyword is greater than or equal to a preset threshold value, obtaining the third matching result as a matching pass;
and when the matching value of the text statement and the expected keyword is smaller than a preset threshold value, obtaining the third matching result as that the matching is failed.
In the embodiment of the invention, the feedback voice of the air conditioner which is successfully opened is subjected to character recognition, and the obtained character voice is 'air, air conditioner, finished, successful, open and open'; in a pre-stored database, acquiring a reference voice corresponding to the voice control instruction of turning on an air conditioner, wherein the reference voice comprises an expected keyword, the expected keyword can be 'air conditioner, turning on', and calculating a matching value between the text sentence and the expected keyword as
Greater than or equal to a preset threshold value (the preset threshold value is set according to the statistic value of the test result, here, the preset threshold value is
) And if so, the third matching result is that the matching is passed.
Optionally, the method for detecting the vehicle-mounted voice interaction function further includes:
and uploading the feedback voice collected by the voice collection device to a cloud server.
In the embodiment of the invention, the cloud server comprises the database, so that the text recognition can be performed on the feedback voice, and the complete recognition of the feedback voice is realized.
Optionally, step 205: judging whether the vehicle-mounted voice interaction function passes the detection according to the first matching result, the second matching result and the third matching result, including:
and when the first matching result, the second matching result and the third matching result are matched, judging that the vehicle-mounted voice interaction function of the vehicle-mounted central control system passes detection.
In the embodiment of the invention, when the first matching result passes, the vehicle-mounted voice assistant is proved to identify and analyze the control voice command to issue a correct control message; when the second matching result passes, the interactive content related to the vehicle-mounted voice assistant and displayed on a vehicle-mounted central control screen of the vehicle-mounted central control system is proved to be correct; and when the third matching result passes, the feedback voice sent by the vehicle-mounted voice assistant is proved to be correct. And when the first matching result, the second matching result and the third matching result are matched, judging that the vehicle-mounted voice interaction function of the vehicle-mounted voice assistant passes the detection.
As shown in fig. 3, a specific embodiment of the present invention is explained:
step 301: the detection system of the vehicle-mounted voice interaction function starts to detect;
step 302: controlling the sound generating device to send a voice control instruction;
step 303: acquiring a control message on a CAN bus of the vehicle detected by a bus message detection device, and matching the control message with a reference message corresponding to the voice control instruction to acquire a first matching result;
step 304: judging whether the first matching result passes or not;
step 305: acquiring interactive contents related to the vehicle-mounted voice assistant, which are acquired by the camera device and displayed on the vehicle-mounted central control screen, matching the interactive contents with preset reference contents, and acquiring a second matching result;
step 306: judging whether the second matching result passes;
step 307: when the second matching result is passed, acquiring feedback voice sent by the vehicle-mounted voice assistant and acquired by the voice acquisition device;
step 308: matching the feedback voice with a reference voice corresponding to the voice control instruction to obtain a third matching result;
step 309: judging whether the third matching result passes;
step 310: when any one of the first matching result, the second matching result and the third matching result fails, indicating that the detection of the vehicle-mounted voice interaction function fails;
step 311: and when the first matching result, the second matching result and the third matching result are all passed, the detection success of the vehicle-mounted voice interaction function is represented.
As shown in fig. 4, an embodiment of the present invention further provides a device for detecting a vehicle-mounted voice interaction function, including:
the control module 401 is used for controlling the sound generating device to send a voice control instruction to the vehicle-mounted central control system;
a first obtaining module 402, configured to obtain a control packet detected by the bus packet detection apparatus, and match the control packet with a reference packet corresponding to the voice control instruction to obtain a first matching result;
a second obtaining module 403, configured to obtain the interactive content collected by the camera device, and match the interactive content with preset reference content to obtain a second matching result;
a third obtaining module 404, configured to obtain the feedback voice collected by the voice collecting device, and match the feedback voice with the reference voice corresponding to the voice control instruction to obtain a third matching result;
and a judging module 405, configured to judge whether the vehicle-mounted voice interaction function of the vehicle-mounted central control system passes the detection according to the first matching result, the second matching result, and the third matching result.
The embodiment of the invention sends a voice control instruction to the vehicle-mounted central control system by controlling the sound generating device; acquiring a control message detected by the bus message detection device, and matching the control message with a reference message corresponding to the voice control instruction to acquire a first matching result; acquiring interactive contents acquired by the camera device, and matching the interactive contents with preset reference contents to acquire a second matching result; acquiring feedback voice acquired by the voice acquisition device, and matching the feedback voice with reference voice corresponding to the voice control instruction to acquire a third matching result; and judging whether the vehicle-mounted voice interaction function passes the detection or not according to the first matching result, the second matching result and the third matching result, so that the vehicle-mounted voice interaction function of the vehicle-mounted central control system is detected, the aim of automatic detection is fulfilled, and the detection accuracy of the vehicle-mounted voice interaction function is improved.
Optionally, the first obtaining module 402 is specifically configured to:
when the control message is the same as the reference message, obtaining the first matching result as a matching pass;
and when the control message is different from the reference message, obtaining the first matching result as that the matching is not passed.
Optionally, the second obtaining module 402 is specifically configured to:
performing machine vision processing on the interactive content;
matching the interactive content after machine vision processing with the preset reference content through pattern matching, optical character recognition and color recognition;
when the interactive content is the same as the preset reference content, obtaining the second matching result as a matching pass;
and when the interactive content is different from the preset reference content, obtaining the second matching result as that the matching is not passed.
Optionally, the interactive content comprises at least one of:
icon content, animation content and text content.
Optionally, the third obtaining module 404 is specifically configured to:
performing character recognition on the feedback voice to obtain character sentences;
acquiring reference voice corresponding to the voice control instruction in a pre-stored database, wherein the reference voice comprises expected keywords;
matching the text sentences and the expected keywords through fuzzy matching;
when the matching value of the text statement and the expected keyword is greater than or equal to a preset threshold value, obtaining the third matching result as a matching pass;
and when the matching value of the text statement and the expected keyword is smaller than a preset threshold value, obtaining the third matching result as that the matching is failed.
Optionally, the apparatus further comprises:
and the uploading module is used for uploading the feedback voice acquired by the voice acquisition device to a cloud server.
Optionally, the determining module 405 is specifically configured to:
and when the first matching result, the second matching result and the third matching result are matched, judging that the vehicle-mounted voice interaction function of the vehicle-mounted central control system passes detection.
The embodiment of the present invention further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and the program or the instruction, when executed by a processor, implements the steps of the method for detecting a vehicle-mounted voice interaction function according to any one of the above.
In this embodiment of the present invention, the readable storage medium executes the steps of the method for detecting a vehicle-mounted voice interaction function, and all embodiments of the method for detecting a vehicle-mounted voice interaction function are applicable to the readable storage medium and can achieve the same or similar beneficial effects, which are not described herein again.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (11)
1. A detection system for vehicle-mounted voice interaction function is characterized by comprising:
the system comprises a main control device, a sound production device, a bus message detection device, a camera device and a voice acquisition device;
the main control device is respectively connected with the sound production device, the voice acquisition device, the bus message detection device and the camera device;
the voice device is used for sending a voice control instruction to the vehicle-mounted central control system;
the bus message detection device is used for detecting a control message in a bus inside the vehicle;
the camera device is used for acquiring interactive contents displayed on the vehicle-mounted central control system;
the voice acquisition device is used for acquiring feedback voice of the vehicle-mounted central control system;
and the main control device is used for detecting the vehicle-mounted voice interaction function of the vehicle-mounted central control system according to the voice control instruction, the interaction content and the feedback voice.
2. The system for detecting the vehicle-mounted voice interaction function according to claim 1, further comprising:
and the cloud server is connected with the main control device through a network and is used for identifying the feedback voice acquired by the voice acquisition device.
3. A method for detecting a vehicle-mounted voice interaction function, applied to the system for detecting a vehicle-mounted voice interaction function according to any one of claims 1 to 2, comprising:
controlling the sound generating device to send a voice control instruction to the vehicle-mounted central control system;
acquiring a control message detected by the bus message detection device, and matching the control message with a reference message corresponding to the voice control instruction to acquire a first matching result;
acquiring interactive contents acquired by the camera device, and matching the interactive contents with preset reference contents to acquire a second matching result;
acquiring feedback voice acquired by the voice acquisition device, and matching the feedback voice with reference voice corresponding to the voice control instruction to acquire a third matching result;
and judging whether the vehicle-mounted voice interaction function passes the detection or not according to the first matching result, the second matching result and the third matching result.
4. The detection method according to claim 3, wherein obtaining the control packet detected by the bus packet detection apparatus, and matching the control packet with the reference packet corresponding to the voice control instruction to obtain a first matching result comprises:
when the control message is the same as the reference message, obtaining the first matching result as a matching pass;
and when the control message is different from the reference message, obtaining the first matching result as that the matching is not passed.
5. The detection method according to claim 3, wherein the step of obtaining the interactive content collected by the camera device and matching the interactive content with a preset reference content to obtain a second matching result comprises:
performing machine vision processing on the interactive content;
matching the interactive content after machine vision processing with the preset reference content through pattern matching, optical character recognition and color recognition;
when the interactive content is the same as the preset reference content, obtaining the second matching result as a matching pass;
and when the interactive content is different from the preset reference content, obtaining the second matching result as that the matching is not passed.
6. The detection method according to claim 3 or 5, wherein the interactive content comprises at least one of:
icon content, animation content and text content.
7. The detection method according to claim 3, wherein obtaining the feedback voice collected by the voice collection device, and matching the feedback voice with the reference voice corresponding to the voice control instruction to obtain a third matching result comprises:
performing character recognition on the feedback voice to obtain a character sentence;
acquiring reference voice corresponding to the voice control instruction in a pre-stored database, wherein the reference voice comprises expected keywords;
matching the text sentences and the expected keywords through fuzzy matching;
when the matching value of the text statement and the expected keyword is greater than or equal to a preset threshold value, obtaining the third matching result as a matching pass;
and when the matching value of the text statement and the expected keyword is smaller than a preset threshold value, obtaining the third matching result as that the matching is failed.
8. The detection method according to claim 3, further comprising:
and uploading the feedback voice acquired by the voice acquisition device to a cloud server.
9. The method for detecting the vehicle-mounted voice interaction function according to claim 3, wherein judging whether the vehicle-mounted voice interaction function passes the detection according to the first matching result, the second matching result and the third matching result comprises:
and when the first matching result, the second matching result and the third matching result are matched, judging that the vehicle-mounted voice interaction function of the vehicle-mounted central control system passes detection.
10. The utility model provides a detection apparatus for on-vehicle voice interaction function, its characterized in that includes:
the control module is used for controlling the sound generating device to send a voice control instruction to the vehicle-mounted central control system;
the first acquisition module is used for acquiring the control message detected by the bus message detection device and matching the control message with the reference message corresponding to the voice control instruction to acquire a first matching result;
the second acquisition module is used for acquiring the interactive content acquired by the camera device and matching the interactive content with the preset reference content to acquire a second matching result;
the third acquisition module is used for acquiring the feedback voice acquired by the voice acquisition device and matching the feedback voice with the reference voice corresponding to the voice control instruction to acquire a third matching result;
and the judging module is used for judging whether the vehicle-mounted voice interaction function of the vehicle-mounted central control system passes the detection or not according to the first matching result, the second matching result and the third matching result.
11. A readable storage medium, characterized in that the readable storage medium stores thereon a program or instructions which, when executed by a processor, implement the steps of the detection method of the vehicle-mounted voice interaction function according to any one of claims 3 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110116856.5A CN114664286A (en) | 2021-01-28 | 2021-01-28 | Detection system, method and device for vehicle-mounted voice interaction function |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110116856.5A CN114664286A (en) | 2021-01-28 | 2021-01-28 | Detection system, method and device for vehicle-mounted voice interaction function |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114664286A true CN114664286A (en) | 2022-06-24 |
Family
ID=82026266
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110116856.5A Pending CN114664286A (en) | 2021-01-28 | 2021-01-28 | Detection system, method and device for vehicle-mounted voice interaction function |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114664286A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202710079U (en) * | 2012-06-28 | 2013-01-30 | 惠州市德赛西威汽车电子有限公司 | Navigation voice guidance automatic testing system based on voice recognition technology |
| US20140278439A1 (en) * | 2013-03-14 | 2014-09-18 | Accenture Global Services Limited | Voice based automation testing for hands free module |
| CN109285543A (en) * | 2018-09-07 | 2019-01-29 | 惠州市德赛西威汽车电子股份有限公司 | A kind of vehicle-mounted multimedia navigating instrument voice automatization test system |
| CN110379426A (en) * | 2019-08-26 | 2019-10-25 | 北京汽车股份有限公司 | Vehicle-mounted voice system test device and tone testing system |
| CN110503960A (en) * | 2019-09-26 | 2019-11-26 | 大众问问(北京)信息科技有限公司 | Uploaded in real time method, apparatus, equipment and the storage medium of speech recognition result |
| CN111341296A (en) * | 2020-02-17 | 2020-06-26 | 诚迈科技（南京）股份有限公司 | Voice-controlled response test method, test machine and storage medium |
| US10860648B1 (en) * | 2018-09-12 | 2020-12-08 | Amazon Technologies, Inc. | Audio locale mismatch detection |
-
2021
- 2021-01-28 CN CN202110116856.5A patent/CN114664286A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202710079U (en) * | 2012-06-28 | 2013-01-30 | 惠州市德赛西威汽车电子有限公司 | Navigation voice guidance automatic testing system based on voice recognition technology |
| US20140278439A1 (en) * | 2013-03-14 | 2014-09-18 | Accenture Global Services Limited | Voice based automation testing for hands free module |
| CN109285543A (en) * | 2018-09-07 | 2019-01-29 | 惠州市德赛西威汽车电子股份有限公司 | A kind of vehicle-mounted multimedia navigating instrument voice automatization test system |
| US10860648B1 (en) * | 2018-09-12 | 2020-12-08 | Amazon Technologies, Inc. | Audio locale mismatch detection |
| CN110379426A (en) * | 2019-08-26 | 2019-10-25 | 北京汽车股份有限公司 | Vehicle-mounted voice system test device and tone testing system |
| CN110503960A (en) * | 2019-09-26 | 2019-11-26 | 大众问问(北京)信息科技有限公司 | Uploaded in real time method, apparatus, equipment and the storage medium of speech recognition result |
| CN111341296A (en) * | 2020-02-17 | 2020-06-26 | 诚迈科技（南京）股份有限公司 | Voice-controlled response test method, test machine and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103528617B (en) | A kind of cockpit instrument identifies and detection method and device automatically | |
| CN111724782B (en) | Response time testing system, method and equipment of vehicle-mounted voice interaction system | |
| WO2019196205A1 (en) | Foreign language teaching evaluation information generating method and apparatus | |
| CN111652087B (en) | Car inspection method, device, electronic equipment and storage medium | |
| CN113567778B (en) | Scene-based real-vehicle automatic testing method for vehicle-mounted information entertainment system | |
| WO2023001169A1 (en) | Automobile instrument test method, apparatus and system, and storage medium | |
| CN108711152B (en) | Image analysis method and device based on AI technology and user terminal | |
| CN111141529B (en) | Automatic test method for automobile instrument signals | |
| CN109616106A (en) | Vehicle-mounted control screen voice recognition process testing method, electronic equipment and system | |
| CN110308346A (en) | Cockpit display system automatic test approach and system based on image recognition | |
| CN112686322A (en) | Part difference identification method, device, equipment and storage medium | |
| CN112286825A (en) | Screen testing method and device for intelligent cabin and electronic equipment | |
| WO2022062968A1 (en) | Self-training method, system, apparatus, electronic device, and storage medium | |
| CN114664286A (en) | Detection system, method and device for vehicle-mounted voice interaction function | |
| CN110322587A (en) | Evaluation recording method, device, equipment and storage medium in driving procedure | |
| CN112687140A (en) | Assessment automatic scoring method, device and system | |
| CN116616691A (en) | Man-machine interaction vision detection method and system based on virtual reality | |
| CN110108510A (en) | Based on embedded system automobile electronics intelligent checking system and its method | |
| CN116645683A (en) | Signature handwriting identification method, system and storage medium based on prompt learning | |
| CN114049598B (en) | State identification method and device of power primitive, storage medium and electronic equipment | |
| CN107871113B (en) | Emotion hybrid recognition detection method and device | |
| CN114936358A (en) | Human-computer interaction based verification method and verification system | |
| CN114264904A (en) | Full liquid crystal instrument testing method and system based on simulation and machine vision | |
| CN113590399A (en) | Automatic testing system and method for vehicle-mounted voice | |
| CN110046067B (en) | Interface testing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |