CN111696561A - Voice interaction system and method based on auditory, visual and olfactory feedback - Google Patents
Voice interaction system and method based on auditory, visual and olfactory feedback Download PDFInfo
- Publication number
- CN111696561A CN111696561A CN202010459814.7A CN202010459814A CN111696561A CN 111696561 A CN111696561 A CN 111696561A CN 202010459814 A CN202010459814 A CN 202010459814A CN 111696561 A CN111696561 A CN 111696561A
- Authority
- CN
- China
- Prior art keywords
- sound
- voice
- microphone
- host
- auditory
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 24
- 230000000007 visual effect Effects 0.000 title claims abstract description 20
- 238000000034 method Methods 0.000 title claims abstract description 14
- 239000003205 fragrance Substances 0.000 claims abstract description 13
- 230000004044 response Effects 0.000 claims description 9
- 230000008859 change Effects 0.000 claims description 3
- 230000000694 effects Effects 0.000 claims description 3
- 206010037844 rash Diseases 0.000 claims 2
- 230000008569 process Effects 0.000 abstract description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000001681 protective effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L17/00—Speaker identification or verification
- G10L17/22—Interactive procedures; Man-machine interfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
Abstract
The invention belongs to the technical field of automobiles, and particularly relates to a voice interaction system and method based on auditory, visual and olfactory feedback. The system comprises a microphone, a sound host, a voice engine, a loudspeaker, a central control screen, an atmosphere lamp and a fragrance system; the microphone and the sound host are connected through a wire harness; the sound host and the voice engine are connected by a software interface; the voice engine is connected with the loudspeaker, the central control screen, the atmosphere lamp and the fragrance system through a wire harness. The invention can correspond to the vision, hearing and smell of the driver in multiple channels in the voice interaction process of the driver and the real vehicle, and creates an ceremonial interaction mode for the user so as to achieve the purpose of improving the ceremonial and scientific senses of the cockpit.
Description
Technical Field
The invention belongs to the technical field of automobiles, and particularly relates to a voice interaction system and method based on auditory, visual and olfactory feedback.
Background
The intelligent vehicle is a comprehensive system integrating functions of environmental perception, planning decision, multi-level auxiliary driving and the like, intensively applies technologies such as computer, modern sensing, information fusion, communication, artificial intelligence, automatic control and the like, and is a typical high and new technology complex. The current research on intelligent vehicles mainly aims to improve the safety and the comfort of automobiles and provide excellent human-vehicle interaction interfaces. In recent years, intelligent vehicles have become hot spots for the research in the field of vehicle engineering in the world and new power for the growth of the automobile industry, and many developed countries incorporate the intelligent vehicles into intelligent transportation systems which are intensively developed.
With the gradual popularization of the concept of the intelligent passenger cabins, each large car factory can vigorously build the layout of the personalized intelligent passenger cabins. Most importantly, the five-sense information which can improve the perception of the user is the most important, and how to reasonably combine the five senses is a subject to be considered in the future.
Disclosure of Invention
The invention provides a voice interaction system and method based on auditory, visual and olfactory feedback, wherein in the voice interaction process of a driver and a real vehicle, the real vehicle feeds back the visual, auditory and olfactory aspects of the driver so as to achieve the purpose of improving the ceremonies and the technological senses of a cabin, and the market blank of how to reasonably combine five senses of the existing intelligent cabin is filled.
The technical scheme of the invention is described as follows by combining the attached drawings:
a voice interaction system based on auditory, visual and olfactory feedback comprises a microphone 1, a sound host 2, a voice engine 3, a loudspeaker 4, a central control screen 5, an atmosphere lamp 6 and an atmosphere system 7; the microphone 1 and the sound host 2 are connected through a wire harness; the sound host 2 and the voice engine 3 are connected by a software interface; the voice engine 3 is connected with the loudspeaker 4, the central control screen 5, the atmosphere lamp 6 and the atmosphere system 7 through a wire harness.
The microphone 1 is used for receiving the voice of a user 8 and transmitting a voice file to the sound host 2;
the sound equipment main machine 2 is used for judging sound, and the main machine executes corresponding distribution to the judgment result according to a preset logic and respectively distributes to corresponding control units;
the speech engine 3 is used for converting the judgment result into audible sound information;
the loudspeaker 4 is used for playing corresponding prompt tones and reply words;
the central control screen 5 is used for dynamically displaying a corresponding result;
the atmosphere lamp 6 is used for reminding a user 8 through flickering and color changing of fixed frequency;
the fragrance system 7 is used to perform multiple scent burst for different instructions.
A voice interaction method based on auditory, visual and olfactory feedback, the interaction method comprising the following steps:
step one, when a user 8 initiates voice interaction in an automobile cabin, receiving the voice of the user 8 through a microphone 1, and transmitting a sound file of the user 8 to a sound host 2 through the microphone 1;
step two, the voice assistant engine of the sound host 2 judges the sound, and the host executes corresponding distribution to the judgment result according to the preset logic and distributes the judgment result to the corresponding control units respectively;
step three, the loudspeaker 4 makes auditory response to the response sound;
step four, the central control screen 5 executes visual display of the main result and the UI dynamic effect;
fifthly, the atmosphere lamp 6 carries out visual display through flickering and color change with fixed frequency;
and step six, the fragrance system 7 executes the eruption of various fragrance types to achieve olfactory response.
The invention has the beneficial effects that:
in the voice interaction process of the driver and the real vehicle, the real vehicle can feed back the visual sense, the auditory sense and the olfactory sense of the driver so as to achieve the purpose of improving the ceremony sense and the science and technology sense of the cabin.
Drawings
FIG. 1 is a schematic structural diagram of the present invention.
In the figure: 1. a microphone;
2. a sound host;
3. a speech engine;
4. a speaker;
5. a central control screen;
6. an atmosphere lamp;
7. a fragrance system;
8. a user.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, a voice interaction system based on auditory, visual and olfactory feedback comprises a microphone 1, a main audio unit 2, a voice engine 3, a loudspeaker 4, a central control screen 5, an atmosphere lamp 6 and an atmosphere system 7.
The microphone 1 and the sound host 2 are connected through a wire harness; the sound host 2 and the voice engine 3 are connected by a software interface; the voice engine 3 is connected with the loudspeaker 4, the central control screen 5, the atmosphere lamp 6 and the atmosphere system 7 through a wire harness.
The microphone 1 is used for receiving the voice of a user 8 and transmitting a voice file to the sound host 2;
the sound equipment main machine 2 is used for judging sound, and the main machine executes corresponding distribution to the judgment result according to a preset logic and respectively distributes to corresponding control units;
the speech engine 3 is used for converting the judgment result into audible sound information;
the loudspeaker 4 is used for playing corresponding prompt tones and reply words;
the central control screen 5 is used for dynamically displaying a corresponding result;
the atmosphere lamp 6 is used for reminding a user through flickering and color changing of fixed frequency;
the fragrance system 7 is used to perform multiple scent burst for different instructions.
A voice interaction method based on auditory, visual and olfactory feedback, the interaction method comprising the following steps:
step one, when a user 8 initiates voice interaction in an automobile cabin, receiving the voice of the user 8 through a microphone 1, and transmitting a sound file of the user 8 to a sound host 2 through the microphone 1;
step two, the voice assistant engine of the sound host 2 judges the sound, and the host executes corresponding distribution to the judgment result according to the preset logic and distributes the judgment result to the corresponding control units respectively;
step three, the loudspeaker 4 makes auditory response to the response sound;
step four, the central control screen 5 executes visual display of the main result and the UI dynamic effect;
fifthly, the atmosphere lamp 6 carries out visual display through flickering and color change with fixed frequency;
and step six, the fragrance system 7 executes the eruption of various fragrance types to achieve olfactory response.
The invention responds in multiple channels, and finally creates a ceremonial interaction mode for users.
The preferred embodiments of the present invention have been described in detail with reference to the accompanying drawings, however, the present invention is not limited to the specific details of the above embodiments, and various simple modifications can be made to the technical solution of the present invention within the technical idea of the present invention, and these simple modifications are within the protective scope of the present invention.
It should be noted that the various technical features described in the above embodiments can be combined in any suitable manner without contradiction, and the invention is not described in any way for the possible combinations in order to avoid unnecessary repetition.
In addition, any combination of the various embodiments of the present invention is also possible, and the same should be considered as the disclosure of the present invention as long as it does not depart from the spirit of the present invention.
Claims (3)
1. A voice interaction system based on auditory, visual and olfactory feedback is characterized by comprising a microphone (1), a sound main unit (2), a voice engine (3), a loudspeaker (4), a central control screen (5), an atmosphere lamp (6) and an atmosphere system (7); the microphone (1) and the sound host (2) are connected through a wire harness; the sound equipment host (2) and the voice engine (3) are connected by a software interface; the voice engine (3), the loudspeaker (4), the central control screen (5), the atmosphere lamp (6) and the atmosphere system (7) are connected through a wire harness.
2. A speech interaction system based on auditory, visual and olfactory feedback according to claim 1, characterized in that the microphone (1) is used to receive the speech of the user (8) and to transmit the speech file to the sound host (2); the sound equipment main machine (2) is used for judging sound, and the main machine correspondingly distributes the judgment result according to the preset logic and respectively distributes the judgment result to the corresponding control units; the voice engine (3) is used for converting the judgment result into audible sound information; the loudspeaker (4) is used for playing corresponding prompt tones and reply words; the central control screen (5) is used for dynamically displaying a corresponding result; the atmosphere lamp (6) is used for reminding a user through flickering and color changing of fixed frequency; the fragrance system (7) is used for carrying out multiple fragrance component eruptions for different instructions.
3. A voice interaction method based on auditory, visual and olfactory feedback according to claim 1, characterized in that the interaction method comprises the following steps:
step one, when a user (8) initiates voice interaction in an automobile cabin, receiving the voice of the user (8) through a microphone (1), and transmitting a sound file of the user (8) to a sound host (2) through the microphone (1);
step two, the voice assistant engine of the sound host (2) judges the sound, and the host carries out corresponding distribution on the judgment result according to the preset logic and respectively distributes the judgment result to corresponding control units;
thirdly, the loudspeaker (4) performs auditory response to the response sound;
step four, the central control screen (5) executes visual display of the main result and the UI dynamic effect;
fifthly, the atmosphere lamp (6) carries out visual display through flickering and color change with fixed frequency;
and step six, the fragrance system (7) executes the eruption of various fragrance types to achieve olfactory response.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010459814.7A CN111696561A (en) | 2020-05-27 | 2020-05-27 | Voice interaction system and method based on auditory, visual and olfactory feedback |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010459814.7A CN111696561A (en) | 2020-05-27 | 2020-05-27 | Voice interaction system and method based on auditory, visual and olfactory feedback |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111696561A true CN111696561A (en) | 2020-09-22 |
Family
ID=72478510
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010459814.7A Pending CN111696561A (en) | 2020-05-27 | 2020-05-27 | Voice interaction system and method based on auditory, visual and olfactory feedback |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111696561A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112455370A (en) * | 2020-11-24 | 2021-03-09 | 一汽奔腾轿车有限公司 | Emotion management and interaction system and method based on multidimensional data arbitration mechanism |
| CN112530423A (en) * | 2020-11-12 | 2021-03-19 | 一汽奔腾轿车有限公司 | Semantic multi-channel distribution processing system and method based on natural language understanding |
| CN113971954A (en) * | 2021-12-23 | 2022-01-25 | 广州小鹏汽车科技有限公司 | Voice interaction method and device, vehicle and storage medium |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103295572A (en) * | 2012-08-13 | 2013-09-11 | 深圳市路畅科技股份有限公司 | Speech recognition method and car-mounted multimedia navigator system with speech recognition function |
| CN104757954A (en) * | 2015-05-05 | 2015-07-08 | 奇瑞汽车股份有限公司 | Health monitoring and comfort adjusting system and method for vehicle |
| CN105527710A (en) * | 2016-01-08 | 2016-04-27 | 北京乐驾科技有限公司 | Intelligent head-up display system |
| CN106559569A (en) * | 2016-11-20 | 2017-04-05 | 广西大学 | A kind of automobile integrated man-machine information interaction system |
| CN107657950A (en) * | 2017-08-22 | 2018-02-02 | 广州小鹏汽车科技有限公司 | Automobile speech control method, system and device based on high in the clouds and more order words |
| CN108128238A (en) * | 2017-12-25 | 2018-06-08 | 奇瑞商用车（安徽）有限公司 | A kind of voice activated control for automobile atmosphere lamp |
| CN207790472U (en) * | 2017-11-09 | 2018-08-31 | 北京兴科迪电子技术研究院 | A kind of healthy driving system |
| CN109065039A (en) * | 2018-07-12 | 2018-12-21 | 吉利汽车研究院（宁波）有限公司 | A kind of system for controlling gas generating unit |
| CN110111782A (en) * | 2019-02-26 | 2019-08-09 | 百度国际科技（深圳）有限公司 | Voice interactive method and equipment |
| CN110211585A (en) * | 2019-06-05 | 2019-09-06 | 广州小鹏汽车科技有限公司 | In-car entertainment interactive approach, device, vehicle and machine readable media |
| CN110936792A (en) * | 2019-12-18 | 2020-03-31 | 奇瑞汽车股份有限公司 | Automobile fragrance control system |
| CN110970029A (en) * | 2018-09-28 | 2020-04-07 | 上海博泰悦臻电子设备制造有限公司 | Vehicle, vehicle-mounted equipment and vehicle-mounted voice interaction method based on voice semantic recognition |
-
2020
- 2020-05-27 CN CN202010459814.7A patent/CN111696561A/en active Pending
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103295572A (en) * | 2012-08-13 | 2013-09-11 | 深圳市路畅科技股份有限公司 | Speech recognition method and car-mounted multimedia navigator system with speech recognition function |
| CN104757954A (en) * | 2015-05-05 | 2015-07-08 | 奇瑞汽车股份有限公司 | Health monitoring and comfort adjusting system and method for vehicle |
| CN105527710A (en) * | 2016-01-08 | 2016-04-27 | 北京乐驾科技有限公司 | Intelligent head-up display system |
| CN106559569A (en) * | 2016-11-20 | 2017-04-05 | 广西大学 | A kind of automobile integrated man-machine information interaction system |
| CN107657950A (en) * | 2017-08-22 | 2018-02-02 | 广州小鹏汽车科技有限公司 | Automobile speech control method, system and device based on high in the clouds and more order words |
| CN207790472U (en) * | 2017-11-09 | 2018-08-31 | 北京兴科迪电子技术研究院 | A kind of healthy driving system |
| CN108128238A (en) * | 2017-12-25 | 2018-06-08 | 奇瑞商用车（安徽）有限公司 | A kind of voice activated control for automobile atmosphere lamp |
| CN109065039A (en) * | 2018-07-12 | 2018-12-21 | 吉利汽车研究院（宁波）有限公司 | A kind of system for controlling gas generating unit |
| CN110970029A (en) * | 2018-09-28 | 2020-04-07 | 上海博泰悦臻电子设备制造有限公司 | Vehicle, vehicle-mounted equipment and vehicle-mounted voice interaction method based on voice semantic recognition |
| CN110111782A (en) * | 2019-02-26 | 2019-08-09 | 百度国际科技（深圳）有限公司 | Voice interactive method and equipment |
| CN110211585A (en) * | 2019-06-05 | 2019-09-06 | 广州小鹏汽车科技有限公司 | In-car entertainment interactive approach, device, vehicle and machine readable media |
| CN110936792A (en) * | 2019-12-18 | 2020-03-31 | 奇瑞汽车股份有限公司 | Automobile fragrance control system |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112530423A (en) * | 2020-11-12 | 2021-03-19 | 一汽奔腾轿车有限公司 | Semantic multi-channel distribution processing system and method based on natural language understanding |
| CN112455370A (en) * | 2020-11-24 | 2021-03-09 | 一汽奔腾轿车有限公司 | Emotion management and interaction system and method based on multidimensional data arbitration mechanism |
| CN113971954A (en) * | 2021-12-23 | 2022-01-25 | 广州小鹏汽车科技有限公司 | Voice interaction method and device, vehicle and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111696561A (en) | Voice interaction system and method based on auditory, visual and olfactory feedback | |
| CN105632521B (en) | A kind of random source of sound automatic sound control device based on automobile | |
| CN102711030A (en) | Intelligent audio system for vehicle and sound source adjustment method for intelligent audio system | |
| WO2005002901A1 (en) | Speed dependent service availability in a motor vehicle | |
| CN112298074A (en) | Convenient automobile personalized function setting system and setting method | |
| CN103692967A (en) | Listening position adjusting method and system for automobile sound box | |
| CN111591237A (en) | Scene-based vehicle-mounted information service system | |
| CN107585094A (en) | A kind of vehicle electronics display system and method | |
| CN112492726B (en) | Atmosphere lamp control system and method | |
| CN214507437U (en) | Atmosphere lamp control system and vehicle | |
| CN114103850A (en) | System for realizing active sound enhancement of automobile | |
| CN106274645A (en) | Control method for vehicle, device and server | |
| CN112918381B (en) | Vehicle-mounted robot welcome method, device and system | |
| CN112040619A (en) | Vehicle atmosphere lamp control system and control method thereof | |
| CN108600394A (en) | A kind of wisdom interaction screen display system based on car networking | |
| CN115071559A (en) | Vehicle-mounted atmosphere lamp dynamic adjustment method based on music rhythm | |
| CN110723067A (en) | Method for automatically adjusting voice alarm for bus and low-speed alarm | |
| CN210822028U (en) | Vehicle-mounted double-control system based on voice sound control and environment photoelectric conversion | |
| CN114435242A (en) | Automobile digital audio output method and device and warning device | |
| CN112455370A (en) | Emotion management and interaction system and method based on multidimensional data arbitration mechanism | |
| CN210555305U (en) | Electric vehicle | |
| CN209395747U (en) | Sunroof control system | |
| CN114454789A (en) | Seat temperature adjusting method based on SOA service | |
| CN112530423A (en) | Semantic multi-channel distribution processing system and method based on natural language understanding | |
| CN211166762U (en) | Whole car L OGO lamp control device based on voice interaction technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200922 |
|
| RJ01 | Rejection of invention patent application after publication |