CN106790938B - Man-machine interaction vehicle-mounted system based on artificial intelligence - Google Patents
Man-machine interaction vehicle-mounted system based on artificial intelligence Download PDFInfo
- Publication number
- CN106790938B CN106790938B CN201611246400.6A CN201611246400A CN106790938B CN 106790938 B CN106790938 B CN 106790938B CN 201611246400 A CN201611246400 A CN 201611246400A CN 106790938 B CN106790938 B CN 106790938B
- Authority
- CN
- China
- Prior art keywords
- module
- information
- voice
- vehicle
- wireless communication
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 37
- 238000013473 artificial intelligence Methods 0.000 title claims abstract description 21
- 238000004891 communication Methods 0.000 claims abstract description 52
- 230000010365 information processing Effects 0.000 claims abstract description 23
- 230000005540 biological transmission Effects 0.000 claims abstract description 17
- 230000010354 integration Effects 0.000 claims description 15
- 230000009467 reduction Effects 0.000 claims description 14
- 230000007613 environmental effect Effects 0.000 claims description 9
- 230000005236 sound signal Effects 0.000 claims description 3
- 230000002194 synthesizing effect Effects 0.000 claims description 2
- 230000000903 blocking effect Effects 0.000 claims 1
- 230000015572 biosynthetic process Effects 0.000 description 8
- 238000003786 synthesis reaction Methods 0.000 description 8
- 238000013461 design Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 5
- 238000004458 analytical method Methods 0.000 description 4
- 230000006399 behavior Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000000034 method Methods 0.000 description 4
- 230000002457 bidirectional effect Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000006855 networking Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000000428 dust Substances 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003058 natural language processing Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/60—Substation equipment, e.g. for use by subscribers including speech amplifiers
- H04M1/6033—Substation equipment, e.g. for use by subscribers including speech amplifiers for providing handsfree use or a loudspeaker mode in telephone sets
- H04M1/6041—Portable telephones adapted for handsfree use
- H04M1/6075—Portable telephones adapted for handsfree use adapted for handsfree use in a vehicle
- H04M1/6083—Portable telephones adapted for handsfree use adapted for handsfree use in a vehicle by interfacing with the vehicle audio system
- H04M1/6091—Portable telephones adapted for handsfree use adapted for handsfree use in a vehicle by interfacing with the vehicle audio system including a wireless interface
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L2021/02161—Number of inputs available containing the signal or the noise to be suppressed
- G10L2021/02165—Two microphones, one receiving mainly the noise signal and the other one mainly the speech signal
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Quality & Reliability (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Computational Linguistics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Mobile Radio Communication Systems (AREA)
- Telephone Function (AREA)
Abstract
The invention discloses a man-machine interaction vehicle-mounted system based on artificial intelligence, which comprises a vehicle-mounted terminal system and a mobile terminal system; the vehicle-mounted terminal system comprises a voice acquisition module, a voice output module, a central control module and a first wireless communication module, the mobile terminal system comprises an information processing module and a second wireless communication module, the first wireless communication module is connected with the second wireless communication module to realize information transmission between the vehicle-mounted terminal system and the mobile terminal system, and the central control module is respectively connected with the voice acquisition module, the voice output module and the first wireless communication module and controls the modules according to a received instruction and operation information; the voice acquisition module is used for acquiring user voice information and environment information and transmitting the user voice information and the environment information to the mobile terminal subsystem; the voice output module is used for playing the voice received from the mobile terminal system; the information processing module is used for identifying and editing the received information into synthesized voice and transmitting the synthesized voice to the vehicle-mounted terminal system.
Description
Technical Field
The invention relates to the technical field of artificial intelligence, in particular to a human-computer interaction vehicle-mounted system based on artificial intelligence.
Background
Artificial Intelligence (Artificial Intelligence), abbreviated in english as AI. The method is a new technical science for researching and developing theories, methods, technologies and application systems for simulating, extending and expanding human intelligence. Artificial intelligence is a branch of computer science that attempts to understand the essence of intelligence and produce a new intelligent machine that can react in a manner similar to human intelligence, a field of research that includes robotics, speech recognition, image recognition, natural language processing, and expert systems. Among them, a very important aspect of artificial intelligence is the voice interaction technology.
At present, in the field of very widely used vehicles, namely small electric vehicles, including electric bicycles, electric motorcycles, electric tricycles and the like, since products mainly face to the salary level, it is difficult to adopt a voice interaction system similar to automobiles and voice-controlled robots, which is expensive and complex in design, due to cost considerations, on the other hand, there is still an application requirement of intelligent voice in the field, for example, some small electric vehicles broadcast mileage, electric quantity and fault information through voice synthesis, but such vehicle types have obvious defects and shortcomings: the vehicle-mounted voice chip has weaker performance and smaller voice library model, so that the voice synthesis effect is hard to hear, the service content is limited, the humanization is lacked, and the user experience is poorer. In addition, the social inventory of small electric vehicles is over two hundred million vehicles at present, and among huge users, many vehicle users often ride the electric vehicle by one hand and make a call and watch mobile phone information by one hand every day, and the frequently-occurring unsafe operation behaviors are urgently improved. Therefore, the development of an intelligent vehicle-mounted system which is suitable for a small electric vehicle and has rich voice interaction functions is urgently needed.
Therefore, those skilled in the art are dedicated to develop a low-cost, highly-integrated and high-performance man-machine interaction vehicle-mounted system based on artificial intelligence, and a brand-new vehicle-using experience is provided for users.
Disclosure of Invention
In view of the above defects in the prior art, the technical problem to be solved by the present invention is to provide a human-computer interaction vehicle-mounted system based on artificial intelligence, which has low cost, high integration and strong performance.
In order to achieve the aim, the invention provides a man-machine interaction vehicle-mounted system based on artificial intelligence, which comprises a vehicle-mounted terminal system and a mobile terminal system; the vehicle-mounted terminal system comprises a voice acquisition module, a voice output module, a central control module and a first wireless communication module, the mobile terminal system comprises an information processing module and a second wireless communication module, the first wireless communication module is connected with the second wireless communication module to realize information transmission between the vehicle-mounted terminal system and the mobile terminal system, the central control module is respectively connected with the voice acquisition module, the voice output module and the first wireless communication module to perform information transmission between the modules, and the modules are controlled according to a received instruction and operation information; the voice acquisition module is used for acquiring user voice information and environmental noise information and transmitting the user voice information and the environmental noise information to the mobile terminal system; the voice output module is used for playing the voice received from the mobile terminal system; the information processing module is used for identifying and editing the received information into synthesized voice and transmitting the synthesized voice to the vehicle-mounted terminal system.
Furthermore, the voice collecting module collects voice information by adopting a microphone array, wherein the microphone array comprises a main microphone and at least one auxiliary microphone, the main microphone is arranged at a position close to the user and is mainly used for collecting voice information of the user, and the auxiliary microphone is arranged at a position far away from the user and is mainly used for collecting environmental noise information.
Further, the information processing module comprises a first voice noise reduction sub-module or the voice acquisition module comprises a second voice noise reduction sub-module.
Further, the first wireless communication module and the second wireless communication module perform point-to-point communication by adopting a mode of bidirectional audio data and digital data transmission.
Furthermore, the first wireless communication module and the second wireless communication module perform information interaction through Wi-Fi, Bluetooth or a mode of combining Wi-Fi and Bluetooth.
Furthermore, the vehicle-mounted terminal system also comprises a first information acquisition module, a second information acquisition module and a central control module, wherein the first information acquisition module is used for acquiring the state information of the vehicle and sending the state information to the information processing module through the central control module; and/or the mobile terminal system also comprises a second information acquisition module which is used for acquiring the state information of the mobile equipment, including telephone information, mobile phone local file information, text information displayed on a screen of the mobile equipment and the like, and sending the state information to the information processing module.
Furthermore, the information processing module further comprises a content integration sub-module, which is used for editing and integrating the received information with the scene style.
Further, the information processing module further comprises a third party application interface sub-module, which is used for starting a third party application program.
Further, the vehicle-mounted terminal system further comprises an unlocking module used for responding to the received unlocking instruction, the mobile terminal system further comprises an unlocking request module used for acquiring an unlocking request input by the mobile equipment and sending the unlocking request to the second wireless communication module, and the mobile terminal sends the unlocking request through a manual input mode or a microphone of the mobile terminal to collect voice information.
Further, the voice acquisition module further comprises a wind shielding sub-module which is arranged in front of the voice acquisition module according to the advancing direction of the vehicle and used for reducing the environmental noise.
Compared with the prior art, the invention has the following technical effects: the invention fully embodies the olive-shaped architecture design with low cost and high performance, namely, the invention only needs to design the voice acquisition at the front end and the voice external hardware at the rear end at the vehicle-mounted end, preferably selects a smart phone as mobile end equipment, and establishes a point-to-point audio and data bidirectional transmission channel between the vehicle and the mobile phone by utilizing a wireless transmission module, thereby handing the complex data processing with large computation load, such as voice recognition, content integration, voice synthesis and the like, in the middle process part of voice interaction to the mobile phone end for completion, fully utilizes the strong computing capability, storage capability and networking mass information collecting capability of a mobile phone chip, and fully utilizes a third-party program interface of mobile phone application software to realize rich functional response after voice recognition. Because the speech recognition and speech synthesis engine is arranged at the mobile phone end, the program is easy to install and integrate and is easy to update in an iterative manner, and therefore the latest and most perfect intelligent speech interaction service can be synchronously maintained. The whole system is low in hardware cost and strong in software performance, and is very suitable for market popularization of small-sized electric vehicles sensitive to cost. The system can not only realize hands-free conversation with clear tone quality, but also provide accurate humanized intelligent voice interaction service based on comprehensive vehicle-mounted information and user mobile phone information collection, analysis and image tracing, and improve driving safety.
The conception, the specific structure and the technical effects of the present invention will be further described with reference to the accompanying drawings to fully understand the objects, the features and the effects of the present invention.
Drawings
FIG. 1 is a schematic diagram of a human-computer interaction vehicle-mounted system with a first voice noise reduction sub-module disposed at a mobile terminal according to a preferred embodiment of the present invention;
FIG. 2 is a schematic diagram of a man-machine interaction vehicle-mounted system with a second voice noise reduction sub-module disposed at a vehicle-mounted end according to a preferred embodiment of the present invention.
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Detailed Description
As shown in fig. 1, in a preferred embodiment of the present invention, a first voice noise reduction module is disposed in a human-computer interaction vehicle-mounted system at a mobile terminal, and includes a vehicle-mounted terminal subsystem and a mobile phone terminal subsystem;
the vehicle-mounted terminal system comprises a first wireless communication module, a voice acquisition module, a voice output module, a vehicle information acquisition module, an unlocking module and a central control module;
the mobile phone terminal subsystem comprises an information processing module, a mobile phone information acquisition module, an unlocking request module and a second wireless communication module;
the first wireless communication module is connected with the second wireless communication module to realize information transmission between the vehicle-mounted terminal system and the mobile terminal system; the first wireless communication module and the second wireless communication module carry out point-to-point communication in a mode of bidirectional audio data and digital data transmission; the audio data may be either digital or analog audio, and is used to convey the voice signals acquired by the microphone array and the audio signals output via the handset. The digital data is used for transmitting instruction information interaction between the vehicle-mounted end and the mobile phone end. When the audio data is in a digital audio format, the communication between the first wireless communication module and the second wireless communication module can adopt a single digital transmission mode. When the audio data adopts analog audio, the communication between the first wireless communication module and the second wireless communication module adopts two different transmission modes of analog transmission and digital transmission, and the two different transmission modes are respectively used for transmitting the analog audio and the digital data. Further, the first wireless communication module of the vehicle-mounted end and the second wireless communication module of the mobile phone end may adopt Wi-Fi, bluetooth, or Wi-Fi in combination with bluetooth, and the like, and different data transmission modes mean that different communication protocols are adopted, and different design circuits are adopted for hardware.
The voice acquisition module is used for acquiring user voice information and environment information and transmitting the user voice information and the environment information to the mobile phone terminal subsystem; the microphone array is adopted, wherein the microphone array comprises a main microphone and at least one auxiliary microphone, the main microphone is arranged at a position close to a vehicle user and mainly used for collecting user voice information, the auxiliary microphone is arranged at a position far away from the vehicle user and mainly used for collecting environmental noise, a plurality of auxiliary microphones can be arranged at different positions of a vehicle-mounted end and used for collecting and screening the environmental noise in different directions, and the voice recognition rate and the call definition in the call making process can be improved after voice noise reduction.
The voice output module is used for playing voice received from the mobile terminal system, for example, the voice output module is used for playing audio information which is transmitted to the vehicle-mounted terminal through the mobile phone terminal in a downlink manner by the loudspeaker.
The vehicle information acquisition module and the mobile phone information acquisition module are both used for increasing the universality and the practicability of man-machine interaction content, and the vehicle information acquisition system comprises at least one of the vehicle information acquisition module arranged at a vehicle-mounted end and the mobile phone information acquisition module arranged at a mobile phone end, and certainly, if the vehicle end and the mobile phone end are both provided with the information acquisition modules, the information sources can be richer.
The vehicle information acquisition module is used for acquiring vehicle state information and sending the vehicle state information to the information processing module through the central control module, and the acquired information can be visual, such as mileage, speed, voltage, current, charging time, charging frequency and the like, and can be inference type, such as remaining driving mileage (estimated value), vehicle using habits of vehicle users (safety behaviors such as deceleration and sliding, dangerous behaviors such as sudden braking) and depreciation and loss trends of components such as a battery and the like.
The mobile phone information acquisition module is used for acquiring state information of the mobile device and sending the state information to the information processing module, and comprises the steps of acquiring telephone information, mobile phone local file information, character content information displayed on a mobile phone screen and the like, wherein the acquired information can be visual, such as weather, time, incoming calls, short messages, notifications, residual electric quantity, geographic positions, music files and the like, can be inference type, and can analyze user characteristics, such as gender, age level, preference and the like, according to a mobile phone application installation list, the opening frequency of a certain application, the service duration, concerned content, selection habits and the like. In addition, the mobile phone information acquisition module can search and obtain mass information from the internet at any time according to the requirement based on the networking advantage of the mobile phone. The information base established by the information collected from the vehicle-mounted end and the mobile phone end is not only a basis for establishing user analysis and image tracing for a vehicle user, but also an information source for subsequently providing accurate personalized man-machine interaction service for the vehicle user.
The central control module is respectively connected with the first wireless communication module, the voice acquisition module, the voice output module, the vehicle information acquisition module and the unlocking module, so that information transmission among the modules is carried out, and meanwhile, the modules are controlled according to a received instruction and operation information; it acts as a control hub for communication and interaction with the mobile phone end.
The information processing module is used for identifying, editing and synthesizing the received information into voice and transmitting the voice to the vehicle-mounted terminal system, and specifically comprises the functions of voice identification, content editing and voice synthesis. The voice communication system also comprises a first voice noise reduction submodule used for improving the voice recognition rate and the hands-free communication definition. The system also comprises a content integration submodule for editing and integrating the received information with the scene style, and specifically, according to the obtained vehicle-side information and/or mobile phone-side information and the related scene style model, compiling and integrating passive answer type and/or active push type content for output. It contains both the logical model of the requirements under different scenarios and the model of the semantic style characteristics of the specific speaker. It should be noted that the "requirement" in the requirement logic model relates to both human-computer interaction and includes both the inquiry requirement of the "-person" provided by the vehicle user and the push requirement of the "-machine" required to be notified to the vehicle user by the mobile phone based on the result obtained by analyzing a large amount of information data, so that the content integration sub-module generates the passive answer content of the "person" to be responded and the active push content of the "machine" to be responded according to the requirement logic model. Specifically, firstly, a voice request of a vehicle user from a vehicle-mounted end is recognized, then the received information is integrated into passive answer type and/or active push type content through a content integration submodule according to a scene style model, and finally the passive answer type and/or active push type content synthesis audio voice information is sent to a vehicle-mounted terminal system for playing;
the information processing module also comprises a third-party application interface submodule which is used for starting a third-party application program, so that the functions of the man-machine interaction vehicle-mounted system are greatly increased, for example, many vehicle users like to listen to music while wearing earphones while riding, the behavior is not only neglected to be safe, but also can not select music when riding, and the playing of mobile phone music on a vehicle can be realized through the vehicle-mounted hands-free function provided by the system, and the music can be freely selected through voice recognition. Because more and more music is played only on certain third-party music software due to the problem of music copyright, the third-party application interface submodule of the system can realize seamless connection with the music software.
Still including setting up the unblock request module at the cell-phone end, it is used for obtaining the unblock request of cell-phone input and sends to second wireless communication module and the unblock module at on-vehicle end, and the unblock module is used for responding the unblock instruction of receiving, and wherein the unblock request module can adopt manual input mode or use the cell-phone end to send the unblock instruction through voiceprint recognition from taking the microphone, and this unlocking device's design aim at: the unlocking of present small-size electric motor car generally adopts ordinary remote controller mode, if this system does not set up the unblock request module via cell-phone end, then the vehicle user must operate following step in actual operation: the vehicle remote control system has the advantages that the vehicle is unlocked by taking out the common remote controller firstly, then the mobile phone is taken out to realize the on-line communication with the vehicle-mounted end, the complexity is increased by two-step operation, the second step of the operation that a vehicle user forgets or is lazy to take out the mobile phone is easily caused, the utilization rate of the system can be greatly reduced, therefore, the unlocking request module is arranged at the mobile phone end, the two-step operation of unlocking the vehicle and the on-line operation of the mobile phone and the vehicle can be completed in one step, the unlocking habit of the vehicle user is hardly changed, meanwhile, the complexity of carrying the vehicle remote controller when the vehicle user leaves is saved, and.
The wind shielding device is arranged at the front end of the microphone and is used for shielding and reducing wind noise interference on the microphone when a vehicle moves forwards. This windshield may be a hood customized for the microphone or may utilize some existing windshield, such as a transparent windshield provided for the vehicle occupant in front of the handlebar for some vehicles.
The invention is further illustrated by the following example of voice interaction:
for example, the meter part of a small electric vehicle, whether a mechanical pointer meter or a liquid crystal meter is a part with a high damage rate due to factors such as vibration, water resistance, dust resistance, sunlight irradiation and cost, and a vehicle user inquires through a vehicle-mounted end microphone at the moment: "how many kilometers can run at present? The voice information is transmitted to a first voice noise reduction module through a microphone array to filter noise, the noise is identified as words through an information processing module, the words are output to a content integration submodule, at the moment, the content integration submodule searches an information base stored in a mobile phone end to obtain time information based on a mobile phone information acquisition module and electric quantity information based on a vehicle information acquisition module, and meanwhile, a scene style model is combined according to the user information tracing characteristics of a vehicle user, for example, the user likes a network shopping type, the compiled semantic style can be called 'parent', the user likes a cartoon maid type, the compiled semantic style can be called 'master', and the content integration submodule compiles and completes a segment of anthropomorphic passive answer type words: "host, now six o' clock in the afternoon, i can run 8 km more. Based on the requirement logic model in the content integration submodule, namely the requirement of the machine, for example, data analysis from a vehicle information acquisition module, a section of active push type characters can be synchronously compiled: "owner, you are not charged in time last time, and remember to go home today. "
The characters compiled by the content integration submodule are combined with simulated voices of specific speakers such as male voices, female voices and stars with different timbres contained in a current universal voice synthesis engine, a very fine voice synthesis effect with high simulation naturalness can be provided by means of powerful calculation processing capacity of a mobile phone chip and a stored large-capacity voice library, and finally voice audio is transmitted to a voice output module (such as a loudspeaker) of a vehicle-mounted end to be played, so that human-computer interaction with humanization, infectivity and embodying artificial intelligence is completed, and a vehicle user has brand new experience.
In the system, the information acquisition and analysis based on the vehicle-mounted end and the mobile phone end are combined with a content integration submodule, particularly a demand logic model contained in a scene style model related in the content integration submodule, because a large number of models and logic algorithms are constructed in a customized manner under the condition of depending on deep understanding of human-vehicle information interaction application scenes, the system also has obvious "artificial intelligence" characteristics and can be called as special intelligence. Different from public intelligence and proprietary intelligence of a voice engine, the interactive logic model in the designed content integration submodule is richer, the more detailed the embodied man-machine interaction service is, the more powerful and humanized the user experience is, and the small-sized electric vehicle product can have market competitiveness beyond the conventional market correspondingly.
As shown in fig. 2, in the preferred embodiment of the present invention, the second voice noise reduction sub-module is disposed in the human-computer interaction vehicle-mounted system at the vehicle-mounted end, and the second voice noise reduction sub-module is disposed at the vehicle-mounted end, which substantially reduces noise through hardware, which means that hardware cost will be moderately increased, but the gain that can be obtained is that the first wireless communication module only needs to transmit the audio data in the form of mono channel after noise reduction and filtering to the second wireless communication module, so that the requirement for the first wireless communication module to have audio data transmission capability can be reduced. Meanwhile, a plurality of small-sized electric vehicles are provided with a satellite positioning module of a GPS (global positioning system) and SIM (subscriber identity module) card aiming at anti-theft tracking, and automatic call making and monitoring after the vehicles are stolen are realized by utilizing the SIM card module, so that the second voice noise reduction sub-module is arranged at the vehicle end, the definition of monitoring the calls can be improved, a vehicle user can make calls directly through the SIM card module on the vehicle when riding the vehicle, and the clear call quality is realized.
The foregoing detailed description of the preferred embodiments of the invention has been presented. It should be understood that numerous modifications and variations could be devised by those skilled in the art in light of the present teachings without departing from the inventive concepts. Therefore, the technical solutions available to those skilled in the art through logic analysis, reasoning and limited experiments based on the prior art according to the concept of the present invention should be within the scope of protection defined by the claims.
Claims (7)
1. A man-machine interaction vehicle-mounted system based on artificial intelligence is characterized by comprising a vehicle-mounted terminal system and a mobile terminal system; the vehicle-mounted terminal system comprises a voice acquisition module, a voice output module, a central control module, a first wireless communication module and a first information acquisition module, the mobile terminal system comprises an information processing module and a second wireless communication module, the first wireless communication module is connected with the second wireless communication module to realize information transmission between the vehicle-mounted terminal system and the mobile terminal system, the central control module is respectively connected with the voice acquisition module, the voice output module, the first wireless communication module and the first information acquisition module to transmit information between the modules and control the modules according to a receiving instruction and operation information, and the first information acquisition module is used for acquiring state information of a vehicle and sending the state information to the information processing module through the central control module; the mobile terminal system also comprises a second information acquisition module which is used for acquiring the state information of the mobile equipment and sending the state information to the information processing module; the voice acquisition module is used for acquiring user voice information and environmental noise information and transmitting the user voice information and the environmental noise information to the mobile terminal system; the voice output module is used for playing the voice received from the mobile terminal system; the information processing module is used for identifying, editing and synthesizing received information into voice and transmitting the voice to the vehicle-mounted terminal system, the information processing module comprises a content integration submodule for combining the received information with scene styles to edit and integrate and output passive answer type and/or active push type content, point-to-point communication is carried out between the first wireless communication module and the second wireless communication module in a mode of bidirectionally transmitting audio data and digital data, the audio data comprise digital audio and/or analog audio and are used for transmitting voice signals acquired by the vehicle-mounted terminal voice acquisition module and audio signals output by a mobile phone terminal, and the digital data are used for transmitting instruction information interaction of non-audio signals between the vehicle-mounted terminal central control module and the mobile phone terminal information processing module.
2. The human-computer interaction vehicle-mounted system based on artificial intelligence of claim 1, wherein the voice collecting module collects the voice information by using a microphone array, wherein the microphone array comprises a main microphone and at least one auxiliary microphone, the main microphone is mainly used for collecting the voice information of the user, and the auxiliary microphone is mainly used for collecting the environmental noise information.
3. The artificial intelligence based human-computer interaction vehicle-mounted system of claim 1, wherein the information processing module comprises a first voice noise reduction sub-module or the voice acquisition module comprises a second voice noise reduction sub-module.
4. The human-computer interaction vehicle-mounted system based on artificial intelligence of claim 1, wherein the first wireless communication module and the second wireless communication module perform information interaction through Wi-Fi, bluetooth or Wi-Fi combined bluetooth.
5. The human-computer interaction vehicle-mounted system based on artificial intelligence of claim 1, wherein the information processing module further comprises a third party application interface sub-module for launching a third party application.
6. The human-computer interaction vehicle-mounted system based on artificial intelligence of claim 1, wherein the vehicle-mounted terminal system further comprises an unlocking module for responding to the received unlocking instruction, and the mobile terminal system further comprises an unlocking request module for acquiring an unlocking request input by the mobile device and sending the unlocking request to the second wireless communication module.
7. The artificial intelligence based human-computer interaction vehicle system of claim 1, wherein the voice acquisition module further comprises a wind blocking sub-module for reducing ambient noise.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611022203 | 2016-11-16 | ||
| CN2016110222036 | 2016-11-16 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106790938A CN106790938A (en) | 2017-05-31 |
| CN106790938B true CN106790938B (en) | 2020-05-05 |
Family
ID=58928974
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611246400.6A Active CN106790938B (en) | 2016-11-16 | 2016-12-29 | Man-machine interaction vehicle-mounted system based on artificial intelligence |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106790938B (en) |
Families Citing this family (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP7000924B2 (en) * | 2018-03-06 | 2022-01-19 | 株式会社Ｊｖｃケンウッド | Audio content control device, audio content control method, and audio content control program |
| CN108556986A (en) * | 2018-03-28 | 2018-09-21 | 上海乐愚智能科技有限公司 | A kind of central control system and vehicle |
| CN108735203A (en) * | 2018-03-28 | 2018-11-02 | 上海乐愚智能科技有限公司 | Voice interactive method, terminal and computer-readable medium |
| CN108594998A (en) * | 2018-04-19 | 2018-09-28 | 深圳市瀚思通汽车电子有限公司 | A kind of onboard navigation system and its gesture operation method |
| CN109087660A (en) * | 2018-09-29 | 2018-12-25 | 百度在线网络技术（北京）有限公司 | Method, apparatus, equipment and computer readable storage medium for echo cancellor |
| CN109040324A (en) * | 2018-10-30 | 2018-12-18 | 上海碧虎网络科技有限公司 | Vehicle-mounted data services promotion method, device and computer readable storage medium |
| CN109872722B (en) * | 2019-01-17 | 2021-08-31 | 珠海格力电器股份有限公司 | Voice interaction method and device, storage medium and air conditioner |
| CN110077339B (en) * | 2019-04-19 | 2021-04-13 | 广州小鹏汽车科技有限公司 | System and method for adjusting brightness of vehicle-mounted display device |
| CN111312262B (en) * | 2020-01-19 | 2022-03-08 | 鲨港科技(上海)有限公司 | Audio information transmission system, method and device and corresponding two-wheel vehicle and helmet |
| CN113053373A (en) * | 2021-02-26 | 2021-06-29 | 上海声通信息科技股份有限公司 | Intelligent vehicle-mounted voice interaction system supporting voice cloning |
| CN114056343B (en) * | 2022-01-11 | 2022-05-10 | 广州小鹏汽车科技有限公司 | Processing method of vehicle-mounted system function, server and storage medium |
| CN114939268B (en) * | 2022-06-02 | 2023-07-25 | 毛羽鹏 | Man-machine interaction system for monitoring bicycle motion by adopting nano generator |
| CN115017352B (en) * | 2022-06-22 | 2023-04-07 | 润芯微科技(江苏)有限公司 | Mobile phone car machine interaction system based on image recognition |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102358249A (en) * | 2011-08-30 | 2012-02-22 | 上海华勤通讯技术有限公司 | Mobile terminal, vehicle control module, vehicle and vehicle control system and method |
| EP2480003A1 (en) * | 2011-01-04 | 2012-07-25 | Alpine Electronics, Inc. | Electronic apparatus for remotely controlling a mobile information terminal device |
| CN103118176A (en) * | 2013-01-16 | 2013-05-22 | 广东好帮手电子科技股份有限公司 | Method and system for achieving mobile phone voice control function through on-board host computer |
| CN104158944A (en) * | 2014-08-27 | 2014-11-19 | 重庆长安汽车股份有限公司 | Low-cost interconnection system of mobile phone and vehicle machine |
| CN204432572U (en) * | 2015-01-13 | 2015-07-01 | 江苏新日电动车股份有限公司 | A kind of electric motor intelligent central control system |
-
2016
- 2016-12-29 CN CN201611246400.6A patent/CN106790938B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2480003A1 (en) * | 2011-01-04 | 2012-07-25 | Alpine Electronics, Inc. | Electronic apparatus for remotely controlling a mobile information terminal device |
| CN102358249A (en) * | 2011-08-30 | 2012-02-22 | 上海华勤通讯技术有限公司 | Mobile terminal, vehicle control module, vehicle and vehicle control system and method |
| CN103118176A (en) * | 2013-01-16 | 2013-05-22 | 广东好帮手电子科技股份有限公司 | Method and system for achieving mobile phone voice control function through on-board host computer |
| CN104158944A (en) * | 2014-08-27 | 2014-11-19 | 重庆长安汽车股份有限公司 | Low-cost interconnection system of mobile phone and vehicle machine |
| CN204432572U (en) * | 2015-01-13 | 2015-07-01 | 江苏新日电动车股份有限公司 | A kind of electric motor intelligent central control system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106790938A (en) | 2017-05-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106790938B (en) | Man-machine interaction vehicle-mounted system based on artificial intelligence | |
| EP3996346B1 (en) | Message pushing method, storage medium, and server | |
| CN106816149B (en) | Prioritized content loading for vehicle automatic speech recognition systems | |
| CN105022777B (en) | Vehicle application based on driving behavior is recommended | |
| CN107303909B (en) | Voice call-up method, device and equipment | |
| CN102300152B (en) | Method of using vehicle location information with a wireless mobile device | |
| CN106184000B (en) | A kind of sound control method and system based on Car intellectual backsight mirror | |
| CN202495969U (en) | Automobile remote service real-time information system based on intelligent communication tool | |
| KR20170070094A (en) | Voice and connection platform | |
| CN106921783A (en) | Use terminal device, the system and method for communication and social networking application when driving safely | |
| CN105329187A (en) | Intelligent vehicle-mounted system for realizing safe operation through Bluetooth key triggering and control method | |
| CN105551494A (en) | Mobile phone interconnection-based vehicle-mounted speech recognition system and recognition method | |
| CN106412495A (en) | Vehicle with hyperlapse video and social networking | |
| US8682307B2 (en) | Device-interoperability notification method and system, and method for assessing an interoperability of an electronic device with a vehicle | |
| US8521235B2 (en) | Address book sharing system and method for non-verbally adding address book contents using the same | |
| US9466158B2 (en) | Interactive access to vehicle information | |
| CN105022294B (en) | Portable communication device, system and method for work with driving condition man-machine interface | |
| CN109147820B (en) | Vehicle-mounted sound control method and device, electronic equipment and storage medium | |
| CN105761532B (en) | Dynamic voice reminding method and onboard system | |
| CN110544478A (en) | System and method for intelligent far-field voice interaction of cockpit | |
| CN106453483A (en) | Methods and systems to customize a vehicle computing system based on an electronic calendar | |
| CN114629991A (en) | Prompting method and device based on vehicle connection | |
| CN110689882A (en) | Vehicle, playing equipment thereof and multimedia playing automatic control method | |
| CN110691109A (en) | Vehicle, vehicle equipment and vehicle-mounted call environment control method thereof | |
| CN111596874A (en) | Method, device and equipment for synchronously displaying associated information of vehicle-mounted terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |