CN106790938B - Man-machine interaction vehicle-mounted system based on artificial intelligence - Google Patents

Man-machine interaction vehicle-mounted system based on artificial intelligence Download PDF

Info

Publication number
CN106790938B
CN106790938B CN201611246400.6A CN201611246400A CN106790938B CN 106790938 B CN106790938 B CN 106790938B CN 201611246400 A CN201611246400 A CN 201611246400A CN 106790938 B CN106790938 B CN 106790938B
Authority
CN
China
Prior art keywords
module
information
voice
vehicle
wireless communication
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201611246400.6A
Other languages
Chinese (zh)
Other versions
CN106790938A (en
Inventor
焦焱
李洪生
王俊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Quxun Network Technology Co ltd
Original Assignee
Shanghai Quxun Network Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to CN201611022203 priority Critical
Priority to CN2016110222036 priority
Application filed by Shanghai Quxun Network Technology Co ltd filed Critical Shanghai Quxun Network Technology Co ltd
Publication of CN106790938A publication Critical patent/CN106790938A/en
Application granted granted Critical
Publication of CN106790938B publication Critical patent/CN106790938B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/60Substation equipment, e.g. for use by subscribers including speech amplifiers
    • H04M1/6033Substation equipment, e.g. for use by subscribers including speech amplifiers for providing handsfree use or a loudspeaker mode in telephone sets
    • H04M1/6041Portable telephones adapted for handsfree use
    • H04M1/6075Portable telephones adapted for handsfree use adapted for handsfree use in a vehicle
    • H04M1/6083Portable telephones adapted for handsfree use adapted for handsfree use in a vehicle by interfacing with the vehicle audio system
    • H04M1/6091Portable telephones adapted for handsfree use adapted for handsfree use in a vehicle by interfacing with the vehicle audio system including a wireless interface
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • G10L21/0216Noise filtering characterised by the method used for estimating noise
    • G10L2021/02161Number of inputs available containing the signal or the noise to be suppressed
    • G10L2021/02165Two microphones, one receiving mainly the noise signal and the other one mainly the speech signal

Abstract

The invention discloses a man-machine interaction vehicle-mounted system based on artificial intelligence, which comprises a vehicle-mounted terminal system and a mobile terminal system; the vehicle-mounted terminal system comprises a voice acquisition module, a voice output module, a central control module and a first wireless communication module, the mobile terminal system comprises an information processing module and a second wireless communication module, the first wireless communication module is connected with the second wireless communication module to realize information transmission between the vehicle-mounted terminal system and the mobile terminal system, and the central control module is respectively connected with the voice acquisition module, the voice output module and the first wireless communication module and controls the modules according to a received instruction and operation information; the voice acquisition module is used for acquiring user voice information and environment information and transmitting the user voice information and the environment information to the mobile terminal subsystem; the voice output module is used for playing the voice received from the mobile terminal system; the information processing module is used for identifying and editing the received information into synthesized voice and transmitting the synthesized voice to the vehicle-mounted terminal system.

Description

Man-machine interaction vehicle-mounted system based on artificial intelligence
Technical Field
The invention relates to the technical field of artificial intelligence, in particular to a human-computer interaction vehicle-mounted system based on artificial intelligence.
Background
Artificial Intelligence (Artificial Intelligence), abbreviated in english as AI. The method is a new technical science for researching and developing theories, methods, technologies and application systems for simulating, extending and expanding human intelligence. Artificial intelligence is a branch of computer science that attempts to understand the essence of intelligence and produce a new intelligent machine that can react in a manner similar to human intelligence, a field of research that includes robotics, speech recognition, image recognition, natural language processing, and expert systems. Among them, a very important aspect of artificial intelligence is the voice interaction technology.
At present, in the field of very widely used vehicles, namely small electric vehicles, including electric bicycles, electric motorcycles, electric tricycles and the like, since products mainly face to the salary level, it is difficult to adopt a voice interaction system similar to automobiles and voice-controlled robots, which is expensive and complex in design, due to cost considerations, on the other hand, there is still an application requirement of intelligent voice in the field, for example, some small electric vehicles broadcast mileage, electric quantity and fault information through voice synthesis, but such vehicle types have obvious defects and shortcomings: the vehicle-mounted voice chip has weaker performance and smaller voice library model, so that the voice synthesis effect is hard to hear, the service content is limited, the humanization is lacked, and the user experience is poorer. In addition, the social inventory of small electric vehicles is over two hundred million vehicles at present, and among huge users, many vehicle users often ride the electric vehicle by one hand and make a call and watch mobile phone information by one hand every day, and the frequently-occurring unsafe operation behaviors are urgently improved. Therefore, the development of an intelligent vehicle-mounted system which is suitable for a small electric vehicle and has rich voice interaction functions is urgently needed.
Therefore, those skilled in the art are dedicated to develop a low-cost, highly-integrated and high-performance man-machine interaction vehicle-mounted system based on artificial intelligence, and a brand-new vehicle-using experience is provided for users.
Disclosure of Invention
In view of the above defects in the prior art, the technical problem to be solved by the present invention is to provide a human-computer interaction vehicle-mounted system based on artificial intelligence, which has low cost, high integration and strong performance.
In order to achieve the aim, the invention provides a man-machine interaction vehicle-mounted system based on artificial intelligence, which comprises a vehicle-mounted terminal system and a mobile terminal system; the vehicle-mounted terminal system comprises a voice acquisition module, a voice output module, a central control module and a first wireless communication module, the mobile terminal system comprises an information processing module and a second wireless communication module, the first wireless communication module is connected with the second wireless communication module to realize information transmission between the vehicle-mounted terminal system and the mobile terminal system, the central control module is respectively connected with the voice acquisition module, the voice output module and the first wireless communication module to perform information transmission between the modules, and the modules are controlled according to a received instruction and operation information; the voice acquisition module is used for acquiring user voice information and environmental noise information and transmitting the user voice information and the environmental noise information to the mobile terminal system; the voice output module is used for playing the voice received from the mobile terminal system; the information processing module is used for identifying and editing the received information into synthesized voice and transmitting the synthesized voice to the vehicle-mounted terminal system.
Furthermore, the voice collecting module collects voice information by adopting a microphone array, wherein the microphone array comprises a main microphone and at least one auxiliary microphone, the main microphone is arranged at a position close to the user and is mainly used for collecting voice information of the user, and the auxiliary microphone is arranged at a position far away from the user and is mainly used for collecting environmental noise information.
Further, the information processing module comprises a first voice noise reduction sub-module or the voice acquisition module comprises a second voice noise reduction sub-module.
Further, the first wireless communication module and the second wireless communication module perform point-to-point communication by adopting a mode of bidirectional audio data and digital data transmission.
Furthermore, the first wireless communication module and the second wireless communication module perform information interaction through Wi-Fi, Bluetooth or a mode of combining Wi-Fi and Bluetooth.
Furthermore, the vehicle-mounted terminal system also comprises a first information acquisition module, a second information acquisition module and a central control module, wherein the first information acquisition module is used for acquiring the state information of the vehicle and sending the state information to the information processing module through the central control module; and/or the mobile terminal system also comprises a second information acquisition module which is used for acquiring the state information of the mobile equipment, including telephone information, mobile phone local file information, text information displayed on a screen of the mobile equipment and the like, and sending the state information to the information processing module.
Furthermore, the information processing module further comprises a content integration sub-module, which is used for editing and integrating the received information with the scene style.
Further, the information processing module further comprises a third party application interface sub-module, which is used for starting a third party application program.
Further, the vehicle-mounted terminal system further comprises an unlocking module used for responding to the received unlocking instruction, the mobile terminal system further comprises an unlocking request module used for acquiring an unlocking request input by the mobile equipment and sending the unlocking request to the second wireless communication module, and the mobile terminal sends the unlocking request through a manual input mode or a microphone of the mobile terminal to collect voice information.
Further, the voice acquisition module further comprises a wind shielding sub-module which is arranged in front of the voice acquisition module according to the advancing direction of the vehicle and used for reducing the environmental noise.
Compared with the prior art, the invention has the following technical effects: the invention fully embodies the olive-shaped architecture design with low cost and high performance, namely, the invention only needs to design the voice acquisition at the front end and the voice external hardware at the rear end at the vehicle-mounted end, preferably selects a smart phone as mobile end equipment, and establishes a point-to-point audio and data bidirectional transmission channel between the vehicle and the mobile phone by utilizing a wireless transmission module, thereby handing the complex data processing with large computation load, such as voice recognition, content integration, voice synthesis and the like, in the middle process part of voice interaction to the mobile phone end for completion, fully utilizes the strong computing capability, storage capability and networking mass information collecting capability of a mobile phone chip, and fully utilizes a third-party program interface of mobile phone application software to realize rich functional response after voice recognition. Because the speech recognition and speech synthesis engine is arranged at the mobile phone end, the program is easy to install and integrate and is easy to update in an iterative manner, and therefore the latest and most perfect intelligent speech interaction service can be synchronously maintained. The whole system is low in hardware cost and strong in software performance, and is very suitable for market popularization of small-sized electric vehicles sensitive to cost. The system can not only realize hands-free conversation with clear tone quality, but also provide accurate humanized intelligent voice interaction service based on comprehensive vehicle-mounted information and user mobile phone information collection, analysis and image tracing, and improve driving safety.
The conception, the specific structure and the technical effects of the present invention will be further described with reference to the accompanying drawings to fully understand the objects, the features and the effects of the present invention.
Drawings
FIG. 1 is a schematic diagram of a human-computer interaction vehicle-mounted system with a first voice noise reduction sub-module disposed at a mobile terminal according to a preferred embodiment of the present invention;
FIG. 2 is a schematic diagram of a man-machine interaction vehicle-mounted system with a second voice noise reduction sub-module disposed at a vehicle-mounted end according to a preferred embodiment of the present invention.
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Detailed Description
As shown in fig. 1, in a preferred embodiment of the present invention, a first voice noise reduction module is disposed in a human-computer interaction vehicle-mounted system at a mobile terminal, and includes a vehicle-mounted terminal subsystem and a mobile phone terminal subsystem;
the vehicle-mounted terminal system comprises a first wireless communication module, a voice acquisition module, a voice output module, a vehicle information acquisition module, an unlocking module and a central control module;
the mobile phone terminal subsystem comprises an information processing module, a mobile phone information acquisition module, an unlocking request module and a second wireless communication module;
the first wireless communication module is connected with the second wireless communication module to realize information transmission between the vehicle-mounted terminal system and the mobile terminal system; the first wireless communication module and the second wireless communication module carry out point-to-point communication in a mode of bidirectional audio data and digital data transmission; the audio data may be either digital or analog audio, and is used to convey the voice signals acquired by the microphone array and the audio signals output via the handset. The digital data is used for transmitting instruction information interaction between the vehicle-mounted end and the mobile phone end. When the audio data is in a digital audio format, the communication between the first wireless communication module and the second wireless communication module can adopt a single digital transmission mode. When the audio data adopts analog audio, the communication between the first wireless communication module and the second wireless communication module adopts two different transmission modes of analog transmission and digital transmission, and the two different transmission modes are respectively used for transmitting the analog audio and the digital data. Further, the first wireless communication module of the vehicle-mounted end and the second wireless communication module of the mobile phone end may adopt Wi-Fi, bluetooth, or Wi-Fi in combination with bluetooth, and the like, and different data transmission modes mean that different communication protocols are adopted, and different design circuits are adopted for hardware.
The voice acquisition module is used for acquiring user voice information and environment information and transmitting the user voice information and the environment information to the mobile phone terminal subsystem; the microphone array is adopted, wherein the microphone array comprises a main microphone and at least one auxiliary microphone, the main microphone is arranged at a position close to a vehicle user and mainly used for collecting user voice information, the auxiliary microphone is arranged at a position far away from the vehicle user and mainly used for collecting environmental noise, a plurality of auxiliary microphones can be arranged at different positions of a vehicle-mounted end and used for collecting and screening the environmental noise in different directions, and the voice recognition rate and the call definition in the call making process can be improved after voice noise reduction.
The voice output module is used for playing voice received from the mobile terminal system, for example, the voice output module is used for playing audio information which is transmitted to the vehicle-mounted terminal through the mobile phone terminal in a downlink manner by the loudspeaker.
The vehicle information acquisition module and the mobile phone information acquisition module are both used for increasing the universality and the practicability of man-machine interaction content, and the vehicle information acquisition system comprises at least one of the vehicle information acquisition module arranged at a vehicle-mounted end and the mobile phone information acquisition module arranged at a mobile phone end, and certainly, if the vehicle end and the mobile phone end are both provided with the information acquisition modules, the information sources can be richer.
The vehicle information acquisition module is used for acquiring vehicle state information and sending the vehicle state information to the information processing module through the central control module, and the acquired information can be visual, such as mileage, speed, voltage, current, charging time, charging frequency and the like, and can be inference type, such as remaining driving mileage (estimated value), vehicle using habits of vehicle users (safety behaviors such as deceleration and sliding, dangerous behaviors such as sudden braking) and depreciation and loss trends of components such as a battery and the like.
The mobile phone information acquisition module is used for acquiring state information of the mobile device and sending the state information to the information processing module, and comprises the steps of acquiring telephone information, mobile phone local file information, character content information displayed on a mobile phone screen and the like, wherein the acquired information can be visual, such as weather, time, incoming calls, short messages, notifications, residual electric quantity, geographic positions, music files and the like, can be inference type, and can analyze user characteristics, such as gender, age level, preference and the like, according to a mobile phone application installation list, the opening frequency of a certain application, the service duration, concerned content, selection habits and the like. In addition, the mobile phone information acquisition module can search and obtain mass information from the internet at any time according to the requirement based on the networking advantage of the mobile phone. The information base established by the information collected from the vehicle-mounted end and the mobile phone end is not only a basis for establishing user analysis and image tracing for a vehicle user, but also an information source for subsequently providing accurate personalized man-machine interaction service for the vehicle user.
The central control module is respectively connected with the first wireless communication module, the voice acquisition module, the voice output module, the vehicle information acquisition module and the unlocking module, so that information transmission among the modules is carried out, and meanwhile, the modules are controlled according to a received instruction and operation information; it acts as a control hub for communication and interaction with the mobile phone end.
The information processing module is used for identifying, editing and synthesizing the received information into voice and transmitting the voice to the vehicle-mounted terminal system, and specifically comprises the functions of voice identification, content editing and voice synthesis. The voice communication system also comprises a first voice noise reduction submodule used for improving the voice recognition rate and the hands-free communication definition. The system also comprises a content integration submodule for editing and integrating the received information with the scene style, and specifically, according to the obtained vehicle-side information and/or mobile phone-side information and the related scene style model, compiling and integrating passive answer type and/or active push type content for output. It contains both the logical model of the requirements under different scenarios and the model of the semantic style characteristics of the specific speaker. It should be noted that the "requirement" in the requirement logic model relates to both human-computer interaction and includes both the inquiry requirement of the "-person" provided by the vehicle user and the push requirement of the "-machine" required to be notified to the vehicle user by the mobile phone based on the result obtained by analyzing a large amount of information data, so that the content integration sub-module generates the passive answer content of the "person" to be responded and the active push content of the "machine" to be responded according to the requirement logic model. Specifically, firstly, a voice request of a vehicle user from a vehicle-mounted end is recognized, then the received information is integrated into passive answer type and/or active push type content through a content integration submodule according to a scene style model, and finally the passive answer type and/or active push type content synthesis audio voice information is sent to a vehicle-mounted terminal system for playing;
the information processing module also comprises a third-party application interface submodule which is used for starting a third-party application program, so that the functions of the man-machine interaction vehicle-mounted system are greatly increased, for example, many vehicle users like to listen to music while wearing earphones while riding, the behavior is not only neglected to be safe, but also can not select music when riding, and the playing of mobile phone music on a vehicle can be realized through the vehicle-mounted hands-free function provided by the system, and the music can be freely selected through voice recognition. Because more and more music is played only on certain third-party music software due to the problem of music copyright, the third-party application interface submodule of the system can realize seamless connection with the music software.
Still including setting up the unblock request module at the cell-phone end, it is used for obtaining the unblock request of cell-phone input and sends to second wireless communication module and the unblock module at on-vehicle end, and the unblock module is used for responding the unblock instruction of receiving, and wherein the unblock request module can adopt manual input mode or use the cell-phone end to send the unblock instruction through voiceprint recognition from taking the microphone, and this unlocking device's design aim at: the unlocking of present small-size electric motor car generally adopts ordinary remote controller mode, if this system does not set up the unblock request module via cell-phone end, then the vehicle user must operate following step in actual operation: the vehicle remote control system has the advantages that the vehicle is unlocked by taking out the common remote controller firstly, then the mobile phone is taken out to realize the on-line communication with the vehicle-mounted end, the complexity is increased by two-step operation, the second step of the operation that a vehicle user forgets or is lazy to take out the mobile phone is easily caused, the utilization rate of the system can be greatly reduced, therefore, the unlocking request module is arranged at the mobile phone end, the two-step operation of unlocking the vehicle and the on-line operation of the mobile phone and the vehicle can be completed in one step, the unlocking habit of the vehicle user is hardly changed, meanwhile, the complexity of carrying the vehicle remote controller when the vehicle user leaves is saved, and.
The wind shielding device is arranged at the front end of the microphone and is used for shielding and reducing wind noise interference on the microphone when a vehicle moves forwards. This windshield may be a hood customized for the microphone or may utilize some existing windshield, such as a transparent windshield provided for the vehicle occupant in front of the handlebar for some vehicles.
The invention is further illustrated by the following example of voice interaction:
for example, the meter part of a small electric vehicle, whether a mechanical pointer meter or a liquid crystal meter is a part with a high damage rate due to factors such as vibration, water resistance, dust resistance, sunlight irradiation and cost, and a vehicle user inquires through a vehicle-mounted end microphone at the moment: "how many kilometers can run at present? The voice information is transmitted to a first voice noise reduction module through a microphone array to filter noise, the noise is identified as words through an information processing module, the words are output to a content integration submodule, at the moment, the content integration submodule searches an information base stored in a mobile phone end to obtain time information based on a mobile phone information acquisition module and electric quantity information based on a vehicle information acquisition module, and meanwhile, a scene style model is combined according to the user information tracing characteristics of a vehicle user, for example, the user likes a network shopping type, the compiled semantic style can be called 'parent', the user likes a cartoon maid type, the compiled semantic style can be called 'master', and the content integration submodule compiles and completes a segment of anthropomorphic passive answer type words: "host, now six o' clock in the afternoon, i can run 8 km more. Based on the requirement logic model in the content integration submodule, namely the requirement of the machine, for example, data analysis from a vehicle information acquisition module, a section of active push type characters can be synchronously compiled: "owner, you are not charged in time last time, and remember to go home today. "
The characters compiled by the content integration submodule are combined with simulated voices of specific speakers such as male voices, female voices and stars with different timbres contained in a current universal voice synthesis engine, a very fine voice synthesis effect with high simulation naturalness can be provided by means of powerful calculation processing capacity of a mobile phone chip and a stored large-capacity voice library, and finally voice audio is transmitted to a voice output module (such as a loudspeaker) of a vehicle-mounted end to be played, so that human-computer interaction with humanization, infectivity and embodying artificial intelligence is completed, and a vehicle user has brand new experience.
In the system, the information acquisition and analysis based on the vehicle-mounted end and the mobile phone end are combined with a content integration submodule, particularly a demand logic model contained in a scene style model related in the content integration submodule, because a large number of models and logic algorithms are constructed in a customized manner under the condition of depending on deep understanding of human-vehicle information interaction application scenes, the system also has obvious "artificial intelligence" characteristics and can be called as special intelligence. Different from public intelligence and proprietary intelligence of a voice engine, the interactive logic model in the designed content integration submodule is richer, the more detailed the embodied man-machine interaction service is, the more powerful and humanized the user experience is, and the small-sized electric vehicle product can have market competitiveness beyond the conventional market correspondingly.
As shown in fig. 2, in the preferred embodiment of the present invention, the second voice noise reduction sub-module is disposed in the human-computer interaction vehicle-mounted system at the vehicle-mounted end, and the second voice noise reduction sub-module is disposed at the vehicle-mounted end, which substantially reduces noise through hardware, which means that hardware cost will be moderately increased, but the gain that can be obtained is that the first wireless communication module only needs to transmit the audio data in the form of mono channel after noise reduction and filtering to the second wireless communication module, so that the requirement for the first wireless communication module to have audio data transmission capability can be reduced. Meanwhile, a plurality of small-sized electric vehicles are provided with a satellite positioning module of a GPS (global positioning system) and SIM (subscriber identity module) card aiming at anti-theft tracking, and automatic call making and monitoring after the vehicles are stolen are realized by utilizing the SIM card module, so that the second voice noise reduction sub-module is arranged at the vehicle end, the definition of monitoring the calls can be improved, a vehicle user can make calls directly through the SIM card module on the vehicle when riding the vehicle, and the clear call quality is realized.
The foregoing detailed description of the preferred embodiments of the invention has been presented. It should be understood that numerous modifications and variations could be devised by those skilled in the art in light of the present teachings without departing from the inventive concepts. Therefore, the technical solutions available to those skilled in the art through logic analysis, reasoning and limited experiments based on the prior art according to the concept of the present invention should be within the scope of protection defined by the claims.

Claims (7)

1. A man-machine interaction vehicle-mounted system based on artificial intelligence is characterized by comprising a vehicle-mounted terminal system and a mobile terminal system; the vehicle-mounted terminal system comprises a voice acquisition module, a voice output module, a central control module, a first wireless communication module and a first information acquisition module, the mobile terminal system comprises an information processing module and a second wireless communication module, the first wireless communication module is connected with the second wireless communication module to realize information transmission between the vehicle-mounted terminal system and the mobile terminal system, the central control module is respectively connected with the voice acquisition module, the voice output module, the first wireless communication module and the first information acquisition module to transmit information between the modules and control the modules according to a receiving instruction and operation information, and the first information acquisition module is used for acquiring state information of a vehicle and sending the state information to the information processing module through the central control module; the mobile terminal system also comprises a second information acquisition module which is used for acquiring the state information of the mobile equipment and sending the state information to the information processing module; the voice acquisition module is used for acquiring user voice information and environmental noise information and transmitting the user voice information and the environmental noise information to the mobile terminal system; the voice output module is used for playing the voice received from the mobile terminal system; the information processing module is used for identifying, editing and synthesizing received information into voice and transmitting the voice to the vehicle-mounted terminal system, the information processing module comprises a content integration submodule for combining the received information with scene styles to edit and integrate and output passive answer type and/or active push type content, point-to-point communication is carried out between the first wireless communication module and the second wireless communication module in a mode of bidirectionally transmitting audio data and digital data, the audio data comprise digital audio and/or analog audio and are used for transmitting voice signals acquired by the vehicle-mounted terminal voice acquisition module and audio signals output by a mobile phone terminal, and the digital data are used for transmitting instruction information interaction of non-audio signals between the vehicle-mounted terminal central control module and the mobile phone terminal information processing module.
2. The human-computer interaction vehicle-mounted system based on artificial intelligence of claim 1, wherein the voice collecting module collects the voice information by using a microphone array, wherein the microphone array comprises a main microphone and at least one auxiliary microphone, the main microphone is mainly used for collecting the voice information of the user, and the auxiliary microphone is mainly used for collecting the environmental noise information.
3. The artificial intelligence based human-computer interaction vehicle-mounted system of claim 1, wherein the information processing module comprises a first voice noise reduction sub-module or the voice acquisition module comprises a second voice noise reduction sub-module.
4. The human-computer interaction vehicle-mounted system based on artificial intelligence of claim 1, wherein the first wireless communication module and the second wireless communication module perform information interaction through Wi-Fi, bluetooth or Wi-Fi combined bluetooth.
5. The human-computer interaction vehicle-mounted system based on artificial intelligence of claim 1, wherein the information processing module further comprises a third party application interface sub-module for launching a third party application.
6. The human-computer interaction vehicle-mounted system based on artificial intelligence of claim 1, wherein the vehicle-mounted terminal system further comprises an unlocking module for responding to the received unlocking instruction, and the mobile terminal system further comprises an unlocking request module for acquiring an unlocking request input by the mobile device and sending the unlocking request to the second wireless communication module.
7. The artificial intelligence based human-computer interaction vehicle system of claim 1, wherein the voice acquisition module further comprises a wind blocking sub-module for reducing ambient noise.
CN201611246400.6A 2016-11-16 2016-12-29 Man-machine interaction vehicle-mounted system based on artificial intelligence Active CN106790938B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201611022203 2016-11-16
CN2016110222036 2016-11-16

Publications (2)

Publication Number Publication Date
CN106790938A CN106790938A (en) 2017-05-31
CN106790938B true CN106790938B (en) 2020-05-05

Family

ID=58928974

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611246400.6A Active CN106790938B (en) 2016-11-16 2016-12-29 Man-machine interaction vehicle-mounted system based on artificial intelligence

Country Status (1)

Country Link
CN (1) CN106790938B (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108556986A (en) * 2018-03-28 2018-09-21 上海乐愚智能科技有限公司 A kind of central control system and vehicle
CN108735203A (en) * 2018-03-28 2018-11-02 上海乐愚智能科技有限公司 Voice interactive method, terminal and computer-readable medium
CN108594998A (en) * 2018-04-19 2018-09-28 深圳市瀚思通汽车电子有限公司 A kind of onboard navigation system and its gesture operation method
CN109087660A (en) * 2018-09-29 2018-12-25 百度在线网络技术(北京)有限公司 Method, apparatus, equipment and computer readable storage medium for echo cancellor
CN109040324A (en) * 2018-10-30 2018-12-18 上海碧虎网络科技有限公司 Vehicle-mounted data services promotion method, device and computer readable storage medium
CN109872722A (en) * 2019-01-17 2019-06-11 珠海格力电器股份有限公司 A kind of voice interactive method, device, storage medium and air-conditioning
CN110077339B (en) * 2019-04-19 2021-04-13 广州小鹏汽车科技有限公司 System and method for adjusting brightness of vehicle-mounted display device
CN111312262A (en) * 2020-01-19 2020-06-19 鲨港科技(上海)有限公司 Audio information transmission system, method and device and corresponding two-wheel vehicle and helmet

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102358249A (en) * 2011-08-30 2012-02-22 上海华勤通讯技术有限公司 Mobile terminal, vehicle control module, vehicle and vehicle control system and method
EP2480003A1 (en) * 2011-01-04 2012-07-25 Alpine Electronics, Inc. Electronic apparatus for remotely controlling a mobile information terminal device
CN103118176A (en) * 2013-01-16 2013-05-22 广东好帮手电子科技股份有限公司 Method and system for achieving mobile phone voice control function through on-board host computer
CN104158944A (en) * 2014-08-27 2014-11-19 重庆长安汽车股份有限公司 Low-cost interconnection system of mobile phone and vehicle machine
CN204432572U (en) * 2015-01-13 2015-07-01 江苏新日电动车股份有限公司 A kind of electric motor intelligent central control system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2480003A1 (en) * 2011-01-04 2012-07-25 Alpine Electronics, Inc. Electronic apparatus for remotely controlling a mobile information terminal device
CN102358249A (en) * 2011-08-30 2012-02-22 上海华勤通讯技术有限公司 Mobile terminal, vehicle control module, vehicle and vehicle control system and method
CN103118176A (en) * 2013-01-16 2013-05-22 广东好帮手电子科技股份有限公司 Method and system for achieving mobile phone voice control function through on-board host computer
CN104158944A (en) * 2014-08-27 2014-11-19 重庆长安汽车股份有限公司 Low-cost interconnection system of mobile phone and vehicle machine
CN204432572U (en) * 2015-01-13 2015-07-01 江苏新日电动车股份有限公司 A kind of electric motor intelligent central control system

Also Published As

Publication number Publication date
CN106790938A (en) 2017-05-31

Similar Documents

Publication Publication Date Title
US9612999B2 (en) Method and system for supervising information communication based on occupant and vehicle environment
CN105530171B (en) Method and device for playing instant message voice by vehicle-mounted terminal
US9188449B2 (en) Controlling in-vehicle computing system based on contextual data
US10149132B2 (en) Pedestrial crash prevention system and operation method thereof
CN105096485B (en) The collection of riding information, querying method, traffic scheduling method and device
CN103761242B (en) Search method, searching system and natural language understanding system
CN105329187B (en) The intelligent vehicle-mounted system and control method of safety operation are realized in Bluetooth key triggering
CN103991419B (en) For selecting the method and system of driver's preference
CN103916534B (en) Mobile terminal
US8805349B2 (en) Method for controlling mobile communications
US9143603B2 (en) Methods and arrangements employing sensor-equipped smart phones
CN102163080B (en) For the multimode input system of voice-based menu and content navigation service
EP2491550B1 (en) Personalized text-to-speech synthesis and personalized speech feature extraction
US20170103749A1 (en) Dynamically adding or removing functionality to speech recognition systems
CN103782578B (en) System and method for providing from network content to telecommunication system in vehicle
US7177634B2 (en) Method of voice access for vehicle services
US7616943B2 (en) Automatic communication of personalized messages to a telematics equipped vehicle
US9412374B2 (en) Speech recognition having multiple modes in a motor vehicle
US8213861B2 (en) Method of vehicle to vehicle communication
JP5799010B2 (en) Method and system for running internet radio applications in a vehicle
CN104428832B (en) Speech recognition equipment and its method
US8554831B2 (en) System and method for executing hands-free operation of an electronic calendar application within a vehicle
CN104158944B (en) Low-cost interconnection system of mobile phone and vehicle machine
US8600741B2 (en) Method of using microphone characteristics to optimize speech recognition performance
US8781838B2 (en) In-vehicle text messaging experience engine

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant