CN106790938A - A kind of man-machine interaction onboard system based on artificial intelligence - Google Patents
A kind of man-machine interaction onboard system based on artificial intelligence Download PDFInfo
- Publication number
- CN106790938A CN106790938A CN201611246400.6A CN201611246400A CN106790938A CN 106790938 A CN106790938 A CN 106790938A CN 201611246400 A CN201611246400 A CN 201611246400A CN 106790938 A CN106790938 A CN 106790938A
- Authority
- CN
- China
- Prior art keywords
- module
- voice
- information
- vehicle
- terminal system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 28
- 238000013473 artificial intelligence Methods 0.000 title claims abstract description 26
- 238000004891 communication Methods 0.000 claims abstract description 47
- 238000012545 processing Methods 0.000 claims abstract description 10
- 238000012546 transfer Methods 0.000 claims abstract description 9
- 230000007613 environmental effect Effects 0.000 claims abstract description 4
- 230000010354 integration Effects 0.000 claims description 15
- 230000010365 information processing Effects 0.000 claims description 9
- 238000013459 approach Methods 0.000 claims description 2
- 230000005540 biological transmission Effects 0.000 description 9
- 230000002452 interceptive effect Effects 0.000 description 8
- 238000013461 design Methods 0.000 description 7
- 230000015572 biosynthetic process Effects 0.000 description 6
- 238000000034 method Methods 0.000 description 6
- 238000003786 synthesis reaction Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 238000004458 analytical method Methods 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 230000001351 cycling effect Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000007405 data analysis Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 238000004088 simulation Methods 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 230000002194 synthesizing effect Effects 0.000 description 2
- 240000007817 Olea europaea Species 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 231100001261 hazardous Toxicity 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000000465 moulding Methods 0.000 description 1
- 238000003058 natural language processing Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/60—Substation equipment, e.g. for use by subscribers including speech amplifiers
- H04M1/6033—Substation equipment, e.g. for use by subscribers including speech amplifiers for providing handsfree use or a loudspeaker mode in telephone sets
- H04M1/6041—Portable telephones adapted for handsfree use
- H04M1/6075—Portable telephones adapted for handsfree use adapted for handsfree use in a vehicle
- H04M1/6083—Portable telephones adapted for handsfree use adapted for handsfree use in a vehicle by interfacing with the vehicle audio system
- H04M1/6091—Portable telephones adapted for handsfree use adapted for handsfree use in a vehicle by interfacing with the vehicle audio system including a wireless interface
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L2021/02161—Number of inputs available containing the signal or the noise to be suppressed
- G10L2021/02165—Two microphones, one receiving mainly the noise signal and the other one mainly the speech signal
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Computational Linguistics (AREA)
- Quality & Reliability (AREA)
- Computer Networks & Wireless Communication (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Telephone Function (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
The invention discloses a kind of man-machine interaction onboard system based on artificial intelligence, including vehicle-mounted terminal system and mobile terminal system；Vehicle-mounted terminal system includes voice acquisition module, voice output module, central control module and the first wireless communication module, mobile terminal system includes message processing module and the second wireless communication module, wherein the first wireless communication module and the second wireless communication module are connected, to realize the information transfer between vehicle-mounted terminal system and mobile terminal system, central control module is connected with voice acquisition module, voice output module and the first wireless communication module respectively, while being controlled to above-mentioned module also according to instruction and operation information is received；Voice acquisition module is used to gather user speech information and environmental information and is sent to the mobile terminal system；Voice output module is used to play the voice received from the mobile terminal system；Message processing module is used for the information identification Edit and Compose voice of reception and is sent to vehicle-mounted terminal system.
Description
Technical field
The present invention relates to field of artificial intelligence, more particularly to a kind of vehicle-mounted system of man-machine interaction based on artificial intelligence
System.
Background technology
Artificial intelligence (Artificial Intelligence), english abbreviation is AI.It is study, be developed for simulation,
Extend and extend a new technological sciences of intelligent theory, method, technology and the application system of people.Artificial intelligence is to calculate
One branch of machine science, it attempts to understand essence of intelligence, and produce it is a kind of it is new can be in the similar mode of human intelligence
The intelligence machine made a response, the research in the field includes robot, speech recognition, image recognition, natural language processing and specially
Family's system etc..Wherein, the very important aspect of artificial intelligence is exactly interactive voice technology.
At present, using the vehicles --- small-sized electric car field widely, including electric bicycle, electronic rub
Motorcycle, electro-tricycle etc., because product is mainly directed towards wage-earners, for cost consideration, it is difficult to use and automobile and acoustic control
The voice interactive system that robot is similar, price is high, design is complicated, on the other hand, still has intelligence in the field
The application demand of voice, such as part small-sized electric car report mileage, electricity, fault message, but this car by phonetic synthesis
There is open defect and deficiency in type：Vehicle-mounted voice chip performance is weaker, and sound storehouse model is smaller, causes phonetic synthesis effect to be listened and inducts
Firmly, service content is limited, impersonality, and Consumer's Experience is poor.Additionally, the social recoverable amount of small-sized electric car has exceeded at present
200000000, in huge user, there are many vehicle users often to ride electric motor car on the other hand daily, make a phone call on the other hand, see the mobile phone
Information, very unsafe operation behavior of this frequent appearance is suddenly waited to improve.Therefore developing a kind of cost is suitable for small electrical
Motor-car, the intelligent onboard system with abundant voice interactive function turn into the urgent need to.
Therefore, those skilled in the art be devoted to developing a kind of inexpensive, highly integrated, performance it is strong based on artificial intelligence
Man-machine interaction onboard system, provide the user a kind of brand-new car experience.
The content of the invention
In view of the drawbacks described above of prior art, the technical problems to be solved by the invention are to provide a kind of low cost, height
The strong man-machine interaction onboard system based on artificial intelligence of integrated, performance.
To achieve the above object, the invention provides a kind of man-machine interaction onboard system based on artificial intelligence, including car
Carry terminal system and mobile terminal system；The vehicle-mounted terminal system includes voice acquisition module, voice output module, center control
Molding block and the first wireless communication module, the mobile terminal system include message processing module and the second wireless communication module,
Wherein described first wireless communication module and the second wireless communication module are connected, to realize the vehicle-mounted terminal system and mobile terminal
Information transfer between subsystem, the central control module respectively with the voice acquisition module, voice output module and
One wireless communication module is connected, and carries out the information transfer between module, while being instructed with operation information to above-mentioned also according to receiving
Module is controlled；The voice acquisition module is used to gather user speech information and ambient noise information and is sent to the shifting
Moved end subsystem；The voice output module is used to play the voice received from the mobile terminal system；Described information treatment
Module is used for the information identification Edit and Compose voice of reception and is sent to the vehicle-mounted terminal system.
Further, the voice acquisition module is to gather voice messaging using microphone array, wherein the Mike
Wind array includes a main microphon and at least one secondary microphone, and it is main that main microphon is arranged on the position near apart from user
For gathering user speech information, secondary microphone is arranged on the position remote apart from user and is mainly used in collection ambient noise letter
Breath.
Further, described information processing module includes that the first voice de-noising submodule or voice acquisition module include second
Voice de-noising submodule.
Further, transmitted in both directions audio number is used between first wireless communication module and the second wireless communication module
Point-to-point communication is carried out according to the mode with numerical data.
Further, between first wireless communication module and the second wireless communication module by Wi-Fi, bluetooth or
Wi-Fi combinations bluetooth approach carries out information exchange.
Further, the vehicle-mounted terminal system also includes first information acquisition module, its state for being used for collection vehicle
Information is simultaneously sent to described information processing module by the central control module；And/or the mobile terminal system is also
Including the second information acquisition module, its status information for being used to gather mobile device includes that phone information, mobile phone local file are believed
Cease and be shown in text information of mobile device screen etc. and send to described information processing module.
Further, described information processing module also includes content integration submodule, and its information for being used to receive is combined
Scene style enters edlin integration.
Further, described information processing module also includes third-party application interface sub-module, and it is used to start third party
Application program.
Further, the vehicle-mounted terminal system also includes unlocked state, and it is used to respond the unlock instruction for receiving, described
Mobile terminal system also includes unlocking request module, its unlocking request for being used to obtain mobile device input and transmission to described the
Two wireless communication modules, wherein mobile terminal manually input mode or its carry microphone collection voice messaging send unblock
Request.
Further, the voice acquisition module also includes the submodule that keeps out the wind, and it is arranged on according to vehicle forward direction
Before the voice acquisition module, for reducing environmental noise.
Compared with prior art, there is following technique effect in the present invention：Fully demonstrate inexpensive, high performance olive type frame
Structure is designed, i.e., the present invention is only needed to design outside the voice collecting of front end and the voice of rear end and puts hardware in vehicle-mounted end, preferably intelligent hand
Machine sets up point-to-point audio and data pair by between vehicle and mobile phone as mobile end equipment using wireless transport module
To transmission channel, so as to by the pilot process part of interactive voice --- the macrooperation such as speech recognition, content integration, phonetic synthesis
Amount complex data treatment transfers to mobile phone terminal to complete, take full advantage of the powerful computing capability of chip for cell phone, storage capacity and
The magnanimity information that can be networked collects ability, while also making full use of third party's routine interface of mobile phone application software, realizes voice
Abundant functional response after identification.Because speech recognition and speech synthesis engine are arranged on mobile phone terminal, its program is easily installed collection
Into, be easy to iteration and update, keep newest most perfect intelligent sound interactive service such that it is able to synchronous.Whole system hardware cost
Low, software performance is strong, is highly suitable for the small-sized electric car marketing of cost sensitivity.System can not only realize sound clarity
Hand-free call, and based on comprehensive on-vehicle information and user mobile phone information search, parse, retouch picture, can provide accurately
The intelligent sound interactive service of hommization, while improving travel safety.
The technique effect of design of the invention, concrete structure and generation is described further below with reference to accompanying drawing, with
It is fully understood from the purpose of the present invention, feature and effect.
Brief description of the drawings
Fig. 1 is the vehicle-mounted system of man-machine interaction that the preferred embodiments of the present invention the first voice de-noising submodule is arranged on mobile terminal
System schematic diagram；
Fig. 2 is the vehicle-mounted system of man-machine interaction that the preferred embodiments of the present invention the second voice de-noising submodule is arranged on vehicle-mounted end
System schematic diagram.
Below in conjunction with the embodiment of the present invention, the technical scheme in the embodiment of the present invention is clearly and completely described,
Obviously, described embodiment is only a part of embodiment of the invention, rather than whole embodiments.Based in the present invention
Embodiment, the every other embodiment that those of ordinary skill in the art are obtained under the premise of creative work is not made, all
Belong to the scope of protection of the invention.
Specific embodiment
As shown in figure 1, the preferred embodiments of the present invention the first voice de-noising module is arranged on the man-machine interaction car of mobile terminal
Loading system, including vehicle-mounted terminal system and mobile phone terminal system；
Vehicle-mounted terminal system includes that the first wireless communication module, voice acquisition module, voice output module, information of vehicles are adopted
Collection module, unlocked state and central control module；
Mobile phone terminal system includes that message processing module, cellphone information acquisition module, unlocking request module and second are wireless
Communication module；
First wireless communication module and the second wireless communication module are connected, to realize vehicle-mounted terminal system and mobile terminal subsystem
Information transfer between system；Between first wireless communication module and the second wireless communication module using transmitted in both directions voice data and
The mode of numerical data carries out point-to-point communication；Voice data both can be that DAB can also be analogue audio frequency, for passing
Pass the voice signal obtained by microphone array and the audio signal exported via mobile phone terminal.Numerical data is used to transmit vehicle-mounted end
Command information between mobile phone terminal is interacted.When voice data uses digital audio format, the first wireless communication module and the
Communication between two wireless communication modules can use single digital transmission mode.When voice data uses analogue audio frequency,
Communication between first wireless communication module and the second wireless communication module is different using two kinds of analogue transmission and Digital Transmission
Transmission means, is respectively used to the transmission of analogue audio frequency and the transmission of numerical data.Further illustrate, the first channel radio of vehicle-mounted end
Second wireless communication module of letter module and mobile phone terminal can be using connection sides such as Wi-Fi, bluetooth or Wi-Fi combination bluetooths
Formula, different data transfer mode means that, using different communication protocol, hardware uses different design circuits.
Voice acquisition module is used to gather user speech information and environmental information and is sent to mobile phone terminal system；It is used
Microphone array, wherein microphone array include a main microphon and at least one secondary microphone, main microphon be arranged on away from
Position close to vehicle driver is mainly used in gathering user speech information, and secondary microphone is arranged on remote apart from vehicle driver
Position is mainly used in gathering ambient noise, and the diverse location that multiple secondary microphone is located at vehicle-mounted end can be set, and gathers and screens not
Equidirectional ambient noise, contributes to clear in the call during phonetic recognization rate being improved after voice de-noising and is made a phone call
Degree, now, the first voice de-noising submodule need to process at least two-way audio signal, and it includes main microphon voice signal and at least
The noise signal of secondary microphone all the way.
Voice output module is used to play the voice received from mobile terminal system, and such as voice output module is loudspeaker
By via being put outside the audio-frequency information of mobile phone terminal downlink transfer to vehicle-mounted end.
Collecting vehicle information module and cellphone information acquisition module are for increasing popularity, the reality of man-machine interaction content
With property, the present invention is including being arranged on the collecting vehicle information module of vehicle-mounted end and being arranged on the cellphone information acquisition module of mobile phone terminal
At least one of both, certainly, if all having information acquisition module in vehicle end and mobile phone terminal, can cause that information is come
More enrich in source.
Collecting vehicle information module is used for collection vehicle status information and is sent to information processing by central control module
Module, the information for being obtained can be visual-type, such as including mileage, speed, voltage, electric current, charging interval, charge frequency
Deng, can be inference type, for example including wheeled remaining mileage (valuation), vehicle user with car be accustomed to (safety behavior
Such as deceleration, hazardous act is for example brought to a halt) and the depreciation loss trend of part such as battery etc..
Cellphone information acquisition module is used to gather the status information of mobile device and sends to message processing module, and it includes
Collection phone information, mobile phone local file information, the word content information etc. for being shown in mobile phone screen, the information for being obtained can be with
Visual-type, such as including weather, time, incoming call, short message, notice, dump energy, geographical position, music file etc., can be with
It is inference type, for example, inventory, the open frequency of a certain application is installed according to mobile phone application, uses duration, attentinal contents, selection
Custom etc., analysis user characteristics, including sex, age level, deflection hobby etc..Additionally, cellphone information acquisition module can be with
Networking advantage based on mobile phone, searches for and obtains the magnanimity information from internet at any time as needed.By from vehicle-mounted end
The information bank that the information gathered with mobile phone terminal is set up, is both, for vehicle driver sets up the basis that customer analysis retouch picture, to be also
The follow-up information source that accurate personalized man-machine interactive service is provided for vehicle driver.
Central control module respectively with the first wireless communication module, voice acquisition module, voice output module, information of vehicles
Acquisition module and unlocked state are connected, and carry out the information transfer between module, while being instructed and operation information pair also according to receiving
Above-mentioned module is controlled；It is served as and realizes communication and the control axis for interacting with mobile phone terminal.
Message processing module is used for the information identification Edit and Compose voice of reception and is sent to vehicle-mounted terminal system, its tool
Speech recognition, Edition Contains, speech-sound synthesizing function are included for body.It also includes the first voice de-noising submodule, for improving
Phonetic recognization rate and hand-free call definition.It also includes content integration submodule, for the information combination scene wind that will be received
Lattice enter edlin integration, specifically according to the vehicle client information and/or mobile phone client information combination associated scenario Style Model for obtaining
The passive answer type and/or active push type content for exporting are integrated in establishment.Its demand being both included under different scenes is patrolled
Collect the model also semantic style and features model comprising specific enunciator.It should be noted that " needing in aforementioned need logical model
Ask " it is related to man-machine interaction both sides, both including being proposed from vehicle driver --- and the inquiry demand of " people ", also including hand
The result that generator terminal is based on bulk information data analysis acquisition needs to inform vehicle driver --- the push demand of " machine ", thus
Content integration submodule according to demand logical model generate respectively in response to " people " passive answer type content and in response to " machine "
Active push type content.Specifically, the voice request of the vehicle driver from vehicle-mounted end is recognized first, then by content
Integrate submodule and the information of reception is integrated into passive answer type and/or active push type content according to scene Style Model, most
Passive answer type and/or active push type content Composite tone voice messaging are sent into vehicle-mounted terminal system afterwards to play；
Message processing module also includes third-party application interface sub-module, and it is used to start third party application, and this will
So that the function of man-machine interaction onboard system is greatly increased, such as many vehicle drivers are liked cycling while having on earphone
Listen music, this behavior not only ignore safety and also when cycling cannot selected songs, now by the car handsfree of the system offer
Function can realize mobile phone music broadcasting onboard, and can be by the free selected songs of speech recognition.Due to being limited by music
Copyright problem, increasing music is only played on certain third party's music software, therefore, the third-party application of the system connects
Openning module can realize the slitless connection with these music softwares.
Also include being arranged on the unlocking request module of mobile phone terminal, it is used to obtain the unlocking request of mobile phone input and send extremely
Second wireless communication module and the unlocked state in vehicle-mounted end, unlocked state are used to respond the unlock instruction for receiving, wherein unlocking
Request module can send unlock instruction using being manually entered mode or carrying microphone using mobile phone terminal by Application on Voiceprint Recognition,
The purpose of design of this tripper is：The unblock of current small-sized electric car generally uses normal remote control mode, if this
System is not provided with via the unlocking request module of mobile phone terminal, then vehicle driver certainly will need operation as follows in practical operation
Step：First take out normal remote control unblock vehicle, take out mobile phone realization and the communication online of vehicle-mounted end again, the operation of two steps increased
Triviality, is very easy to cause vehicle driver to forget or be disinclined to take out mobile phone operation second step, and this can substantially reduce and be
The utilization rate of system, therefore unlocking request module is set in mobile phone terminal, can be by vehicle unblock and mobile phone and online this two step of vehicle
Step completion is operated and made, hardly changes the unblock custom of vehicle user, taken while can also save vehicle user and go out
With the cumbersome of vehicle remote control device, the frequency of use to improving the system is highly beneficial.
Also include the submodule that keeps out the wind in voice acquisition module, specifically abat-vent is arranged on microphone front face,
When vehicle advances, made an uproar interference for blocking and reducing the wind that microphone is subject to.This abat-vent can be for microphone is fixed
The fan housing of system, it is also possible to utilize some existing abat-vents, such as some vehicles are in front of handlebar for vehicle user is set
Transparent wind sheild.
Below by way of interactive voice example, the present invention is described further：
For example, the meter unit of small-sized electric car is due to factors, nothing such as vibrations, waterproof and dustproof, sunlight irradiation and costs
By being that mechanical indicator instrument or liquid crystal instrument are all spoilage parts higher, now vehicle driver passes through vehicle-mounted end Mike
Wind is inquired：" now some, moreover it is possible to how many kilometer run", the voice messaging is communicated to the first voice and drops by microphone array
Make an uproar modular filtration noise, then word is identified as via message processing module, then by word output to content integration submodule, this
When, content integration submodule is searched for from the information bank for being stored in mobile phone terminal and obtains time letter based on cellphone information acquisition module
Cease, information about power is obtained based on collecting vehicle information module, while the user profile according to the vehicle driver is retouched as feature knot
Scene Style Model is closed, for example, likes net purchase type, it is " parent " that the semantic style of establishment can call, and likes animation maid servant's type, is worked out
It is " owner " that semantic style can call, and content integration submodule works out such one section has the passive answer type for personalizing
Word：" owner, is now six o'clock of afternoon, and I can also again run 8 kilometers." now based on the demand in content integration submodule
Logical model --- the demand of " machine ", such as, from the data analysis of collecting vehicle information module, can synchronously work out one section of master
Dynamic push-type word：" owner, you charged not in time last time, went home today to remember.”
The above-mentioned word worked out by content integration submodule is combined included in speech synthesis engine general at present not
With the analog voice of the specific speaker such as the male voice of tone color, female voice and star, energy is processed by the powerful calculating of chip for cell phone
Power and the large capacity audio storehouse of storage, can provide phonetic synthesis effect becoming more meticulous very much, that simulation of natural degree is high, finally, language
Sound audio is sent to vehicle-mounted end voice output module (such as loudspeaker) broadcasting, so that complete one section has hommization, sense very much
Dye power, the man-machine interaction for embodying " artificial intelligence ", allow vehicle driver to have brand-new experience.
In " the man-machine interaction onboard system based on artificial intelligence " of the system statement, involved message processing module
Including speech recognition and speech-sound synthesizing function generally using the speech engine provided by third party, what these speech engines had
" artificial intelligence " feature can be referred to as publicly-owned intelligence, in the present system, information gathering and analysis based on vehicle-mounted end and mobile phone terminal
Combined content integrates the requirement logic mould that the scene Style Model being related in submodule, particularly content integration submodule is included
Type because under depending on deep understanding people and car information exchange application scenarios, a large amount of models of structure that customize and logic calculate
Method, so also having obvious " artificial intelligence " feature, can be referred to as proprietary intelligence.Different from " the publicly-owned intelligence of speech engine
Can ", " proprietary intelligence " depends on vehicle manufacture side's stand-alone development, and interaction logic model is got in the content integration submodule of its design
Abundant, then the man-machine interaction service for embodying is finer, and Consumer's Experience gets over tool appeal and hommization, also can accordingly cause small electrical
Motor-car product has the transnormal market competitiveness.
As shown in Fig. 2 the preferred embodiments of the present invention the second voice de-noising submodule is arranged on the man-machine interaction of vehicle-mounted end
In onboard system, the second voice de-noising submodule is arranged on vehicle-mounted end, its essence is by hardware noise reduction, it means that hardware
Cost appropriate can increase, but the gain that can be obtained is, the first wireless communication module only needs transmission to the second wireless communication module
By the voice data of the monophonic form after noise reduction filtering, can reduce and possess voice data to the first wireless communication module
The requirement of transmittability.Meanwhile, there are many small-sized electric cars to have been loaded with being intended to the satellite fix mould of the GPS+SIM cards of anti-theft tracking
Block, and using SIM module realize vehicle it is stolen after automatic dialing phone and monitoring, therefore, the second voice de-noising submodule
Block is arranged at vehicle end, can not only improve the definition of monitoring telephone, and then vehicle user can be allowed direct when cycling
Called by the SIM module on car, and with clearly speech quality.
Preferred embodiment of the invention described in detail above.It should be appreciated that one of ordinary skill in the art without
Need creative work just can make many modifications and variations with design of the invention.Therefore, all technologies in the art
Personnel are available by logical analysis, reasoning, or a limited experiment on the basis of existing technology under this invention's idea
Technical scheme, all should be in the protection domain being defined in the patent claims.
Claims (10)
1. a kind of man-machine interaction onboard system based on artificial intelligence, it is characterised in that including vehicle-mounted terminal system and mobile terminal
Subsystem；The vehicle-mounted terminal system includes voice acquisition module, voice output module, central control module and the first channel radio
Letter module, the mobile terminal system includes message processing module and the second wireless communication module, wherein first channel radio
Letter module and the connection of the second wireless communication module, to realize that the information between the vehicle-mounted terminal system and mobile terminal system is passed
Defeated, the central control module is connected with the voice acquisition module, voice output module and the first wireless communication module respectively,
The information transfer between module is carried out, while being controlled to above-mentioned module also according to instruction and operation information is received；Institute's predicate
Sound acquisition module is used to gather user speech information and ambient noise information and is sent to the mobile terminal system；The voice
Output module is used to play the voice received from the mobile terminal system；Described information processing module is used for the information that will be received
Identification Edit and Compose voice is simultaneously sent to the vehicle-mounted terminal system.
2. the man-machine interaction onboard system of artificial intelligence is based on as claimed in claim 1, it is characterised in that the voice collecting
Module is to gather voice messaging using microphone array, wherein the microphone array includes a main microphon and at least one
Individual secondary microphone, main microphon is mainly used in gathering user speech information, and secondary microphone is mainly used in gathering ambient noise information.
3. the man-machine interaction onboard system of artificial intelligence is based on as claimed in claim 1, it is characterised in that described information treatment
Module includes that the first voice de-noising submodule or voice acquisition module include the second voice de-noising submodule.
4. the man-machine interaction onboard system of artificial intelligence is based on as claimed in claim 1, it is characterised in that described first is wireless
Carried out by the way of transmitted in both directions voice data and numerical data between communication module and the second wireless communication module point-to-point
Communication.
5. the man-machine interaction onboard system of artificial intelligence is based on as claimed in claim 1, it is characterised in that described first is wireless
Information exchange is carried out by Wi-Fi, bluetooth or Wi-Fi combinations bluetooth approach between communication module and the second wireless communication module.
6. the man-machine interaction onboard system of artificial intelligence is based on as claimed in claim 1, it is characterised in that the vehicle-mounted terminal
System also includes first information acquisition module, and its status information for being used for collection vehicle is simultaneously sent by the central control module
To described information processing module；And/or the mobile terminal system also includes the second information acquisition module, and it is used to gather
The status information of mobile device is simultaneously sent to described information processing module.
7. the man-machine interaction onboard system of artificial intelligence is based on as claimed in claim 1, it is characterised in that described information treatment
Module also includes content integration submodule, and it is used to for the information combination scene style of reception to enter edlin integration.
8. the man-machine interaction onboard system of artificial intelligence is based on as claimed in claim 1, it is characterised in that described information treatment
Module also includes third-party application interface sub-module, and it is used to start third party application.
9. the man-machine interaction onboard system of artificial intelligence is based on as claimed in claim 1, it is characterised in that the vehicle-mounted terminal
System also includes unlocked state, and it is used to respond the unlock instruction for receiving, and the mobile terminal system also includes unlocking request mould
Block, it is used to obtain the unlocking request of mobile device input and send to second wireless communication module.
10. the man-machine interaction onboard system of artificial intelligence is based on as claimed in claim 1, it is characterised in that the voice is adopted
Collection module also includes the submodule that keeps out the wind, and it is used to reduce environmental noise.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2016110222036 | 2016-11-16 | ||
| CN201611022203 | 2016-11-16 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106790938A true CN106790938A (en) | 2017-05-31 |
| CN106790938B CN106790938B (en) | 2020-05-05 |
Family
ID=58928974
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611246400.6A Active CN106790938B (en) | 2016-11-16 | 2016-12-29 | Man-machine interaction vehicle-mounted system based on artificial intelligence |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106790938B (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108556986A (en) * | 2018-03-28 | 2018-09-21 | 上海乐愚智能科技有限公司 | A kind of central control system and vehicle |
| CN108594998A (en) * | 2018-04-19 | 2018-09-28 | 深圳市瀚思通汽车电子有限公司 | A kind of onboard navigation system and its gesture operation method |
| CN108735203A (en) * | 2018-03-28 | 2018-11-02 | 上海乐愚智能科技有限公司 | Voice interactive method, terminal and computer-readable medium |
| CN109040324A (en) * | 2018-10-30 | 2018-12-18 | 上海碧虎网络科技有限公司 | Vehicle-mounted data services promotion method, device and computer readable storage medium |
| CN109087660A (en) * | 2018-09-29 | 2018-12-25 | 百度在线网络技术（北京）有限公司 | Method, apparatus, equipment and computer readable storage medium for echo cancellor |
| CN109872722A (en) * | 2019-01-17 | 2019-06-11 | 珠海格力电器股份有限公司 | Voice interaction method and device, storage medium and air conditioner |
| CN110077339A (en) * | 2019-04-19 | 2019-08-02 | 广州小鹏汽车科技有限公司 | For adjusting the system and method for display device for mounting on vehicle brightness |
| CN110232915A (en) * | 2018-03-06 | 2019-09-13 | Jvc 建伍株式会社 | Sound-content control device, sound-content control method and storage medium |
| CN111312262A (en) * | 2020-01-19 | 2020-06-19 | 鲨港科技(上海)有限公司 | Audio information transmission system, method and device and corresponding two-wheel vehicle and helmet |
| CN113053373A (en) * | 2021-02-26 | 2021-06-29 | 上海声通信息科技股份有限公司 | Intelligent vehicle-mounted voice interaction system supporting voice cloning |
| CN114056343A (en) * | 2022-01-11 | 2022-02-18 | 广州小鹏汽车科技有限公司 | Interaction method, server and storage medium |
| CN114939268A (en) * | 2022-06-02 | 2022-08-26 | 毛羽鹏 | Human-computer interaction system for monitoring bicycle motion by adopting nano generator |
| CN115017352A (en) * | 2022-06-22 | 2022-09-06 | 润芯微科技(江苏)有限公司 | Mobile phone car machine interaction system based on image recognition |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102358249A (en) * | 2011-08-30 | 2012-02-22 | 上海华勤通讯技术有限公司 | Mobile terminal, vehicle control module, vehicle and vehicle control system and method |
| EP2480003A1 (en) * | 2011-01-04 | 2012-07-25 | Alpine Electronics, Inc. | Electronic apparatus for remotely controlling a mobile information terminal device |
| CN103118176A (en) * | 2013-01-16 | 2013-05-22 | 广东好帮手电子科技股份有限公司 | Method and system for achieving mobile phone voice control function through on-board host computer |
| CN104158944A (en) * | 2014-08-27 | 2014-11-19 | 重庆长安汽车股份有限公司 | Low-cost interconnection system of mobile phone and vehicle machine |
| CN204432572U (en) * | 2015-01-13 | 2015-07-01 | 江苏新日电动车股份有限公司 | A kind of electric motor intelligent central control system |
-
2016
- 2016-12-29 CN CN201611246400.6A patent/CN106790938B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2480003A1 (en) * | 2011-01-04 | 2012-07-25 | Alpine Electronics, Inc. | Electronic apparatus for remotely controlling a mobile information terminal device |
| CN102358249A (en) * | 2011-08-30 | 2012-02-22 | 上海华勤通讯技术有限公司 | Mobile terminal, vehicle control module, vehicle and vehicle control system and method |
| CN103118176A (en) * | 2013-01-16 | 2013-05-22 | 广东好帮手电子科技股份有限公司 | Method and system for achieving mobile phone voice control function through on-board host computer |
| CN104158944A (en) * | 2014-08-27 | 2014-11-19 | 重庆长安汽车股份有限公司 | Low-cost interconnection system of mobile phone and vehicle machine |
| CN204432572U (en) * | 2015-01-13 | 2015-07-01 | 江苏新日电动车股份有限公司 | A kind of electric motor intelligent central control system |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110232915A (en) * | 2018-03-06 | 2019-09-13 | Jvc 建伍株式会社 | Sound-content control device, sound-content control method and storage medium |
| CN110232915B (en) * | 2018-03-06 | 2023-05-30 | Jvc 建伍株式会社 | Audio content control device, audio content control method, and storage medium |
| CN108735203A (en) * | 2018-03-28 | 2018-11-02 | 上海乐愚智能科技有限公司 | Voice interactive method, terminal and computer-readable medium |
| CN108556986A (en) * | 2018-03-28 | 2018-09-21 | 上海乐愚智能科技有限公司 | A kind of central control system and vehicle |
| CN108594998A (en) * | 2018-04-19 | 2018-09-28 | 深圳市瀚思通汽车电子有限公司 | A kind of onboard navigation system and its gesture operation method |
| CN109087660A (en) * | 2018-09-29 | 2018-12-25 | 百度在线网络技术（北京）有限公司 | Method, apparatus, equipment and computer readable storage medium for echo cancellor |
| CN109040324A (en) * | 2018-10-30 | 2018-12-18 | 上海碧虎网络科技有限公司 | Vehicle-mounted data services promotion method, device and computer readable storage medium |
| CN109872722B (en) * | 2019-01-17 | 2021-08-31 | 珠海格力电器股份有限公司 | Voice interaction method and device, storage medium and air conditioner |
| CN109872722A (en) * | 2019-01-17 | 2019-06-11 | 珠海格力电器股份有限公司 | Voice interaction method and device, storage medium and air conditioner |
| CN110077339A (en) * | 2019-04-19 | 2019-08-02 | 广州小鹏汽车科技有限公司 | For adjusting the system and method for display device for mounting on vehicle brightness |
| CN111312262A (en) * | 2020-01-19 | 2020-06-19 | 鲨港科技(上海)有限公司 | Audio information transmission system, method and device and corresponding two-wheel vehicle and helmet |
| WO2021143631A1 (en) * | 2020-01-19 | 2021-07-22 | 鲨港科技(上海)有限公司 | Audio information transmission system, method, device, corresponding two-wheeled vehicle, and helmet |
| CN111312262B (en) * | 2020-01-19 | 2022-03-08 | 鲨港科技(上海)有限公司 | Audio information transmission system, method and device and corresponding two-wheel vehicle and helmet |
| TWI777371B (en) * | 2020-01-19 | 2022-09-11 | 大陸商鯊港科技（上海）有限公司 | Audio information transmission system, method and device and corresponding two-wheeled vehicle and helmet |
| CN113053373A (en) * | 2021-02-26 | 2021-06-29 | 上海声通信息科技股份有限公司 | Intelligent vehicle-mounted voice interaction system supporting voice cloning |
| CN114056343A (en) * | 2022-01-11 | 2022-02-18 | 广州小鹏汽车科技有限公司 | Interaction method, server and storage medium |
| CN114056343B (en) * | 2022-01-11 | 2022-05-10 | 广州小鹏汽车科技有限公司 | Processing method of vehicle-mounted system function, server and storage medium |
| CN114939268A (en) * | 2022-06-02 | 2022-08-26 | 毛羽鹏 | Human-computer interaction system for monitoring bicycle motion by adopting nano generator |
| CN115017352A (en) * | 2022-06-22 | 2022-09-06 | 润芯微科技(江苏)有限公司 | Mobile phone car machine interaction system based on image recognition |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106790938B (en) | 2020-05-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106790938A (en) | A kind of man-machine interaction onboard system based on artificial intelligence | |
| CN102006373B (en) | Vehicle-mounted service system and method based on voice command control | |
| CN107069127B (en) | The long-range management of electric vehicle charging profile | |
| CN104158944B (en) | Low-cost interconnection system of mobile phone and vehicle machine | |
| CN107097718A (en) | Active speech synthesizing device and the vehicles | |
| CN107134286A (en) | ANTENNAUDIO player method, music player and storage medium based on interactive voice | |
| CN106847278A (en) | System of selection and its mobile terminal apparatus and information system based on speech recognition | |
| CN205544350U (en) | On -vehicle intelligent charging ware and on -vehicle speech information pusher | |
| CN106921783A (en) | Use terminal device, the system and method for communication and social networking application when driving safely | |
| CN110286745A (en) | Dialog process system, the vehicle with dialog process system and dialog process method | |
| CN110211583A (en) | A kind of voice interactive method and interactive voice equipment based on intelligent line traffic control | |
| CN206849495U (en) | Vehicle-mounted voice interactive terminal and interactive system for vehicle-mounted voice | |
| CN206856594U (en) | Active speech synthesizing device and the vehicles | |
| CN206226731U (en) | A kind of vehicle intelligent cloud mirror system | |
| DE202012009638U1 (en) | Voice-controlled communication system | |
| CN201869345U (en) | Vehicle-mounted sound system capable of accessing Internet | |
| CN103716474A (en) | Vehicle-borne communication interaction system based on agent and background | |
| CN207968881U (en) | Vehicle-mounted voice intercom system | |
| CN206224162U (en) | A kind of on-vehicle Bluetooth speech control system | |
| CN113022305A (en) | Three-screen intelligent cabin host system of automobile | |
| CN206042128U (en) | On -vehiclely multi -functional exempt from to operate intelligent service device | |
| CN108111790A (en) | A kind of automobile data recorder | |
| CN111601286A (en) | Vehicle-mounted terminal, signal processing method and device | |
| CN103630144A (en) | Automobile acoustic control navigation device and method | |
| CN202887468U (en) | Vehicle-mounted system used for traffic information acquisition, publishing and utilization |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |