CN108923808A - Vehicle and its car-mounted terminal and speech interaction mode active triggering method - Google Patents
Vehicle and its car-mounted terminal and speech interaction mode active triggering method Download PDFInfo
- Publication number
- CN108923808A CN108923808A CN201810569023.2A CN201810569023A CN108923808A CN 108923808 A CN108923808 A CN 108923808A CN 201810569023 A CN201810569023 A CN 201810569023A CN 108923808 A CN108923808 A CN 108923808A
- Authority
- CN
- China
- Prior art keywords
- interaction mode
- user
- speech interaction
- real
- vehicle
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 88
- 238000000034 method Methods 0.000 title claims abstract description 43
- 230000007613 environmental effect Effects 0.000 claims abstract description 49
- 238000013507 mapping Methods 0.000 claims description 26
- 230000008569 process Effects 0.000 claims description 13
- 230000008451 emotion Effects 0.000 claims description 8
- 238000012544 monitoring process Methods 0.000 abstract description 12
- 230000002452 interceptive effect Effects 0.000 description 23
- 238000005516 engineering process Methods 0.000 description 13
- 238000004891 communication Methods 0.000 description 12
- 230000006855 networking Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 230000008859 change Effects 0.000 description 4
- 230000036651 mood Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000001960 triggered effect Effects 0.000 description 3
- 230000003542 behavioural effect Effects 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 2
- 235000013399 edible fruits Nutrition 0.000 description 2
- 238000005265 energy consumption Methods 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 230000001939 inductive effect Effects 0.000 description 2
- 210000003205 muscle Anatomy 0.000 description 2
- 239000003921 oil Substances 0.000 description 2
- 238000004088 simulation Methods 0.000 description 2
- 238000003786 synthesis reaction Methods 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000004907 flux Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 239000010705 motor oil Substances 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 235000015096 spirit Nutrition 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
- B60R16/037—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for occupant comfort, e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
- B60R16/0373—Voice control
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
- H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
- H04B1/3822—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving specially adapted for use in vehicles
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Mechanical Engineering (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
- Navigation (AREA)
- Traffic Control Systems (AREA)
Abstract
The application provides a kind of vehicle and its car-mounted terminal and speech interaction mode active triggering method, car-mounted terminal is not belonging to the environmental factor information of user's acoustic control information by monitoring, judged whether to trigger speech interaction mode according to the environmental factor information, if so, triggering speech interaction mode.In this way, the application can actively monitoring environmental factor information, and according to environmental factor information intelligent actively triggering starting speech interaction mode, it is not only user-friendly, but guarantee traffic safety, largely improve user experience.
Description
Technical field
This application involves vehicle technology fields, and in particular to a kind of car-mounted terminal and its speech interaction mode actively triggering side
Method, and the vehicle of the application car-mounted terminal.
Background technique
Major part vehicle-mounted terminal system carries out any operation all using manually controlling come the operation of complete paired systems at present
When, driver will be depended on and press a series of buttons with hand to realize, this will disperse the attention of driver when driving,
Increase traffic hazard；Also there is part vehicle-mounted terminal system that can control the various functions of onboard system using voice command,
When needing to operate, as long as saying relevant order can be completed, the both hands of driver have been liberated, it is easy to use.
The prior art can design reasonable voice man-machine interface according to vehicle-mounted environment, simplify operation, make voice command
Control system is more stable and reliable.
But existing speech recognition needs the voice signal of recording operation person in advance, it then just can be quasi- in operation
True voice command recognition is merely able to use for the operator of recorded voice.Moreover, existing voice interactive mode generally require by
It waits user actively to trigger dynamicly, such as wake-up, key or touch screen are clicked, and can not accomplish actively to trigger, this is in very great Cheng
User experience is affected on degree, when especially driver can not divert one's attention to operate when driving, can not start voice
Interaction and easy influence traffic safety.
It is insufficient for the various aspects of the prior art, present inventor by further investigation, propose a kind of vehicle and its
Car-mounted terminal and speech interaction mode active triggering method.
Summary of the invention
The purpose of the application is, provides a kind of vehicle and its car-mounted terminal and speech interaction mode active triggering method,
Starting speech interaction mode actively intelligently can be triggered according to driving situation, it is not only user-friendly, but also guarantee traffic safety,
Largely improve user experience.
In order to solve the above technical problems, the application provides a kind of speech interaction mode active triggering method of car-mounted terminal,
Wherein, the speech interaction mode active triggering method includes the following steps：
Car-mounted terminal monitors environmental factor information, wherein the environmental factor information is not belonging to triggering speech interaction mode
User's acoustic control information；
Judged whether to trigger speech interaction mode according to the environmental factor information；
If so, triggering speech interaction mode.
Wherein, the step of active triggering starting speech interaction mode, comprises the following processes：
Judge to obtain current real-time scene according to the environmental factor information comprehensive analysis of objective reality；
Obtain prompt information corresponding with the real-time scene in preset scene prompt information mapping table；
The prompt information is prompted to user to start speech interaction mode.
Wherein, described that the prompt information is prompted to the step of user is to start speech interaction mode, it further include as follows
Process：
After the prompt information is prompted to user, user's Real-time Feedback according to made by the prompt information is received；
In the Real-time Feedback for receiving user, formally start speech interaction mode；The real-time anti-of user is not being received
When feedback, stop starting speech interaction mode.
Wherein, the real-time scene is current geographic position, real-time weather, current stroke, real-time road, user emotion
Any combination of one or more of them；It is corresponding with each prompt information in the preset scene prompt information mapping table
Be：Operation behavior habit of the user under each real-time scene, the prompt information are current for prompting the user whether to execute
Corresponding operation behavior habit under real-time scene.
Wherein, the car-mounted terminal passes through vehicle-mounted camera, GPS positioning module, navigation application program APP or Cloud Server
Monitor environmental factor information.
It wherein, further include that the operation behavior habit at combining environmental information and family updates the preset scene prompt periodically
Information mapping table.
In order to solve the above technical problems, the application also provides a kind of car-mounted terminal, wherein the car-mounted terminal includes processing
Device, the processor is for executing program data, to realize above-mentioned speech interaction mode active triggering method.
In order to solve the above technical problems, the application also provides a kind of vehicle, wherein the vehicle configuration has above-mentioned vehicle
Mounted terminal.
Wherein, the vehicle configuration has vehicle-mounted camera, infrared sensor, seat sensor, temperature sensor or connection
The network modules of Cloud Server are respectively used to monitor different environmental factor information.
The application vehicle and its car-mounted terminal and speech interaction mode active triggering method, car-mounted terminal are not belonged to by monitoring
In the environmental factor information of user's acoustic control information, judge whether to trigger interactive voice mould then according to the environmental factor information
Formula, if so, triggering speech interaction mode.The application can actively monitoring environmental factor information, and according to environmental factor information intelligence
Actively triggering starts speech interaction mode on energy ground, not only user-friendly, but also guarantee traffic safety, largely improves use
Family experience.
Above description is only the general introduction of technical scheme, in order to better understand the technological means of the application,
And it can be implemented in accordance with the contents of the specification, and in order to allow the above and other objects, features and advantages of the application can
It is clearer and more comprehensible, it is special below to lift preferred embodiment, and cooperate attached drawing, detailed description are as follows.
Detailed description of the invention
Fig. 1 is the flow diagram of one embodiment of speech interaction mode active triggering method of the application car-mounted terminal.
Fig. 2 is the module diagram of the application car-mounted terminal.
Fig. 3 is the flow diagram of one embodiment of speech interaction mode active triggering method of the application Cloud Server.
Specific embodiment
Further to illustrate that the application is the technical means and efficacy reaching predetermined application purpose and being taken, below in conjunction with
Attached drawing and preferred embodiment, to the application, detailed description are as follows.
By the explanation of specific embodiment, when can be to reach the technological means and effect that predetermined purpose is taken to the application
Fruit be able to more deeply and it is specific understand, however institute's accompanying drawings are only to provide reference and description is used, and are not used to this Shen
It please limit.
Referring to Fig. 1, Fig. 1 is the stream of one embodiment of speech interaction mode active triggering method of the application car-mounted terminal
Journey schematic diagram.
In the present embodiment, the speech interaction mode active triggering method includes but is not limited to following steps.
Step S101, car-mounted terminal monitor environmental factor information, wherein the environmental factor information is not belonging to triggering voice
User's acoustic control information of interactive mode；
Step S102 judges whether to trigger speech interaction mode according to the environmental factor information；
Step S103, if so, triggering speech interaction mode.
It is worth noting that the environmental factor information is not belonging to user's acoustic control information of triggering speech interaction mode, refer to
Be to be not belonging to user speech and say " starting speech interaction mode ", " acoustic control please be start " etc. to be intended to triggering starting interactive voice
The content of mode, the environmental factor information refer to the environmental factor that non-user subjectivity can control/changes immediately, such as road
Condition, weather, present position or navigation APP stroke currently in use etc..And user using acoustic control information, click keys or
It clicks the non intelligent mode that screen etc. actively starts and then belongs to non-ambient factor information.
It should be noted that the step of actively triggering starts speech interaction mode described in present embodiment, specifically can wrap
Include following process：Judge to obtain current real-time scene according to the environmental factor information comprehensive analysis of objective reality；It obtains default
Scene prompt information mapping table in prompt information corresponding with the real-time scene；The prompt information is prompted to use
Family is to start speech interaction mode.In other words, present embodiment needs first to will be prompted to information alert to user, just starts voice
Interactive mode removes the voice control of acquisition user without starting speech interaction mode always, reduces system energy consumption.In addition, such as
When fruit judgement does not need triggering speech interaction mode, then do not trigger.
Furthermore, described that the prompt information is prompted to the step of user is to start speech interaction mode, may be used also
To comprise the following processes：After the prompt information is prompted to user, it is real according to made by the prompt information to receive user
When feed back；In the Real-time Feedback for receiving user, formally start speech interaction mode；In the Real-time Feedback for not receiving user
When, stop starting speech interaction mode.
In other words, present embodiment can by environmental factor information trigger starting thread, but in order to avoid easily from
Dynamic starting, therefore after prompting user, it needs user to make Real-time Feedback and goes to confirm, just further start speech interaction mode.
In order to avoid due to needing the Real-time Feedback of user just to start speech interaction mode, the Real-time Feedback of present embodiment
Can be can directly control the phonetic orders of vehicle-mounted various equipment, such as " good ", " radio please be open and play 99.9 frequencies
Radio station " or " starting navigation APP " etc., it is preferable that content indicated by these Real-time Feedbacks, the as operation behavior of user are practised
It is used.
For example, real-time scene described in present embodiment be current geographic position, real-time weather, current stroke, in real time
Any combination of road conditions, the one or more of them of user emotion；In the preset scene prompt information mapping table with
Each prompt information is corresponding to be：Operation behavior habit of the user under each real-time scene, the prompt information is for prompting
Whether user executes corresponding operation behavior habit under current real-time scene.
Furthermore, it is understood that corresponding with the real-time scene in the preset scene prompt information mapping table of acquisition
The prompt information is prompted to the step of user is to start speech interaction mode, comprised the following processes by prompt information：
If the real-time scene is highway, user's habit is got from preset scene prompt information mapping table
The used prompt information for playing inducing resuscitation music, and formally start speech interaction mode if the Real-time Feedback for receiving user, with root
It is controlled according to the voice of user；
If the real-time scene be it is rainy, got from preset scene prompt information mapping table user habit broadcast
Put the prompt information of lyrical music, and formally start speech interaction mode if the Real-time Feedback for receiving user, with according to
The voice at family is controlled；
If the real-time scene is the stroke to go back home, use is got from preset scene prompt information mapping table
Family habit plays the prompt information of country music, and formally starts speech interaction mode if the Real-time Feedback for receiving user,
To be controlled according to the voice of user；
If the real-time scene is the road conditions of congestion, user is got from preset scene prompt information mapping table
Habit starting radio listens to the prompt information in radio station, and formally starts interactive voice mould if the Real-time Feedback for receiving user
Formula, to be controlled according to the voice of user；
If the real-time scene is the unhappy mood of user, obtained from preset scene prompt information mapping table
It is accustomed to playing the prompt information of pleasant music to user, and formally starts interactive voice mould if the Real-time Feedback for receiving user
Formula, to be controlled according to the voice of user.
For example, if the real-time scene is the road conditions that old man is going across the road, and the corresponding pass of preset scene prompt information
Be get user's habit in table Stop and give way and will start it is double dodge indicator lights prompt rear cars, then prompt the user whether to open double
Indicator light is dodged, if user's Real-time Feedback is " unlatching is double to dodge ", vehicle opens double sudden strain of a muscle indicator lights and starts interactive voice mould simultaneously
Formula is to obtain the subsequent voice messaging of user.
In the present embodiment, speech interaction mode can realize interactive experience by the way of mostly wheel interactive voice.
In order to realize the one of which to current geographic position, real-time weather, current stroke, real-time road, user emotion
Or the monitoring of a variety of any combination, the step of the monitoring environmental factor information of car-mounted terminal described in present embodiment, the vehicle-mounted end
End can monitor environmental factor information by vehicle-mounted camera, GPS positioning module, navigation application program APP or Cloud Server.Than
Such as, real-time road and user emotion etc. are monitored by vehicle-mounted camera, current geographic position is monitored by GPS positioning module, is led to
It crosses navigation application program APP and monitors current stroke, or obtain the weather forecast etc. of network-side by Cloud Server.
It should be noted that present embodiment can also be accustomed to periodically including the operation behavior of combining environmental information and family
The preset scene prompt information mapping table is updated, can specifically include following process：Different ground is obtained periodically
Manage position, different weather, different strokes, different road conditions, one or more of them any combination of user's difference mood
New real-time scene, and obtain user it is new operation behavior habit；It is generated according to the new operation behavior habit intelligence of user new
Prompt information；Database is provided, new real-time scene and new prompt information are corresponded to form new scene prompt letter
It ceases mapping table and stores into the database.
Wherein, the period of present embodiment can be one hour, half a day, one day, one week or one month etc., not make herein
It limits.
For example, user likes which type of song listened on rainy day, it can like starting which equipment or like in rural area
Which song is listened, goes to film the exterior whether scenic spot will start vehicle-mounted camera, whether will start driving recording in highway
Instrument carries out real-time road early warning and alarming etc..
In wherein some concrete application examples, present embodiment can be pushed related prompt message by the way of Push
To car-mounted terminal, which may include corresponding signal language and relevant parameter, such as monitors rainy day, and according to it
The behavioural habits of preceding user are liked, and recommend corresponding song, then can issue " the song XXX for recommending a rainy day to like for you ",
And the details of the song are prompted, such as url information (format that browser is used to be packaged list input).Car-mounted terminal includes
Corresponding prompting message processing system extracts relevant parameter information when receiving this kind of prompt information, and uses TTS automatically
(Text To Speech, from Text To Speech) plays the prompt information, after prompt information finishes, automatic trigger at
Interactive voice (identification) mode waits user's Real-time Feedback can be automatic if the information of user feedback " good " etc at this time
The url information of the song is simultaneously transferred to music module by starting music module, if user speech input " being out of use " etc
Information then closes interactive voice (identification) mode, and using the answer of TTS prompt " being aware of " etc, while can be user
Real-time Feedback issues car-mounted terminal, constantly to improve/change the prompt information of recommendation.
The application can actively monitoring environmental factor information, and according to environmental factor information intelligent actively triggering starting language
Sound interactive mode, it is not only user-friendly, but also guarantee traffic safety, largely improve user experience.
Please refer to figure 2, and Fig. 2 is the module diagram of the application car-mounted terminal.
In the present embodiment, the car-mounted terminal includes processor 21, and the processor 21 is used to execute program data,
To realize the speech interaction mode active triggering method of any above embodiment.
Present embodiment also provides a kind of vehicle, and the vehicle can be configured with car-mounted terminal described in Fig. 2, in addition, originally
Vehicle described in embodiment can be configured with vehicle-mounted camera, infrared sensor, seat sensor, temperature sensor or connection
The network modules of Cloud Server are respectively used to monitor different environmental factor information.
Above embodiment can be realized in car-mounted terminal side, and speech interaction mode master can be completed without network support
Dynamic triggering method, and in order to realize " Reduction of Students' Study Load, weight reducing " to car-mounted terminal, the process that can also be processed to is deployed in network side
On Cloud Server, specifically, referring to Fig. 3, Fig. 3 is the speech interaction mode active triggering method one of the application Cloud Server
The flow diagram of embodiment.
The speech interaction mode active triggering method includes but is not limited to following steps.
Step S301, Cloud Server monitor environmental factor information by car-mounted terminal, wherein the environmental factor information is not
Belong to user's acoustic control information of triggering speech interaction mode；
Step S302 judges whether to trigger speech interaction mode according to the environmental factor information；
Step S303 triggers starting speech interaction mode by network-control car-mounted terminal.
Wherein, if it is determined that not triggered then to triggering speech interaction mode is not needed.
It is worth noting that the environmental factor information is not belonging to user's acoustic control information of triggering speech interaction mode, refer to
Be to be not belonging to user speech and say " starting speech interaction mode ", " acoustic control please be start " etc. to be intended to triggering starting interactive voice
The content of mode, the environmental factor information refer to the environmental factor that non-user subjectivity can control/changes immediately, such as road
Condition, weather, present position or navigation APP stroke currently in use etc..And user using acoustic control information, click keys or
It clicks the non intelligent mode that screen etc. actively starts and then belongs to non-ambient factor information.
It should be noted that the step of starting speech interaction mode is actively triggered described in present embodiment by network-control
Suddenly, it can specifically include following process：Judge to obtain according to the environmental factor information comprehensive analysis of objective reality current real-time
Scene；Obtain prompt information corresponding with the real-time scene in preset scene prompt information mapping table；Pass through network
The prompt information is sent to car-mounted terminal and is prompted to user to start speech interaction mode.In other words, this embodiment party
Formula needs to first pass through network and the prompt information is sent to car-mounted terminal and is prompted to user, just starts speech interaction mode,
The voice control of acquisition user is removed without starting speech interaction mode always, reduces system energy consumption.
Furthermore, described that the prompt information is sent to by car-mounted terminal by network and is prompted to user to start
The step of speech interaction mode, can also comprise the following processes：After the prompt information is prompted to user, user's root is received
According to Real-time Feedback made by the prompt information；In the Real-time Feedback for receiving user, formally start speech interaction mode；?
When not receiving the Real-time Feedback of user, stop starting speech interaction mode.
In other words, present embodiment can by environmental factor information trigger starting thread, but in order to avoid easily from
Dynamic starting, therefore after prompting user, it needs user to make Real-time Feedback and goes to confirm, just further start speech interaction mode.
In order to avoid due to needing the Real-time Feedback of user just to start speech interaction mode, the Real-time Feedback of present embodiment
Can be can directly control the phonetic orders of vehicle-mounted various equipment, such as " good ", " radio please be open and play 99.9 frequencies
Radio station " or " starting navigation APP " etc., it is preferable that content indicated by these Real-time Feedbacks, the as operation behavior of user are practised
It is used.
For example, real-time scene described in present embodiment be current geographic position, real-time weather, current stroke, in real time
Any combination of road conditions, the one or more of them of user emotion, in the preset scene prompt information mapping table with
Each prompt information is corresponding to be：Operation behavior habit of the user under each real-time scene, the prompt information is for prompting
Whether user executes corresponding operation behavior habit under current real-time scene.
Furthermore, it is understood that corresponding with the real-time scene in the preset scene prompt information mapping table of acquisition
The prompt information is prompted to the step of user is to start speech interaction mode, comprised the following processes by prompt information：
If the real-time scene is highway, user's habit is got from preset scene prompt information mapping table
The used prompt information for playing inducing resuscitation music, and formally start speech interaction mode if the Real-time Feedback for receiving user, with root
It is controlled according to the voice of user；
If the real-time scene be it is rainy, got from preset scene prompt information mapping table user habit broadcast
Put the prompt information of lyrical music, and formally start speech interaction mode if the Real-time Feedback for receiving user, with according to
The voice at family is controlled；
If the real-time scene is the stroke to go back home, use is got from preset scene prompt information mapping table
Family habit plays the prompt information of country music, and formally starts speech interaction mode if the Real-time Feedback for receiving user,
To be controlled according to the voice of user；
If the real-time scene is the road conditions of congestion, user is got from preset scene prompt information mapping table
Habit starting radio listens to the prompt information in radio station, and formally starts interactive voice mould if the Real-time Feedback for receiving user
Formula, to be controlled according to the voice of user；
If the real-time scene is the unhappy mood of user, obtained from preset scene prompt information mapping table
It is accustomed to playing the prompt information of pleasant music to user, and formally starts interactive voice mould if the Real-time Feedback for receiving user
Formula, to be controlled according to the voice of user.
For example, if the real-time scene is the road conditions that old man is going across the road, and the corresponding pass of preset scene prompt information
Be get user's habit in table Stop and give way and will start it is double dodge indicator lights prompt rear cars, then prompt the user whether to open double
Indicator light is dodged, if user's Real-time Feedback is " unlatching is double to dodge ", vehicle opens double sudden strain of a muscle indicator lights and starts interactive voice mould simultaneously
Formula is to obtain the subsequent voice messaging of user.
In the present embodiment, speech interaction mode can realize interactive experience by the way of mostly wheel interactive voice.
In order to realize to current geographic position, real-time weather, current stroke, real-time road, user emotion or any combination
Monitoring, the step of the monitoring environmental factor information of car-mounted terminal described in present embodiment, the car-mounted terminal can be by vehicle-mounted
Camera, GPS positioning module or navigation application program APP monitor environmental factor information.For example, being monitored by vehicle-mounted camera real
Shi Lukuang and user emotion etc. monitor current geographic position by GPS positioning module, are worked as by navigation application program APP monitoring
Front travel, or the weather forecast etc. by Cloud Server acquisition network-side.
It should be noted that present embodiment can also be accustomed to periodically including the operation behavior of combining environmental information and family
The preset scene prompt information mapping table is updated, can specifically include following process：Cloud Server passes through vehicle-mounted end
End obtains different geographical locations, different weather, different strokes, different road conditions, user's difference mood periodically or appoints
The new real-time scene of meaning combination, and obtain the new operation behavior habit of user；It is accustomed to intelligence according to the new operation behavior of user
Generate new prompt information；Database is provided, corresponds new real-time scene and new prompt information to form new scene
Prompt information mapping table is simultaneously stored into the database.
Wherein, the period of present embodiment can be one hour, half a day, one day, one week or one month etc., not make herein
It limits.
For example, user likes which type of song listened on rainy day, it can like starting which equipment or like in rural area
Which song is listened, goes to film the exterior whether scenic spot will start vehicle-mounted camera, whether will start driving recording in highway
Instrument carries out real-time road early warning and alarming etc..
In wherein some concrete application examples, present embodiment can be pushed related prompt message by the way of Push
To car-mounted terminal, which may include corresponding signal language and relevant parameter, such as monitors rainy day, and according to it
The behavioural habits of preceding user are liked, and recommend corresponding song, then can issue " the song XXX for recommending a rainy day to like for you ",
And the details of the song are prompted, such as url information (format that browser is used to be packaged list input).Car-mounted terminal includes
Corresponding prompting message processing system extracts relevant parameter information when receiving this kind of prompt information, and uses TTS automatically
(Text To Speech, from Text To Speech) plays the prompt information, after prompt information finishes, automatic trigger at
Interactive voice (identification) mode waits user's Real-time Feedback can be automatic if the information of user feedback " good " etc at this time
The url information of the song is simultaneously transferred to music module by starting music module, if user speech input " being out of use " etc
Information then closes interactive voice (identification) mode, and using the answer of TTS prompt " being aware of " etc, while can be user
Real-time Feedback issues car-mounted terminal, constantly to improve/change the prompt information of recommendation.
The application can actively monitoring environmental factor information, and according to environmental factor information intelligent actively triggering starting language
Sound interactive mode, it is not only user-friendly, but also guarantee traffic safety, largely improve user experience.
It is worth noting that, the car-mounted terminal and Cloud Server of present embodiment can use 5G technology, for example utilize 5G
The network connection of car networking network implementations car-mounted terminal and Cloud Server, 5G technology used by present embodiment can be one
Technology towards displaying, the application play crucial support to vehicle (especially intelligent network connection automobile) using 5G technology and make
With, connection people, attachment or connection vehicle are realized simultaneously, it specifically can be using following three typical case scenes composition.
First is eMBB (Enhance Mobile Broadband enhances mobile broadband), and user experience rate is made to exist
0.1~1gpbs, peak rate is in 10gbps, and flux density is in 10Tbps/km2；
Second super reliable low time delay communication, the main indicator that the application may be implemented are that time delay is ms end to end
(millisecond) rank；Reliability is close to 100%；
Third is mMTC (magnanimity machine type communication), and the main indicator that the application may be implemented is connection number density, often
Square kilometre connection 1,000,000 other terminals, 10^6/km2.
By the above-mentioned means, the application using 5G technology super reliable, low time delay when the characteristics of, in conjunction with such as radar with take the photograph
It can realize and interact with vehicle, while be felt using the interactive of 5G technology to the ability shown in vehicle offer as first-class
Know function, user can do an output to external environment, and luminous energy does not detect state, can also do some feedbacks etc..Into one
For step, the application is also applied to inside the collaboration of automatic Pilot, such as platooning etc..
In addition, the application can also realize communication enhancing automatic Pilot sensing capability using 5G technology, and can satisfy
Passenger inside the vehicle to the on-vehicle informations such as AR (augmented reality)/VR (virtual reality), game, film, mobile office entertain and it is high-precision
The demand of degree.The download of the other 3D high accuracy positioning map of Centimeter Level may be implemented in 3~4Gb/km, normal vehicle in the application
The data volume of speed limit 120km/h (thousand ms/hour) map lower each second is 90Mbps~120Mbps (megabits per second), simultaneously also
It can support the local map Real-time Reconstruction of fusion onboard sensor information, and dangerous situation modeling and analysis etc..
In this application, above-mentioned radio station starting recommender system and method based on car-mounted terminal, can be used and has
In the Vehicular system of vehicle TBOX, it may be also connected in the CAN bus of vehicle.
In the present embodiment, CAN may include three network channels CAN_1, CAN_2 and CAN_3, and vehicle can also be set
An ethernet network channel is set, wherein three CAN network channels can be logical by two car networking gateways and ethernet network
Road is connected, and for example, wherein CAN_1 network channel includes hybrid drive train, and wherein CAN_2 network channel includes
Running guarantee system, wherein CAN_3 network channel includes electric dynamometer system, and ethernet network channel includes higher management system
System, the higher management system include the people-Che-road simulation system being connected on ethernet network channel as node and comprehensive
Close information acquisition unit, the car networking gateway of the CAN_1 network channel, CAN_2 network channel and ethernet network channel
It can integrate in integrated information acquisition unit；CAN_3 network channel and the car networking gateway in ethernet network channel can collect
At in people-Che-road simulation system.
Furthermore, the node of CAN_1 network channel connection has：Engine ECU, motor MCU, battery BMS,
Automatic transmission TCU and hybrid controller HCU；The node of CAN_2 network channel connection has：Rack TT&C system, oil
Door sensor group, power analyzer, instant oil consumption instrument, DC power cabinet, engine water temperature control system, engine motor oil temperature
Cold temperature control system in control system, motor water temperature control system and engine；The node of CAN_3 network channel connection
Have：Electric dynamometer controller.
The rate of the preferred CAN_1 network channel is 250Kbps, using J1939 agreement；CAN_2 network channel
Rate be 500Kbps, using CANopen agreement；The rate of CAN_3 network channel is 1Mbps, using CANopen agreement；With
Too the rate of net network channel is 10/100Mbps, using ICP/IP protocol.
In the present embodiment, the car networking gateway supports the 5G network of 5G technology, may be fitted with
IEEE802.3 interface, DSPI interface, eSCI interface, CAN interface, MLB interface, LIN interface and/or I2C interface.
In the present embodiment, it for example, IEEE802.3 interface can be used for connecting wireless router, is provided for vehicle
WIFI network；DSPI (supplier's manager component) interface is suitable for connecting Bluetooth adapter and NFC (close range wireless communication)
Orchestration can provide bluetooth connection and connect with NFC；ESCI interface is for connecting 4G/5G module, with internet communication；CAN interface
For connecting vehicle CAN bus；MLB interface is used to connect interior MOST (the system transmission towards media) bus, LIN interface
For connecting interior LIN (local interconnect network) bus；IC interface is for connecting DSRC (dedicated short range communication) module and fingerprint
Identification module.In addition, the application can mutually convert each different agreement by using MPC5668G chip, it will be different
Network merged.
In addition, present embodiment vehicle TBOX system, Telematics-BOX, referred to as vehicle-mounted TBOX or telematics
Device.
Present embodiment Telematics is the telecommunications (Telecommunications) and information science of telecommunication
(Informatics) synthesis is defined as leading by the computer system, wireless communication technique, satellite that are built on vehicle
Boat device exchanges the Internet technologies of information such as text, voice and provides the service system of information.Briefly just by wireless
Vehicle is accessed internet (car networking system) by network, provides various information necessary to driving, life for car owner.
In addition, present embodiment Telematics is wireless communication technique, satellite navigation system, network communication technology and vehicle
The synthesis for carrying computer when breaking down in vehicle driving, connects service centre by wireless communication, carries out remote vehicle and examines
Disconnected, built-in computer on the engine can recorde the state of vehicle main component, and provide accurately for maintenance personal at any time
Abort situation and reason.Information is received by user communication terminal and checks traffic map, road conditions introduction, traffic information, peace
Entirely with public security service and entertainment information service etc., in addition, the vehicle of present embodiment can also back seat be arranged electronic game
And network application.It can be appreciated that present embodiment provides service by Telematics, it can be convenient user and understand traffic letter
The parking situation in parking lot is ceased, closed on, current location is confirmed, can also be connect with the network server in family, understand house in time
In electric appliance working order, security situation and guest come to visit situation etc..
Present embodiment vehicle also settable ADAS (Advanced Driver Assistant System, advanced driving
Auxiliary system), it can use the above-mentioned various sensors being installed on vehicle, the environment number inside and outside first time collecting cart
According to the technical processing such as quiet, dynamic object identification, detecting and tracking being carried out, so as to allow driver when most fast
Between discover may generation danger, to arouse attention and improve safety.Accordingly, the application ADAS can also using radar,
The sensors such as laser and ultrasonic wave can detect light, heat, pressure or other for monitoring the variable of vehicle-state, be usually located at
The front/rear collision bumper of vehicle, side-view mirror, inside control stick or on windshield.It is not difficult to find out that above-mentioned ADAS function is used
Various Intelligent hardwares, can be accessed by way of ethernet link car networking system realize communication connection, interaction.
The host of present embodiment vehicle may include logical device, circuit and/or code appropriate for realizing OSI mould
Type (Open System Interconnection, inventionthe open systems interconnection reference model) five layers of operation above and/or
Feature operation.Therefore, host can be generated for the data packet of network transmission and/or be handled these data packets, and also
The data packet received from network can be handled.Meanwhile host can be by executing command adapted thereto and/or running a kind of or more
Application program is planted to provide service for local user and/or one or more remote users or network node.The application not
With in embodiment, one or more security protocols are can be used in host.
The above is only the preferred embodiment of the application, not makes any form of restriction to the application, though
Right the application has been disclosed in a preferred embodiment above, however is not limited to the application, any technology people for being familiar with this profession
Member, is not departing within the scope of technical scheme, when the technology contents using the disclosure above make a little change or modification
For the equivalent embodiment of equivalent variations, but all technical spirits pair without departing from technical scheme content, according to the application
Any simple modification, equivalent change and modification made by above embodiments, in the range of still falling within technical scheme.
Claims (9)
1. a kind of speech interaction mode active triggering method of car-mounted terminal, which is characterized in that the speech interaction mode is actively
Triggering method includes the following steps：
Car-mounted terminal monitors environmental factor information, wherein the environmental factor information is not belonging to the use of triggering speech interaction mode
Family acoustic control information；
Judged whether to trigger speech interaction mode according to the environmental factor information；
If so, triggering speech interaction mode.
2. speech interaction mode active triggering method according to claim 1, which is characterized in that the active triggering starting
The step of speech interaction mode, comprises the following processes：
Judge to obtain current real-time scene according to the environmental factor information comprehensive analysis of objective reality；
Obtain prompt information corresponding with the real-time scene in preset scene prompt information mapping table；
The prompt information is prompted to user to start speech interaction mode.
3. speech interaction mode active triggering method according to claim 2, which is characterized in that described to believe the prompt
Breath is prompted to the step of user is to start speech interaction mode, further includes following process：
After the prompt information is prompted to user, user's Real-time Feedback according to made by the prompt information is received；
In the Real-time Feedback for receiving user, formally start speech interaction mode；When not receiving the Real-time Feedback of user,
Stop starting speech interaction mode.
4. speech interaction mode active triggering method according to claim 3, which is characterized in that the real-time scene is to work as
Preceding geographical location, real-time weather, current stroke, real-time road, user emotion one or more of them any combination；
It is corresponding with each prompt information in the preset scene prompt information mapping table to be：User is in each real-time field
Operation behavior habit under scape, the prompt information is for prompting the user whether to execute corresponding operation row under current real-time scene
For habit.
5. speech interaction mode active triggering method according to claim 1-4, which is characterized in that described vehicle-mounted
Terminal monitors environmental factor information by vehicle-mounted camera, GPS positioning module, navigation application program APP or Cloud Server.
6. according to the described in any item speech interaction mode active triggering methods of claim 2-4, which is characterized in that further include knot
The operation behavior habit for closing environmental information and family updates the preset scene prompt information mapping table periodically.
7. a kind of car-mounted terminal, which is characterized in that the car-mounted terminal includes processor, and the processor is for executing program number
According to realize speech interaction mode active triggering method according to claim 1-6.
8. a kind of vehicle, which is characterized in that the with good grounds car-mounted terminal as claimed in claim 7 of vehicle configuration.
9. vehicle according to claim 8, which is characterized in that the vehicle configuration have vehicle-mounted camera, infrared sensor,
Seat sensor, temperature sensor or the network modules for connecting Cloud Server, are respectively used to monitor different environmental factor information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810569023.2A CN108923808A (en) | 2018-06-05 | 2018-06-05 | Vehicle and its car-mounted terminal and speech interaction mode active triggering method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810569023.2A CN108923808A (en) | 2018-06-05 | 2018-06-05 | Vehicle and its car-mounted terminal and speech interaction mode active triggering method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108923808A true CN108923808A (en) | 2018-11-30 |
Family
ID=64419676
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810569023.2A Pending CN108923808A (en) | 2018-06-05 | 2018-06-05 | Vehicle and its car-mounted terminal and speech interaction mode active triggering method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108923808A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109599106A (en) * | 2018-12-04 | 2019-04-09 | 深圳创维汽车智能有限公司 | Vehicle-mounted terminal system control method, car-mounted terminal and storage medium |
| CN110544478A (en) * | 2019-11-04 | 2019-12-06 | 南京创维信息技术研究院有限公司 | System and method for intelligent far-field voice interaction of cockpit |
| CN110979202A (en) * | 2019-11-08 | 2020-04-10 | 华为技术有限公司 | Method, device and system for changing style of automobile |
| CN111275920A (en) * | 2018-12-04 | 2020-06-12 | 上海博泰悦臻电子设备制造有限公司 | Vehicle, user communication terminal and collision accident detection processing method |
| CN111324329A (en) * | 2018-12-17 | 2020-06-23 | 上海博泰悦臻电子设备制造有限公司 | Vehicle and voice interaction method and system based on article display information |
| CN111951795A (en) * | 2020-08-10 | 2020-11-17 | 中移（杭州）信息技术有限公司 | Voice interaction method, server, electronic device and storage medium |
| CN113689853A (en) * | 2021-08-11 | 2021-11-23 | 北京小米移动软件有限公司 | Voice interaction method and device, electronic equipment and storage medium |
| CN113923607A (en) * | 2021-10-12 | 2022-01-11 | 广州小鹏自动驾驶科技有限公司 | Method, device and system for voice interaction outside vehicle |
| CN115512560A (en) * | 2022-10-17 | 2022-12-23 | 广汽埃安新能源汽车股份有限公司 | Vehicle control system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101323305A (en) * | 2008-05-14 | 2008-12-17 | 奇瑞汽车股份有限公司 | Vehicle-mounted speech recognition control system and control method |
| CN104660679A (en) * | 2015-01-21 | 2015-05-27 | 上海修源网络科技有限公司 | Automobile operating system with voice prompt function and control method thereof |
| US20170129496A1 (en) * | 2015-11-06 | 2017-05-11 | Leauto Intelligent Technology (Beijing) Co. Ltd | Method and vehicle terminal thereof for vehicle data processing |
| CN106682090A (en) * | 2016-11-29 | 2017-05-17 | 上海智臻智能网络科技股份有限公司 | Active interaction implementing device, active interaction implementing method and intelligent voice interaction equipment |
| CN107303909A (en) * | 2016-04-20 | 2017-10-31 | 斑马网络技术有限公司 | Voice awaking method, device and equipment |
-
2018
- 2018-06-05 CN CN201810569023.2A patent/CN108923808A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101323305A (en) * | 2008-05-14 | 2008-12-17 | 奇瑞汽车股份有限公司 | Vehicle-mounted speech recognition control system and control method |
| CN104660679A (en) * | 2015-01-21 | 2015-05-27 | 上海修源网络科技有限公司 | Automobile operating system with voice prompt function and control method thereof |
| US20170129496A1 (en) * | 2015-11-06 | 2017-05-11 | Leauto Intelligent Technology (Beijing) Co. Ltd | Method and vehicle terminal thereof for vehicle data processing |
| CN107303909A (en) * | 2016-04-20 | 2017-10-31 | 斑马网络技术有限公司 | Voice awaking method, device and equipment |
| CN106682090A (en) * | 2016-11-29 | 2017-05-17 | 上海智臻智能网络科技股份有限公司 | Active interaction implementing device, active interaction implementing method and intelligent voice interaction equipment |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109599106A (en) * | 2018-12-04 | 2019-04-09 | 深圳创维汽车智能有限公司 | Vehicle-mounted terminal system control method, car-mounted terminal and storage medium |
| CN111275920A (en) * | 2018-12-04 | 2020-06-12 | 上海博泰悦臻电子设备制造有限公司 | Vehicle, user communication terminal and collision accident detection processing method |
| CN111324329A (en) * | 2018-12-17 | 2020-06-23 | 上海博泰悦臻电子设备制造有限公司 | Vehicle and voice interaction method and system based on article display information |
| CN110544478A (en) * | 2019-11-04 | 2019-12-06 | 南京创维信息技术研究院有限公司 | System and method for intelligent far-field voice interaction of cockpit |
| CN110979202A (en) * | 2019-11-08 | 2020-04-10 | 华为技术有限公司 | Method, device and system for changing style of automobile |
| CN110979202B (en) * | 2019-11-08 | 2023-09-08 | 华为技术有限公司 | Method, device and system for changing automobile style |
| CN111951795A (en) * | 2020-08-10 | 2020-11-17 | 中移（杭州）信息技术有限公司 | Voice interaction method, server, electronic device and storage medium |
| CN111951795B (en) * | 2020-08-10 | 2024-04-09 | 中移（杭州）信息技术有限公司 | Voice interaction method, server, electronic device and storage medium |
| CN113689853A (en) * | 2021-08-11 | 2021-11-23 | 北京小米移动软件有限公司 | Voice interaction method and device, electronic equipment and storage medium |
| CN113923607A (en) * | 2021-10-12 | 2022-01-11 | 广州小鹏自动驾驶科技有限公司 | Method, device and system for voice interaction outside vehicle |
| CN115512560A (en) * | 2022-10-17 | 2022-12-23 | 广汽埃安新能源汽车股份有限公司 | Vehicle control system |
| CN115512560B (en) * | 2022-10-17 | 2024-04-12 | 广汽埃安新能源汽车股份有限公司 | Vehicle control system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108923808A (en) | Vehicle and its car-mounted terminal and speech interaction mode active triggering method | |
| CN110798658A (en) | Remote vehicle moving control method, mobile terminal and vehicle | |
| CN110920540B (en) | Vehicle, vehicle equipment and vehicle equipment theme automatic adjusting method thereof | |
| CN109115236A (en) | Vehicle, vehicle device equipment and its stroke automatic navigation method based on condition triggering | |
| CN110576808B (en) | Vehicle, vehicle machine equipment and scene information pushing method based on artificial intelligence | |
| CN108833589B (en) | Vehicle, vehicle equipment and vehicle equipment navigation data synchronization method thereof | |
| CN109099917A (en) | Vehicle, vehicle device equipment, user communication terminal and its vehicle address air navigation aid | |
| CN109115235A (en) | Vehicle, vehicle device equipment, user communication terminal and its more equipment switch air navigation aid | |
| CN110958559B (en) | Vehicle, vehicle-mounted equipment and instant interaction method based on map display | |
| CN110901524A (en) | Vehicle, vehicle equipment and vehicle-mounted atmosphere lamp style automatic adjusting method thereof | |
| CN111200720A (en) | Internet of vehicles platform, vehicle remote video monitoring method and system | |
| CN108731699A (en) | Intelligent terminal and its voice-based navigation routine planing method and vehicle again | |
| CN110654332A (en) | Vehicle, vehicle-mounted rest auxiliary device and method thereof and vehicle-mounted equipment | |
| CN110793537A (en) | Navigation path recommendation method, vehicle machine and vehicle | |
| CN111311939A (en) | Vehicle, vehicle equipment and traffic light information map display method thereof | |
| CN110654331A (en) | Vehicle, vehicle equipment and vehicle-mounted assistant interaction method thereof | |
| CN110920388B (en) | Vehicle, vehicle equipment and vehicle equipment style adjusting method based on environmental factors | |
| CN110954127A (en) | Vehicle, user terminal and navigation map theme automatic adjusting method thereof | |
| CN112017459A (en) | Vehicle, vehicle equipment and driving assistance method for signal lamp recognition thereof | |
| CN110871810A (en) | Vehicle, vehicle equipment and driving information prompting method based on driving mode | |
| CN111417101A (en) | Vehicle, intelligent terminal and vehicle emergency rescue method based on geographic position | |
| CN111291275A (en) | Vehicle, vehicle equipment and live-based tour scheme recommendation method thereof | |
| CN108874221A (en) | The application control method of vehicle and its car-mounted terminal touch-control system | |
| CN111047292A (en) | Intelligent transportation tool, intelligent equipment and intelligent travel reminding method | |
| CN108983773A (en) | Vehicle, vehicle device equipment, user communication terminal and its stroke automatic planning |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181130 |
|
| RJ01 | Rejection of invention patent application after publication |