CN109493871A - The multi-screen voice interactive method and device of onboard system, storage medium and vehicle device - Google Patents
The multi-screen voice interactive method and device of onboard system, storage medium and vehicle device Download PDFInfo
- Publication number
- CN109493871A CN109493871A CN201710814877.8A CN201710814877A CN109493871A CN 109493871 A CN109493871 A CN 109493871A CN 201710814877 A CN201710814877 A CN 201710814877A CN 109493871 A CN109493871 A CN 109493871A
- Authority
- CN
- China
- Prior art keywords
- screen
- user
- voice
- interactive
- interactive voice
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000002452 interceptive effect Effects 0.000 title claims abstract description 146
- 238000000034 method Methods 0.000 title claims abstract description 36
- 230000003993 interaction Effects 0.000 claims description 16
- 230000033001 locomotion Effects 0.000 claims description 11
- 230000004044 response Effects 0.000 claims description 6
- 238000012795 verification Methods 0.000 claims description 6
- 230000000052 comparative effect Effects 0.000 claims description 4
- 238000010200 validation analysis Methods 0.000 claims description 4
- 238000012360 testing method Methods 0.000 claims description 2
- 230000008569 process Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000001755 vocal effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000004069 differentiation Effects 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000002618 waking effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L17/00—Speaker identification or verification
- G10L17/22—Interactive procedures; Man-machine interfaces
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/18—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using ultrasonic, sonic, or infrasonic waves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L17/00—Speaker identification or verification
- G10L17/26—Recognition of special voice characteristics, e.g. for use in lie detectors; Recognition of animal voices
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Abstract
A kind of the multi-screen voice interactive method and device, storage medium and vehicle device of onboard system, the onboard system includes multiple screens, and the multi-screen voice interactive method includes: the interactive voice request for acquiring user；The sound source position of interactive voice request is positioned, to obtain positioning result；It is controlled using the interactive voice request nearest screen of the positioning result of adjusting the distance.User can be improved to the usage experience of multi-screen onboard system by the multi-screen interactive voice of realization onboard system using technical solution of the present invention.
Description
Technical field
The present invention relates to onboard system design field, in particular to the multi-screen voice interactive method and dress of a kind of onboard system
It sets, storage medium and vehicle device.
Background technique
With popularizing for vehicle, the optimization design and user experience of onboard system are by more and more vehicle users weight
Depending on.Originally, onboard system is generally based on onboard navigation system, by commercial communication satellite, by global positioning system (Global
Position System, abbreviation GPS) it is applied in automobile navigation, accurate map, geography information are provided and clearly advanced
Route can show the way for motor vehicle operators.Then, as onboard system content is gradually enriched, more and more more matchmakers are provided with
Body function, to enrich user experience.
In the prior art, user can control the screen of onboard system by way of interactive voice, such as
The voice assistant software realization of onboard system can be passed through.However, onboard system is by the main main screen for driving position setting towards multiple
Screen development.By taking five-seater as an example, in addition to master drives position and is provided with main screen, pair is also equipped in front of copilot and back row seat
Screen.There is the demand of interactive voice to multiple screens in onboard system in user.
Therefore, in order to further increase the usage experience of user, how the multi-screen interactive voice of onboard system, which goes to realize, is
One urgent problem to be solved.
Summary of the invention
Present invention solves the technical problem that being how to pass through the multi-screen interactive voice for realizing onboard system, user is improved to more
Shield the usage experience of onboard system.
In order to solve the above technical problems, the embodiment of the present invention provides a kind of multi-screen voice interactive method of onboard system, institute
Stating onboard system includes multiple screens, and the multi-screen voice interactive method includes: the interactive voice request for acquiring user；To described
The sound source position of interactive voice request is positioned, to obtain positioning result；It is adjusted the distance using interactive voice request described
The nearest screen of positioning result is controlled.
Optionally, described to carry out control packet using the interactive voice request nearest screen of the positioning result of adjusting the distance
Include: the nearest screen of the positioning result of adjusting the distance is waken up；The nearest screen of positioning result described in command range is to described
Interactive voice request is responded.
Optionally, the nearest screen of positioning result described in the command range requests the interactive voice to carry out response bag
It includes: the voiceprint of the interactive voice request is identified, to determine user identity；Based on the user identity, load with it is described
The personal settings information that voiceprint matches；Based on the personal settings information, positioning result described in command range is most
Close screen responds interactive voice request.
Optionally, the interactive voice for acquiring user requests to include: the user speech in collecting vehicle；To the user speech into
Row verifying obtains the interactive voice request when being verified.
Optionally, it is described to the user speech carry out verifying include: the content for identifying the user speech；When the use
When the content of family voice includes preset control instruction word, it is verified.
Optionally, it includes: that more each screen receives that the sound source position to interactive voice request, which carries out positioning,
The intensity of sound for the interactive voice request arrived；And/or image recognition is carried out to the sounding movement of user each in vehicle.
In order to solve the above technical problems, the embodiment of the present invention also provides a kind of multi-screen voice interaction device of onboard system,
The onboard system includes multiple screens, and described device includes: voice request acquisition module, suitable for acquiring the interactive voice of user
Request；Position locating module, the sound source position suitable for requesting the interactive voice positions, to obtain positioning result；Screen
Curtain control module, suitable for being controlled using the interactive voice request nearest screen of the positioning result of adjusting the distance.
Optionally, the screen control module includes: wake-up submodule, suitable for the nearest screen of the positioning result of adjusting the distance
Curtain is waken up；Screen control submodule, the screen nearest suitable for positioning result described in command range ask the interactive voice
It asks and is responded.
Optionally, the screen control submodule includes: identity validation submodule, is suitable for identifying the interactive voice request
Voiceprint, to determine user identity；Information loads submodule, is suitable for being based on the user identity, load and the vocal print
The personal settings information that information matches；Personalized control submodule, be suitable for be based on the personal settings information, control away from
The screen nearest from the positioning result responds interactive voice request.
Optionally, the voice request acquisition module includes: voice collecting submodule, suitable for user's language in collecting vehicle
Sound；Speech verification submodule obtains the interactive voice when being verified and asks suitable for verifying to the user speech
It asks.
Optionally, the speech verification submodule includes: content recognition submodule, suitable for identifying in the user speech
Hold；When the content of the user speech includes preset control instruction word, it is verified.
Optionally, the position locating module includes: intensity Comparative sub-module, is adapted to compare the institute that each screen receives
The intensity of sound of predicate sound interaction request；And/or image recognition submodule, suitable for the sounding movement to user each in vehicle
Carry out image recognition.
In order to solve the above technical problems, the embodiment of the present invention also provides a kind of storage medium, it is stored thereon with computer and refers to
The step of order, the computer instruction executes the multi-screen voice interactive method of above-mentioned onboard system when running.
In order to solve the above technical problems, the embodiment of the present invention also provides a kind of vehicle device, including memory and processor, it is described
The computer instruction that can be run on the processor is stored on memory, the processor runs the computer instruction
The step of multi-screen voice interactive method of the above-mentioned onboard system of Shi Zhihang.
Compared with prior art, the technical solution of the embodiment of the present invention has the advantages that
The multi-screen voice interactive method of the embodiment of the present invention can be requested by acquiring the interactive voice of user, to institute
The sound source position of predicate sound interaction request is positioned, and to obtain positioning result, requests the institute that adjusts the distance using the interactive voice
The nearest screen of positioning result is stated to be controlled.On the one hand the multi-screen voice control of onboard system is realized, it is easily operated, it can be with
User is effectively improved to the usage experience of onboard system；On the other hand, the nearest screen of the positioning result described in command range
When being responded to the interactive voice request of user, it targetedly can only open the screen and user carries out interactive voice,
Other screens can be not turned on (that is, maintaining dormant state), energy saving.
Furthermore, the step in the multi-screen voice interactive method in the embodiment of the present invention is suitable in same operating system
Under executed, set by the way that the display information of the main screen data-interface and vice screen curtain data-interface is separately arranged
Set major and minor screen display content.On the one hand different screen display contents can be adjusted according to different operator seats, fit well
Using the individual demand at family；On the other hand, due to running on same operating system, a control is only needed in hardware configuration
Device processed can suitably reduce the hardware cost of onboard system.
Furthermore, in the embodiment of the present invention, the interactive voice request for acquiring user may include: collecting vehicle
Interior user speech；The user speech is verified, the interactive voice request is obtained when being verified.Namely guarantee
And not all user speech content can be used as the condition that corresponding screen carries out interactive voice that starts, and can effectively mention
The validity of high multi-screen interactive voice.
Furthermore, in the embodiment of the present invention, the sound source position to interactive voice request is carried out
Positioning can be compared using intensity of sound and sounding motion images identify and carry out sound source position positioning by the way of combining, and be conducive to
Guarantee the accuracy of sound source position positioning.
Furthermore, in the embodiment of the present invention, due to the vocal print letter by identifying the interactive voice request
Breath, it is determined that user identity, and it is based on the user identity, it is loaded with the personal settings to match with the voiceprint and believes
Breath can then be based on the personal settings information, and the nearest screen of positioning result described in command range is to the interactive voice
Request is responded, and user can be made more to meet the interactive voice process in onboard system the personalized need of user, can
To greatly improve the usage experience of user.
Detailed description of the invention
Fig. 1 is a kind of flow chart of the multi-screen voice interactive method of onboard system of the embodiment of the present invention.
Fig. 2 is the flow chart of the multi-screen voice interactive method of another onboard system of the embodiment of the present invention.
Fig. 3 is a kind of schematic block diagram of the multi-screen voice interaction device of onboard system of the embodiment of the present invention.
Specific embodiment
As described in the background section, in the prior art, user can be by way of interactive voice to onboard system
Screen controlled.However, onboard system is developed by the main main screen for driving position setting towards multiple screens.User is to vehicle-mounted system
There is the demand of interactive voice in multiple screens in system.Therefore, in order to further increase the usage experience of user, onboard system
Multi-screen interactive voice how to go realize be a urgent problem to be solved.
The embodiment of the present invention proposes a kind of multi-screen voice interactive method of onboard system, by the interactive voice for acquiring user
Request positions the sound source position of interactive voice request, to obtain positioning result, is requested using the interactive voice
The nearest screen of the positioning result of adjusting the distance is controlled, and the multi-screen voice control of onboard system may be implemented, can be effective
User is improved to the usage experience of onboard system in ground.
It is understandable to enable above-mentioned purpose of the invention, feature and beneficial effect to become apparent, with reference to the accompanying drawing to this
The specific embodiment of invention is described in detail.
The embodiment of the invention discloses a kind of terminal synchronous display method of onboard system, which can be answered
For onboard system.Wherein, the onboard system of the embodiment of the present invention may include multiple screens, such as main screen and vice screen curtain.
The main screen is set to main driving position；The quantity of the vice screen curtain can be set to pair for one or more, the vice screen curtain
Operator seat, or by taking double cab as an example, the vice screen curtain can also be set to the front of co-driver and back row seat, this implementation
Example is without specifically limited.
Fig. 1 is a kind of flow chart of the terminal synchronous display method of onboard system of the embodiment of the present invention.
As shown in Figure 1, the multi-screen voice interactive method of the onboard system of the present embodiment may comprise steps of:
Step S101 acquires the interactive voice request of user.
Step S102 positions the sound source position of interactive voice request, to obtain positioning result.
Step S103 is controlled using the interactive voice request nearest screen of the positioning result of adjusting the distance.
In embodiments of the present invention, intelligence can have been pre-installed respectively on the main screen and vice screen curtain in the onboard system
Application module, is referred to as applied or application program (Application, abbreviation APP) or application module.It is opened on the main screen
Apply and shown on the main screen, applying for opening on the vice screen curtain is shown on the vice screen curtain.For example, described
Application module may include having application relevant to driving, such as relevant application of navigating, and can also include multimedia project
Relevant application, such as video, audio, radio channels, life search etc..Wherein, the life search can be comment
Class search is searched for or purchased by group to class, but not limited to this.
In specific implementation, it can be preset with different types of application on the main screen and vice screen curtain, can also preset
There is identical application, the present embodiment is without specifically limited.However, it is contemplated that the individual character of travel safety and different user
Change setting, it is preferable that different according to screen type carry out application type differentiation.Application on the main screen of driver's seat is only
Related to driving, the application on each vice screen curtain can be related to multimedia project, and then can largely guarantee to drive
The traffic safety of personnel, and multimedia recreation function is sufficiently positioned on each vice screen curtain simultaneously, increase user in vehicle
By bus enjoyment.
Firstly, being acquired in the specific implementation of step S101 to the interactive voice request of user.Acquisition is by vehicle-mounted
What the hardware device in system was realized, such as speech transducer.Using Technology of Audio Collection, telecommunications is converted voice signals into
Number, and be transmitted to the central controller in onboard system and conduct further analysis and handle.The information for including in the voice of user
It at least may include: voice content, tone color namely voiceprint, voice intensity etc..It, can be in the central controller after acquired
The one or more of information for including in the voice of the user are identified respectively.Wherein, in identification, can at least know
Not Chu user speech content, other information are optional.
It will be apparent to a skilled person that being identified to voice, including to voice content, voiceprint, language
The identification of the information such as loudness of a sound degree, can be using any enforceable speech processing algorithm, and the embodiment of the present invention is without limitation.
Secondly, include multiple screens by onboard system in this present embodiment in the specific implementation of step S102, because
This, the screen for how going the interactive voice request of confirmation user pointed can be by the sound source position requested the interactive voice
It sets and is positioned to realize.After obtaining positioning result, the positioning result indicates some position hair of user in the car
Voice is gone out.
Again, in the specific implementation of step S103, the present embodiment then makees the screen nearest apart from the positioning result
For the screen of user's interactive voice request to be carried out, and the screen is controlled using interactive voice request.Generally
For, after user enters vehicle, it will the different location being seated in vehicle, such as driver's seat, passenger seat or rear row seat.Big
In most scenes, user just starts to propose interactive voice request after taking a seat in the car.That is, auditory localization can be passed through
Mode determines the physical location that user takes a seat, and when user proposes interactive voice request, controls screen (namely the distance in face of it
The nearest screen of sound source) its interactive voice is requested to carry out response to be the most rationally, most to meet user demand and user experience most
Good mode.
In specific implementation, carrying out control to the screen may include following form: for example: the voice request of user is
" today, how is Shanghai weather? ", or the flight of tomorrow morning " inquiry from Shanghai to Beijing ", or " playing a song " or " broadcast
Put a film " etc., accordingly, controlled screen then shows the Weather information in Shanghai today, or display in interactive voice
Shanghai to Beijing all flight frequencies that tomorrow morning, 6:00-12:00 took off, or play a song or film.
Furthermore, the multi-screen voice interactive method of the embodiment of the present invention can be asked by acquiring the interactive voice of user
It asks, the sound source position of interactive voice request is positioned, to obtain positioning result, utilize interactive voice request pair
The screen nearest apart from the positioning result is controlled.On the one hand the multi-screen voice control for realizing onboard system, is easy to grasp
Make, user can be effectively improved to the usage experience of onboard system；On the other hand, the positioning result described in command range is nearest
Screen when being responded to the request of the interactive voice of user, targetedly can only open the screen and user carries out voice
Interaction, other screens can be not turned on (that is, maintaining dormant state), energy saving.
In embodiments of the present invention, the onboard system may include main screen data-interface and vice screen curtain data-interface,
Wherein, the main screen data-interface and the main screen correspond, the vice screen curtain data-interface and the vice screen curtain one
One is corresponding.When the adjustment of display information or update of the major and minor screen data interface storage, the display of the major and minor screen
Content is adjusted or updates.Namely in the present embodiment, nearest using the interactive voice request positioning result of adjusting the distance
Screen controlled, can be by the main screen data-interface and pair to realize the multi-screen interactive voice of onboard system
The adjustment of data content is realized in screen data interface.
Furthermore, the step in the multi-screen voice interactive method in the present embodiment be suitable under same operating system into
Row executes, and is arranged by the way that the display information of the main screen data-interface and vice screen curtain data-interface is separately arranged
Major and minor screen display content.On the one hand different screen display contents can be adjusted according to different operator seats, be well adapted for
The individual demand of user；On the other hand, due to running on same operating system, a control is only needed in hardware configuration
Device can suitably reduce the hardware cost of onboard system.
In specific implementation, Android (Android) operating system can have been run in the onboard system, but has been not limited to
This, can run the embedded OSs such as other any operating systems appropriate, such as Linux in the onboard system.
Together referring to Fig. 1 and Fig. 2, in a preferred embodiment, the step S101 may include following each
Step:
Step S1011, the user speech in collecting vehicle.
Step S1012, verifies the user speech, and the interactive voice request is obtained when being verified.
Furthermore, in the present embodiment, and not all user speech can be used as the corresponding screen of starting into
The condition of row interactive voice.For example, occurring in user's voice content of non-voices interaction request such as chat, make a phone call in the car
When, be identified as to the non-voice request error of user in the car in order to prevent interactive voice request, to the user speech into
Row verifying is necessary, and can effectively improve the validity of multi-screen interactive voice.
In actual implementation, described in the step S1012 user speech is verified can use it is following
Mode is implemented: identifying the content of the user speech；When the content of the user speech includes preset control instruction word
When, it is verified.Wherein, the preset control instruction word can be preparatory typing.Memory in the onboard system
In can store by the instruction dictionary being made of multiple control instruction words.
It should be noted that in the present embodiment, as long as the voice content of user can be by above-mentioned verifying, to user's
Identity without any particular determination namely it is any include that interactive voice representated by the voice content of preset control instruction word is asked
Asking can be identified by onboard system.
In addition, the embodiment of the present invention to the content of the control instruction word without particular determination, as long as can be described
Onboard system identifies and generates preset response.For example, " today, how is Shanghai weather? " corresponding control instruction
Word can be respectively " today ", " Shanghai " and " weather "；Control corresponding to " flight for inquiring the tomorrow morning from Shanghai to Beijing "
System instruction word can be respectively " Shanghai ", " Beijing ", " flight " and " tomorrow morning "；" playing a song " or " play an electricity
Control instruction word corresponding to shadow " can respectively " play " and " song " or " film ".
It is further preferred that in the specific implementation of the step S1012, to testing for the content for identifying the user speech
It is also verified and can be carried out in the way of fuzzy matching with matching for preset control instruction word by card.For example, working as user
Voice content be " how is weather? ", it includes control instruction word be " weather ", then can be identified as at this time voice friendship
Mutually request.At this point, onboard system can further put question to " may I ask you and concern weather when and where? " by screen,
User be further sent out voice " today, how is Shanghai weather? " the screen is responded afterwards.Or optionally, user is not
Further provide for " when and where " information, the current vehicle location of default and current time can be foundation by onboard system
To " how is weather? " it is responded on the screen.
In a preferred embodiment, the sound source position of interactive voice request is carried out in the step S102
Positioning may include following each step: the intensity of sound for the interactive voice request that more each screen receives；With/
Or, the sounding movement to user each in vehicle carries out image recognition.
In specific implementation, the intensity of sound pair that can be requested by acquiring the interactive voice that each screen receives
The sound source position of the interactive voice request is positioned, for example, user A rides on passenger seat, is then located in vehicle and is driven
The intensity of sound of user A received by seat and the sensor of passenger seat (including passenger seat and rear row seat) is entirely different
, it can be by being compared to the intensity of sound value received, it is easy to obtain, the sensor positioned at passenger seat receives
Intensity of sound value it is maximum, due to the vice screen curtain that can determine whether out sound source position in passenger seat, then before opening the passenger seat
Screen as interactive voice.
Further, it is also possible in vehicle the sounding movement of each user carry out carrying out sound by the way of image recognition it is fixed
Position.Firstly, it is necessary to using the voice of speech transducer acquisition user A, it is other to carry out speech recognition to it to obtain voice content；Its
It is secondary, the sounding movement of interior each user is played back using vehicle-mounted camera, and image recognition is carried out to it, with sounding
Which user that the mode of movement and voice content matching verifying judges sending voice is；Finally, being that user A has issued in locking
When voice, user A is extracted by vehicle-mounted camera and rides on passenger seat, then the vice screen curtain before opening the passenger seat
Screen as interactive voice.
Furthermore, it is preferable that the mode that can also be combined using above two mode carries out sound source position positioning,
I.e. in such a way that intensity of sound compares and the identification of sounding motion images combines, it is more advantageous to the standard for guaranteeing sound source position positioning
True property.
It is understood to one skilled in the art that the positioning of the sound source position in the present embodiment can use it is any enforceable
Mode carries out, however it is not limited to which this above two or a combination of both scheme is no longer illustrated one by one herein.
Together referring to Fig. 1 and Fig. 2, in specific implementation, the step S103 may include following each step for continuation:
Step S1031, the nearest screen of the positioning result of adjusting the distance are waken up.
Step S1032, the nearest screen of positioning result described in command range respond interactive voice request.
In the specific implementation of step S1031, the nearest screen of the positioning result of adjusting the distance wake up and can be indicated
It, can also be with by the screen nearest apart from the positioning result from standby mode (such as screen is in black state) to working condition
Indicate that the central controller in onboard system from Message Processing process or its priority, controls described nearest apart from the positioning result
Screen response that the interactive voice is requested be waken up.
Preferably, the step S1032 may include following each step:
The voiceprint of the interactive voice request is identified, to determine user identity；Based on the user identity, load with
The personal settings information that the voiceprint matches；Based on the personal settings information, knot is positioned described in command range
The nearest screen of fruit responds interactive voice request.
In the present embodiment, the voiceprint of the interactive voice request is extracted in the voice signal of user, analyzes
And identification.Specific voiceprint is associated one by one with specific user identity.For example, the onboard system can be by user
Voiceprint registered as logon information and log on to each screen of onboard system.When onboard system recognizes the sound of user
When line information is the voiceprint that " registration " is crossed, then user identity can be confirmed by relevance.
And after user logs on to screen as log-on message using its voiceprint, it will record its personalization in the car
Setting information, for example, its set-up mode to system, it may include screen background, font, font size etc., then such as its use habit
With personal preference, it may include its song liked, film or picture etc..It therefore, can be based on described after confirming user identity
User identity, the personal settings information that load matches with the voiceprint.The personal settings information can be with data
Form be stored in the memory of onboard system, can also be embodied in respond its interactive voice request screen on.
In the present embodiment, the personal settings information, the nearest screen of positioning result described in command range can be based on
Curtain responds interactive voice request.For example, user voice content be " how is weather? " when, according to user
Personal settings information, the screen directly provides the Weather information of Shanghai today, or in the voice content of user is " to play
When one first song " or " playing a film ", according to the personal settings information of user, the screen is directly in the favorite of user
A song is selected in playlist or a film plays out.Correspondingly, " what for inquiring weather to it to user is no longer needed to
When where " further confirm that, without randomly, with having no personal presentation randomly choosing song or film plays out.
Furthermore, in the present embodiment, due to the voiceprint by identifying the interactive voice request, it is determined that
User identity, and it is based on the user identity, be loaded with the personal settings information to match with the voiceprint, then it can be with
Based on the personal settings information, the nearest screen of positioning result described in command range rings interactive voice request
It answers, user can be made more to meet the interactive voice process in onboard system the personalized need of user, can greatly be mentioned
The usage experience of high user.
It is understood to one skilled in the art that in the present embodiment using the interactive voice request to corresponding screen into
Row control can be carried out using any enforceable mode, however it is not limited to which the personal settings information based on user identity carries out.
As shown in figure 3, the embodiment of the invention also discloses a kind of multi-screen voice interaction devices of onboard system, wherein institute
Stating onboard system may include multiple screens.It will be appreciated by those skilled in the art that the multi-screen voice of onboard system described in the present embodiment
Interactive device 30 is for implementing above-mentioned Fig. 1 to method and technology scheme described in embodiment illustrated in fig. 2.
Specifically, the multi-screen voice interaction device 30 of the onboard system may include voice request acquisition module 301, position
Set locating module 302 and screen control module 303.
Wherein, the voice request acquisition module 301 is suitable for acquiring the interactive voice request of user；The position positioning mould
The sound source position that block 302 is suitable for requesting the interactive voice positions, to obtain positioning result；The screen control module
303 are suitable for being controlled using the interactive voice request nearest screen of the positioning result of adjusting the distance.
Furthermore, the embodiment of the present invention can be requested by acquiring the interactive voice of user, to the interactive voice
The sound source position of request is positioned, and to obtain positioning result, requests the positioning result of adjusting the distance using the interactive voice
Nearest screen is controlled.On the one hand the multi-screen voice control of onboard system is realized, it is easily operated, it can effectively improve
Usage experience of the user to onboard system；On the other hand, language of the nearest screen of the positioning result described in command range to user
When sound interaction request is responded, it targetedly can only open the screen and user carries out interactive voice, other screens can
To be not turned on, energy saving.
In specific implementation, the screen control module 303 may include waking up submodule 3031 and screen control submodule
Block 3032.Wherein, the wake-up submodule 3031 is waken up suitable for the nearest screen of the positioning result of adjusting the distance；The screen
Curtain control submodule 3032 is suitable for the nearest screen of positioning result described in command range and responds to interactive voice request.
Preferably, the screen control submodule 3032 may include identity validation submodule 30321, information load submodule
Block 30322 and personalized control submodule 30323.
Wherein, the identity validation submodule 30321 is suitable for identifying the voiceprint of the interactive voice request, with determination
User identity；The information load submodule 30322 is suitable for being based on the user identity, and load matches with the voiceprint
Personal settings information；The personalization control submodule 30323 is suitable for being based on the personal settings information, command range
The nearest screen of the positioning result responds interactive voice request.
In specific implementation, the voice request acquisition module 301 may include voice collecting submodule 3011 and voice
Verify submodule 3012.Wherein, the voice collecting submodule 3011 is suitable for the user speech in collecting vehicle；The speech verification
Submodule 3012 is suitable for verifying the user speech, and the interactive voice request is obtained when being verified.
Preferably, the speech verification submodule 3012 may include content recognition submodule 30121, the content recognition
Submodule 30121 is suitable for identifying the content of the user speech；When the content of the user speech includes preset control instruction
When word, it is verified.
In specific implementation, the position locating module 302 may include that intensity Comparative sub-module 3021 and/or image are known
Small pin for the case module 3022.Wherein, the intensity Comparative sub-module 3021 is adapted to compare the interactive voice that each screen receives
The intensity of sound of request；Described image identifies that submodule 3022 is suitable for carrying out image knowledge to the sounding movement of user each in vehicle
Not.
The more information of multi-screen voice interaction device 30 about the onboard system is referred to Fig. 1 into Fig. 2 institute
The associated description for stating the multi-screen voice interactive method of onboard system, no longer repeats one by one herein.
The embodiment of the invention also discloses a kind of storage mediums, can store computer instruction, the computer thereon
The step of executing multi-screen voice interactive method of the Fig. 1 to onboard system illustrated in fig. 2 when instruction operation.The storage medium can
To include ROM, RAM, disk or CD etc..
The embodiment of the invention also discloses a kind of vehicle device, the vehicle device may include memory and processor, the storage
The computer instruction that can be run on the processor is stored on device, the processor is held when running the computer instruction
Row Fig. 1 to onboard system illustrated in fig. 2 multi-screen voice interactive method the step of.In specific implementation, the vehicle device can be with
It is set in automobile, such as can be the onboard system for being provided with multi-screen.
Although present disclosure is as above, present invention is not limited to this.Anyone skilled in the art are not departing from this
It in the spirit and scope of invention, can make various changes or modifications, therefore protection scope of the present invention should be with claim institute
Subject to the range of restriction.
Claims (14)
1. a kind of multi-screen voice interactive method of onboard system, the onboard system includes multiple screens, which is characterized in that described
Method includes:
Acquire the interactive voice request of user；
The sound source position of interactive voice request is positioned, to obtain positioning result；
It is controlled using the interactive voice request nearest screen of the positioning result of adjusting the distance.
2. multi-screen voice interactive method according to claim 1, which is characterized in that described to be requested using the interactive voice
The nearest screen of the positioning result of adjusting the distance carries out control
The nearest screen of the positioning result of adjusting the distance is waken up；
The nearest screen of positioning result described in command range responds interactive voice request.
3. multi-screen voice interactive method according to claim 2, which is characterized in that positioning result described in the command range
Nearest screen carries out response to interactive voice request
The voiceprint of the interactive voice request is identified, to determine user identity；
The personal settings information to be matched based on the user identity, load with the voiceprint；
Based on the personal settings information, the nearest screen of positioning result described in command range to the interactive voice request into
Row response.
4. multi-screen voice interactive method according to claim 1, which is characterized in that acquire the interactive voice request packet of user
It includes:
User speech in collecting vehicle；
The user speech is verified, the interactive voice request is obtained when being verified.
5. multi-screen voice interactive method according to claim 4, which is characterized in that described to test the user speech
Card includes:
Identify the content of the user speech；When the content of the user speech includes preset control instruction word, verifying is logical
It crosses.
6. multi-screen voice interactive method according to claim 1, which is characterized in that it is described to the interactive voice request
Sound source position carries out positioning
The intensity of sound for the interactive voice request that more each screen receives；
And/or image recognition is carried out to the sounding movement of user each in vehicle.
7. a kind of multi-screen voice interaction device of onboard system, the onboard system includes multiple screens, which is characterized in that described
Device includes:
Voice request acquisition module, suitable for acquiring the interactive voice request of user；
Position locating module, the sound source position suitable for requesting the interactive voice positions, to obtain positioning result；
Screen control module, suitable for being controlled using the interactive voice request nearest screen of the positioning result of adjusting the distance
System.
8. multi-screen voice interaction device according to claim 7, which is characterized in that the screen control module includes:
Submodule is waken up, the nearest screen of the positioning result is waken up suitable for adjusting the distance；
Screen control submodule, the screen nearest suitable for positioning result described in command range ring interactive voice request
It answers.
9. multi-screen voice interaction device according to claim 8, which is characterized in that the screen control submodule includes:
Identity validation submodule, suitable for identifying the voiceprint of the interactive voice request, to determine user identity；
Information loads submodule, is suitable for being based on the user identity, the personal settings that load matches with the voiceprint
Information；
Personalized control submodule is suitable for being based on the personal settings information, the nearest screen of positioning result described in command range
Curtain responds interactive voice request.
10. multi-screen voice interaction device according to claim 7, which is characterized in that the voice request acquisition module packet
It includes:
Voice collecting submodule, suitable for the user speech in collecting vehicle；
Speech verification submodule obtains the interactive voice when being verified and asks suitable for verifying to the user speech
It asks.
11. multi-screen voice interaction device according to claim 10, which is characterized in that the speech verification submodule packet
It includes:
Content recognition submodule, suitable for identifying the content of the user speech；When the content of the user speech includes preset
When control instruction word, it is verified.
12. multi-screen voice interaction device according to claim 7, which is characterized in that the position locating module includes:
Intensity Comparative sub-module is adapted to compare the intensity of sound for the interactive voice request that each screen receives；
And/or image recognition submodule, image recognition is carried out suitable for the sounding movement to user each in vehicle.
13. a kind of storage medium, is stored thereon with computer instruction, which is characterized in that the computer instruction executes when running
The step of multi-screen voice interactive method of onboard system described in any one of claims 1 to 6.
14. a kind of vehicle device, including memory and processor, be stored on the memory to run on the processor
Computer instruction, which is characterized in that perform claim requires any one of 1 to 6 when the processor runs the computer instruction
The step of multi-screen voice interactive method of the onboard system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710814877.8A CN109493871A (en) | 2017-09-11 | 2017-09-11 | The multi-screen voice interactive method and device of onboard system, storage medium and vehicle device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710814877.8A CN109493871A (en) | 2017-09-11 | 2017-09-11 | The multi-screen voice interactive method and device of onboard system, storage medium and vehicle device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109493871A true CN109493871A (en) | 2019-03-19 |
Family
ID=65688917
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710814877.8A Pending CN109493871A (en) | 2017-09-11 | 2017-09-11 | The multi-screen voice interactive method and device of onboard system, storage medium and vehicle device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109493871A (en) |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110021298A (en) * | 2019-04-23 | 2019-07-16 | 广州小鹏汽车科技有限公司 | A kind of automotive voice control system |
| CN110082726A (en) * | 2019-04-10 | 2019-08-02 | 北京梧桐车联科技有限责任公司 | Sound localization method and device, positioning device and storage medium |
| CN110171372A (en) * | 2019-05-27 | 2019-08-27 | 广州小鹏汽车科技有限公司 | Interface display method, device and the vehicle of car-mounted terminal |
| CN110232924A (en) * | 2019-06-03 | 2019-09-13 | 中国第一汽车股份有限公司 | Vehicle-mounted voice management method, device, vehicle and storage medium |
| CN110932862A (en) * | 2019-10-22 | 2020-03-27 | 安信通科技（澳门）有限公司 | Vehicle-mounted equipment login management method and device in vehicle |
| CN111090412A (en) * | 2019-12-18 | 2020-05-01 | 北京声智科技有限公司 | Volume adjusting method and device and audio equipment |
| CN111261156A (en) * | 2019-12-30 | 2020-06-09 | 北京梧桐车联科技有限责任公司 | Voice acquisition method and device and computer readable storage medium |
| CN111324202A (en) * | 2020-02-19 | 2020-06-23 | 中国第一汽车股份有限公司 | Interaction method, device, equipment and storage medium |
| CN111694433A (en) * | 2020-06-11 | 2020-09-22 | 北京百度网讯科技有限公司 | Voice interaction method and device, electronic equipment and storage medium |
| WO2020224265A1 (en) * | 2019-05-05 | 2020-11-12 | 珠海格力电器股份有限公司 | Voice control method and apparatus |
| CN112102836A (en) * | 2020-11-18 | 2020-12-18 | 北京声智科技有限公司 | Voice control screen display method and device, electronic equipment and medium |
| CN112489661A (en) * | 2019-08-23 | 2021-03-12 | 上海汽车集团股份有限公司 | Vehicle-mounted multi-screen communication method and device |
| CN112655000A (en) * | 2020-04-30 | 2021-04-13 | 华为技术有限公司 | In-vehicle user positioning method, vehicle-mounted interaction method, vehicle-mounted device and vehicle |
| CN114248786A (en) * | 2022-01-18 | 2022-03-29 | 合创汽车科技有限公司 | Vehicle control method, system, apparatus, computer device, medium, and product |
| CN114564159A (en) * | 2020-11-27 | 2022-05-31 | 上海擎感智能科技有限公司 | Control method, system and computer storage medium |
| CN115061762A (en) * | 2022-06-07 | 2022-09-16 | 阿波罗智联(北京)科技有限公司 | Page display method and device, electronic equipment and medium |
| CN115158197A (en) * | 2022-07-21 | 2022-10-11 | 重庆蓝鲸智联科技有限公司 | Control system of on-vehicle intelligent passenger cabin amusement based on sound localization |
| CN115440211A (en) * | 2022-06-01 | 2022-12-06 | 北京罗克维尔斯科技有限公司 | Vehicle-mounted voice management method, device, equipment and medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090055178A1 (en) * | 2007-08-23 | 2009-02-26 | Coon Bradley S | System and method of controlling personalized settings in a vehicle |
| CN103729193A (en) * | 2014-01-11 | 2014-04-16 | 苏州思必驰信息科技有限公司 | Method and device for man-machine interaction |
| CN105280183A (en) * | 2015-09-10 | 2016-01-27 | 百度在线网络技术（北京）有限公司 | Voice interaction method and system |
| CN105700389A (en) * | 2014-11-27 | 2016-06-22 | 青岛海尔智能技术研发有限公司 | Smart home natural language control method |
| CN105957523A (en) * | 2016-04-22 | 2016-09-21 | 乐视控股（北京）有限公司 | Vehicular system control method and device |
| CN105957521A (en) * | 2016-02-29 | 2016-09-21 | 青岛克路德机器人有限公司 | Voice and image composite interaction execution method and system for robot |
| CN106448658A (en) * | 2016-11-17 | 2017-02-22 | 海信集团有限公司 | Voice control method of intelligent home equipment, as well as intelligent home gateway |
| CN106653021A (en) * | 2016-12-27 | 2017-05-10 | 上海智臻智能网络科技股份有限公司 | Voice wake-up control method and device and terminal |
| CN106847269A (en) * | 2017-01-20 | 2017-06-13 | 浙江小尤鱼智能技术有限公司 | The sound control method and device of a kind of intelligent domestic system |
| CN106878281A (en) * | 2017-01-11 | 2017-06-20 | 上海蔚来汽车有限公司 | In-car positioner, method and vehicle-mounted device control system based on mixed audio |
-
2017
- 2017-09-11 CN CN201710814877.8A patent/CN109493871A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090055178A1 (en) * | 2007-08-23 | 2009-02-26 | Coon Bradley S | System and method of controlling personalized settings in a vehicle |
| CN103729193A (en) * | 2014-01-11 | 2014-04-16 | 苏州思必驰信息科技有限公司 | Method and device for man-machine interaction |
| CN105700389A (en) * | 2014-11-27 | 2016-06-22 | 青岛海尔智能技术研发有限公司 | Smart home natural language control method |
| CN105280183A (en) * | 2015-09-10 | 2016-01-27 | 百度在线网络技术（北京）有限公司 | Voice interaction method and system |
| CN105957521A (en) * | 2016-02-29 | 2016-09-21 | 青岛克路德机器人有限公司 | Voice and image composite interaction execution method and system for robot |
| CN105957523A (en) * | 2016-04-22 | 2016-09-21 | 乐视控股（北京）有限公司 | Vehicular system control method and device |
| CN106448658A (en) * | 2016-11-17 | 2017-02-22 | 海信集团有限公司 | Voice control method of intelligent home equipment, as well as intelligent home gateway |
| CN106653021A (en) * | 2016-12-27 | 2017-05-10 | 上海智臻智能网络科技股份有限公司 | Voice wake-up control method and device and terminal |
| CN106878281A (en) * | 2017-01-11 | 2017-06-20 | 上海蔚来汽车有限公司 | In-car positioner, method and vehicle-mounted device control system based on mixed audio |
| CN106847269A (en) * | 2017-01-20 | 2017-06-13 | 浙江小尤鱼智能技术有限公司 | The sound control method and device of a kind of intelligent domestic system |
Cited By (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110082726A (en) * | 2019-04-10 | 2019-08-02 | 北京梧桐车联科技有限责任公司 | Sound localization method and device, positioning device and storage medium |
| CN110021298A (en) * | 2019-04-23 | 2019-07-16 | 广州小鹏汽车科技有限公司 | A kind of automotive voice control system |
| WO2020224265A1 (en) * | 2019-05-05 | 2020-11-12 | 珠海格力电器股份有限公司 | Voice control method and apparatus |
| CN110171372A (en) * | 2019-05-27 | 2019-08-27 | 广州小鹏汽车科技有限公司 | Interface display method, device and the vehicle of car-mounted terminal |
| CN110232924A (en) * | 2019-06-03 | 2019-09-13 | 中国第一汽车股份有限公司 | Vehicle-mounted voice management method, device, vehicle and storage medium |
| CN112489661B (en) * | 2019-08-23 | 2024-04-12 | 上海汽车集团股份有限公司 | Vehicle-mounted multi-screen communication method and device |
| CN112489661A (en) * | 2019-08-23 | 2021-03-12 | 上海汽车集团股份有限公司 | Vehicle-mounted multi-screen communication method and device |
| CN110932862A (en) * | 2019-10-22 | 2020-03-27 | 安信通科技（澳门）有限公司 | Vehicle-mounted equipment login management method and device in vehicle |
| CN111090412A (en) * | 2019-12-18 | 2020-05-01 | 北京声智科技有限公司 | Volume adjusting method and device and audio equipment |
| CN111261156A (en) * | 2019-12-30 | 2020-06-09 | 北京梧桐车联科技有限责任公司 | Voice acquisition method and device and computer readable storage medium |
| CN111324202A (en) * | 2020-02-19 | 2020-06-23 | 中国第一汽车股份有限公司 | Interaction method, device, equipment and storage medium |
| CN112655000A (en) * | 2020-04-30 | 2021-04-13 | 华为技术有限公司 | In-vehicle user positioning method, vehicle-mounted interaction method, vehicle-mounted device and vehicle |
| CN111694433A (en) * | 2020-06-11 | 2020-09-22 | 北京百度网讯科技有限公司 | Voice interaction method and device, electronic equipment and storage medium |
| CN112102836A (en) * | 2020-11-18 | 2020-12-18 | 北京声智科技有限公司 | Voice control screen display method and device, electronic equipment and medium |
| CN114564159A (en) * | 2020-11-27 | 2022-05-31 | 上海擎感智能科技有限公司 | Control method, system and computer storage medium |
| CN114564159B (en) * | 2020-11-27 | 2024-01-30 | 上海擎感智能科技有限公司 | Control method, system and computer storage medium |
| CN114248786B (en) * | 2022-01-18 | 2024-03-29 | 合创汽车科技有限公司 | Vehicle control method, system, device, computer equipment and medium |
| CN114248786A (en) * | 2022-01-18 | 2022-03-29 | 合创汽车科技有限公司 | Vehicle control method, system, apparatus, computer device, medium, and product |
| CN115440211A (en) * | 2022-06-01 | 2022-12-06 | 北京罗克维尔斯科技有限公司 | Vehicle-mounted voice management method, device, equipment and medium |
| CN115061762A (en) * | 2022-06-07 | 2022-09-16 | 阿波罗智联(北京)科技有限公司 | Page display method and device, electronic equipment and medium |
| CN115158197A (en) * | 2022-07-21 | 2022-10-11 | 重庆蓝鲸智联科技有限公司 | Control system of on-vehicle intelligent passenger cabin amusement based on sound localization |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109493871A (en) | The multi-screen voice interactive method and device of onboard system, storage medium and vehicle device | |
| CN108284840B (en) | Autonomous vehicle control system and method incorporating occupant preferences | |
| US11023515B2 (en) | Infotainment based on vehicle navigation data | |
| CN111402925B (en) | Voice adjustment method, device, electronic equipment, vehicle-mounted system and readable medium | |
| CN109491624A (en) | Multi-screen control method and device, storage medium and the vehicle device of onboard system | |
| CN109491625A (en) | The terminal synchronous display method and device of onboard system, storage medium and vehicle device | |
| CN109671424B (en) | Responsive activation of vehicle features | |
| US20200108720A1 (en) | Agent system, agent control method, and storage medium | |
| CN108657186B (en) | Intelligent cockpit interaction method and device | |
| CN112614491B (en) | Vehicle-mounted voice interaction method and device, vehicle and readable medium | |
| CN110389744A (en) | Multimedia music processing method and system based on recognition of face | |
| CN110389676A (en) | The vehicle-mounted middle multimedia operation interface of control determines method | |
| JP3695995B2 (en) | Navigation device, navigation method, and computer-readable recording medium storing navigation program | |
| CN110111471A (en) | A kind of automobile account login method, onboard system and vehicle | |
| KR20200073420A (en) | Control system and method of interlocking control system of voice recognition function of vehicle | |
| CN113548062B (en) | Interactive control method and device for automobile and computer storage medium | |
| JP7211856B2 (en) | AGENT DEVICE, AGENT SYSTEM, SERVER DEVICE, CONTROL METHOD FOR AGENT DEVICE, AND PROGRAM | |
| EP3958577A2 (en) | Voice interaction method, voice interaction system, server and storage medium | |
| CN109017559A (en) | The method and apparatus for generating prompt information | |
| JP2009090927A (en) | Information management server, parking assist device, navigation system equipped with parking assist device, information management method, parking assist method, information management program, parking assist program, and record medium | |
| JP7235554B2 (en) | AGENT DEVICE, CONTROL METHOD OF AGENT DEVICE, AND PROGRAM | |
| CN110247915B (en) | Vehicle-mounted system multi-account management method and device of vehicle | |
| JP7266418B2 (en) | AGENT DEVICE, CONTROL METHOD OF AGENT DEVICE, AND PROGRAM | |
| CN111753039A (en) | Adjustment method, information processing method, vehicle and server | |
| CN110444047A (en) | Method and system for assisting in flying device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190319 |