CN110509931A - The information displaying method of voice response, device and system - Google Patents

The information displaying method of voice response, device and system Download PDF

Info

Publication number
CN110509931A
CN110509931A CN201910803302.5A CN201910803302A CN110509931A CN 110509931 A CN110509931 A CN 110509931A CN 201910803302 A CN201910803302 A CN 201910803302A CN 110509931 A CN110509931 A CN 110509931A
Authority
CN
China
Prior art keywords
information
user
service display
vehicle
display information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910803302.5A
Other languages
Chinese (zh)
Other versions
CN110509931B (en
Inventor
高文敏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Xiaopeng Motors Technology Co Ltd
Original Assignee
Guangzhou Xiaopeng Motors Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Xiaopeng Motors Technology Co Ltd filed Critical Guangzhou Xiaopeng Motors Technology Co Ltd
Priority to CN201910803302.5A priority Critical patent/CN110509931B/en
Publication of CN110509931A publication Critical patent/CN110509931A/en
Application granted granted Critical
Publication of CN110509931B publication Critical patent/CN110509931B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33Querying
    • G06F16/332Query formulation
    • G06F16/3329Natural language query formulation or dialogue systems
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/146Display means

Abstract

This application involves intelligent automobile technical fields, more particularly to a kind of information displaying method of voice response, device, computer equipment and storage medium, it include: the phonetic search information for obtaining user, according to the corresponding service display information of the phonetic search acquisition of information;Wherein, the service display information is the information for needing to be shown in onboard system;If the current interface of the onboard system is in occupied state, suspend the display service display information, and generates the prompt information that pause shows the service display information;When detecting that vehicle is in parked state, user is reminded to check the service display information according to the prompt information;It is not only avoided in this programme because service display information covers the related interfaces shown in onboard system, the generation of the case where to influence user's driver behavior, and user can also be prevented because checking service display information in the improperly time, lead to traffic accident, improves the personal safety of user.

Description

The information displaying method of voice response, device and system
Technical field
This application involves intelligent automobile technical field more particularly to a kind of information displaying methods of voice response, device, meter Calculate machine equipment and storage medium.
Background technique
Currently, various intellectual technologies are widely used, for example, intelligent automobile is as computer internet technology develops Into the public visual field, with the universalness of intelligent automobile, the interaction demand between people and vehicle is also higher and higher, such as intelligent automobile Onboard system can identify the voice messaging of user, and corresponding operation or page presentation etc. are executed according to voice messaging.
But in the prior art, when vehicle is in driving status, user initiates voice response, intelligent vehicle-mounted system pair After information in user speech question and answer is identified, relevant visual information can be directly displayed to the exhibition current in onboard system Show interface, will lead to current showing in this way, the information in interface is covered, the displaying operation of relevant information can not be continued to execute, Influence user experience.
Summary of the invention
The purpose of the application is intended at least can solve above-mentioned one of technological deficiency, especially in the prior art by user's language Mail answers corresponding relevant information and is directly showed in displaying interface, causes to show that interface information is covered, influences user experience Technological deficiency.
The application provides a kind of information displaying method of voice response, includes the following steps:
The phonetic search information for obtaining user, according to the corresponding service display information of the phonetic search acquisition of information;Its In, the service display information is the information for needing to be shown in onboard system;
If the current interface of the onboard system is in occupied state, suspend the display service display information, and raw The prompt information of the service display information is shown at pause;
When detecting that vehicle is in parked state, user is reminded to check that the service display is believed according to the prompt information Breath.
In one embodiment, the information displaying method of the voice response, further includes:
In the vehicle parking car locking, and when user leaves the vehicle, the service display information is pushed into user Terminal is shown.
In one embodiment, the information displaying method of the voice response, further includes:
User type is determined according to the phonetic search information;
If the user type is copilot user, the prompt information is sent to the corresponding use of the user type Family terminal;
The service display information is pushed according to the confirmation message that the user terminal returns.
In one embodiment, the step of user type being determined according to the phonetic search information, comprising:
Voice source in the phonetic search information is positioned to obtain azimuth information;
The inner space information for obtaining vehicle, determines user class according to the inner space information and azimuth information of the vehicle Type.
In one embodiment, after the step of service display information corresponding according to the phonetic search acquisition of information, Further include:
The reply strategy of the service display information is determined according to the information content of the service display information;
If the information content is text information, the service display information is generated by voice according to the information content Return information, and played out by in-vehicle player.
In one embodiment, the occupied state includes navigational state;
It is described when detecting that vehicle is in parked state, according to the prompt information remind user check the business exhibition Before the step of showing information, further includes:
When the navigational state terminates, and vehicle is presently in gear when being parking gear, determines that the vehicle is in parking State.
In one embodiment, according to the prompt information remind user check the service display information the step of it Before, further includes:
Monitor the current running state information of the vehicle, and the environmental information being presently in;
Information and environmental information determine the reminder time of the prompt information according to the operation state.
In one embodiment, when information and environmental information determine the prompting of the prompt information according to the operation state Between the step of after, further includes:
If the vehicle is in parked state, and the onboard system then passes through internal loudspeaker currently without operating status The prompt information is played, and shows the service display information in the onboard system.
Present invention also provides a kind of device for displaying information of voice response comprising:
Message processing module, it is corresponding according to the phonetic search acquisition of information for obtaining the phonetic search information of user Service display information;Wherein, the service display information is the information for needing to be shown in onboard system;
State detection module suspends described in display if the current interface for the onboard system is in occupied state Service display information, and generate the prompt information that pause shows the service display information;
Information display module, for reminding user according to the prompt information when detecting that vehicle is in parked state Check the service display information.
Present invention also provides a kind of computer equipment, including memory and processor, meter is stored in the memory Calculation machine readable instruction, when the computer-readable instruction is executed by the processor, so that the processor executes such as above-mentioned reality Apply the step in the information displaying method of voice response described in any one of example.
Present invention also provides a kind of computer storage medium, it is stored in the computer storage medium computer-readable Instruction, when the computer-readable instruction is executed by one or more processors, so that one or more processors execute as above The step of stating the information displaying method of voice response described in any one of embodiment.
Information displaying method, device, computer equipment and the storage medium of above-mentioned voice response, according to the user got Phonetic search information obtain corresponding service display information, and when judging that onboard system is in occupied state, pause display The service display information generates a prompt information according to the service display information, and when vehicle is in parked state, passes through The prompt information reminds user to check service display information.
In the present solution, directly will not after phonetic search acquisition of information according to user corresponding service display information The service display information is shown in onboard system, but according to the occupied state and vehicle of the display interface of onboard system Parked state, in due course by prompt information prompting user check service display information, in so avoiding because of service display Information covers the related interfaces that are showing in onboard system, thus generation the case where influence user's driver behavior, and in vehicle Be in parked state when, by prompt information remind user check service display information, prevent user because in the improperly time It checks service display information, leads to traffic accident, improve the personal safety of user.
Further, when vehicle is in parked state, judge whether the vehicle is in parking and car locking state, and at this When vehicle parking car locking is left, service display information is pushed into user terminal and is shown, to form interactive closed loop, promoted User experience.
Further, the user type of the user is determined by the phonetic search information of user, and is determining the user When type is copilot user, it directly will be prompted to information and be sent to the corresponding user terminal of the user, and according to the user terminal Service display information is pushed to user terminal by the confirmation message of return, guarantees that copilot user can receive within first time The feedback information of the phonetic search information sent to it, promotes the user experience of copilot user.
The additional aspect of the application and advantage will be set forth in part in the description, these will become from the following description It obtains obviously, or recognized by the practice of the application.
Detailed description of the invention
The application is above-mentioned and/or additional aspect and advantage will become from the following description of the accompanying drawings of embodiments Obviously and it is readily appreciated that, in which:
Fig. 1 is the applied environment figure of the information displaying method of voice response provided by the embodiments of the present application;
Fig. 2 is the information displaying method flow chart of the voice response of one embodiment;
Fig. 3 is the user type confirmation method flow chart of one embodiment;
Fig. 4 is the device for displaying information structural schematic diagram of the voice response of one embodiment;
Fig. 5 is the schematic diagram of internal structure of the computer equipment of one embodiment.
Specific embodiment
Embodiments herein is described below in detail, examples of the embodiments are shown in the accompanying drawings, wherein from beginning to end Same or similar label indicates same or similar element or element with the same or similar functions.Below with reference to attached The embodiment of figure description is exemplary, and is only used for explaining the application, and cannot be construed to the limitation to the application.
Those skilled in the art of the present technique are appreciated that unless expressly stated, singular " one " used herein, " one It is a ", " described " and "the" may also comprise plural form.It is to be further understood that being arranged used in the description of the present application Diction " comprising " refer to that there are the feature, integer, step, operation, element and/or component, but it is not excluded that in the presence of or addition Other one or more features, integer, step, operation, element, component and/or their combination.
Those skilled in the art of the present technique are appreciated that unless otherwise defined, all terms used herein (including technology art Language and scientific term), there is meaning identical with the general understanding of those of ordinary skill in the application fields.Should also Understand, those terms such as defined in the general dictionary, it should be understood that have in the context of the prior art The consistent meaning of meaning, and unless by specific definitions as in the embodiment of the present application, otherwise will not with idealization or excessively Formal meaning is explained.
Refering to what is shown in Fig. 1, Fig. 1 is the applied environment figure of the embodiment of the present application;In the present embodiment, the technical solution of the application It can be based on being realized on onboard system, as shown in figure 1, onboard system acquires voice messaging by sound collection unit, and to the language Message breath realizes correlation function after carrying out relevant treatment;In the embodiment of the present application, onboard system is adopted by sound collection unit Collect the voice messaging of user, and obtain relevant displaying information after parsing to the voice messaging, then obtains car-mounted display The display information of screen will show that information pushes to vehicle-carrying display screen or user terminal according to the display state of the display information, with User is facilitated to watch.
In one embodiment, as shown in Fig. 2, Fig. 2 is the information displaying method process of the voice response of one embodiment Scheme, propose a kind of information displaying method of voice response in the present embodiment, can specifically include following steps:
S110: obtaining the phonetic search information of user, is believed according to the corresponding service display of the phonetic search acquisition of information Breath;Wherein, the service display information is the information for needing to be shown in onboard system.
Due to popularizing for intelligent automobile, more and more users also gradually rely on intelligent automobile bring convenience, thus, Interaction in intelligent automobile between user and automobile is particularly important.
Voice answer system, the subsystem being mounted on onboard system, the voice answer system can be realized according to The voice messaging that family provides shows corresponding return information in the display screen of onboard system, avoids user from being manually entered cumbersome Operation, improves user experience.
In this step, when user needs the correlation function using voice answer system, it can be inputted by voice and need to obtain The voice content taken, the voice content are the phonetic search information of user, which can be used Chinese or English The sound source of form inputs.
After getting the phonetic search information of user, believed according to the corresponding service display of the phonetic search acquisition of information Breath;Many places are equipped with sound pick-up inside intelligent automobile, after collecting the phonetic search information of user, can believe the phonetic search Breath is converted into text information, obtains service display information by corresponding text information.
Wherein, which is the information for needing to be shown in onboard system, and onboard system and user carry out Interactive terminal is equipped with vehicle-carrying display screen, which can be shown in vehicle-carrying display screen.
S120: if the current interface of the onboard system is in occupied state, suspending the display service display information, And generate the prompt information that pause shows the service display information.
In this step, after getting service display information corresponding with the phonetic search information of user by step S110, The state that onboard system is presently in can further be detected.
If onboard system is occupied state at present, such as navigational state then shows that the user of operator seat is driving vehicle Certain destination is reached, the vehicle-carrying display screen of onboard system is in navigation and shows interface, if at this time that service display information is straight It connects and is shown in vehicle-carrying display screen, not only will affect original navigation and show that the content at interface is covered, also will affect user's Driving safety.
Thus, it is contemplated that the behavior that above-mentioned influence user security drives in this step, is currently at occupancy in onboard system When state, pause shows the service display information, and generates the prompt information that pause shows the service display information.
It is understood that occupied state here refers to being occupied by visualization procedure, and need the weight of real-time display Want application state.
Here pause shows that the service display information refers to that the service display system information is preferentially shown in vehicle by pause Carry the operation of display screen.
Here generation pause shows that the prompt information of the service display information is referred to the service display according to pause It is this operation that information is preferentially shown in vehicle-carrying display screen, generates corresponding prompt information, for example, which can To be " you have a people of unread information " this relevant prompt.
Further, the prompt information may include the phonetic search information acquisition time, generate the time and this mention Show the transmission address etc. of information.
Further, the application applies also for being currently at any priority with navigational state when onboard system Other states of priority identical or greater than navigational state, equally pause shows service display letter under other states Breath, and generate the prompt information that pause shows the service display information.
It should be noted that priority here refers to the priority of preset each process in onboard system, it is vehicle-mounted There are many state of display in system, each display state corresponds to different processes.
S130: when detecting that vehicle is in parked state, user is reminded to check the business according to the prompt information Show information.
In this step, when vehicle is currently at occupied state, such as navigational state shows that vehicle is in driving condition In, the user for being now in operator seat is inconvenient to check relevant service display information, thus the service display information is temporary After stopping display, the prompt information that pause shows the service display information is generated, further, in conjunction with the current institute of vehicle detected The parked state at place, and remind user to check service display information according to the prompt information.
Wherein, the parked state for detecting vehicle preferentially selects whether detection vehicle is in parking gear, when detecting at vehicle When parking gear, user is reminded to check service display information according to the prompt information of generation.
It further, can be by loudspeaker outside vehicle by the prompt information of generation when detecting that vehicle is in parked state It plays out, user is reminded to check service display information.
Further, when detecting that vehicle is in parked state, the status information of also detectable onboard system at this time, If will be prompted to information when any state of current onboard system not running by internal loudspeaker and play out, and by the business Show that information is showed in the vehicle-carrying display screen of onboard system.
The information displaying method of above-mentioned voice response obtains corresponding industry according to the phonetic search information of the user got Business shows information, and when judging that onboard system is in occupied state, and pause shows the service display information, according to the business exhibition Show that information generates a prompt information, and when vehicle is in parked state, reminds user to check business by the prompt information Show information.
In the present solution, directly will not after phonetic search acquisition of information according to user corresponding service display information The service display information is shown in onboard system, but according to the occupied state and vehicle of the display interface of onboard system Parked state, in due course by prompt information prompting user check service display information, in so avoiding because of service display Information covers the related interfaces that are showing in onboard system, thus generation the case where influence user's driver behavior, and in vehicle Be in parked state when, by prompt information remind user check service display information, prevent user because in the improperly time It checks service display information, leads to traffic accident, improve the personal safety of user.
In one embodiment, the information displaying method of the voice response can also include: to lock in the vehicle parking Vehicle, and when user leaves the vehicle, the service display information is pushed into user terminal and is shown.
In the present embodiment, when vehicle is in specified gear, user is reminded to check the service display according to prompt information After information, in the vehicle parking car locking, and when user leaves the vehicle, which is pushed into user terminal It is shown.
When detecting that user stopped and car locking and after leave, show that user not in the car, at this time can not be by vehicle-mounted Service display information is showed user to watch by display screen, thus, when vehicle parking simultaneously leave by car locking, which is believed Breath pushes to user terminal and is shown.
It is equipped with multiple groups photographic device inside intelligent automobile, the user of input phonetic search information can be acquired by photographic device Corresponding facial information, and will be compared between the user information saved in collected facial information and cloud database, Obtain the personal information of corresponding user comprising phone number, client login account of the user etc..
After getting the user terminal of corresponding user, by the service display information push to the user terminal of the user into Row is shown.
In above-described embodiment, when vehicle is in parked state, judge whether the vehicle is in parking and car locking state, and When the vehicle parking car locking is left, service display information is pushed into user terminal and is shown, to form interactive closed loop, Promote user experience.
In one embodiment, as shown in figure 3, Fig. 3 is the user type confirmation method process of the application one embodiment Figure, the information displaying method of the voice response can also include:
S140: the phonetic search information of user is obtained;
S150: user type is determined according to the phonetic search information;
S160: if the user type is copilot user, the prompt information is sent to the user type pair The user terminal answered;
S170: the service display information is pushed according to the confirmation message that the user terminal returns.
The voice answer system of intelligent automobile can be driving with the phonetic search information of user in collecting vehicle, the user The user of position, is also possible to the user of co-driver.
In the present embodiment, user type is determined according to phonetic search information, which may include driving user, pair User is driven, can determine the sending direction of the sound according to the sound source of phonetic search information input, further passes through the hair Direction can be determined whether as copilot user out.
When the user type is copilot user, since the user in co-driver is without carrying out driver behavior, because And after getting the corresponding service display information of the phonetic search information, directly the corresponding prompt of the service display information can be believed Breath is sent to the corresponding user terminal of copilot user.
The acquisition methods of the user terminal can be to be transferred in vocal print library according to the voiceprint in the sound recognized and be somebody's turn to do The corresponding personal information of user obtains phone number, the client login account etc. of the user according to the personal information.
After getting copilot user corresponding phone number, which can be sent to the phone number pair The user terminal answered.It after user receives the prompt information, can be confirmed in user terminal, be returned according to user terminal Confirmation message pushes corresponding service display information.
Further, after the login account for getting the corresponding client of the user, the client push industry can be passed through Business shows information.It is understood that client here refers to and the visitor that installs on the matched mobile terminal of onboard system Family end.
In above-described embodiment, the user type of the user is determined by the phonetic search information of user, and determining the use When family type is copilot user, it directly will be prompted to information and be sent to the corresponding user terminal of the user, and according to user end It holds the confirmation message returned that service display information is pushed to user terminal, guarantees that copilot user can be inscribed in first time The feedback information of the phonetic search information of its transmission is received, the user experience of copilot user is promoted.
In one embodiment, the step of determining user type according to the phonetic search information in step S150, can be with Include:
S151: the voice source in the phonetic search information is positioned to obtain azimuth information;
S152: obtaining the inner space information of vehicle, is determined according to the inner space information and azimuth information of the vehicle User type.
In the present embodiment, after getting the phonetic search information of user, which may include needing to search The information content of rope, the corresponding vocal print of the voice, source of the voice etc..
The position coordinates of the voice sender can be positioned by the voice source in phonetic search information, i.e. orientation is believed Breath;After getting the corresponding azimuth information of phonetic search information, it can determine that the orientation is believed according to the inner space information of vehicle The specific location in corresponding vehicle is ceased, then determines the user type of the user.
In vehicle-mounted data library, preserve in model relevant to the vehicle, function introduction, operation instruction and vehicle Portion's spatial information, the inner space information refer to the seat space size of operator seat, co-driver, vehicle interior or so spacing Deng, after being called in vehicle-mounted data library to the vehicle relevant inner space information, can according to the inner space information with And the azimuth information in above-mentioned voice source determines user type.
If the position of sound pick-up is it has been determined that can substantially determine that the orientation in the voice source is believed according to the sending direction of voice Breath can calculate the user in conjunction with the inner space information of vehicle to drive user or copilot user.
Specifically, sound pick-up, the sound pick-up at each position can be installed at multiple positions as needed inside the vehicle It can receive the phonetic search information of user, and strong according to the sound at each position of phonetic search acquisition of information received Degree, relatively high some the corresponding region of sound pick-up of identification intensity of sound, the sending direction of sound source is calculated by the region, really Determine the azimuth information of user.
Further, can inside the vehicle the left and right sides symmetric position at install sound pick-up, then according to sound wave reach position In the time difference of the sound pick-up at sounding baseline both ends, it may be determined that the direction line of sound source, the sound received in conjunction with both ends sound pick-up Loudness of a sound degree can determine the specific orientation of sound source on direction line.
In above-described embodiment, it can determine that the phonetic search is believed according to language search information and the inner space information of vehicle Corresponding user type is ceased, to provide the push mode of different service display information, for different user types to promote use Family experience.
In one embodiment, according to the corresponding service display information of the phonetic search acquisition of information in step S110 Step may include:
S111: the information content of the phonetic search information is parsed to obtain key message;
S112: corresponding match information is searched according to the key message, and is obtained accordingly by the match information Service display information.
In the present embodiment, after getting the phonetic search information of user, text can be converted by the phonetic search information Information then carries out meaning of a word parsing to the information content of the text information, obtains the key message in the text information.
Such as, it converts the phonetic search information of user to after text information and obtains " how charging to vehicle " this section Text, by the text information carry out meaning of a word parsing, can be obtained key message include " how ", " vehicle ", " charging ", pass through the pass Key information can search corresponding match information, such as " how vehicle charges ", " how Vehicular charging carries out ", " how to vehicle Charge " this series of match information.
After obtaining match information, corresponding service display information, such as match information can be got according to the match information For " how vehicle charges ", searched in the corresponding problem base of onboard system according to the match information corresponding with the match information Answer information, the answer information are service display information.
In one embodiment, the step of corresponding service display information being obtained by the match information in step S112 Later, can also include:
S113: the reply strategy of the service display information is determined according to the information content of the service display information;
S114: according to the information content that the service display information is raw if the information content is text information It is played out at voice return information, and by in-vehicle player.
In the present embodiment, the reply strategy of service display information can be determined according to the information content of service display information, The reply strategy refers to the exhibition method of the service display information, including voice broadcasting, customer terminal webpage loaded and displayed or view Frequency displaying etc..
It, can be according to the information content by service display information when the information content of the service display information is text information Speech answering information is generated, and is played out by in-vehicle player.
Such as, the then above-mentioned citing to match information, when the match information is " how vehicle charges ", according to the matching Information searches for answer information corresponding with the match information in the corresponding problem base of onboard system, which is business Show that the information content of information is directly converting the text information to if in the answer information only include text information Voice messaging is replied, i.e. generation speech answering information.
Further, when the information content includes video, picture etc., the video, picture can not by in-vehicle player into After row plays, thus this partial information content transformation is service display information, can by the client installed on mobile terminal or Vehicle-carrying display screen is shown.
In one embodiment, the occupied state may include navigational state;When detecting at vehicle in step S130 When parked state, according to the prompt information remind user check the service display information the step of before, can also wrap Include: when the navigational state terminates, and vehicle is presently in gear when being parking gear, determines that the vehicle is in parked state.
In the present embodiment, when the occupied state of vehicle current interface is navigational state, can detecte the navigational state is No end, and terminating in the navigational state, and when vehicle is in parking gear, the current state of vehicle where user is judged to locating In parked state.
In one embodiment, user is reminded to check the service display information according to the prompt information in step S130 The step of before, can also include:
S131: the current running state information of the vehicle, and the environmental information being presently in are monitored;
S132: information and environmental information determine the reminder time of the prompt information according to the operation state.
In the present embodiment, when detecting that vehicle is currently at specified gear, it can further pass through the current operation of vehicle Status information and the environmental information being presently in determine the reminder time of the prompt information.
Here running state information may include that whether vehicle motor runs, whether vehicle opens car locking mode etc., Here environmental information includes the ambient enviroment that ground is currently located according to the vehicle that GPS positioning obtains, which includes vehicle Road type, peripheral facility etc. where.
For example, can further detect whether vehicle is in flameout state, lock when detecting that vehicle is currently located at parking gear Whether car state and outside vehicle environment are in traffic congestion section, red street lamp crossing etc., and the driving of user is judged with this State.
After determining user's parking and car locking is left, information can be will be prompted in ten seconds it is sent to outside vehicle in loudspeaker remind User pays attention to checking mobile phone.
When user still in driving condition car locking is not left after, then will be prompted to information in five seconds and be sent to interior loudspeaking Device is to check mobile phone after reminding user to get off.
In above-described embodiment, prompt is determined according to the current running state information of vehicle and the environmental information being presently in The reminder time of information to understand the dynamic of user in time, and dynamically sends corresponding prompt information according to this and reminds user, Promote user experience.
In one embodiment, as shown in figure 4, Fig. 4 is the device for displaying information structure of the voice response of one embodiment Schematic diagram provides a kind of device for displaying information of voice response in the present embodiment comprising: message processing module 210, state Detection module 220, information display module 230, in which:
Message processing module 210, for obtaining the phonetic search information of user, according to the phonetic search acquisition of information phase The service display information answered;Wherein, the service display information is the information for needing to be shown in onboard system.
Due to popularizing for intelligent automobile, more and more users also gradually rely on intelligent automobile bring convenience, thus, Interaction in intelligent automobile between user and automobile is particularly important.
Voice answer system, the subsystem being mounted on onboard system, the voice answer system can be realized according to The voice messaging that family provides shows corresponding return information in the display screen of onboard system, avoids user from being manually entered cumbersome Operation, improves user experience.
In this module, when user needs the correlation function using voice answer system, it can be inputted by voice and need to obtain The voice content taken, the voice content are the phonetic search information of user, which can be used Chinese or English The sound source of form inputs.
After getting the phonetic search information of user, believed according to the corresponding service display of the phonetic search acquisition of information Breath;Many places are equipped with sound pick-up inside intelligent automobile, after collecting the phonetic search information of user, can believe the phonetic search Breath is converted into text information, obtains service display information by corresponding text information.
Wherein, which is the information for needing to be shown in onboard system, and onboard system and user carry out Interactive terminal is equipped with vehicle-carrying display screen, which can be shown in vehicle-carrying display screen.
State detection module 220 suspends display institute if the current interface for the onboard system is in occupied state Service display information is stated, and generates the prompt information that pause shows the service display information.
In this module, service display corresponding with the phonetic search information of user is got by message processing module 210 After information, the state that onboard system is presently in can be further detected.
If onboard system is occupied state at present, such as navigational state then shows that the user of operator seat is driving vehicle Certain destination is reached, the vehicle-carrying display screen of onboard system is in navigation and shows interface, if at this time that service display information is straight It connects and is shown in vehicle-carrying display screen, not only will affect original navigation and show that the content at interface is covered, also will affect user's Driving safety.
Thus, it is contemplated that the behavior that above-mentioned influence user security drives in this step, is currently at occupancy in onboard system When state, pause shows the service display information, and generates the prompt information that pause shows the service display information.
It is understood that occupied state here refers to being occupied by visualization procedure, and need the weight of real-time display Want application state.
Here pause shows that the service display information refers to that the service display system information is preferentially shown in vehicle by pause Carry the operation of display screen.
Here generation pause shows that the prompt information of the service display information is referred to the service display according to pause It is this operation that information is preferentially shown in vehicle-carrying display screen, generates corresponding prompt information, which can be that " you have This relevant prompt of one people of unread information ".
Further, the prompt information may include the phonetic search information acquisition time, generate the time and this mention Show the transmission address etc. of information.
Further, the application applies also for being currently at any priority with navigational state when onboard system Other states of priority identical or greater than navigational state, equally pause shows service display letter under other states Breath, and generate the prompt information that pause shows the service display information.
It should be noted that priority here refers to the priority of preset each process in onboard system, it is vehicle-mounted There are many state of display in system, each display state corresponds to different processes.
Information display module 230, for being reminded and being used according to the prompt information when detecting that vehicle is in parked state The service display information is checked at family.
In this module, when vehicle is currently at occupied state, such as navigational state shows that vehicle is in driving condition In, the user for being now in operator seat is inconvenient to check relevant service display information, thus the service display information is temporary After stopping display, the prompt information that pause shows the service display information is generated, further, in conjunction with the current institute of vehicle detected The parked state at place, and remind user to check service display information according to the prompt information.
Wherein, the parked state for detecting vehicle preferentially selects whether detection vehicle is in parking gear, when detecting at vehicle When parking gear, user is reminded to check service display information according to the prompt information of generation.
It further, can be by loudspeaker outside vehicle by the prompt information of generation when detecting that vehicle is in parked state It plays out, user is reminded to check service display information.
Further, when detecting that vehicle is in parked state, the status information of also detectable onboard system at this time, If will be prompted to information when any state of current onboard system not running by internal loudspeaker and play out, and by the business Show that information is showed in the vehicle-carrying display screen of onboard system.
The device for displaying information of above-mentioned voice response obtains corresponding industry according to the phonetic search information of the user got Business shows information, and when judging that onboard system is in occupied state, and pause shows the service display information, according to the business exhibition Show that information generates a prompt information, and when vehicle is in parked state, reminds user to check business by the prompt information Show information.
In the present solution, directly will not after phonetic search acquisition of information according to user corresponding service display information The service display information is shown in onboard system, but according to the occupied state and vehicle of the display interface of onboard system Parked state, in due course by prompt information prompting user check service display information, in so avoiding because of service display Information covers the related interfaces that are showing in onboard system, thus generation the case where influence user's driver behavior, and in vehicle Be in parked state when, by prompt information remind user check service display information, prevent user because in the improperly time It checks service display information, leads to traffic accident, improve the personal safety of user.
The specific of device for displaying information about voice response limits the information that may refer to above for voice response The restriction of methods of exhibiting, details are not described herein.Modules in the device for displaying information of above-mentioned voice response can whole or portion Divide and is realized by software, hardware and combinations thereof.Above-mentioned each module can be embedded in the form of hardware or independently of in terminal device Processor in, can also be stored in a software form in the memory in terminal device, in order to processor call execute with The corresponding operation of upper modules.
In one embodiment it is proposed that a kind of computer equipment, computer equipment include memory, processor and storage On a memory and the computer program that can run on a processor, processor realize any of the above-described reality when executing computer program The step of applying the information displaying method of the voice response of example.
As shown in figure 5, Fig. 5 is the schematic diagram of internal structure of the computer equipment of one embodiment.The computer equipment 310 Including processor 314, non-volatile memory medium 315, memory 311 and the network interface connected by system bus 313 312.Wherein, the non-volatile memory medium 315 of the computer equipment 310 is stored with operating system 317 and computer program 316, when which is executed by processor 314, processor 314 may make to realize the information displaying side of voice response Method.The processor 314 of the computer equipment 310 supports the fortune of entire computer equipment 310 for providing calculating and control ability Row.It is stored with computer program 316 in the memory 311 of the computer equipment 310, the computer program 316 is by processor 314 When execution, processor 314 may make to execute the information displaying method of voice response.The network interface 312 of the computer equipment 310 For with mobile terminal connection communication.
It will be understood by those skilled in the art that structure shown in Fig. 5, only part relevant to application scheme is tied The block diagram of structure does not constitute the restriction for the computer equipment being applied thereon to application scheme, specific computer equipment It may include perhaps combining certain components or with different component layouts than more or fewer components as shown in the figure.
In one embodiment it is proposed that a kind of computer storage medium, calculating is stored in the computer storage medium Machine readable instruction, when which is executed by one or more processors, so that one or more processors execute The step of information displaying method of the voice response of any of the above-described embodiment.
It should be understood that although each step in the flow chart of attached drawing is successively shown according to the instruction of arrow, These steps are not that the inevitable sequence according to arrow instruction successively executes.Unless expressly stating otherwise herein, these steps Execution there is no stringent sequences to limit, can execute in the other order.Moreover, at least one in the flow chart of attached drawing Part steps may include that perhaps these sub-steps of multiple stages or stage are not necessarily in synchronization to multiple sub-steps Completion is executed, but can be executed at different times, execution sequence, which is also not necessarily, successively to be carried out, but can be with other At least part of the sub-step or stage of step or other steps executes in turn or alternately.
The above is only some embodiments of the application, it is noted that for the ordinary skill people of the art For member, under the premise of not departing from the application principle, several improvements and modifications can also be made, these improvements and modifications are also answered It is considered as the protection scope of the application.

Claims (11)

1. a kind of information displaying method of voice response, which comprises the steps of:
The phonetic search information for obtaining user, according to the corresponding service display information of the phonetic search acquisition of information;Wherein, institute Stating service display information is the information for needing to be shown in onboard system;
If the current interface of the onboard system is in occupied state, suspend the display service display information, and generates temporary Stop showing the prompt information of the service display information;
When detecting that vehicle is in parked state, user is reminded to check the service display information according to the prompt information.
2. the information displaying method of voice response according to claim 1, which is characterized in that further include:
In the vehicle parking car locking, and when user leaves the vehicle, the service display information is pushed into user terminal It is shown.
3. the information displaying method of voice response according to claim 1, which is characterized in that further include:
User type is determined according to the phonetic search information;
If the user type is copilot user, it is whole that the prompt information is sent to the corresponding user of the user type End;
The service display information is pushed according to the confirmation message that the user terminal returns.
4. the information displaying method of voice response according to claim 3, which is characterized in that believed according to the phonetic search Cease the step of determining user type, comprising:
Voice source in the phonetic search information is positioned to obtain azimuth information;
The inner space information for obtaining vehicle, determines user type according to the inner space information and azimuth information of the vehicle.
5. the information displaying method of voice response according to claim 1, which is characterized in that believed according to the phonetic search Breath obtained after the step of corresponding service display information, further includes:
The reply strategy of the service display information is determined according to the information content of the service display information;
If the information content is text information, the service display information is generated by speech answering according to the information content Information, and played out by in-vehicle player.
6. the information displaying method of voice response according to claim 1, which is characterized in that the occupied state includes leading Boat state;
It is described when detecting that vehicle is in parked state, remind user to check that the service display is believed according to the prompt information Before the step of breath, further includes:
When the navigational state terminates, and vehicle is presently in gear when being parking gear, determines that the vehicle is in parked state.
7. the information displaying method of voice response according to claim 1, which is characterized in that mentioned according to the prompt information Awake user checked before the step of service display information, further includes:
Monitor the current running state information of the vehicle, and the environmental information being presently in;
Information and environmental information determine the reminder time of the prompt information according to the operation state.
8. the information displaying method of voice response according to claim 7, which is characterized in that believe according to the operation state After the step of breath and environmental information determine the reminder time of the prompt information, further includes:
If the vehicle is in parked state, and the onboard system is then played by internal loudspeaker currently without operating status The prompt information, and the service display information is shown in the onboard system.
9. a kind of device for displaying information of voice response characterized by comprising
Message processing module, for obtaining the phonetic search information of user, according to the corresponding industry of phonetic search acquisition of information Business shows information;Wherein, the service display information is the information for needing to be shown in onboard system;
State detection module suspends the display business if the current interface for the onboard system is in occupied state It shows information, and generates the prompt information that pause shows the service display information;
Information display module, for reminding user to check according to the prompt information when detecting that vehicle is in parked state The service display information.
10. a kind of computer equipment, it is characterised in that: including memory and processor, be stored with computer in the memory Readable instruction, when the computer-readable instruction is executed by the processor so that the processor execute as claim 1 to The step of information displaying method of voice response described in any one of 8.
11. a kind of computer storage medium, it is characterised in that: be stored with computer-readable finger in the computer storage medium It enables, when the computer-readable instruction is executed by one or more processors, so that one or more processors execute such as right It is required that the step of information displaying method of voice response described in any one of 1 to 8.
CN201910803302.5A 2019-08-28 2019-08-28 Information display method, device and system for voice question answering Active CN110509931B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910803302.5A CN110509931B (en) 2019-08-28 2019-08-28 Information display method, device and system for voice question answering

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910803302.5A CN110509931B (en) 2019-08-28 2019-08-28 Information display method, device and system for voice question answering

Publications (2)

Publication Number Publication Date
CN110509931A true CN110509931A (en) 2019-11-29
CN110509931B CN110509931B (en) 2021-02-19

Family

ID=68628592

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910803302.5A Active CN110509931B (en) 2019-08-28 2019-08-28 Information display method, device and system for voice question answering

Country Status (1)

Country Link
CN (1) CN110509931B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111002996A (en) * 2019-12-10 2020-04-14 广州小鹏汽车科技有限公司 Vehicle-mounted voice interaction method, server, vehicle and storage medium
CN112655000A (en) * 2020-04-30 2021-04-13 华为技术有限公司 In-vehicle user positioning method, vehicle-mounted interaction method, vehicle-mounted device and vehicle
CN113688277A (en) * 2021-08-26 2021-11-23 三一专用汽车有限责任公司 Voice content display method, device and system and vehicle

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105008859A (en) * 2014-02-18 2015-10-28 三菱电机株式会社 Speech recognition device and display method
CN108259579A (en) * 2017-12-29 2018-07-06 深圳云天励飞技术有限公司 Vehicle crew's information-pushing method, equipment, readable storage medium storing program for executing and onboard system
CN108806674A (en) * 2017-05-05 2018-11-13 北京搜狗科技发展有限公司 A kind of positioning navigation method, device and electronic equipment
CN108845736A (en) * 2018-06-12 2018-11-20 苏州思必驰信息科技有限公司 Exchange method and system for vehicle-mounted voice system
CN109218035A (en) * 2017-07-05 2019-01-15 阿里巴巴集团控股有限公司 Processing method, electronic equipment, server and the video playback apparatus of group information
CN109299359A (en) * 2018-09-19 2019-02-01 腾讯大地通途(北京)科技有限公司 A kind of road condition query method, apparatus, terminal and storage medium
CN109582872A (en) * 2018-12-04 2019-04-05 北京羽扇智信息科技有限公司 A kind of information-pushing method, device, electronic equipment and storage medium
CN109979460A (en) * 2019-03-11 2019-07-05 上海白泽网络科技有限公司 Visualize voice messaging exchange method and device

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105008859A (en) * 2014-02-18 2015-10-28 三菱电机株式会社 Speech recognition device and display method
CN108806674A (en) * 2017-05-05 2018-11-13 北京搜狗科技发展有限公司 A kind of positioning navigation method, device and electronic equipment
CN109218035A (en) * 2017-07-05 2019-01-15 阿里巴巴集团控股有限公司 Processing method, electronic equipment, server and the video playback apparatus of group information
CN108259579A (en) * 2017-12-29 2018-07-06 深圳云天励飞技术有限公司 Vehicle crew's information-pushing method, equipment, readable storage medium storing program for executing and onboard system
CN108845736A (en) * 2018-06-12 2018-11-20 苏州思必驰信息科技有限公司 Exchange method and system for vehicle-mounted voice system
CN109299359A (en) * 2018-09-19 2019-02-01 腾讯大地通途(北京)科技有限公司 A kind of road condition query method, apparatus, terminal and storage medium
CN109582872A (en) * 2018-12-04 2019-04-05 北京羽扇智信息科技有限公司 A kind of information-pushing method, device, electronic equipment and storage medium
CN109979460A (en) * 2019-03-11 2019-07-05 上海白泽网络科技有限公司 Visualize voice messaging exchange method and device

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111002996A (en) * 2019-12-10 2020-04-14 广州小鹏汽车科技有限公司 Vehicle-mounted voice interaction method, server, vehicle and storage medium
CN111002996B (en) * 2019-12-10 2023-08-25 广州小鹏汽车科技有限公司 Vehicle-mounted voice interaction method, server, vehicle and storage medium
CN112655000A (en) * 2020-04-30 2021-04-13 华为技术有限公司 In-vehicle user positioning method, vehicle-mounted interaction method, vehicle-mounted device and vehicle
CN113688277A (en) * 2021-08-26 2021-11-23 三一专用汽车有限责任公司 Voice content display method, device and system and vehicle

Also Published As

Publication number Publication date
CN110509931B (en) 2021-02-19

Similar Documents

Publication Publication Date Title
CN110509931A (en) The information displaying method of voice response, device and system
US9552830B2 (en) Vehicle language setting system
CN108891413B (en) Vehicle-mounted fatigue driving prevention system, method, equipment and storage medium
CN111402925B (en) Voice adjustment method, device, electronic equipment, vehicle-mounted system and readable medium
US20150293745A1 (en) Text-reading device and text-reading method
CN110808053B (en) Driver identity verification method and device and electronic equipment
JP2008241309A (en) Service presentation device for vehicle
CN110395269B (en) Vehicle-based human-computer interaction method and system and vehicle
CN109686047A (en) The method and apparatus with prompting are supervised for vehicle condition
CN110654331A (en) Vehicle, vehicle equipment and vehicle-mounted assistant interaction method thereof
CN111144258A (en) Vehicle designated driving method, terminal equipment, computer storage medium and system
JP2019127192A (en) On-vehicle device
CN110580799A (en) taxi network taxi appointment driver and passenger speaking automatic pre-judgment alarm system
CN109017559A (en) The method and apparatus for generating prompt information
CN114640480A (en) Method for information processing, in-vehicle terminal, and computer storage medium
CN110871810A (en) Vehicle, vehicle equipment and driving information prompting method based on driving mode
CN113591744B (en) Method for generating annotation data aiming at dangerous driving behaviors and data acquisition system
US20230031709A1 (en) Autonomous driving vehicle detection method and apparatus, electronic device and readable storage medium
CN113611007B (en) Data processing method and data acquisition system
CN114690896A (en) Information processing apparatus, information processing method, and storage medium
CN114666765A (en) Method and device for seeking vehicle use help from inside to outside of vehicle
CN112613862A (en) Bus payment method, device, equipment and storage medium based on hand pulse recognition
CN113879313A (en) Driver fatigue detection method and device
CN112261586A (en) Method for automatically identifying driver to limit driving range of driver by using vehicle-mounted robot
EP3637052A1 (en) Information processing device, information processing method, and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CP02 Change in the address of a patent holder

Address after: 510000 No.8 Songgang street, Cencun, Tianhe District, Guangzhou City, Guangdong Province

Patentee after: GUANGZHOU XPENG AUTOMOBILE TECHNOLOGY Co.,Ltd.

Address before: Room 245, 333 jiufo Jianshe Road, Zhongxin Guangzhou Knowledge City, Guangzhou, Guangdong 510640

Patentee before: GUANGZHOU XPENG AUTOMOBILE TECHNOLOGY Co.,Ltd.

CP02 Change in the address of a patent holder