CN110509931B - Information display method, device and system for voice question answering - Google Patents
Information display method, device and system for voice question answering Download PDFInfo
- Publication number
- CN110509931B CN110509931B CN201910803302.5A CN201910803302A CN110509931B CN 110509931 B CN110509931 B CN 110509931B CN 201910803302 A CN201910803302 A CN 201910803302A CN 110509931 B CN110509931 B CN 110509931B
- Authority
- CN
- China
- Prior art keywords
- information
- vehicle
- user
- voice
- service display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/332—Query formulation
- G06F16/3329—Natural language query formulation or dialogue systems
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W2050/146—Display means
Landscapes
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Mathematical Physics (AREA)
- Artificial Intelligence (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Navigation (AREA)
Abstract
The application relates to the technical field of intelligent automobiles, in particular to a method and a device for displaying information of voice questions and answers, computer equipment and a storage medium, wherein the method comprises the following steps: acquiring voice search information of a user, and acquiring corresponding service display information according to the voice search information; the service display information is information which needs to be displayed on a vehicle-mounted system; if the current interface of the vehicle-mounted system is in an occupied state, pausing display of the service display information and generating prompt information for pausing display of the service display information; when the vehicle is detected to be in the parking state, reminding a user to check the service display information according to the prompt information; according to the scheme, the phenomenon that the service display information covers the relevant interface being displayed in the vehicle-mounted system is avoided, so that the driving operation of a user is influenced, the traffic accident caused by the fact that the user checks the service display information in an improper time can be prevented, and the personal safety of the user is improved.
Description
Technical Field
The application relates to the technical field of intelligent automobiles, in particular to a voice question and answer information display method and device, computer equipment and a storage medium.
Background
At present, with the development of computer internet technology, various intelligent technologies are widely applied, for example, an intelligent automobile has entered the public field of vision, and with the popularization of the intelligent automobile, the interaction demand between people and vehicles is higher and higher, for example, a vehicle-mounted system of the intelligent automobile can recognize voice information of a user, and perform corresponding operation or page display according to the voice information.
However, in the prior art, when the vehicle is in a driving state, the user initiates a voice question and answer, and after the intelligent vehicle-mounted system identifies information in the user voice question and answer, the related visual information is directly displayed on the current display interface of the vehicle-mounted system, so that the information in the current display interface is covered, the display operation of the related information cannot be continuously executed, and the user experience is influenced.
Disclosure of Invention
The purpose of the present application is to solve at least one of the above technical defects, especially a technical defect in the prior art that related information corresponding to a user's voice question and answer is directly displayed on a display interface, which causes the display interface information to be covered and affects user experience.
The application provides an information display method of voice question answering, which comprises the following steps:
acquiring voice search information of a user, and acquiring corresponding service display information according to the voice search information; the service display information is information which needs to be displayed on a vehicle-mounted system;
if the current interface of the vehicle-mounted system is in an occupied state, pausing display of the service display information and generating prompt information for pausing display of the service display information;
and when the vehicle is detected to be in the parking state, reminding a user to check the service display information according to the prompt information.
In one embodiment, the information display method of the voice question answering further includes:
and when the vehicle is parked and locked and the user leaves the vehicle, the service display information is pushed to the user terminal for display.
In one embodiment, the information display method of the voice question answering further includes:
determining the user type according to the voice search information;
if the user type is a co-driver user, sending the prompt information to a user terminal corresponding to the user type;
and pushing the service display information according to the confirmation information returned by the user terminal.
In one embodiment, the step of determining the user type based on the voice search information comprises:
positioning a voice source in the voice search information to obtain azimuth information;
the method comprises the steps of obtaining interior space information of a vehicle, and determining a user type according to the interior space information and the direction information of the vehicle.
In one embodiment, after the step of obtaining the corresponding service presentation information according to the voice search information, the method further includes:
determining a reply strategy of the service display information according to the information content of the service display information;
and if the information content is character information, generating voice reply information from the service display information according to the information content, and playing the voice reply information through a vehicle-mounted player.
In one embodiment, the occupancy state comprises a navigational state;
when the vehicle is detected to be in the parking state, before the step of reminding the user to check the service display information according to the prompt message, the method further comprises the following steps:
and when the navigation state is finished and the current gear of the vehicle is a parking gear, determining that the vehicle is in the parking state.
In one embodiment, before the step of reminding the user to view the service presentation information according to the prompt message, the method further includes:
monitoring the current running state information of the vehicle and the current environment information;
and determining the reminding time of the prompt message according to the running state information and the environmental information.
In one embodiment, after the step of determining the reminding time of the prompt message according to the operating state information and the environment information, the method further includes:
and if the vehicle is in a parking state and the vehicle-mounted system is not in a current running state, playing the prompt information through a loudspeaker in the vehicle, and displaying the service display information in the vehicle-mounted system.
The application also provides an information display device of pronunciation question answering, it includes:
the information processing module is used for acquiring voice search information of a user and acquiring corresponding service display information according to the voice search information; the service display information is information which needs to be displayed on a vehicle-mounted system;
the state detection module is used for pausing the display of the service display information if the current interface of the vehicle-mounted system is in an occupied state and generating prompt information for pausing the display of the service display information;
and the information display module is used for reminding a user to check the service display information according to the prompt information when the vehicle is detected to be in the parking state.
The present application further provides a computer device, which includes a memory and a processor, where the memory stores computer readable instructions, and when the computer readable instructions are executed by the processor, the processor executes the steps in the information presentation method for voice question answering according to any one of the above embodiments.
The present application further provides a computer storage medium, in which computer readable instructions are stored, and when the computer readable instructions are executed by one or more processors, the one or more processors execute the steps of the information presentation method for voice question answering according to any one of the above embodiments.
According to the voice question and answer information display method, the voice question and answer information display device, the computer equipment and the storage medium, corresponding service display information is obtained according to the obtained voice search information of the user, when the vehicle-mounted system is judged to be in the occupied state, the service display information is paused to be displayed, a piece of prompt information is generated according to the service display information, and when the vehicle is in the parking state, the user is reminded to check the service display information through the prompt information.
According to the scheme, after the corresponding service display information is acquired according to the voice search information of the user, the service display information is not directly displayed in the vehicle-mounted system, but the user is timely reminded to check the service display information through the prompt information according to the occupation state of the display interface of the vehicle-mounted system and the parking state of the vehicle, so that the condition that the driving operation of the user is influenced due to the fact that the service display information covers the relevant interface which is being displayed in the vehicle-mounted system is avoided, and when the vehicle is in the parking state, the user is reminded to check the service display information through the prompt information, the situation that the traffic accidents are caused due to the fact that the user checks the service display information at an improper time is prevented, and the personal safety of the user is improved.
Further, when the vehicle is in the parking state, whether the vehicle is in the parking and locking state is judged, and when the vehicle is parked and locked and leaves, the service display information is pushed to the user terminal for display, so that an interactive closed loop is formed, and the user experience is improved.
Furthermore, the user type of the user is determined through the voice search information of the user, when the user type is determined to be the co-driver user, the prompt information is directly sent to the user terminal corresponding to the user, the service display information is pushed to the user terminal according to the confirmation information returned by the user terminal, the co-driver user can be ensured to receive the feedback information of the voice search information sent by the co-driver user in the first time, and the user experience of the co-driver user is improved.
Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.
Drawings
The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is an application environment diagram of an information presentation method for a voice question answering according to an embodiment of the present application;
FIG. 2 is a flow diagram of an embodiment of a method for presenting information in a voice question and answer;
FIG. 3 is a flow diagram of a user type validation method of an embodiment;
FIG. 4 is a schematic structural diagram of an information presentation apparatus for voice question answering according to an embodiment;
fig. 5 is a schematic internal structure diagram of the computer device according to the embodiment.
Detailed Description
Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary only for the purpose of explaining the present application and are not to be construed as limiting the present application.
As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It will be understood by those within the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
Referring to fig. 1, fig. 1 is a diagram of an application environment of an embodiment of the present application; in this embodiment, the technical scheme of the present application may be implemented on the basis of a vehicle-mounted system, for example, in fig. 1, the vehicle-mounted system collects voice information through a voice collecting unit, and performs related processing on the voice information to implement related functions; in the embodiment of the application, the vehicle-mounted system collects the voice information of the user through the voice collecting unit, analyzes the voice information and then obtains the related display information, then obtains the display information of the vehicle-mounted display screen, and pushes the display information to the vehicle-mounted display screen or the user terminal according to the display state of the display information, so that the user can watch the display information conveniently.
In an embodiment, as shown in fig. 2, fig. 2 is a flowchart of an information presentation method of a voice question and answer of an embodiment, where the embodiment provides an information presentation method of a voice question and answer, which may specifically include the following steps:
s110: acquiring voice search information of a user, and acquiring corresponding service display information according to the voice search information; the service display information is information which needs to be displayed on a vehicle-mounted system.
Due to the popularization of intelligent automobiles, more and more users gradually rely on the convenience brought by the intelligent automobiles, and therefore, the interaction between the users and the automobiles in the intelligent automobiles is very important.
The voice question-answering system is a subsystem carried on the vehicle-mounted system, and can display corresponding reply information in a display screen of the vehicle-mounted system according to voice information provided by a user, so that complicated operation of manual input of the user is avoided, and user experience is improved.
In this step, when the user needs to use the related functions of the voice question-answering system, the voice content to be acquired can be input through voice, the voice content is the voice search information of the user, and the voice search information can be input by using a sound source in a Chinese or English form.
After voice search information of a user is acquired, acquiring corresponding service display information according to the voice search information; pick-up devices are installed at multiple positions in the intelligent automobile, after voice search information of a user is collected, the voice search information can be converted into text information, and service display information is obtained through the corresponding text information.
The service display information is information which needs to be displayed on the vehicle-mounted system, a vehicle-mounted display screen is arranged at a terminal where the vehicle-mounted system interacts with a user, and the service display information can be displayed on the vehicle-mounted display screen.
S120: and if the current interface of the vehicle-mounted system is in an occupied state, pausing the display of the service display information and generating prompt information for pausing the display of the service display information.
In this step, after the service display information corresponding to the voice search information of the user is acquired in step S110, the current state of the vehicle-mounted system may be further detected.
If the vehicle-mounted system is in an occupied state at present, such as a navigation state, it indicates that a user at a driving position is driving a vehicle to reach a certain destination, and the vehicle-mounted display screen of the vehicle-mounted system is in a navigation display interface, and if the service display information is directly displayed in the vehicle-mounted display screen at the moment, not only the content of the original navigation display interface is covered, but also the driving safety of the user is affected.
Therefore, in consideration of the above-mentioned behavior affecting safe driving of the user, in this step, when the vehicle-mounted system is currently in the occupied state, the display of the service presentation information is suspended, and the prompt information for suspending the display of the service presentation information is generated.
It is understood that the occupation state herein refers to an important application state that is occupied by a visualization program and needs to be displayed in real time.
The suspension of displaying the service presentation information herein refers to suspension of an operation of preferentially displaying the service presentation information on the in-vehicle display screen.
The generation of the prompt message for suspending the display of the service exhibition information herein refers to the generation of a corresponding prompt message according to the operation of suspending the display of the service exhibition information on the vehicle-mounted display screen preferentially, for example, the prompt message may be a relevant prompt of "you have an unread message".
Further, the prompt message may include the acquisition time, generation time, and sending address of the voice search message.
Furthermore, the method and the device are also suitable for pausing and displaying the service display information in any other state which has the same priority as or higher than the priority of the navigation state when the vehicle-mounted system is currently in the other state, and generating the prompt information for pausing and displaying the service display information.
It should be noted that the priority here refers to the priority of each process preset in the vehicle-mounted system, and the vehicle-mounted system has multiple display states, and each display state corresponds to a different process.
S130: and when the vehicle is detected to be in the parking state, reminding a user to check the service display information according to the prompt information.
In this step, when the vehicle is currently in an occupied state, such as a navigation state, indicating that the vehicle is currently in a driving state, the user at the driving position is inconvenient to view the relevant service display information, so that after the service display information is paused, prompt information for pausing the display of the service display information is generated, and further, the detected parking state of the vehicle is combined, and the user is prompted to view the service display information according to the prompt information.
And when the vehicle is detected to be in the parking gear, reminding a user to check the service display information according to the generated prompt information.
Further, when the vehicle is detected to be in the parking state, the generated prompt information can be played through the loudspeaker outside the vehicle, and a user is reminded to check the service display information.
Furthermore, when the vehicle is detected to be in the parking state, the state information of the vehicle-mounted system at the time can be detected, if the current vehicle-mounted system does not operate in any state, the prompt information is played through a loudspeaker in the vehicle, and the service display information is displayed on a vehicle-mounted display screen of the vehicle-mounted system.
According to the information display method of the voice question answering, corresponding service display information is obtained according to the obtained voice search information of the user, when the vehicle-mounted system is judged to be in the occupied state, the service display information is paused to be displayed, a piece of prompt information is generated according to the service display information, and when the vehicle is in the parking state, the user is reminded to check the service display information through the prompt information.
According to the scheme, after the corresponding service display information is acquired according to the voice search information of the user, the service display information is not directly displayed in the vehicle-mounted system, but the user is timely reminded to check the service display information through the prompt information according to the occupation state of the display interface of the vehicle-mounted system and the parking state of the vehicle, so that the condition that the driving operation of the user is influenced due to the fact that the service display information covers the relevant interface which is being displayed in the vehicle-mounted system is avoided, and when the vehicle is in the parking state, the user is reminded to check the service display information through the prompt information, the situation that the traffic accidents are caused due to the fact that the user checks the service display information at an improper time is prevented, and the personal safety of the user is improved.
In one embodiment, the information display method for the voice question answering may further include: and when the vehicle is parked and locked and the user leaves the vehicle, the service display information is pushed to the user terminal for display.
In this embodiment, when the vehicle is in the designated gear, after the user is reminded to check the service display information according to the prompt message, the vehicle is parked and locked, and when the user leaves the vehicle, the service display information is pushed to the user terminal for display.
When the fact that the user parks, locks and leaves is detected, the fact that the user is not in the vehicle is indicated, at the moment, the service display information cannot be displayed to the user through the vehicle-mounted display screen to be watched, and therefore when the vehicle parks, locks and leaves, the service display information is pushed to the user terminal to be displayed.
The intelligent automobile is internally provided with a plurality of groups of camera devices, the face information corresponding to a user who inputs voice search information can be collected through the camera devices, the collected face information is compared with the user information stored in the cloud database, and the personal information of the corresponding user is obtained and comprises the mobile phone number of the user, the client login account number and the like.
And after the user terminal of the corresponding user is obtained, the service display information is pushed to the user terminal of the user for display.
In the above embodiment, when the vehicle is in the parking state, whether the vehicle is in the parking and locking state is judged, and when the vehicle is parked and locked, the service display information is pushed to the user terminal for display, so that an interactive closed loop is formed, and the user experience is improved.
In an embodiment, as shown in fig. 3, fig. 3 is a flowchart of a user type confirmation method according to an embodiment of the present application, where the information presentation method for a voice question and answer may further include:
s140: acquiring voice search information of a user;
s150: determining the user type according to the voice search information;
s160: if the user type is a co-driver user, sending the prompt information to a user terminal corresponding to the user type;
s170: and pushing the service display information according to the confirmation information returned by the user terminal.
The voice question-answering system of the intelligent automobile can collect voice search information of users in the automobile, and the users can be users in driving positions or users in copilot positions.
In this embodiment, the user type is determined according to the voice search information, where the user type may include a driver and a co-driver, the sound emitting direction may be determined according to a sound source input by the voice search information, and further, whether the user is a co-driver may be determined according to the sound emitting direction.
When the user type is a co-driver user, the user at the co-driver position does not need to perform driving operation, so that after the service display information corresponding to the voice search information is acquired, the prompt information corresponding to the service display information can be directly sent to the user terminal corresponding to the co-driver user.
The method for acquiring the user terminal may call the personal information corresponding to the user in the voiceprint library according to the voiceprint information in the recognized voice, and acquire the mobile phone number, the client login account number, and the like of the user according to the personal information.
And after the mobile phone number corresponding to the copilot user is obtained, the prompt message can be sent to the user terminal corresponding to the mobile phone number. After receiving the prompt message, the user can confirm at the user terminal and push corresponding service display information according to the confirmation message returned by the user terminal.
Further, after the login account of the client corresponding to the user is obtained, the service display information can be pushed through the client. It is understood that the client herein refers to a client installed on a mobile terminal matched with the in-vehicle system.
In the embodiment, the user type of the user is determined through the voice search information of the user, when the user type is determined to be the co-driver user, the prompt information is directly sent to the user terminal corresponding to the user, and the service display information is pushed to the user terminal according to the confirmation information returned by the user terminal, so that the co-driver user can receive the feedback information of the voice search information sent by the co-driver user in the first time, and the user experience of the co-driver user is improved.
In one embodiment, the step of determining the user type according to the voice search information in step S150 may include:
s151: positioning a voice source in the voice search information to obtain azimuth information;
s152: the method comprises the steps of obtaining interior space information of a vehicle, and determining a user type according to the interior space information and the direction information of the vehicle.
In this embodiment, after obtaining the voice search information of the user, the voice search information may include information content to be searched, a voiceprint corresponding to the voice, a source of the voice, and the like.
The position coordinates of the voice sender, namely the azimuth information, can be positioned through the voice source in the voice search information; after the azimuth information corresponding to the voice search information is acquired, the specific position in the vehicle corresponding to the azimuth information can be determined according to the internal space information of the vehicle, and then the user type of the user is determined.
The type, function introduction, operation instruction and vehicle internal space information related to the vehicle are stored in the vehicle-mounted database, the internal space information refers to the size of the seat space of the driving seat and the assistant driving seat, the left and right vehicle distances in the vehicle, and the like.
If the position of the sound pick-up is determined, the direction information of the voice source can be roughly determined according to the voice emitting direction, and the user can be calculated to be a driving user or a co-driving user by combining the internal space information of the vehicle.
Specifically, sound collectors may be installed at a plurality of positions in the vehicle as needed, the sound collectors at the respective positions may receive the voice search information of the user, and obtain the sound intensity at the respective positions according to the received voice search information, identify a certain area corresponding to the sound collector with relatively high sound intensity, calculate the sound emission direction of the sound source through the certain area, and determine the azimuth information of the user.
Furthermore, sound pick-up devices can be arranged at the symmetrical positions of the left side and the right side in the vehicle, then the direction line of the sound source can be determined according to the time difference of sound waves reaching the sound pick-up devices at the two ends of the sound measurement base line, and the specific direction of the sound source can be determined on the direction line by combining the sound intensity received by the sound pick-up devices at the two ends.
In the embodiment, the user type corresponding to the voice search information can be determined according to the language search information and the internal space information of the vehicle, so that different pushing modes of service display information are provided for different user types, and the user experience is improved.
In an embodiment, the step of obtaining the corresponding service presentation information according to the voice search information in step S110 may include:
s111: analyzing the information content of the voice search information to obtain key information;
s112: and searching corresponding matching information according to the key information, and acquiring corresponding service display information through the matching information.
In this embodiment, after the voice search information of the user is acquired, the voice search information may be converted into text information, and then, the information content of the text information is subjected to word meaning analysis to acquire the key information in the text information.
For example, after the voice search information of the user is converted into the text information, a text of "how to charge the vehicle" is obtained, the text information is subjected to word meaning analysis, and key information including "how to" charge the vehicle "and" charging "is obtained, and corresponding matching information, such as a series of matching information of" how to charge the vehicle "," how to charge the vehicle "and" how to charge the vehicle ", can be searched through the key information.
After the matching information is obtained, corresponding service display information can be obtained according to the matching information, if the matching information is 'how to charge a vehicle', answer information corresponding to the matching information is searched in a question bank corresponding to a vehicle-mounted system according to the matching information, and the answer information is the service display information.
In an embodiment, after the step of obtaining the corresponding service presentation information through the matching information in step S112, the method may further include:
s113: determining a reply strategy of the service display information according to the information content of the service display information;
s114: and if the information content is character information, generating voice reply information from the service display information according to the information content, and playing the voice reply information through a vehicle-mounted player.
In this embodiment, a reply policy of the service presentation information may be determined according to the information content of the service presentation information, where the reply policy refers to a presentation manner of the service presentation information, and includes voice playing, client page loading display, video presentation, or the like.
When the information content of the service display information is character information, the service display information can be generated into voice reply information according to the information content, and the voice reply information is played through a vehicle-mounted player.
For example, following the above example of the matching information, when the matching information is "how to charge the vehicle", answer information corresponding to the matching information is searched in a question bank corresponding to the vehicle-mounted system according to the matching information, where the answer information is information content of the service presentation information, and if the answer information only includes text information, the text information is directly converted into voice information for replying, that is, voice reply information is generated.
Further, when the information content includes a video, a picture, etc., the video and the picture cannot be played through the vehicle-mounted player, so that the part of the information content is converted into the service display information and then can be displayed through a client installed on the mobile terminal or a vehicle-mounted display screen.
In one embodiment, the occupancy state may include a navigational state; in step S130, when it is detected that the vehicle is in the parking state, before the step of prompting the user to view the service display information according to the prompt information, the method may further include: and when the navigation state is finished and the current gear of the vehicle is a parking gear, determining that the vehicle is in the parking state.
In this embodiment, when the occupied state of the current interface of the vehicle is the navigation state, whether the navigation state is ended or not may be detected, and when the navigation state is ended and the vehicle is in the parking gear, the current state of the vehicle where the user is located may be determined as being in the parking state.
In an embodiment, before the step of reminding the user to view the service presentation information according to the prompt information in step S130, the method may further include:
s131: monitoring the current running state information of the vehicle and the current environment information;
s132: and determining the reminding time of the prompt message according to the running state information and the environmental information.
In this embodiment, when it is detected that the vehicle is currently in the designated gear, the reminding time of the prompt message may be further determined according to the current operating state information of the vehicle and the current environmental information.
The operation state information here may include whether the engine of the vehicle is operated, whether the vehicle is in a lock mode, and the like, and the environment information here includes the surrounding environment of the current location of the vehicle, which includes the type of road on which the vehicle is located, surrounding facilities, and the like, obtained from GPS positioning.
For example, when it is detected that the vehicle is currently located in the parking position, whether the vehicle is in a flameout state or a locked state, and whether the environment outside the vehicle is in a traffic jam road section or a red road intersection can be further detected, so as to determine the driving state of the user.
When the user is determined to stop and lock the vehicle and leave, prompt information can be sent to the loudspeaker outside the vehicle within ten seconds to remind the user to pay attention to check the mobile phone.
And when the user is still in a driving state and does not lock the automobile and leave, sending prompt information to the loudspeaker in the automobile within five seconds to remind the user to check the mobile phone after getting off the automobile.
In the embodiment, the reminding time of the prompt message is determined according to the current running state information of the vehicle and the current environment information, so that the dynamic state of the user can be known in time, the corresponding prompt message is sent according to the dynamic state to remind the user, and the user experience is improved.
In an embodiment, as shown in fig. 4, fig. 4 is a schematic structural diagram of an information display apparatus of a voice question and answer according to an embodiment, in which an information display apparatus of a voice question and answer is provided, and the information display apparatus includes: information processing module 210, state detection module 220, information display module 230, wherein:
the information processing module 210 is configured to obtain voice search information of a user, and obtain corresponding service display information according to the voice search information; the service display information is information which needs to be displayed on a vehicle-mounted system.
Due to the popularization of intelligent automobiles, more and more users gradually rely on the convenience brought by the intelligent automobiles, and therefore, the interaction between the users and the automobiles in the intelligent automobiles is very important.
The voice question-answering system is a subsystem carried on the vehicle-mounted system, and can display corresponding reply information in a display screen of the vehicle-mounted system according to voice information provided by a user, so that complicated operation of manual input of the user is avoided, and user experience is improved.
In the module, when a user needs to use the related functions of the voice question-answering system, the voice content needing to be acquired can be input through voice, the voice content is the voice search information of the user, and the voice search information can be input by using a Chinese or English sound source.
After voice search information of a user is acquired, acquiring corresponding service display information according to the voice search information; pick-up devices are installed at multiple positions in the intelligent automobile, after voice search information of a user is collected, the voice search information can be converted into text information, and service display information is obtained through the corresponding text information.
The service display information is information which needs to be displayed on the vehicle-mounted system, a vehicle-mounted display screen is arranged at a terminal where the vehicle-mounted system interacts with a user, and the service display information can be displayed on the vehicle-mounted display screen.
And the state detection module 220 is configured to suspend displaying the service display information if the current interface of the vehicle-mounted system is in an occupied state, and generate a prompt message for suspending displaying the service display information.
In this module, after the service display information corresponding to the voice search information of the user is acquired through the information processing module 210, the current state of the vehicle-mounted system can be further detected.
If the vehicle-mounted system is in an occupied state at present, such as a navigation state, it indicates that a user at a driving position is driving a vehicle to reach a certain destination, and the vehicle-mounted display screen of the vehicle-mounted system is in a navigation display interface, and if the service display information is directly displayed in the vehicle-mounted display screen at the moment, not only the content of the original navigation display interface is covered, but also the driving safety of the user is affected.
Therefore, in consideration of the above-mentioned behavior affecting safe driving of the user, in this step, when the vehicle-mounted system is currently in the occupied state, the display of the service presentation information is suspended, and the prompt information for suspending the display of the service presentation information is generated.
It is understood that the occupation state herein refers to an important application state that is occupied by a visualization program and needs to be displayed in real time.
The suspension of displaying the service presentation information herein refers to suspension of an operation of preferentially displaying the service presentation information on the in-vehicle display screen.
The generation of the prompt message for pausing the display of the service display information herein refers to the generation of a corresponding prompt message according to the operation of pausing the display of the service display system information on the vehicle-mounted display screen preferentially, and the prompt message may be a relevant prompt that "you have an unread message".
Further, the prompt message may include the acquisition time, generation time, and sending address of the voice search message.
Furthermore, the method and the device are also suitable for pausing and displaying the service display information in any other state which has the same priority as or higher than the priority of the navigation state when the vehicle-mounted system is currently in the other state, and generating the prompt information for pausing and displaying the service display information.
It should be noted that the priority here refers to the priority of each process preset in the vehicle-mounted system, and the vehicle-mounted system has multiple display states, and each display state corresponds to a different process.
And the information display module 230 is configured to, when it is detected that the vehicle is in the parking state, remind a user to view the service display information according to the prompt information.
In the module, when the vehicle is currently in an occupied state, such as a navigation state, the vehicle is in a driving state, and a user in a driving position at the moment is inconvenient to check related service display information, so that prompt information for suspending the display of the service display information is generated after the service display information is suspended, and further, the detected parking state of the vehicle is combined, and the user is reminded to check the service display information according to the prompt information.
And when the vehicle is detected to be in the parking gear, reminding a user to check the service display information according to the generated prompt information.
Further, when the vehicle is detected to be in the parking state, the generated prompt information can be played through the loudspeaker outside the vehicle, and a user is reminded to check the service display information.
Furthermore, when the vehicle is detected to be in the parking state, the state information of the vehicle-mounted system at the time can be detected, if the current vehicle-mounted system does not operate in any state, the prompt information is played through a loudspeaker in the vehicle, and the service display information is displayed on a vehicle-mounted display screen of the vehicle-mounted system.
The information display device for the voice question answering obtains corresponding service display information according to the obtained voice search information of the user, pauses to display the service display information when the vehicle-mounted system is judged to be in the occupied state, generates a piece of prompt information according to the service display information, and reminds the user to check the service display information through the prompt information when the vehicle is in the parking state.
According to the scheme, after the corresponding service display information is acquired according to the voice search information of the user, the service display information is not directly displayed in the vehicle-mounted system, but the user is timely reminded to check the service display information through the prompt information according to the occupation state of the display interface of the vehicle-mounted system and the parking state of the vehicle, so that the condition that the driving operation of the user is influenced due to the fact that the service display information covers the relevant interface which is being displayed in the vehicle-mounted system is avoided, and when the vehicle is in the parking state, the user is reminded to check the service display information through the prompt information, the situation that the traffic accidents are caused due to the fact that the user checks the service display information at an improper time is prevented, and the personal safety of the user is improved.
For the specific limitation of the information display device for the voice question and answer, the above limitation on the information display method for the voice question and answer can be referred to, and details are not repeated here. All or part of the modules in the information display device for the voice question and answer can be realized by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent of a processor in the terminal device, and can also be stored in a memory in the terminal device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, a computer device is provided, where the computer device includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the steps of the information presentation method for a voice question answering according to any one of the above embodiments when executing the computer program.
As shown in fig. 5, fig. 5 is a schematic internal structure diagram of a computer device according to an embodiment. The computer device 310 includes a processor 314, a non-volatile storage medium 315, a memory 311, and a network interface 312 connected by a system bus 313. The non-volatile storage medium 315 of the computer device 310 stores an operating system 317 and a computer program 316, and when the computer program 316 is executed by the processor 314, the processor 314 can be enabled to implement the information presentation method of the voice question answering. The processor 314 of the computer device 310 is used to provide computing and control capabilities that support the operation of the entire computer device 310. The memory 311 of the computer device 310 stores a computer program 316, and when the computer program 316 is executed by the processor 314, the processor 314 can execute the information presentation method of the voice question answering. The network interface 312 of the computer device 310 is used for connecting communication with the mobile terminal.
Those skilled in the art will appreciate that the architecture shown in fig. 5 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer storage medium is provided, in which computer readable instructions are stored, and when executed by one or more processors, the one or more processors execute the steps of the information presentation method for voice question answering of any one of the above embodiments.
It should be understood that, although the steps in the flowcharts of the figures are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless explicitly stated herein. Moreover, at least a portion of the steps in the flow chart of the figure may include multiple sub-steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed alternately or alternately with other steps or at least a portion of the sub-steps or stages of other steps.
The foregoing is only a partial embodiment of the present application, and it should be noted that, for those skilled in the art, several modifications and decorations can be made without departing from the principle of the present application, and these modifications and decorations should also be regarded as the protection scope of the present application.
Claims (10)
1. An information display method of voice question answering is characterized by comprising the following steps:
acquiring voice search information of a user, and acquiring corresponding service display information according to the voice search information; the service display information is information which needs to be displayed on a vehicle-mounted system;
if the current interface of the vehicle-mounted system is in an occupied state, pausing display of the service display information and generating prompt information for pausing display of the service display information;
when the vehicle is detected to be in a parking state, monitoring the current running state information of the vehicle and the current environment information; determining the reminding time of the prompt message according to the running state information and the environmental information; and reminding a user to check the service display information according to the prompt information at the reminding time.
2. The information presentation method of a voice question answering according to claim 1, further comprising:
and when the vehicle is parked and locked and the user leaves the vehicle, the service display information is pushed to the user terminal for display.
3. The information presentation method of a voice question answering according to claim 1, further comprising:
determining the user type according to the voice search information;
if the user type is a co-driver user, sending the prompt information to a user terminal corresponding to the user type;
and pushing the service display information according to the confirmation information returned by the user terminal.
4. The method for displaying information on voice questions and answers according to claim 3, wherein the step of determining the user type according to the voice search information comprises:
positioning a voice source in the voice search information to obtain azimuth information;
the method comprises the steps of obtaining interior space information of a vehicle, and determining a user type according to the interior space information and the direction information of the vehicle.
5. The information display method of voice question answering according to claim 1, wherein after the step of obtaining corresponding service display information according to the voice search information, further comprising:
determining a reply strategy of the service display information according to the information content of the service display information;
and if the information content is character information, generating voice reply information from the service display information according to the information content, and playing the voice reply information through a vehicle-mounted player.
6. The information presentation method of voice question answering according to claim 1, characterized in that the occupation state comprises a navigation state;
when the vehicle is detected to be in the parking state, before the step of reminding the user to check the service display information according to the prompt message, the method further comprises the following steps:
and when the navigation state is finished and the current gear of the vehicle is a parking gear, determining that the vehicle is in the parking state.
7. The information presentation method of a voice question answering according to claim 1, wherein after the step of determining the reminding time of the prompt message according to the running state information and the environment information, further comprising:
and if the vehicle is in a parking state and the vehicle-mounted system is not in a current running state, playing the prompt information through a loudspeaker in the vehicle, and displaying the service display information in the vehicle-mounted system.
8. An information display device of voice question answering is characterized by comprising:
the information processing module is used for acquiring voice search information of a user and acquiring corresponding service display information according to the voice search information; the service display information is information which needs to be displayed on a vehicle-mounted system;
the state detection module is used for pausing the display of the service display information if the current interface of the vehicle-mounted system is in an occupied state and generating prompt information for pausing the display of the service display information;
the information display module is used for monitoring the current running state information of the vehicle and the current environment information when the vehicle is detected to be in a parking state; determining the reminding time of the prompt message according to the running state information and the environmental information; and reminding a user to check the service display information according to the prompt information at the reminding time.
9. A computer device, characterized by: comprising a memory and a processor, wherein the memory stores computer readable instructions, which when executed by the processor, cause the processor to execute the steps of the information presentation method of voice question answering according to any one of claims 1 to 7.
10. A computer storage medium, characterized in that: the computer storage medium stores computer readable instructions which, when executed by one or more processors, cause the one or more processors to perform the steps of the method for presenting information of phonetic answers according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910803302.5A CN110509931B (en) | 2019-08-28 | 2019-08-28 | Information display method, device and system for voice question answering |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910803302.5A CN110509931B (en) | 2019-08-28 | 2019-08-28 | Information display method, device and system for voice question answering |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110509931A CN110509931A (en) | 2019-11-29 |
| CN110509931B true CN110509931B (en) | 2021-02-19 |
Family
ID=68628592
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910803302.5A Active CN110509931B (en) | 2019-08-28 | 2019-08-28 | Information display method, device and system for voice question answering |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110509931B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111002996B (en) * | 2019-12-10 | 2023-08-25 | 广州小鹏汽车科技有限公司 | Vehicle-mounted voice interaction method, server, vehicle and storage medium |
| WO2021217572A1 (en) * | 2020-04-30 | 2021-11-04 | 华为技术有限公司 | In-vehicle user positioning method, on-board interaction method, on-board device, and vehicle |
| CN113688277B (en) * | 2021-08-26 | 2023-05-12 | 三一专用汽车有限责任公司 | Voice content display method, device and system and vehicle |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5893217B2 (en) * | 2014-02-18 | 2016-03-23 | 三菱電機株式会社 | Voice recognition apparatus and display method |
| CN108806674A (en) * | 2017-05-05 | 2018-11-13 | 北京搜狗科技发展有限公司 | A kind of positioning navigation method, device and electronic equipment |
| CN109218035A (en) * | 2017-07-05 | 2019-01-15 | 阿里巴巴集团控股有限公司 | Processing method, electronic equipment, server and the video playback apparatus of group information |
| CN108259579B (en) * | 2017-12-29 | 2021-05-11 | 深圳云天励飞技术有限公司 | Vehicle personnel information pushing method and device, readable storage medium and vehicle-mounted system |
| CN108845736A (en) * | 2018-06-12 | 2018-11-20 | 苏州思必驰信息科技有限公司 | Exchange method and system for vehicle-mounted voice system |
| CN109299359B (en) * | 2018-09-19 | 2020-10-27 | 腾讯大地通途（北京）科技有限公司 | Road condition query method, device, terminal and storage medium |
| CN109582872B (en) * | 2018-12-04 | 2021-11-16 | 北京羽扇智信息科技有限公司 | Information pushing method and device, electronic equipment and storage medium |
| CN109979460A (en) * | 2019-03-11 | 2019-07-05 | 上海白泽网络科技有限公司 | Visualize voice messaging exchange method and device |
-
2019
- 2019-08-28 CN CN201910803302.5A patent/CN110509931B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN110509931A (en) | 2019-11-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110509931B (en) | Information display method, device and system for voice question answering | |
| US11281357B2 (en) | Methods and systems for taxonomy assist at data entry points | |
| CN111402925B (en) | Voice adjustment method, device, electronic equipment, vehicle-mounted system and readable medium | |
| WO2024007864A1 (en) | Vehicle detection method and apparatus, device, and storage medium | |
| CN111797755A (en) | Automobile passenger emotion recognition method and electronic equipment | |
| Chittaro et al. | Driver distraction caused by mobile devices: studying and reducing safety risks | |
| CN110871810A (en) | Vehicle, vehicle equipment and driving information prompting method based on driving mode | |
| LeBlanc | Road departure crash warning system field operational test: methodology and results. volume 1: technical report | |
| CN109017559A (en) | The method and apparatus for generating prompt information | |
| CN116853282A (en) | Vehicle control method, device, computer equipment and storage medium | |
| CN113591744B (en) | Method for generating annotation data aiming at dangerous driving behaviors and data acquisition system | |
| CN113611007B (en) | Data processing method and data acquisition system | |
| Kugler et al. | Mobility tracking system for CO2 footprint determination | |
| CN113689719A (en) | Vehicle state determination method, vehicle state determination device, electronic device, and storage medium | |
| Nowakowski | Navigation system destination entry: The effects of driver workload and input devices, and implications for SAE recommended practice | |
| CN110709671B (en) | Information processing apparatus, information processing method, and program | |
| CN113628360B (en) | Data acquisition method and system | |
| CN112261586A (en) | Method for automatically identifying driver to limit driving range of driver by using vehicle-mounted robot | |
| CN112164225A (en) | Information processing method, device, equipment and storage medium | |
| Sheng et al. | A Car Breakdown Service Station Locator System | |
| US11551485B2 (en) | Information output device and information output method | |
| JP2008058508A (en) | Traffic regulation examination conducting device for vehicle, and traffic regulation examination system | |
| Pereira et al. | Simultaneous interaction with in-vehicle systems while turning left: comparison among three groups of drivers | |
| CN116968663A (en) | Vehicle interface control | |
| CN110706546A (en) | Method and system for performing subject-two simulation examination by using VR (virtual reality) |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP02 | Change in the address of a patent holder |
Address after: 510000 No.8 Songgang street, Cencun, Tianhe District, Guangzhou City, Guangdong Province Patentee after: GUANGZHOU XPENG AUTOMOBILE TECHNOLOGY Co.,Ltd. Address before: Room 245, 333 jiufo Jianshe Road, Zhongxin Guangzhou Knowledge City, Guangzhou, Guangdong 510640 Patentee before: GUANGZHOU XPENG AUTOMOBILE TECHNOLOGY Co.,Ltd. |
|
| CP02 | Change in the address of a patent holder |