CN110019740B - Interaction method of vehicle-mounted terminal, server and storage medium - Google Patents
Interaction method of vehicle-mounted terminal, server and storage medium Download PDFInfo
- Publication number
- CN110019740B CN110019740B CN201810502872.6A CN201810502872A CN110019740B CN 110019740 B CN110019740 B CN 110019740B CN 201810502872 A CN201810502872 A CN 201810502872A CN 110019740 B CN110019740 B CN 110019740B
- Authority
- CN
- China
- Prior art keywords
- user
- driving behavior
- voice
- vehicle
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 66
- 230000003993 interaction Effects 0.000 title claims abstract description 30
- 230000002452 interceptive effect Effects 0.000 claims abstract description 11
- 230000006399 behavior Effects 0.000 claims description 160
- 230000008451 emotion Effects 0.000 claims description 19
- 238000004891 communication Methods 0.000 claims description 17
- 238000012545 processing Methods 0.000 claims description 8
- 238000013507 mapping Methods 0.000 claims description 6
- 238000004590 computer program Methods 0.000 claims description 3
- 230000004044 response Effects 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 238000013461 design Methods 0.000 description 3
- 230000036651 mood Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000002650 habitual effect Effects 0.000 description 2
- 206010039203 Road traffic accident Diseases 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000001914 calming effect Effects 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000000446 fuel Substances 0.000 description 1
- 238000007306 functionalization reaction Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/332—Query formulation
- G06F16/3329—Natural language query formulation or dialogue systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/3331—Query processing
- G06F16/334—Query execution
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computational Linguistics (AREA)
- Mathematical Physics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Artificial Intelligence (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Navigation (AREA)
Abstract
An interaction method of a vehicle-mounted terminal, the vehicle-mounted terminal and a server are provided. The interaction method comprises the following steps: acquiring driving behavior state information of a user; comparing the driving behavior state information with the driving behavior habit data of the user; determining driving behavior habit data corresponding to the driving behavior state information based on the comparison result; and outputting interactive information to the user based on the driving behavior habit data. The interaction method provided by the embodiment of the disclosure can interact with the user according to the user habit and the driving state, so that the interaction is more intelligent, and the user experience is improved.
Description
Technical Field
The embodiment of the disclosure relates to an interaction method of a vehicle-mounted terminal, the vehicle-mounted terminal and a server corresponding to the method, and a nonvolatile storage medium.
Background
In the development process of modern automobiles, the driving stability of a user is improved by utilizing the multi-functionalization of a vehicle-mounted terminal, and meanwhile, the improvement of the driving experience degree of the user in the driving process becomes an important standard for measuring the superior performance of the automobiles. For example, the vehicle-mounted terminal broadcasting station of the automobile can help a user to obtain the latest information, and music playing is helpful for relieving the tension of the user; the vehicle-mounted navigation system can help a user to obtain the latest road condition information, the optimal navigation route and the like when the user goes out.
The multifunctional operation of the vehicle-mounted terminal also means that the user operates multiple steps in the using process, and the attention of the user in driving is dispersed to a certain extent, so that potential safety hazards are caused. The voice navigation based on the voice recognition system also starts to enter the market, and the voice recognition system can release both hands and eyes of a driver to a great extent, so that the driving concentration of the user is improved, and the driving safety is improved. However, although the conventional voice navigation system can receive voice information, it can receive only an instruction sentence, and thus, it is not sufficient for actual scene communication. Moreover, the existing voice navigation system can only navigate according to the requirements of users, intelligent interaction cannot be realized, and user experience is influenced to a certain extent.
Disclosure of Invention
An object of the embodiments of the present disclosure is to provide an interaction method for a vehicle-mounted terminal, a server, and a storage medium, so as to solve the above technical problems.
According to at least one embodiment of the present disclosure, an interaction method of a vehicle-mounted terminal is provided, which includes: acquiring driving behavior state information of a user; comparing the driving behavior state information with the driving behavior habit data of the user; determining driving behavior habit data corresponding to the driving behavior state information based on the comparison result; and outputting interactive information to the user based on the driving behavior habit data.
For example, the driving behavior state information includes voice information input to the vehicle-mounted terminal, and the acquiring the driving behavior state information of the user includes: and receiving voice input of a user, and processing the input voice to obtain the voice information.
For example, the voice information includes volume information, the driving behavior habit data includes habit volume data, and the step of comparing the driving behavior state information with the driving behavior habit data of the user includes: and comparing the volume information with the habit volume data of the user.
For example, the step of determining information corresponding to the driving behavior state information based on the comparison result includes: determining an emotion of the user based on the comparison result; determining a voice and/or an image corresponding to the emotion based on the emotion of the user; the step of outputting interactive information to the user based on the driving behavior habit data comprises the following steps: and outputting voice and/or images corresponding to the emotion to the user.
For example, the processing the input voice to obtain the voice information includes: recognizing voice input by a user, and determining identification information of the user according to a recognition result; determining a voice instruction set corresponding to the user based on the identification information, wherein the voice instruction set comprises a mapping relation between input voice and corresponding voice information; and converting the input voice into the voice information based on the mapping relation.
For example, the driving behavior state information includes: at least one of driving parameters, driving routes and operation instructions for the vehicle-mounted terminal in the process from vehicle starting to vehicle stopping, wherein the step of determining driving behavior habit data corresponding to the driving behavior state information based on the comparison result comprises the following steps: determining driving behavior habit data matched with the driving behavior state information based on the comparison result; the step of outputting interactive information to the user based on the driving behavior habit data comprises the following steps: and outputting prompt information whether to execute the behavior corresponding to the driving behavior habit data to a user.
For example, the operation instruction to the vehicle-mounted terminal includes a driving route navigation instruction, and the step of determining driving behavior habit data matched with the driving behavior state information based on the comparison result includes: determining whether the driving routes include a first route based on the comparison result, wherein the first route is the time when a vehicle with the vehicle-mounted terminal passes through a road section corresponding to the route for more than a preset number of times, and the step of outputting prompt information whether to execute the behavior corresponding to the driving behavior habit data to the user comprises the following steps: and outputting prompt information whether to reduce navigation voice prompt when the user approaches the first route.
For example, the interaction method further comprises: and acquiring a reply of the user to the output prompt message, and determining whether to send an execution instruction related to the prompt message or not based on the reply.
For example, before the step of comparing the driving behavior state information with the driving behavior habit data of the user, the method further includes: determining a driving behavior habit favorite library corresponding to the user based on the driving behavior state information of the user; and storing the driving behavior state information of the user into the driving behavior habit favorite library.
For example, after the step of storing the driving behavior state information of the user in the driving behavior habit preferences library, the method further includes: and analyzing the data in the driving behavior habit preference library to determine the driving behavior habit data of the user.
For example, the driving behavior state information of the user includes voice information, and when the driving behavior habit preference library corresponding to the user cannot be determined based on the voice information, the driving behavior habit preference library corresponding to the voice information is established.
For example, the vehicle-mounted terminal is in signal connection with a server, and the method further comprises: and sending the driving behavior habit favorite library to the server.
For example, the interaction method further comprises: and receiving driving behavior habit data sent by the server, wherein the driving behavior habit data is obtained by analyzing a habit preference database received from the vehicle-mounted terminal by the server.
For example, the interaction method further comprises: receiving driving sharing data sent by the server, and matching the vehicle position with the driving sharing data; and outputting the driving sharing data matched with the vehicle position to the user based on the matching result.
For example, the step of acquiring the driving behavior state information of the user includes: acquiring user voice information; the method further comprises the following steps: when it is determined that the voice information of the user includes at least two destinations, a navigation route to or to the at least two destinations is determined, and the navigation route is output to the user.
For example, the step of acquiring the driving behavior state information of the user includes: acquiring user voice information; the method further comprises the following steps: and when the voice information of the user is determined to include the driving avoiding place, determining a navigation route which does not pass through the avoiding place, and outputting the navigation route to the user.
For example, the driving behavior habit data includes communication takeover data of the vehicle-mounted terminal to the mobile terminal, and the step of determining the driving behavior habit data corresponding to the driving behavior state information based on the comparison result includes: determining the communication takeover data corresponding to the driving behavior state information based on the comparison result; the step of outputting interactive information to the user based on the driving behavior habit data comprises the following steps: and outputting the prompt information of the communication takeover to the user, and outputting the prompt information of whether to start the communication event to the user when the user answers the output prompt information affirmatively and receives a communication signal instruction of the mobile terminal.
According to at least one embodiment of the present disclosure, there is also provided a vehicle-mounted terminal including: the memory stores instructions, and the processor executes the instructions to execute the interaction method.
According to at least one embodiment of the present disclosure, there is also provided a computer-executable non-volatile storage medium, in which computer program instructions are stored, which when executed by a processor perform the aforementioned interaction method.
According to at least one embodiment of the present disclosure, there is also provided a server in signal connection with a vehicle-mounted terminal, the server including a memory, and a processor, the processor executing program instructions in the memory to perform: receiving a driving behavior habit preference library sent by the vehicle-mounted terminal, and processing the driving behavior preference library to obtain driving behavior habit data; and sending the driving behavior habit data to the vehicle-mounted terminal.
For example, the server is in signal connection with a plurality of vehicle-mounted terminals, and the processor, when executing the program instructions in the memory, further executes: receiving the driving behavior habit preference libraries sent by the plurality of vehicle-mounted terminals, and processing the driving behavior habit preference libraries to obtain driving sharing data; and receiving a request of at least one vehicle-mounted terminal of the plurality of vehicle-mounted terminals, and sending the driving sharing data corresponding to the request to the vehicle-mounted terminals based on the request.
The interaction method provided by the embodiment of the disclosure can interact with the user according to the user habit and the driving state, so that the interaction is more intelligent, and the user experience is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings used in the description of the embodiments will be briefly introduced below. The drawings in the following description are merely exemplary embodiments of the disclosure.
FIG. 1 shows a flowchart of an interaction method of a vehicle terminal according to an embodiment of the present disclosure;
FIG. 2 shows a schematic structural diagram of a vehicle terminal according to an embodiment of the present disclosure;
FIG. 3 shows a schematic structural diagram of a server according to an embodiment of the present disclosure;
FIG. 4 shows a flow diagram of a method performed by a processor in the server when executing instructions in the memory;
fig. 5 shows a schematic diagram of a server and a vehicle-mounted terminal connection according to an embodiment of the disclosure.
Detailed Description
Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. Note that in the present specification and the drawings, steps and elements having substantially the same structure are denoted by the same reference numerals, and repeated explanation of the steps and elements will be omitted.
In the following embodiments of the present disclosure, the in-vehicle terminal refers to an electronic terminal on a vehicle, a system capable of interacting with a user having a microprocessor.
Fig. 1 depicts a flowchart of an interaction method 100 of a vehicle terminal according to one embodiment of the present disclosure. An interaction method of an embodiment of the present disclosure will be described below with reference to fig. 1. Referring to fig. 1, the interaction method 100 of the in-vehicle terminal includes steps S101-S104.
In step S101, driving behavior state information of the user is acquired.
In step S102, the driving behavior state information is compared with the driving behavior habit data of the user.
In step S103, the driving behavior habit data corresponding to the driving behavior state information is determined based on the comparison result.
In step S104, interactive information is output to the user based on the driving behavior habit data.
According to an example of the present disclosure, the user driving behavior state information includes, for example, a current emotion of the user, voice input by the user, driving parameter information during a process from start to stop of the vehicle, driving behavior of the user, and the like. The current mood of the user for example comprises a positive mood and a negative mood, for example being happy or angry. The voice input by the user includes, for example, the user inputting voice information such as "drive a car", "drive an air conditioner", "go to a company", and the like. The driving behavior of the user includes, for example, a behavior of opening a door of the user, a behavior of starting an engine by the user, a behavior of stopping a vehicle by the user, and the like. The driving parameter information of the user from the vehicle starting to the vehicle stopping process includes, for example, the current geographical position information of the vehicle, the vehicle driving speed, the fuel consumption and other parameters.
For example, when the driving behavior state information is voice information input to the in-vehicle terminal, the voice input of the user may be received in step S101, and the input voice may be processed to obtain the voice information. The voice input is, for example, a voice analog signal of the user's original voice, and the voice information is, for example, a computer instruction such as a binary code that can be recognized by the in-vehicle terminal.
For example, a voice input of a user may be received through a microphone, the voice input of the user may be voice-recognized through voice recognition software, the input voice may be converted into a voice text according to a recognition result, and then the voice text may be converted into voice information. For example, since each user is different in habits, different voices may be input for the same instruction, and in this example, the voices input by the users may be converted into voice texts, keywords may be extracted from the voice texts, and voice information that can be recognized by the in-vehicle terminal may be generated based on the keywords. For example, for the command of "open WIFI (wireless fidelity)", the user may input "connect wireless network", "open hotspot", etc., and these input voices may be processed and then uniformly converted into voice information of "open WIFI".
For example, the microphone may receive a voice input from the user, perform voice recognition on the voice input from the user, and determine identification information of the user according to the recognition result, where the identification information is, for example, a name of the user, user identity information, a user id (identification), and the like. A set of voice instructions corresponding to the user is then determined based on the identification information. The voice instruction set includes, for example, a mapping relationship of an input voice and corresponding voice information. The input speech is then converted into speech information based on the mapping relationship. For example, because the voice intonations and words of users in different dialects are different, in order to avoid recognizing and judging the input voice every time and improve the recognition speed, when receiving the voice input, whether the voice input user is the voice user registered in the vehicle-mounted terminal before can be determined according to the recognized voice characteristics, if so, the voice information matched with the voice input by the user is directly found in the voice instruction set of the user, and the vehicle-mounted terminal is controlled by using the matched voice instruction. Therefore, the requirements of users in different dialects can be met, and the situations of low recognition speed, low efficiency and the like caused by nonstandard voice are avoided.
Compared with the prior art, the voice instructions adopted by the existing voice navigation system are uniformly set when leaving a factory, and a user does not need to skillfully master the specific voice instructions corresponding to the functions, so that the output accuracy of the voice instructions of the user and the recognition sensitivity of the voice recognition system to the instructions are improved, the convenience of the actual use of the voice recognition system is improved, and the user experience is improved.
Further, according to an example of the present disclosure, the voice information includes voice volume information of the user, and the driving behavior habit data includes habit volume data. The habitual volume data are obtained by the vehicle-mounted terminal according to the voice information input by the user and acquired each time. For example, an average value of the history volume, or the volume before the start of driving, or the like may be used as the habit volume data. For example, volume effect levels may include whisper, normal, loud, and yelling. In step S102, when the driving behavior state information is compared with the driving behavior habit data of the user, the volume information may be compared with the habit volume data of the user. And determines the emotion of the user based on the comparison result in step S103. For example, if the volume input is greater than the user's habitual average volume data, it may indicate that the user is angry. Also for example, when the volume of a user (e.g., a driver) is detected in a "loud" or "shouting" mode, the emotion of the user is determined to be "anger" for negative emotions. If the user is a new user, the voice information of the new user needs to be acquired for many times to determine the normal volume of the new user. In step S104, based on the driving behavior habit data, a voice and/or an image corresponding to the emotion is output to the user. For example, if the emotion is a negative emotion, such as anger, the speech and/or image corresponding to the emotion includes: voices and/or images capable of calming down the negative emotion, or voices and/or images preferred by the user. Such as a soothing volume or music that the user regularly listens to at ordinary times. For example, the vehicle-mounted terminal may play a voice to inform the user of the driving danger when the user is angry, so as to remind the user of concentrating on driving. Therefore, the emotion of the user can be quickly restored as much as possible, and traffic accidents caused by negative emotion are avoided.
According to an example of the present disclosure, if the driving behavior state information is driving parameters (e.g., time to turn on the engine, vehicle speed, acceleration) during the period from the vehicle start to the vehicle stop, a driving route (e.g., a position in a navigation map, an origin, a destination), or an operation instruction to the in-vehicle terminal (e.g., music on, air conditioner on, radio, etc.), driving behavior habit data matching the driving parameters or the operation instruction may be determined based on the comparison result in step S103. For example, when the time when the user turns on the vehicle is the working time in the user habit data, the user driving behavior habit data corresponding to the time, for example, habit data that the driving destination is a company, is determined, and the habit data of turning on the radio immediately after the user gets on the vehicle. And after the habit data is determined, outputting prompt information whether to execute the behavior corresponding to the driving behavior habit data to the user based on the driving behavior habit data. For example, when the user starts the engine to go out from home to a company at 7 points per day, the in-vehicle terminal outputs a prompt to the user whether to navigate to the company. For example, when the user inputs voice "navigation" after turning on the in-vehicle terminal, a prompt is output to the user whether to navigate to the company's route. When the user starts the engine, a prompt whether to start the radio is output to the user. And then, the vehicle-mounted terminal performs corresponding navigation action or radio starting action according to the answer of the user. Therefore, interaction with the user is carried out according to the user habits, the user operation can be reduced, the user can control the vehicle-mounted terminal through the voice command, and the user experience is improved.
According to one example of the present disclosure, the operation instruction to the in-vehicle terminal includes a driving route navigation instruction. Then, in step S103, it may be determined whether the driving route includes a first route, which is a route corresponding to which the vehicle in which the vehicle-mounted terminal is located passes more than a preset number of times, based on the comparison result. For example, a route that passes a segment in the route more than a first number of times, e.g., 3-5 times. If the first route is passed, the user is very familiar with the road section, and in order to avoid providing navigation information when the user is familiar with the road section and disturbing driving of the user, prompt information of whether to reduce the navigation voice prompt when the user is passing the first route can be output to the user. Thereby reducing the influence of the navigation voice on the user. If the route is the second route which is routed more than the second number of times, for example, 10 times, a prompt message whether to stop the voice navigation on the route may be output to the user, thereby avoiding unnecessary prompts.
In addition, when the user is about to reach the destination (for example, 1-2 kilometers away from the destination) after the user behavior data is compared with the user habit data, a parking lot where the user frequently parks is obtained according to the habit data in the user habit preference library, and inquiry information whether to navigate to the parking lot is output to the user. And recommending hotels and entertainment places near the parking lot to the user, and performing corresponding navigation according to the response of the user. For example, after the user inputs a certain destination, the vehicle-mounted terminal enters a destination search interface to search, and if no result the user wants is available, the user can browse by inputting a voice command of "previous page" or "next page" by voice. If not, the user can input the voice command of 'new search' by voice to search again.
In addition, according to an example, the user may select a planned navigation route scheme stored in the in-vehicle terminal by inputting "a certain route" by voice.
In addition, after the prompt message is sent to the user, the reply of the user to the output prompt message can be further acquired, and whether to send the execution instruction related to the prompt message is determined based on the reply. For example, when the user inputs a certain address by voice, in order to avoid a voice input error, the in-vehicle terminal may output confirmation information for confirming whether the address is the address to the user, and perform a corresponding operation when the voice input by the user is confirmed, such as "yes". When the user replies with a negative voice of "not yes", the user is requested to re-input the voice or another voice-like address is provided for the user to refer to.
Furthermore, according to an example of the present disclosure, before step S102, that is, before comparing the driving behavior state information with the driving behavior habit data of the user, the established driving behavior habit preference library of the user may be obtained first. For example, after the user starts using the in-vehicle terminal, the driving behavior habit database corresponding to the user is determined based on the driving behavior state information of the user, and the habit data corresponding to the user is found from the habit database. And storing the driving behavior state information of the user acquired each time into a driving behavior habit favorite library, and updating the habit favorite library. For example, the habit data of the user on the in-vehicle terminal is entered into the habit database every time, and the habit database is updated. The habit-like library used correspondingly is ensured to be the latest habit-like library, and the method is suitable for the continuously updated use habits of the users.
In addition, according to an example of the present disclosure, after the driving behavior state information of the user is stored in the driving behavior habit preference library, data in the driving behavior habit preference library may be further analyzed to determine driving behavior habit data of the user. For example, after acquiring the driving behavior state information of the user, the in-vehicle terminal stores the driving behavior state information into the driving behavior habit preference library. And then analyzing all data in the habit preference library, or analyzing data in recent preset time (for example, one month and three months), and obtaining driving behavior habit data of the user according to the analysis result, so that the habit data is the recent habit of the user.
In addition, according to an example of the present disclosure, the driving behavior state information of the user is voice information, and when the vehicle-mounted terminal cannot determine the driving behavior habit preference library corresponding to the user based on the voice information, for example, it is determined that the user does not have the corresponding habit preference library according to the voice, and therefore, when the vehicle-mounted terminal is a new user, the driving behavior habit preference library corresponding to the voice information may be established. For example, when the user uses the vehicle-mounted terminal for the first time, the vehicle-mounted terminal does not have the driving behavior habit preference library corresponding to the user at this time, and the default popular habit data may be adopted to generate the habit preference library as the habit preference library of the new user.
In addition, in the foregoing embodiment, the in-vehicle terminal itself analyzes the data in the habit preferences library. In order to reduce the burden of the vehicle-mounted terminal, in one example, the vehicle-mounted terminal can be in signal connection with the server and sends the driving behavior preference library to the server. And the server side is responsible for analyzing the data in the habit and taste library and sending an analysis result to the vehicle-mounted terminal for use.
In one example, the vehicle-mounted terminal may receive driving behavior habit data sent by the server, and the driving behavior habit data is obtained by analyzing the habit preferences library received from the vehicle-mounted terminal by the server. The vehicle-mounted terminal can directly use the driving behavior habit data sent by the server to judge the driving behavior of the user.
In addition, according to an example of the present disclosure, after connecting with the server, the vehicle-mounted terminal may further receive driving share data sent by the server. For example, the server may be connected to one in-vehicle terminal or a plurality of in-vehicle terminals. Fig. 5 shows a schematic diagram of a server and a vehicle-mounted terminal connection according to an embodiment of the disclosure. Referring to fig. 5, one server 300 may connect a plurality of in-vehicle terminals 200. And the server stores the data sent by the vehicle-mounted terminal, and analyzes useful data as shared data according to the big data. The shared data is, for example, a parking lot near the geographic location, a nearby hotel, etc. The vehicle-mounted terminal can match the vehicle position with the driving sharing data sent by the server, and based on a matching result, the driving sharing data matched with the vehicle position are output to the user. For example, by location matching, parking lots in the shared data about the vicinity of the geographic location are found. By using the shared data, the useful information of a plurality of vehicle-mounted terminals can be gathered, and the travel of each user is facilitated.
According to an example of the present disclosure, a plurality of pieces of voice information of a user or a plurality of pieces of voice information in one piece of voice information may be acquired in step S101; when it is determined that at least two destinations are included in the user voice information, for example, when a certain destination needs to be reached again by going to a certain place, the vehicle-mounted terminal may determine a route or a navigation route to the two destinations, and output the navigation route to the user.
According to an example of the present disclosure, after the voice information of the user is acquired in step S101, when it is determined that the navigation requirement in the voice information of the user includes an avoidance point of a driving, a navigation route that does not pass through the avoidance point may be determined according to the requirement of the user, and the navigation route may be output to the user.
The navigation systems in the two examples can design the navigation route according to the requirements of the user, so that different requirements of the user are met, and the user experience is improved.
According to an example of the present disclosure, the driving behavior habit data may further include communication takeover data of the mobile terminal by the vehicle-mounted terminal. For example, a user may associate a cell phone with a vehicle terminal via bluetooth. When the mobile phone receives the short message, the WeChat or receives the call, the mobile phone sends the signal to the vehicle-mounted terminal through the Bluetooth, and the vehicle-mounted terminal takes over the event generated on the mobile phone. In this way, in step S103, the in-vehicle terminal may determine the communication takeover data corresponding to the driving behavior state information based on the comparison of the driving behavior of the user with the habit preferences library. For example, if the user turns on the engine and is accustomed to associate the mobile phone with the vehicle-mounted terminal to request the vehicle-mounted terminal to take over the incoming call event and the short message event, in step S104, the vehicle-mounted terminal may output a prompt message for taking over the communication to the user based on the driving behavior habit data. For example, after the user turns on the engine, inquiry information about whether to associate with the vehicle-mounted terminal through bluetooth is output to the user, and whether to take over an incoming call event and a short message event.
When the user answers the output prompt message in the affirmative, the vehicle-mounted terminal sends an instruction to the Bluetooth device to establish association with the mobile phone. When receiving the communication signal instruction of the mobile terminal, outputting prompt information whether to start a communication event to the user. For example, when an incoming call event occurs on the mobile phone of the user, the mobile phone automatically sends the incoming call event to the vehicle-mounted device through the bluetooth, and the vehicle-mounted device can display incoming call information on a display screen and output inquiry information whether to answer the call to the user. After that, the in-vehicle apparatus makes a call or hangs up the call according to the user's response. Therefore, the event of the mobile terminal of the user is taken over through the vehicle-mounted terminal, the user can conveniently answer the call without operating any key when driving the vehicle and only needs to interact with the vehicle-mounted terminal, the use of the communication terminal by the user when driving the vehicle is facilitated, and the risk caused by calling during driving the vehicle is reduced.
The interaction method provided by the embodiment of the disclosure can interact with the user according to the user habit and the driving state, so that the interaction is more intelligent, and the user experience is improved.
The interaction method of the vehicle-mounted terminal according to the embodiment of the disclosure is introduced above, and the vehicle-mounted terminal corresponding to the interaction method is further introduced below. The vehicle-mounted terminal is the same as the vehicle-mounted terminal in the method, and specific reference can be made to all the embodiments. For the sake of brevity of this description, only a brief description will be provided below. Fig. 2 shows a schematic structural diagram of a vehicle-mounted terminal according to an embodiment of the present disclosure. Referring to fig. 2, the in-vehicle terminal 200 includes a memory 210 and a processor 220. The memory 210 is used for storing instructions, and the processor 220 executes the instructions in the memory 210 and performs the interaction method of the foregoing embodiment.
There is also provided, in accordance with at least one embodiment of the present disclosure, a computer-executable non-volatile storage medium having computer program instructions stored therein, which when executed by a processor in a computer, perform all of the embodiments of the aforementioned interaction method.
The server signal-connected to the in-vehicle terminal in the foregoing embodiment will be further described below. The server is the same as the server in all the embodiments described above, and for the brevity of the description, only a brief description is given below, and the specific functions of the server are referred to all the embodiments of the interaction method described above. Fig. 3 shows a schematic structural diagram of a server according to an embodiment of the present disclosure. Figure 4 shows a flow chart of a method performed when a processor in the server executes instructions in the memory. Referring to fig. 3 and 4, server 300 includes memory 310, processor 320, and when processor 320 executes program instructions in memory 310, steps S401-S403 of fig. 4 are performed.
In step S401, the driving behavior preference library transmitted by the in-vehicle terminal is received.
In step S402, the driving behavior preference library is processed to obtain driving behavior data.
In step S403, the driving behavior habit data is transmitted to the in-vehicle terminal.
According to an example of the present disclosure, referring to fig. 5, the server 300 is in signal connection with a plurality of in-vehicle terminals 200, and when the processor in the server 300 executes the program instructions in the memory, the following steps are further performed: the method comprises the steps of receiving a driving behavior habit preference library sent by a plurality of vehicle-mounted terminals, and processing the driving behavior habit preference library to obtain driving sharing data; the method comprises the steps of receiving a request of at least one vehicle-mounted terminal of a plurality of vehicle-mounted terminals, and sending driving sharing data corresponding to the request to the vehicle-mounted terminals based on the request.
The server in the embodiment of the disclosure can analyze and process the data sent by the vehicle-mounted terminal and then send the data to the vehicle-mounted terminal, so that the resources of the vehicle-mounted terminal are saved, and the data processing efficiency is improved.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both. And the software modules may be disposed in any form of computer storage media. To clearly illustrate this interchangeability of hardware and software, various illustrative components and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.
Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions are possible in the present disclosure depending on design requirements and other factors, provided they come within the scope of the appended claims and their equivalents.
Claims (18)
1. An interaction method of a vehicle-mounted terminal comprises the following steps:
acquiring driving behavior state information of a user;
comparing the driving behavior state information with the driving behavior habit data of the user;
determining driving behavior habit data corresponding to the driving behavior state information based on the comparison result;
outputting interactive information to a user based on the driving behavior habit data;
wherein the driving behavior state information comprises an operation instruction for the vehicle-mounted terminal, the operation instruction for the vehicle-mounted terminal comprises a driving route navigation instruction,
the step of determining the driving behavior habit data corresponding to the driving behavior state information based on the comparison result includes:
determining whether the driving route comprises a first route or not based on the comparison result, wherein the first route is formed by the fact that the vehicle where the vehicle-mounted terminal is located passes through a road section corresponding to the route for more than a preset number of times;
the step of outputting interactive information to the user based on the driving behavior habit data comprises the following steps:
and outputting prompt information whether the navigation voice prompt is reduced when the user passes through the first route.
2. The method according to claim 1, wherein the driving behavior state information further includes voice information input to the in-vehicle terminal,
the acquiring of the driving behavior state information of the user comprises the following steps:
and receiving voice input of a user, and processing the input voice to obtain the voice information.
3. The method of claim 2, wherein the voice information includes volume information, the driving behavior habit data includes habit volume data,
the step of comparing the driving behavior state information with the driving behavior habit data of the user comprises:
and comparing the volume information with the habit volume data of the user.
4. The method according to claim 3, wherein the step of determining driving behavior habit data corresponding to the driving behavior state information based on the comparison result further comprises:
determining an emotion of the user based on the comparison result;
determining a voice and/or an image corresponding to the emotion based on the emotion of the user;
the step of outputting interactive information to the user based on the driving behavior habit data comprises the following steps:
and outputting voice and/or images corresponding to the emotion to the user.
5. The method of claim 2, wherein,
the step of processing the input voice to obtain the voice information comprises:
recognizing voice input by a user, and determining identification information of the user according to a recognition result;
determining a voice instruction set corresponding to the user based on the identification information, wherein the voice instruction set comprises a mapping relation between input voice and corresponding voice information;
and converting the input voice into the voice information based on the mapping relation.
6. The method of claim 1, wherein the driving behavior state information further comprises: the driving parameters from the vehicle start to the vehicle stop,
the step of determining the driving behavior habit data corresponding to the driving behavior state information based on the comparison result includes:
determining driving behavior habit data matched with the driving parameters based on the comparison result; the step of outputting interactive information to the user based on the driving behavior habit data comprises the following steps:
and outputting prompt information whether to execute the behavior corresponding to the driving behavior habit data to a user.
7. The method of claim 1 or 6, further comprising:
acquiring the user's response to the output prompt message,
determining whether to send an execution instruction related to the hint information based on the reply.
8. The method of claim 1, wherein prior to the step of comparing the driving behavior state information with the driving behavior habit data of the user, the method further comprises:
determining a driving behavior habit favorite library corresponding to the user based on the driving behavior state information of the user;
and storing the driving behavior state information of the user into the driving behavior habit favorite library.
9. The method of claim 8, wherein after the step of storing the driving behavior state information of the user in the driving behavior habit preferences library, the method further comprises:
and analyzing the data in the driving behavior habit preference library to determine the driving behavior habit data of the user.
10. The method of claim 8, wherein the user driving behavior state information comprises voice information,
and when the driving behavior habit preference library corresponding to the user cannot be determined based on the voice information, establishing the driving behavior habit preference library corresponding to the voice information.
11. The method of claim 8, wherein the in-vehicle terminal is in signal connection with a server,
the method further comprises the following steps:
and sending the driving behavior habit favorite library to the server.
12. The method of claim 11, further comprising:
and receiving driving behavior habit data sent by the server, wherein the driving behavior habit data is obtained by analyzing a habit preference database received from the vehicle-mounted terminal by the server.
13. The method of claim 11 or 12, further comprising:
receiving the driving sharing data sent by the server,
matching the vehicle position with the driving sharing data;
and outputting the driving sharing data matched with the vehicle position to the user based on the matching result.
14. The method of claim 1, wherein,
the step of obtaining the driving behavior state information of the user comprises the following steps:
acquiring user voice information;
the method further comprises the following steps:
when it is determined that the voice information of the user includes at least two destinations,
determining a navigation route to or through the at least two destinations,
outputting the navigation route to the user.
15. The method of claim 1, wherein the first and second light sources are selected from the group consisting of,
the step of acquiring the driving behavior state information of the user comprises the following steps:
acquiring user voice information;
the method further comprises the following steps:
when it is determined that the voice information of the user includes the avoidance driving place,
determining a navigation route that does not pass through the avoided location,
outputting the navigation route to the user.
16. The method of claim 1, wherein the driving behavior habit data comprises communication takeover data of the vehicle-mounted terminal to the mobile terminal,
the step of determining the driving behavior habit data corresponding to the driving behavior state information based on the comparison result includes:
determining the communication takeover data corresponding to the driving behavior state information based on the comparison result;
the step of outputting interactive information to the user based on the driving behavior habit data comprises the following steps:
outputting a prompt message of the communication takeover to a user,
when the user answers the output prompt message affirmatively and receives the communication signal instruction of the mobile terminal, the prompt message of whether to start the communication event is output to the user.
17. An in-vehicle terminal comprising: a memory storing instructions that, when executed by the processor, perform the method of any of claims 1-16.
18. A computer-executable non-volatile storage medium having computer program instructions stored therein which, when executed by a processor, perform the method of any one of claims 1 to 16.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810502872.6A CN110019740B (en) | 2018-05-23 | 2018-05-23 | Interaction method of vehicle-mounted terminal, server and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810502872.6A CN110019740B (en) | 2018-05-23 | 2018-05-23 | Interaction method of vehicle-mounted terminal, server and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110019740A CN110019740A (en) | 2019-07-16 |
| CN110019740B true CN110019740B (en) | 2021-10-01 |
Family
ID=67188319
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810502872.6A Active CN110019740B (en) | 2018-05-23 | 2018-05-23 | Interaction method of vehicle-mounted terminal, server and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110019740B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110376968A (en) * | 2019-07-19 | 2019-10-25 | 上海航盛实业有限公司 | A kind of automotive window kinetic control system |
| CN110503854A (en) * | 2019-08-29 | 2019-11-26 | 重庆交通大学 | A kind of DAS (Driver Assistant System) and method based on zigbee communication protocol |
| CN116829415A (en) * | 2020-12-29 | 2023-09-29 | 武汉路特斯汽车有限公司 | Driver monitoring method for monitoring activities of a driver of a vehicle and vehicle for carrying out said method |
| CN113270096A (en) * | 2021-05-13 | 2021-08-17 | 前海七剑科技(深圳)有限公司 | Voice response method and device, electronic equipment and computer readable storage medium |
| CN115440221B (en) * | 2022-11-09 | 2023-03-24 | 佛山市天地行科技有限公司 | Vehicle-mounted intelligent voice interaction method and system based on cloud computing |
Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101256589A (en) * | 2008-03-31 | 2008-09-03 | 腾讯科技（深圳）有限公司 | Method and system for pushing-sending service information |
| CN101408283A (en) * | 2007-10-12 | 2009-04-15 | 马飞 | Automobile emotion expression lamp and method thereof |
| CN101493334A (en) * | 2009-03-10 | 2009-07-29 | 深圳市凯立德计算机系统技术有限公司 | Navigation system and method thereof for searching peripheral interested points |
| CN101527726A (en) * | 2008-03-05 | 2009-09-09 | 索尼株式会社 | Method and device for personalizing multimedia application |
| CN101616358A (en) * | 2009-07-24 | 2009-12-30 | 深圳市凯立德计算机系统技术有限公司 | A kind of point of interest voice broadcast method and point of interest voice broadcast equipment |
| CN101777253A (en) * | 2009-12-24 | 2010-07-14 | 戴磊 | Real-time road condition acquiring, analyzing and back-feeding and intelligent transportation integrated service system |
| CN102437973A (en) * | 2011-12-24 | 2012-05-02 | 上海量明科技发展有限公司 | Method and system for outputting user information in instant messaging |
| CN102499699A (en) * | 2011-11-10 | 2012-06-20 | 东北大学 | Vehicle-mounted embedded-type road rage driving state detection device based on brain electrical signal and method |
| CN102664031A (en) * | 2011-12-13 | 2012-09-12 | 中华电信股份有限公司 | Music recommendation system and method with navigation characteristic |
| CN102874259A (en) * | 2012-06-15 | 2013-01-16 | 浙江吉利汽车研究院有限公司杭州分公司 | Automobile driver emotion monitoring and automobile control system |
| CN103870529A (en) * | 2012-12-13 | 2014-06-18 | 现代自动车株式会社 | Music recommendation system and method for vehicle |
| CN104354701A (en) * | 2014-10-29 | 2015-02-18 | 云南大学 | Human-car interaction realization method |
| CN105070288A (en) * | 2015-07-02 | 2015-11-18 | 百度在线网络技术（北京）有限公司 | Vehicle-mounted voice instruction recognition method and device |
| CN105513395A (en) * | 2015-11-30 | 2016-04-20 | 华南理工大学 | Intelligent information pushing system and method based on vehicle destination prediction |
| CN105700682A (en) * | 2016-01-08 | 2016-06-22 | 北京乐驾科技有限公司 | Intelligent gender and emotion recognition detection system and method based on vision and voice |
| CN106649843A (en) * | 2016-12-30 | 2017-05-10 | 上海博泰悦臻电子设备制造有限公司 | Media file recommending method and system based on vehicle-mounted terminal and vehicle-mounted terminal |
| CN107204185A (en) * | 2017-05-03 | 2017-09-26 | 深圳车盒子科技有限公司 | Vehicle-mounted voice exchange method, system and computer-readable recording medium |
| CN107729548A (en) * | 2017-01-25 | 2018-02-23 | 问众智能信息科技（北京）有限公司 | LBS search ordering methods and device based on car data |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070048690A1 (en) * | 2005-08-26 | 2007-03-01 | Doron Precision Systems, Inc. | Simulated convex mirrors for driving simulators |
| US8001105B2 (en) * | 2006-06-09 | 2011-08-16 | Ebay Inc. | System and method for keyword extraction and contextual advertisement generation |
-
2018
- 2018-05-23 CN CN201810502872.6A patent/CN110019740B/en active Active
Patent Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101408283A (en) * | 2007-10-12 | 2009-04-15 | 马飞 | Automobile emotion expression lamp and method thereof |
| CN101527726A (en) * | 2008-03-05 | 2009-09-09 | 索尼株式会社 | Method and device for personalizing multimedia application |
| CN101256589A (en) * | 2008-03-31 | 2008-09-03 | 腾讯科技（深圳）有限公司 | Method and system for pushing-sending service information |
| CN101493334A (en) * | 2009-03-10 | 2009-07-29 | 深圳市凯立德计算机系统技术有限公司 | Navigation system and method thereof for searching peripheral interested points |
| CN101616358A (en) * | 2009-07-24 | 2009-12-30 | 深圳市凯立德计算机系统技术有限公司 | A kind of point of interest voice broadcast method and point of interest voice broadcast equipment |
| CN101777253A (en) * | 2009-12-24 | 2010-07-14 | 戴磊 | Real-time road condition acquiring, analyzing and back-feeding and intelligent transportation integrated service system |
| CN102499699A (en) * | 2011-11-10 | 2012-06-20 | 东北大学 | Vehicle-mounted embedded-type road rage driving state detection device based on brain electrical signal and method |
| CN102664031A (en) * | 2011-12-13 | 2012-09-12 | 中华电信股份有限公司 | Music recommendation system and method with navigation characteristic |
| CN102437973A (en) * | 2011-12-24 | 2012-05-02 | 上海量明科技发展有限公司 | Method and system for outputting user information in instant messaging |
| CN102874259A (en) * | 2012-06-15 | 2013-01-16 | 浙江吉利汽车研究院有限公司杭州分公司 | Automobile driver emotion monitoring and automobile control system |
| CN103870529A (en) * | 2012-12-13 | 2014-06-18 | 现代自动车株式会社 | Music recommendation system and method for vehicle |
| CN104354701A (en) * | 2014-10-29 | 2015-02-18 | 云南大学 | Human-car interaction realization method |
| CN105070288A (en) * | 2015-07-02 | 2015-11-18 | 百度在线网络技术（北京）有限公司 | Vehicle-mounted voice instruction recognition method and device |
| CN105513395A (en) * | 2015-11-30 | 2016-04-20 | 华南理工大学 | Intelligent information pushing system and method based on vehicle destination prediction |
| CN105700682A (en) * | 2016-01-08 | 2016-06-22 | 北京乐驾科技有限公司 | Intelligent gender and emotion recognition detection system and method based on vision and voice |
| CN106649843A (en) * | 2016-12-30 | 2017-05-10 | 上海博泰悦臻电子设备制造有限公司 | Media file recommending method and system based on vehicle-mounted terminal and vehicle-mounted terminal |
| CN107729548A (en) * | 2017-01-25 | 2018-02-23 | 问众智能信息科技（北京）有限公司 | LBS search ordering methods and device based on car data |
| CN107204185A (en) * | 2017-05-03 | 2017-09-26 | 深圳车盒子科技有限公司 | Vehicle-mounted voice exchange method, system and computer-readable recording medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110019740A (en) | 2019-07-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110019740B (en) | Interaction method of vehicle-mounted terminal, server and storage medium | |
| CN106816149B (en) | Prioritized content loading for vehicle automatic speech recognition systems | |
| US8909153B2 (en) | Vehicle communications using a mobile device | |
| US10818286B2 (en) | Communication system and method between an on-vehicle voice recognition system and an off-vehicle voice recognition system | |
| CN107305769B (en) | Voice interaction processing method, device, equipment and operating system | |
| US9679562B2 (en) | Managing in vehicle speech interfaces to computer-based cloud services due recognized speech, based on context | |
| US10679620B2 (en) | Speech recognition arbitration logic | |
| JP4304952B2 (en) | On-vehicle controller and program for causing computer to execute operation explanation method thereof | |
| US20140067392A1 (en) | Centralized speech logger analysis | |
| US20130197907A1 (en) | Services identification and initiation for a speech-based interface to a mobile device | |
| US11189274B2 (en) | Dialog processing system, vehicle having the same, dialog processing method | |
| US20140066053A1 (en) | Automatically managing a wireless connection at a mobile device | |
| CN108564945B (en) | Vehicle-mounted voice control method and device, electronic equipment and storage medium | |
| US20220128373A1 (en) | Vehicle and control method thereof | |
| JP7274404B2 (en) | INFORMATION PROVIDING DEVICE, INFORMATION PROVIDING METHOD AND PROGRAM | |
| US10319371B2 (en) | Disambiguation of vehicle speech commands | |
| US20220208187A1 (en) | Information processing device, information processing method, and storage medium | |
| US20090150167A1 (en) | Method for organizing data presented to a user in a vehicle | |
| US11620994B2 (en) | Method for operating and/or controlling a dialog system | |
| WO2023082649A1 (en) | Voice conversation prompting method, apparatus and device, and computer-readable storage medium | |
| CN114530154A (en) | In-vehicle robot, method of operating the same, medium, and computer program product | |
| KR102371513B1 (en) | Dialogue processing apparatus and dialogue processing method | |
| CN111583918A (en) | Voice control method, vehicle-mounted terminal and vehicle | |
| JP6708531B2 (en) | Spoken dialogue device, spoken dialogue method, and spoken dialogue program | |
| CN111731320A (en) | Agent system, agent server, control method thereof, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |