CN117956084A

CN117956084A - Vehicle interaction method and system based on voice call

Info

Publication number: CN117956084A
Application number: CN202211280029.0A
Authority: CN
Inventors: 杨笑非
Original assignee: Bayerische Motoren Werke AG
Current assignee: Bayerische Motoren Werke AG
Priority date: 2022-10-19
Filing date: 2022-10-19
Publication date: 2024-04-30

Abstract

The invention provides a vehicle interaction method and a system based on voice call, wherein the method comprises the following steps: monitoring whether a preset voice call triggering condition is met; in response to detecting that any one of the voice call trigger conditions is met, initiating a voice call to a called party associated with the met voice call trigger condition via the in-vehicle communication device; and performing corresponding voice interaction with the called party by using the vehicle-mounted artificial intelligence voice assistant according to the voice call triggering condition.

Description

Vehicle interaction method and system based on voice call

Technical Field

The present invention relates to the field of vehicles, and more particularly to a vehicle interaction method and system based on voice calls.

Background

Today, whole-vehicle factories and users are increasingly concerned with how to enhance the user's interactive experience with vehicles, where "artificial intelligence voice assistant" technology (hereinafter "voice assistant") has gradually begun to be applied within vehicles. Current voice assistants are similar in implementation and user experience to the voice assistant functionality implemented on mobile communication devices, and the driver and passengers can control some functions within the vehicle through voice interaction, such as opening/closing/adjusting air conditioning temperature, opening/closing windows/sunroof, opening radio/tuning, playing songs, adjusting volume, etc.

However, the current in-vehicle voice assistants have very limited combinations of functions for telephone calls, only being able to connect to and make or receive calls through bluetooth and mobile communication devices. In addition, when a user is not in the vehicle, the state of his vehicle is often not informed to the user in time.

For this reason, it is desirable to provide a user with an improved way of vehicle interaction.

Disclosure of Invention

This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.

In view of the above problems, the present invention provides a vehicle interaction method and system based on voice call, so that a user can interact with a vehicle through voice call, for example, on one hand, the vehicle can execute certain specific functions through voice interaction in the call, on the other hand, some voice interaction triggering conditions can be preset, and when the vehicle monitors that any triggering condition is met, the vehicle can actively contact the user in a voice call manner. In this way, the user interaction experience is further enhanced, the interaction functions of the vehicle are enriched, some autonomous functions are executed when the vehicle owner is not in the vehicle, and the relationship between the vehicle owner and the vehicle is tighter.

According to one aspect of the present invention, there is provided a method for enabling vehicle interaction based on a voice call, wherein the method comprises: monitoring whether a preset voice call triggering condition is met; in response to detecting that any one of the voice call trigger conditions is met, initiating a voice call to a called party associated with the met voice call trigger condition via the in-vehicle communication device; and performing corresponding voice interaction with the called party by using the vehicle-mounted artificial intelligence voice assistant according to the voice call triggering condition.

According to a further embodiment of the invention, the voice call trigger condition comprises one or more of the following: a vehicle state; the execution condition of the automatic driving task of the vehicle; calendar class reminding; the user defines the reminding event.

According to a further embodiment of the invention, the vehicle state further comprises some or more of the following: a battery power; residual fuel; tire pressure; the door and window opening and closing state; the vehicle body is bumped.

According to a further embodiment of the invention, the vehicle autopilot task execution report further includes some or more of the following: accident is encountered during the running of the automatic driving task; congestion is encountered during the running of an automatic driving task; the automatic driving task cannot be executed; and completion or imminent completion of the autopilot mission.

According to a further embodiment of the invention, the calendar class reminder event further comprises some or more of the following: commemorative day; holidays; and (5) scheduling reminders.

According to a further embodiment of the invention, the user-defined reminder event further comprises some or more of the following: weather reminding; the vehicle is parked for a long time to remind; and prompting the abnormality of the surrounding environment of the vehicle.

According to a further embodiment of the invention, the method further comprises: receiving a voice call from an incoming party via the in-vehicle communication device; receiving the voice call and performing voice interaction with the caller through an artificial intelligence voice assistant; verifying the identity of the caller by speech recognition; responding to the passing of the identity verification of the calling party, analyzing the voice interaction with the calling party to identify a set voice call triggering condition instruction contained in the voice interaction; and setting the voice call trigger condition and a called party associated with the voice call trigger condition based on the identified set voice call trigger condition instruction.

According to yet another aspect of the present invention, there is provided a system for enabling vehicle interaction based on a voice call, wherein the system comprises: a voice call trigger condition monitoring module configured to monitor whether a preset voice call trigger condition is satisfied; a voice call interface configured to be communicatively coupled to a communication device of a vehicle to initiate a voice call to a called party associated with the satisfied voice call trigger condition; and an artificial intelligence voice assistant module configured to perform a corresponding voice interaction with the called party with respect to the voice call trigger condition.

According to a further embodiment of the invention, the voice call interface is further configured to receive a voice call from an incoming party via the in-vehicle communication device; the artificial intelligence voice assistant module is further configured to answer the voice call and to interact with the caller in voice; the system further comprises: an identity recognition module configured to verify the identity of the incoming party by speech recognition; and a voice control module configured to: responding to the passing of the identity verification of the calling party, analyzing the voice interaction with the calling party to identify a set voice call triggering condition instruction contained in the voice interaction; and setting the voice call trigger condition and a called party associated with the voice call trigger condition based on the identified set voice call trigger condition instruction.

According to still another aspect of the present invention, there is provided a vehicle, wherein the vehicle includes: a communication device configured to support a voice call function; a storage device for storing a user profile and voice call trigger conditions; a call processing system, the call processing system being a system for enabling voice call based vehicle interaction as described in the previous aspect of the invention; and a vehicle control system configured to acquire vehicle state information and control the vehicle to perform a corresponding function.

According to a further embodiment of the invention, the vehicle further comprises: an environmental sensor configured to sense a weather change and/or an environmental abnormality outside the vehicle such that the call processing system can determine whether a preset voice call trigger condition is satisfied based on the sensed weather change and/or environmental abnormality.

According to a further embodiment of the invention, the vehicle further comprises: an autopilot system configured to perform autopilot tasks such that the call processing system is able to determine whether preset voice call trigger conditions are met based on autopilot task performance.

According to a further embodiment of the invention, the vehicle further comprises a user interaction interface for a user to set a voice call trigger condition via the user interaction interface.

According to a further embodiment of the invention, the communication device is configured to support SIM card calls as well as VoIP calls.

These and other features and advantages will become apparent upon reading the following detailed description and upon reference to the associated drawings. It is to be understood that both the foregoing general description and the following detailed description are explanatory only and are not restrictive of aspects as claimed.

Drawings

So that the manner in which the above recited features of the present invention can be understood in detail, a more particular description of the invention, briefly summarized above, may be had by reference to embodiments, some of which are illustrated in the appended drawings. It is to be noted, however, that the appended drawings illustrate only certain typical aspects of this invention and are therefore not to be considered limiting of its scope, for the description may admit to other equally effective aspects.

Fig. 1 is a schematic architecture diagram of a vehicle having a call-based interactive control function according to a first embodiment of the present invention.

Fig. 2 is an exemplary block diagram of a system for implementing voice call based vehicle interactions according to a first embodiment of the present invention.

Fig. 3 is a schematic flow chart of a method for enabling voice call based vehicle interaction according to a first embodiment of the invention.

Fig. 4 is a schematic diagram of the architecture of a vehicle having a call-based interactive control function according to a second embodiment of the present invention.

Fig. 5 is an exemplary block diagram of a system for implementing voice call based vehicle interactions according to a second embodiment of the present invention.

Fig. 6 is a schematic flow chart of a method for enabling voice call based vehicle interaction in accordance with a second embodiment of the present invention.

Detailed Description

The features of the present invention will become more apparent from the detailed description set forth below when taken in conjunction with the drawings.

In order to enhance the interaction function of a vehicle and a vehicle owner, the invention provides a human-vehicle interaction scheme capable of being based on voice calling. In one aspect, a user may call his vehicle and have the vehicle perform corresponding functions in a natural language interaction through a voice call. On the other hand, by presetting some voice interaction triggering conditions, when the vehicle monitors that any triggering condition is met, the vehicle can actively contact the user in a voice call mode. It will be appreciated that the two functions of incoming and outgoing voice calls described above may be independent of each other, i.e., the vehicle may support only answering a call, may support only initiating a call, or both answering and initiating a call. To more clearly illustrate the different implementations of the present invention, the following description is directed to an incoming call scenario and an outgoing call scenario, respectively, wherein fig. 1-3 are embodiments directed to an incoming call scenario and fig. 4-6 are embodiments directed to an outgoing call scenario.

Incoming call scenario

Fig. 1 is a schematic architecture diagram of a vehicle having a call-based interactive control function according to a first embodiment of the present invention. As shown in fig. 1, a vehicle 100 for call-based interactive control functions may include a communication device 102, a storage device 104, a call processing system 106, and a vehicle control system 108.

According to one example of the invention, the communication device 102 may have a voice call function, such as by providing a SIM card unit and associated communication module into which a user may insert a SIM card so that the vehicle 100 may have a function similar to a mobile communication device making or receiving calls. In addition, similar call functions may also be implemented through virtual SIM card technology, such as eSIM cards. Thus, from the user's perspective, the vehicle 100 has its own telephone number after insertion of the SIM card, and the user can call his/her vehicle and make a call by dialing the telephone number. Additionally or alternatively, the vehicle 100 may support voice calls in the form of VoIP. For example, the vehicle 100 may have its own contact, stored as a separate contact in the user's VoIP software, for example, as a Skype contact. The user can call his/her vehicle in Skype as if he/she were calling other contacts. In one embodiment, the communication device 102 may support the telephone call functionality described above through a 2G/3G/4G/5G or other cellular data communication module, while also providing Internet access through these communication modules to support VoIP-type voice calls.

The storage device 104 may be any type of storage device for storing computer readable instructions required by the in-vehicle system to perform various functions, as well as various types of data generated and used, such as user profiles and voice call control rights associated with user identities. The user profile may include user identity information as well as user voiceprint information that may be used in voice calls to determine the identity of the calling party by voiceprint recognition techniques. Each user identity may have a different voice call control authority indicating which vehicle control functions the user is allowed to perform by way of a voice call. In one example, all of the vehicle control functions that can be performed by way of a voice call may be maintained in a list, and each user may be allowed to perform some or all of the functions by way of voice call control rights. By this permission control, it is possible to avoid, for example, that a child gives an unsuitable instruction by calling, for example, that a child can be allowed to chat with a voice assistant by calling, play his favorite music, leave a message for his parent, etc., while an adult or owner himself can be allowed to let the vehicle drive automatically to a specified place by calling, etc., thereby avoiding the occurrence of a security accident.

The call processing system 106 is used to implement the voice call based vehicle interactions of the present invention, and the specific architecture of the call processing system 106 is described in further detail below in conjunction with fig. 2. Fig. 2 is an exemplary block diagram of a call processing system for implementing voice call based vehicle interactions according to a first embodiment of the present invention. As shown in fig. 2, call processing system 106 may include a voice call interface 202, an artificial intelligence voice assistant module 204, an identity module 206, and a voice control module 208.

The voice call interface 202 is communicatively coupled to the communication device 102 of the vehicle 100 for receiving a voice call from an incoming party received by the communication device 102 and transmitting an artificial intelligence voice assistant to the communication device 102 as a voice interaction of the voice call recipient, which in turn is transmitted to the incoming party.

The artificial intelligence voice assistant module 204 is configured to answer voice calls and to interact with an incoming party in voice. In one example, the artificial intelligence voice assistant module 204 may be based on any existing AI voice assistant technology as well as AI operator technology (or "robot operator"). Optionally, because each vehicle is typically configured with an artificial intelligence voice assistant module 204 that interacts only with a very limited number of users (e.g., the owners of the vehicles and their family members), the voice assistant can be trained on the language and communication habits of a particular user through integrated machine learning techniques, enabling the voice assistant to more accurately understand the user's intent and to respond more "humanized" to continuously improve the user's experience and satisfaction.

The identity recognition module 206 may be configured to verify the identity of the incoming party by voice recognition. In one example, identification may be achieved through voiceprint recognition techniques. Voiceprint recognition is a well-established biometric technology that distinguishes speaker identity based on the specificity of human voice acoustic features and can be implemented by adding additional voiceprint recognition modules, for example, to existing voice recognition functions. Although the recognition rate of voice print recognition may not be as high as that of the biometric recognition technology such as fingerprint and palm print, the recognition accuracy of voice print recognition is very high, so to speak about 100%, in consideration of the very limited number of users of the vehicle, especially the smaller number of users who will call the vehicle.

The voice control module 208 then parses the voice interaction with the caller to identify the control instructions contained therein after the caller's authentication passes. In one example, the voice control module 208 may perform voice recognition and semantic parsing of received user voice, which may be implemented using any existing voice recognition technology and semantic parsing technology, which may convert Natural Language (Natural Language) input of the user into control instructions/instructions recognizable by the system. The voice control module 208 may then respond based on the identified control instructions and voice call control authority associated with the identity of the incoming party, e.g., where it is determined that the incoming party has authority to execute the control instructions via voice calls, instructions to perform corresponding vehicle functions may be sent to the vehicle control system 108 of the vehicle 100.

It is noted that while the artificial intelligence voice assistant module 204 and the voice control module 208 are described above as two separate modules, wherein the artificial intelligence voice assistant module 204 is more responsible for voice interaction with the caller/user, or more specifically, for generating answer sentences to be used as a human-machine conversation, and the voice control module 208 is more responsible for converting voice input into instructions requiring the functions performed by the vehicle, both modules are provided with voice recognition and semantic processing functions and thus can be integrated together. In addition, the identity module 206 may also be integrated with one or both of the artificial intelligence voice assistant module 204 and the voice control module 208.

In addition, while call processing system 106 is described above as a separate entity, it may be integrated with the on-board system of the vehicle.

Returning to FIG. 1, the vehicle control system 108 may control the vehicle 100 to perform a corresponding function based on the received instructions from the voice control module 208. Functions that may be performed may include, but are not limited to:

(1) Vehicle-mounted air conditioner for opening, closing or adjusting vehicle

The user can control the in-vehicle air conditioner of the vehicle by calling the vehicle. For example, in summer or winter, the vehicle may be allowed to turn on the air conditioner in advance of the user's use. On the other hand, if the time of use changes, the vehicle may also be caused to turn off the air conditioner by a call. Similarly, if desired, the vehicle may be allowed to adjust the set temperature of the air conditioner by a call.

(2) Lighting device for turning on, off or regulating a vehicle

The user may control the lighting devices of the vehicle by calling the vehicle. For example, the front lights of the vehicles can be turned on or the lights can be changed to facilitate the users to find the vehicles in the parking lot, and the lights can be turned on or the light intensity can be changed to provide illumination when the vehicles travel or meet.

(3) Automatically driving the vehicle to a specified place

In the case where the vehicle is equipped with an automatic driving function, the user can cause the vehicle to automatically travel to a specified place by calling the vehicle, for example, automatically travel from a garage to a home entrance to wait.

(4) Playing audio content in a voice call

It may also be attractive for children to interact with the vehicle by making voice calls, but to ensure security, the child may be granted only a small amount of voice call control authority, for example, to have a voice assistant play various audio content such as favorite music, stories, jokes, etc.

(5) Specifying time and/or condition for a vehicle to perform a particular function

The calling not only can make the vehicle execute a certain function immediately, but also can reserve to execute a certain function. For example, a vehicle may be allowed to travel from a garage to a home gate in 8 am on tomorrow. In addition, the vehicle may be designated to perform some function adjustment, for example, the wife may call the vehicle to get the vehicle to the supermarket to buy milk on the way to alert the husband to get home after the husband gets on the bus.

The foregoing merely illustrates some examples of functions that a vehicle may perform, which are not limiting, but rather any other vehicle-executable function may support instructing the vehicle to perform by calling, where appropriate.

Optionally, the vehicle 100 may also include an in-vehicle voice interaction interface for providing voice interaction of the vehicle 100 with the user, such as receiving user voice input to allow the user to interact with the intelligent voice assistant module 204 also in-vehicle through voice. In addition, the voice interaction interface may also allow the user to edit the user profile in the vehicle, such as providing voiceprints or modifying user identity information. In one example, other user identity information besides voiceprints can also be edited via a non-voice interactive interface, such as through a touch-sensitive center screen.

Fig. 3 is a schematic flow chart of a method 300 for enabling voice call based vehicle interactions according to a first embodiment of the invention. The method 300 may be implemented by an on-board system of the vehicle or a separate call processing system.

The method 300 begins at step 302 with receiving a voice call from an incoming party via an in-vehicle communication device. As described previously, the voice call may be in the form of a conventional mobile telephone call or a VoIP call.

Next, at step 304, the voice call is answered and voice interaction with the caller is performed by the artificial intelligence voice assistant. For example, when a user calls his vehicle like a phone call to a friend or other person, the artificial intelligence voice assistant may be configured to listen to the call as answer Fang Laijie to the call and to interact with the user in voice like a real person.

In step 306, the identity of the incoming party is verified by speech recognition. To avoid that an unauthorized user controls the vehicle, takes up lines or consumes resources through this function, the identity of the incoming party may be verified by means of speech recognition techniques, e.g. by comparing voiceprints extracted from the speech input with voiceprints included in a pre-stored user profile. In one example, this verification may be performed in the background, further enhancing the user experience. In addition to verifying identity by speech recognition, this identity verification information may also be provided by prompting the user with speech or keys by means of a user name and password reserved in the user profile. If the authentication is not passed, the call may be aborted. In addition, telephone number blacklist or whitelist mechanisms may also be implemented to avoid attacks or resource consumption by malicious or unintended irrelevant calls. If the authentication passes, the method proceeds to step 308.

In step 308, in response to the authentication of the caller passing, the voice interaction with the caller is parsed to identify the control instructions contained therein. As described previously, the user's intent may be identified through voice recognition techniques and natural language processing techniques, from which the vehicle function the user wishes to perform is determined and converted into corresponding control instructions.

At step 310, a response is made based on the identified control instruction and the voice call control authority associated with the identity of the incoming party. As described previously, it is necessary to determine whether the caller has authority to perform this function by voice call before letting the vehicle execute instructions. When the caller is confirmed to have the right, the control instruction can be sent to the corresponding control mechanism to be executed, or further control can be carried out through the vehicle-mounted system.

Exhale scene

Fig. 4 is a schematic diagram of the architecture of a vehicle having a call-based interactive control function according to a second embodiment of the present invention. The vehicle shown in fig. 4 may have a similar architecture as compared to the architecture of the vehicle in the first embodiment of the invention described in connection with fig. 1, and the vehicle 400 may include a communication device 402, a storage device 404, a call processing system 406, and a vehicle control system 408.

According to this example, the communication device 402 may have a voice call function, such as by providing a SIM card unit and associated communication module into which a user may insert a SIM card so that the vehicle 100 may have a function similar to a mobile communication device to place or receive a call. In addition, similar call functions may also be implemented through virtual SIM card technology, such as eSIM cards. Thus, from the user's perspective, the vehicle 400 has its own telephone number after insertion of the SIM card, from which the user can receive a voice call and make a call. Additionally or alternatively, the vehicle 400 may support voice calls in the form of VoIP. For example, the vehicle 400 may have its own contact, stored as a separate contact in the user's VoIP software, for example, as a Skype contact. The user can receive a call from his/her vehicle in Skype as well as other contacts. In one embodiment, the communication device 402 may support the telephone call functionality described above through a 2G/3G/4G/5G or other cellular data communication module, while also providing Internet access through these communication modules to support VoIP-type voice calls.

The storage device 404 may be any type of storage device for storing computer readable instructions required by the in-vehicle system to perform various functions and various types of data generated and used, such as user profiles and voice call trigger conditions. The user profile may include identity information of the user, such as a respective birthday, anniversary, for each user, and may also include calendar information of the user, such as scheduling, custom reminders, and the like.

The voice call trigger condition may be associated with a user identity for indicating a condition set for a particular user that triggers the vehicle to initiate a voice call to that user. The voice call trigger conditions may include, but are not limited to, the following types:

(1) Vehicle state. The status of the vehicle may generally be sensed by the on-board sensing device and summarized into the on-board control system, and may include:

Battery charge, e.g., low battery or power battery, complete charge, etc.;

Residual fuel, such as low residual oil;

Tire pressure, such as one or more tire leaks;

The door and window opening and closing states of the vehicle, such as broken door, broken window, non-closing window and the like;

the car body is collided, for example, scraped and rubbed in a parking state, objects falling from high altitude and the like; and

Any other state of the vehicle.

(2) And (5) executing the automatic driving task of the vehicle. Some vehicles equipped with certain energy levels of autopilot capability may perform autopilot tasks, herein primarily referring to unmanned situations where the vehicle owner is not in the vehicle, such as, for example, automatic driving of the vehicle from a parking garage to a designated pick-up area, unmanned tasks in a campus, etc., and task performance reporting may include:

Accidents, such as single car, multiple cars, injury of people and the like, occur during the running of the automatic driving task;

congestion is encountered during the running of an automatic driving task, such as congestion at the exit of a parking garage when the vehicle is driven up from the parking garage;

the automatic driving task cannot be executed, for example, a vehicle is blocked, a garage door cannot be opened, unmanned automatic driving conditions are not met, and the like;

The automatic driving task is completed or is about to be completed, for example, the vehicle is started to a pick-up point or a few minutes are required to be started to the pick-up point; and

Any need to report the user's situation in connection with the performance of an autopilot task.

(3) Calendar class reminders. Similar to alerts issued to users at predetermined times by daily calendar, alarm, memo, notepad, etc. applications, the alerts may include:

Commemorative days, such as birthdays, wedding commemorative days, etc.;

holidays, such as spring festival, christmas, etc.;

schedule reminders, such as workday reminders to go to a company, out meeting schedules, travel schedules, user's own alarms set by schedule, etc.; and

Any other similar calendar class reminder.

(4) The user defines the reminder event. The user may also set events that the user wishes to alert himself by the vehicle, including:

weather reminders, such as when the vehicle detects that outdoors begins to rain, snow, high temperature, sun, etc., may remind the user that corresponding preparations are being made;

A long parking reminder, such as that the vehicle has been parked in place for 1 month and not started;

The abnormal reminding of the surrounding environment of the vehicle, such as water leakage, fire disaster, spontaneous combustion of the vehicle and the like, occurs near the parking space where the vehicle is located; and

Other users can freely set reminding events according to the needs.

Returning to fig. 4, call processing system 406 may be used to implement the voice call based vehicle interactions of the present invention, the specific structure of call processing system 406 is described in further detail below in conjunction with fig. 5. Fig. 5 is an exemplary block diagram of a call processing system for implementing voice call based vehicle interactions according to a second embodiment of the present invention. As shown in fig. 5, call processing system 406 may include a voice call trigger condition monitoring module 502, a voice call interface 504, and an artificial intelligence voice assistant module 506.

The voice call trigger condition monitoring module 502 may be configured to monitor whether a preset voice call trigger condition is satisfied. As previously exemplified, the voice call trigger conditions may mainly include several categories of vehicle status anomalies, vehicle automatic driving task execution reports, calendar class reminders, user-defined reminder events, and the like. To monitor these conditions, the voice call trigger condition monitoring module 502 may obtain relevant information from a number of different modules. For example, for a vehicle state anomaly, the voice call trigger condition monitoring module 502 may obtain vehicle state information from an onboard control system to monitor for the presence of the anomaly. For a vehicle autopilot task execution report, the voice call trigger condition monitoring module 502 may obtain information about the execution and completion of the autopilot task from the autopilot system of the vehicle. For calendar class reminders, the voice call trigger condition monitoring module 502 may obtain relevant information from an application maintaining a user's calendar. For user-defined reminder events, the voice call trigger condition monitoring module 502 may also obtain information from related data sources, such as weather and environmental sensing information outside the vehicle from on-board sensors, a vehicle log from on-board control systems to determine vehicle parking time, and so forth. Through the obtained information, the voice call trigger condition monitoring module 502 may compare whether a previously preset value of the voice call trigger condition is met, and if so, initiate a voice call to the associated user through the voice call interface 504 and the artificial intelligence voice assistant module 506 accordingly.

The voice call interface 502 is communicatively coupled to the communication device 402 of the vehicle 400 for initiating a voice call of a user associated with the triggered condition via the communication device 402. It will be appreciated that each voice call trigger condition may have an associated user and their contact. Each user may also have multiple contact addresses so that in an emergency, when one contact address is not available to the user, another contact address may be used to attempt to contact. Alternatively, the default user and its contact may be set such that the default user of the vehicle may be contacted if the trigger condition does not explicitly associate the user.

The artificial intelligence voice assistant module 504 is configured to perform voice interactions with the called party after the outgoing voice call is answered. Similar to the artificial intelligence voice assistant module 204 described in FIG. 2, the artificial intelligence voice assistant module 504 may be based on any existing AI voice assistant technology as well as AI operator technology (or "robot operator"). For preset trigger events, the trainable AI voice assistant communicates related events in natural language with the called party and preferably can provide the user with coping suggestions for those events in the voice call. For example, "it is now rained outdoors, you remember to take an umbrella when going out", "you have driven your loved car out of the garage automatically, you get on the car at the hall entrance after 2 minutes", "you detect that your loved car right front bumper may be scratched, please go to view", and so on.

In addition, the artificial intelligence voice assistant module 504 itself has the capability to directly interact with voice of a user located in the vehicle. Thus, a user may issue an instruction to set a voice call trigger condition while in the vehicle through the artificial intelligence voice assistant module 504. As previously described in connection with fig. 2, the call processing system may similarly be provided with an identity recognition module and a voice control module to recognize the identity of the user and the voice call trigger conditions to be set and record the voice call trigger condition record in association with the user identity. In a scenario where the call processing system has both incoming voice call answering and voice call initiating capabilities, the user may issue an instruction to set a voice call triggering condition by placing a voice call to the vehicle. This is advantageous when the user is not in the vehicle but temporarily thinks that the vehicle is required to handle some event by itself, for example, the user may call the vehicle by calling it to let it call itself when charging is completed.

Returning to FIG. 4, the vehicle control system 408 may obtain vehicle status information and control the vehicle 400 to perform corresponding functions. The vehicle control system 408 may communicate with various sensors of the vehicle 400, collecting and aggregating data and status reports from the sensors. The vehicle status and various anomaly and fault reporting functions are similar to the vehicle fault status reporting mechanisms common in the prior art. Alternatively, the vehicle 400 may include an environmental sensor that senses weather changes and/or environmental anomalies outside the vehicle such that the call processing system 406 is able to determine whether the preset voice call trigger condition is met based on the sensed weather changes and/or environmental anomalies.

In an alternative example, vehicle 400 may include an autopilot system for performing autopilot tasks such that call processing system 406 is able to determine whether preset voice call trigger conditions are met based on autopilot task performance.

In addition, the vehicle 400 may include user interaction interfaces including a voice interaction interface and buttons or touch input interfaces such as dashboards, screens, etc., for a user to edit voice call triggering conditions within the vehicle.

Fig. 6 is a schematic flow chart diagram of a method 600 for enabling voice call based vehicle interactions in accordance with one embodiment of the present invention. The method 600 may be implemented by an on-board system of the vehicle or a separate call processing system. As shown in fig. 6, the method 600 begins at step 602 by monitoring whether a preset voice call trigger condition is met. In response to detecting that any one of the voice call trigger conditions is met, a voice call is initiated via the in-vehicle communication device to a callee associated with the met voice call trigger condition, step 604. At step 606, corresponding voice interactions with the called party regarding voice call triggering conditions are performed by the onboard artificial intelligence voice assistant.

While the foregoing describes a solution and an embodiment for supporting a user to initiate a voice call to a vehicle and supporting a vehicle to initiate a voice call to a user, respectively, it will be appreciated that by integrating the respective modules and functions of the two embodiments, a solution capable of supporting both scenarios may be obtained. For example, the architecture in both schemes is compatible, and the functionality of the call processing system and the artificial intelligence voice assistant module may be integrated such that, for example, a user may issue instructions to the vehicle to set a voice call trigger condition via a voice call, while the call processing system may utilize an identity recognition module (e.g., voiceprint) to recognize the identity of the user and set an associated voice call trigger condition via a voice control module.

The above describes the vehicle interaction method and system based on voice call of the present invention, which has at least the following advantages compared to the prior art:

1. Providing a means for a user to interact with a vehicle through voice calls;

2. The user can use a dialogue mode to enable the vehicle to execute corresponding functions or receive reminding and notification from the vehicle, and compared with a remote control means and a message notification means such as mobile application, the vehicle using experience of the user is improved; and

3. The function of the vehicle-mounted artificial intelligence voice assistant is further enhanced, and support can be provided for more application scenes by effectively combining with a voice calling mode.

What has been described above includes examples of aspects of the claimed subject matter. It is, of course, not possible to describe every conceivable combination of components or methodologies for purposes of describing the claimed subject matter, but one of ordinary skill in the art may recognize that many further combinations and permutations of the claimed subject matter are possible. Accordingly, the disclosed subject matter is intended to embrace all such alterations, modifications and variations that fall within the spirit and scope of the appended claims.

Claims

1. A method for enabling voice call based vehicle interactions, the method comprising:

Monitoring whether a preset voice call triggering condition is met;

In response to detecting that any one of the voice call trigger conditions is met, initiating a voice call to a called party associated with the met voice call trigger condition via the in-vehicle communication device; and

And carrying out corresponding voice interaction with the called party according to the voice call triggering condition through the vehicle-mounted artificial intelligent voice assistant.

2. The method of claim 1, wherein the voice call trigger condition comprises one or more of:

a vehicle state;

The execution condition of the automatic driving task of the vehicle;

Calendar class reminding; and

The user defines the reminder event.

3. The method of claim 2, wherein the vehicle state further comprises some or more of:

A battery power;

Residual fuel;

Tire pressure;

the door and window opening and closing state; and

The vehicle body is crashed.

4. The method of claim 2, wherein the vehicle autopilot mission performance further includes one or more of:

accident is encountered during the running of the automatic driving task;

congestion is encountered during the running of an automatic driving task;

the automatic driving task cannot be executed; and

The autopilot mission is completed or is about to complete.

5. The method of claim 2, wherein calendar class reminder events further comprise some or more of:

Commemorative day;

Holidays; and

Schedule reminders.

6. The method of claim 2, wherein the user-defined reminder event further comprises one or more of:

Weather reminding;

the vehicle is parked for a long time to remind; and

And (5) reminding of abnormal environment around the vehicle.

7. The method of claim 1, wherein the method further comprises:

receiving a voice call from an incoming party via the in-vehicle communication device;

Receiving the voice call and performing voice interaction with the caller through an artificial intelligence voice assistant;

Verifying the identity of the caller by speech recognition;

responding to the passing of the identity verification of the calling party, analyzing the voice interaction with the calling party to identify a set voice call triggering condition instruction contained in the voice interaction; and

The voice call trigger condition and the called party associated with the voice call trigger condition are set based on the identified set voice call trigger condition instruction.

8. A system for enabling voice call based vehicle interactions, the system comprising:

A voice call trigger condition monitoring module configured to monitor whether a preset voice call trigger condition is satisfied;

A voice call interface configured to be communicatively coupled to a communication device of a vehicle to initiate a voice call to a called party associated with the satisfied voice call trigger condition; and

An artificial intelligence voice assistant module configured to perform a corresponding voice interaction with the called party regarding the voice call trigger condition.

9. The system of claim 8, wherein the voice call trigger condition comprises one or more of:

a vehicle state;

The execution condition of the automatic driving task of the vehicle;

Calendar class reminding; and

The user defines the reminder event.

10. The system as recited in claim 8, wherein:

the voice call interface is further configured to receive a voice call from an incoming party via the in-vehicle communication device;

The artificial intelligence voice assistant module is further configured to answer the voice call and to interact with the caller in voice;

The system further comprises:

An identity recognition module configured to verify the identity of the incoming party by speech recognition; and

A voice control module configured to:

11. A vehicle, characterized in that the vehicle comprises:

A communication device configured to support a voice call function;

a storage device for storing a user profile and voice call trigger conditions;

A call processing system, the call processing system being a system for enabling voice call based vehicle interaction as claimed in any one of claims 8-10; and

A vehicle control system configured to acquire vehicle state information and control a vehicle to perform a corresponding function.

12. The vehicle of claim 11, characterized in that the vehicle further comprises:

an environmental sensor configured to sense a weather change and/or an environmental abnormality outside the vehicle such that the call processing system can determine whether a preset voice call trigger condition is satisfied based on the sensed weather change and/or environmental abnormality.

13. The vehicle of claim 11, characterized in that the vehicle further comprises:

an autopilot system configured to perform autopilot tasks such that the call processing system is able to determine whether preset voice call trigger conditions are met based on autopilot task performance.

14. The vehicle of claim 11, further comprising a user interaction interface for a user to set a voice call trigger condition via the user interaction interface.

15. The vehicle of claim 11, wherein the communication device is configured to support SIM card calls as well as VoIP calls.