EP3769995B1

EP3769995B1 - Intelligent user manual system for vehicle

Info

Publication number: EP3769995B1
Application number: EP20186959.1A
Authority: EP
Inventors: Baojun Xie; Daniel Yang; William MIAO; Tianyun Chen; Jianyun JIANG
Original assignee: Volvo Car Corp
Current assignee: Volvo Car Corp
Priority date: 2019-07-26
Filing date: 2020-07-21
Publication date: 2024-09-11
Anticipated expiration: 2040-07-21
Also published as: US20210023945A1; US11535101B2; EP3769995A1; CN112307072A

Description

Technical Field

The present invention relates to an intelligent user manual system for vehicles configured to be queried by a user by voice.

Background Art

Various functions have been developed by vehicle manufactures to improve the user experience in using the vehicles. Meanwhile, many new functions, especially electronic functions, are emerging, for example as shown in EP 1 961 606 A2 or DE 10 2007 037 493 A1 . However, a user has to know various functions of the vehicle first before making use of them.
In general, a user learns various functions of the vehicle from the seller's instructions, from a website, from discussions with other vehicle owners, by reading a paper user manual, or by watching a video user manual. The user can certainly obtain comprehensive knowledge of the vehicle functions by reading a paper user manual or watching a video user manual, but this could be time consuming and even tedious. A paper user manual generally comprises hundreds of pages, and a video user may be several hours long, so it is hard for a user to read or watch the full manual. Moreover, even if the user reads or watches the manual, the user may not remember or understand all the functions after all. Thus, many users do not know or understand some of the vehicle functions, which would negatively affect the user experience and their appreciation of their vehicles.
Further, in certain circumstances, a plurality of warning lights or icons are provided in the vehicles. For example, on the dashboard of a vehicle, a warning sign may be displayed to warn the driver of the status of abnormal status of certain functionality of the vehicle, such as engine failure. However, these warning lights are in the form of simple figures or icons, and many users do not know the meaning of them. When a warning light is activated, the user may not know which part of the vehicle is wrong and has to check the user manual to find the answer, which requires time and effort. In addition, if a warning light is activated while the vehicle is in operation, the driver has to keep driving and cannot read or reference the user manual simultaneously.
Thus, it is desired to provide a simple way to query interested vehicle functions or status.

Summary of the Invention

The invention is aimed at providing an intelligent user manual system, according to the subject-matter of claim 1.
In one embodiment, the input module further comprises a user manual input interface.
In one embodiment, the input module is further configured to communicate with an intelligent electronic device in which a corresponding APP is installed.
In one embodiment, the recognition module comprises a voice recognition software.
In one embodiment, the processor module is a module in the vehicle computer, or an individual module communicatively connected with the vehicle computer.
In one embodiment, the output module comprises at least an audio output device.
In one embodiment, the output module further comprises a video output device.
In one embodiment, the output module is further configured to communicate with an intelligent electronic device in which a corresponding APP is installed so that the contents that have been obtained by the processor module can be transmitted to the user via the intelligent electronic device.
In one embodiment, the processor module is configured to output information about a vehicle function that has been obtained from the manual database to the user via the output module.
In one embodiment, the manual database comprises one or more of text, picture, video and voice documents related with vehicle functions.

Brief Description of the Drawings

Figure 1 is a schematic block view of an intelligent user manual system according to an embodiment of the invention; and
Figure 2 is a schematic flow chart of a possible operation of the intelligent user manual system of the invention.

Detailed Description of Preferred Embodiments

Below some embodiments of the intelligent user manual system of the invention are described with reference to the drawings.
Figure 1 schematically shows an example of an intelligent user manual system of the invention, the intelligent user manual system comprises:

an input module 1;
a recognition module 2 in communicative connection with the input module 1 and configured to recognize query instructions which are input by a user via the input module 1;
a processor module 3 in communicative connection with the recognition module 2 and configured to perform a query operation based on the user's query instruction that has been recognized by the recognition module 2;
a manual database 4 in communicative connection with the processor module 3 and configured to be checked by the processor module 3; and
an output module 5 in communicative connection with the processor module 3 and configured to output the contents that the processor module 3 have accessed or checked from the manual database 4.

Optionally, the processor module 3 is further configured to query the activated state of each of warning lights 6 of the vehicle, for example, dashboard warning lights, and so the intelligent user manual system may further comprise:
a state acquiring module 7 in communicative connection with the processor module 3 and configured to acquire a vehicle state corresponding to the activated warning light 6 from the manual database 4.
Further descriptions of examples of the above components are provided below.
First, the manual database 4 comprises a digital file (such as text, picture, video and/or voice documents) about vehicle functions, which is stored in the vehicle computer or a separated in-vehicle memory or a cloud platform that is in wireless communication with the vehicle. The processor module 3 may be configured as a module in the vehicle computer, or be configured as an individual unit that is connected with the vehicle computer so that the processor module 3 can check the manual database 4 and other information from the vehicle computer, the separate memory or the cloud platform.
The input module 1 comprises a voice input device, such as a microphone, mounted in the vehicle for receiving voice input from the user. By using the voice input device, the user can conveniently ask about information he or she wants to know.
Further, the input module 1 may also comprise a user manual input interface (for example, keyboard , touch screen, etc.), such as a manual input interface with a screen mounted in the vehicle. Where a manual input interface with a screen is used, optional items, indication items or the like can be provided when the user manually inputs queries.
Further, the input module 1 may be further configured to interconnect with (for example, via vehicle interconnection system) an intelligent electronic device, such as a mobile phone, in which a corresponding software application ("APP") is installed. The user can input queries by using the intelligent electronic device (by voice or manual input, etc.) via the input module 1.
The recognition module 2 comprises a voice recognition software for recognizing the voice that the user inputted via the input module 1 and transforming the voice into a format that is readable by the processor module 3.
The processor module 3 is configured to read and analyze the user's voice information received from the recognition module 2 as well as information that may be inputted via the optional manual input interface or intelligent electronic device to determine whether the user is asking a question about a vehicle function or a warning light. When the processor module 3 determines that the user is asking a question about a vehicle function, the processor module 3 checks the content explaining the vehicle function from the manual database 4 and then delivers a response (e.g., based on information about the vehicle function) to the user via the output module 5. For example, when the processor module 3 determines that the user is asking a question about a warning light 6, the processor module 3 checks the vehicle state data related to the queried warning light 6 via the state acquiring module 7 (for example, from the vehicle computer, the separated memory or the cloud platform or from a corresponding sensor), possibly also checks the manual database 4, and then reports the detailed information about the vehicle state related to the warning light 6 to the user via the output module 5.
The output module 5 may comprises a voice output device, such as a loudspeaker, mounted in the vehicle. Further, the output module 5 may also comprise a video output device. Where the input module 1 comprises a manual input interface with a screen, the output module 5 may share the same screen with the input module 1.
The output module 5 may be also configured to communicate with the intelligent electronic device with a corresponding APP so that the user's query result can be output via the intelligent electronic device.
The warning lights 6 may include one or more of the warning lights (including icons) on the dashboard and/or warning lights mounted at other locations of the vehicle (inside and/or outside the vehicle). The warning lights represent the status of the vehicle, including one or more general vehicle statuses and abnormal statuses (including malfunctions). The general vehicle status comprises: the amount of fuel, the amount of machine oil, the amount of brake liquid, the amount of coolant, the temperature of the radiator, the state of the brake system, the status of vehicle lights, the activation of various vehicle functions (for example, ABS, ESP, etc.), and the like. The abnormal status comprises: a door being unclosed, a seat belt being unfastened, the manual parking brake unreleased, engine malfunction, battery malfunction, brake pad being in a state to be replaced, too low/high wheel tire pressure, and the like. When the user queries, the processor module 3 can report the corresponding state information to the user via the output module 5. For example, when the user finds that there is a warning light 6 activated, the user may ask "what is wrong with the vehicle?" The voice of the user is received by the input module 1 and then recognized by the recognition module 2. The processor module 3 determines the user's question via the recognition module 2 based on the recognized voice information, and then the processor module 3 checks which warning light 6 is activated and obtains the corresponding vehicle state data related with the activated warning light 6 via the state acquiring module 7. Then, the processor module 3 reports the corresponding vehicle state and a possible treatment or recommended action for the user to take. Alternatively or in addition, once the processor module 3 determines which warning light 6 is activated, the processor module 3 determines the corresponding vehicle state data related with the activated warning light 6 by checking the manual database 4, and optionally, also checks the contents of the treatment or recommended action that user shall take from the manual database 4.
It is noted that the intelligent user manual system of the invention can be activated automatically with the start of the vehicle so the intelligent user manual system can wait for the user's query once the vehicle is started. Alternatively, the intelligent user manual system of the invention is normally closed and comprises an activating element by means of which the user can activate the intelligent user manual system.
Figure 2 schematically shows an exemplary process of how the intelligent user manual system of the invention operates.
First, in Step S1, the intelligent user manual system is activated. The intelligent user manual system is automatically activated with the start of the vehicle, or be activated by the user via the activating element. Once the intelligent user manual system is activated, it is in standby for the user's input of a question.
Next, in Step S2, the processor module 3 of the intelligent user manual system receives a user's input from the recognition module 2, recognizes the user's input and determines that the user has asked a question.
Next, in Step S3, the processor module 3 determines whether the user's question is about a vehicle function or about a warning light. If it determines that the user's question is about a vehicle function, the process goes to Step S4, and if it determines that the user's question is about a warning light, the process goes to Step S5.
In Step S4, the processor module 3 checks the manual database 4 based on the user's question about the vehicle function. In Step S5, the processor module checks which warning light is activated based on the user's question about the warning light, obtains the corresponding vehicle state information, and checks and/or obtains the response to the query in the corresponding content in the manual database 4.
After Step S4 or S5, the process goes to Step S6, in which the processor module 3 outputs the vehicle function queried by the user, or outputs the vehicle state related with the queried warning light (and possibly the treatment or recommended action that the user shall take), via the output module 5.
As described above, in the invention, vehicle functions are stored in the vehicle computer, a separated memory or a cloud platform in the form of a digital file, and input and recognition modules (voice type, etc.) are provided for inputting user's questions. According to the user's question, a technique of the invention includes accessing and checking for information regarding the relevant vehicle function and reported to the user, and possible suggestions and recommendations related to the query result will also be reported to the user. The user can conveniently access the vehicle functions of interest in the vehicle, and eliminates the need to read the paper user manual or watch the video user manual, so the user's time is saved, and the user's experience in using the vehicle is improved.
Further, for the solution that includes querying the warning lights, the user can immediately know the vehicle state, especially abnormal status (including malfunctions), by voice query so the user can take necessary actions in time to improve driving safety.

Claims

An intelligent user manual system for vehicles comprising:
a digital manual database (4) stored in a vehicle computer;

a vehicle state acquiring module (7) included in the vehicle computer;

an input module (1) comprising a voice input device configured to receive a voice input of a user of the vehicle;

a recognition module (2) communicatively connected with the input module (1) and configured to recognize a query input by the user via the input module (1);

a processor module (3) communicatively connected with the recognition module (2), the digital manual database (4) and the vehicle state acquiring module (7), the processor module (3) being configured to determine whether the user's question is about a vehicle function or about a warning light (6); and

an output module (5) communicatively connected with the processor module (3) and configured to output the prepared content from the processor module (3) to the user;

characterized in that, in the condition that the user's query is about a vehicle function, the processor module (3) obtains information about the vehicle function from the digital manual database (4); and in the condition that the user's query is about an activated warning light (6) of the vehicle, the processor module (3) obtains information about a vehicle state related with the activated warning light (6) from both the vehicle state acquiring module (7) and the digital manual database (4) and information about an action for the user to take from the digital manual database (4).
The intelligent user manual system of claim 1, wherein the input module (1) further comprises a user manual input interface.
The intelligent user manual system of claim 1 or 2, wherein the input module (1) is further configured to communicate with an intelligent electronic device in which a corresponding APP is installed.
The intelligent user manual system of any one of claims 1 to 3, wherein the recognition module (2) comprises a voice recognition software.
The intelligent user manual system of any one of claims 1 to 4, wherein the processor module (3) is a module in the vehicle computer, or an individual module communicatively connected with the vehicle computer.
The intelligent user manual system of any one of claims 1 to 5, wherein the output module (5) comprises at least an audio output device.
The intelligent user manual system of claim 6, wherein the output module (5) further comprises a video output device.
The intelligent user manual system of claim 6 or 7, wherein the output module (5) is further configured to communicate with an intelligent electronic device in which a corresponding APP is installed so that the contents that have been obtained by the processor module (3) can be transmitted to the user via the intelligent electronic device.
The intelligent user manual system of claim 8, wherein the processor module (3) is configured to determine an action that the user shall take by checking the digital manual database (4), and to output the action that the user should take to the user via the output module (5).
The intelligent user manual system of any one of claims 1 to 9, wherein the digital manual database (4) comprises one or more of text, picture, video and voice documents related with vehicle functions.
The intelligent user manual system of any one of claims 1 to 10, wherein the input module (1) and the output module (5) share an in-vehicle screen.