CN115123084A

CN115123084A - Display device for vehicle

Info

Publication number: CN115123084A
Application number: CN202210157374.9A
Authority: CN
Inventors: 青木夕纪; 村山尚; 河野康一
Original assignee: Honda Motor Co Ltd
Current assignee: Honda Motor Co Ltd
Priority date: 2021-03-24
Filing date: 2022-02-21
Publication date: 2022-09-30
Also published as: JP2022148706A; JP7299262B2

Abstract

A display device (100) for a vehicle, which displays information to an occupant in the driver's seat of the vehicle (1), is provided with: a communication unit (8); a display (4) which is disposed so as to face the driver's seat and extend in the vehicle width direction; and a communication device (10) which is configured to be capable of making a communication through the communication means (8) and capable of displaying on the display (4) an image received from the communication destination through the communication means (8). The communication device (10) is provided with a display control unit (13) which controls the display (4) so that when communication with a communication object through the communication means (8) is started, information of the communication object is displayed on one side of the display (4) in the vehicle width direction, then when communication is permitted from a passenger, the information of the communication object displayed on one side of the display (4) in the vehicle width direction is moved to the other side in the vehicle width direction and displayed, and then, an image of the communication object is displayed on one side of the display (4) in the vehicle width direction.

Description

Display device for vehicle

Technical Field

The present invention relates to a vehicle display device for displaying information to an occupant of a driver's seat of a vehicle.

Background

As such a device, a device for displaying information of a call incoming to a driver of a vehicle is known (for example, see patent document 1). The device described in patent document 1 is connected to a portable device having a telephone function, and when a call is received from the portable device, information such as the name and telephone number of the caller is displayed on a display device provided in an in-vehicle device.

In recent years, vehicles equipped with advanced driving assistance such as automated driving have become widespread. In such a vehicle, it is preferable to transmit various kinds of information to an occupant in a driver seat, which is a main user of the vehicle, through an image screen on a display in order to improve convenience.

Documents of the prior art

Patent document

Patent document 1: japanese patent laid-open publication No. 2016-163176 (JP 2016-163176A).

Disclosure of Invention

One aspect of the present invention is a display device for a vehicle that displays information to an occupant in a driver's seat of the vehicle, the display device including: a communication unit; a display which is disposed so as to face the driver's seat and extend in the vehicle width direction; and a communication device configured to enable communication through the communication means and to display on the display an image received from the communication destination via the communication means. The communication device includes a display control unit that controls the display so that, when communication with a communication target through the communication means is started, information of the communication target is displayed on one side of the display in the vehicle width direction, and then, when permission of communication is instructed by a passenger, the information of the communication target displayed on one side of the display in the vehicle width direction is displayed while moving to the other side of the display in the vehicle width direction, and then, an image of the communication target is displayed on one side of the display in the vehicle width direction.

Drawings

The objects, features and advantages of the present invention are further clarified by the following description of the embodiments in relation to the accompanying drawings.

Fig. 1 is a diagram showing an example of a structure around an instrument panel of a vehicle to which a display device for a vehicle according to an embodiment of the present invention is applied.

Fig. 2 is a block diagram schematically showing the overall configuration of a vehicle display device according to an embodiment of the present invention.

Fig. 3 is a diagram showing an example of a display screen of the display of fig. 1 and 2 when a video call is started.

Fig. 4 is a diagram showing an example of a display screen of the display of fig. 1 and 2 when video call is permitted.

Fig. 5 is a diagram showing an example of a display screen of the display of fig. 1 and 2 during a video call.

Fig. 6 is a diagram showing another example of the display screen of the display of fig. 1 and 2 in a video call.

Fig. 7 is a plan view for explaining a seat arrangement of the vehicle of fig. 1.

Fig. 8 is a diagram showing an example of a display screen of the display of fig. 1 and 2 after the video call is ended.

Fig. 9 is a flowchart illustrating an example of processing executed by the vehicle display device according to the embodiment of the present invention.

Detailed Description

Embodiments of the present invention will be described below with reference to fig. 1 to 9. The display device for a vehicle according to the embodiment of the present invention is applicable to a vehicle having a driver's seat, and particularly to a vehicle having an advanced driving assistance function such as an automatic driving function. Such vehicles include not only vehicles that run only in an automatic driving mode in which driving operation by the driver is not required, but also vehicles that run in an automatic driving mode and in a manual driving mode in which driving operation by the driver is performed.

Fig. 1 is a diagram showing an example of a structure around an instrument panel 1a of a vehicle 1 to which a display device for a vehicle according to an embodiment of the present invention is applied. As shown in fig. 1, an instrument panel 1a is disposed in front of the vehicle interior, and an instrument display 2, rearview mirror displays 3R and 3L, and an information display (hereinafter simply referred to as "display") 4 are provided on the instrument panel 1 a.

The instrument display 2 is disposed on the instrument panel 1a so as to face a driver's seat (in the example of fig. 1, the right side in the vehicle width direction), and displays information related to the state of the vehicle 1 such as the vehicle speed. The mirror displays 3L and 3R are disposed at the vehicle width direction left and right ends of the instrument panel 1a, respectively, and display images and the like corresponding to left and right mirrors that reflect the left and right rear sides of the vehicle 1. The display 4 is disposed in the vicinity of the center in the vehicle width direction between the instrument display 2 and the mirror display 3L on the dashboard 1a, extends in the vehicle width direction, and displays various information to the occupant.

A speaker 5 for outputting sound to an occupant in the driver's seat, an in-vehicle camera 6 for capturing an image of the occupant in the driver's seat, and an input unit 7 (fig. 2) such as a microphone for receiving sound input from the occupant in the driver's seat are provided near the driver's seat in the instrument panel 1 a. The input unit 7 may be configured to include a touch panel, buttons, and the like for accepting operation input, in addition to the microphone.

Various information is displayed on the display 4 in accordance with an instruction from the occupant input through the input unit 7. For example, a navigation screen for setting a destination of the vehicle 1 or guiding a route to the set destination, a video call screen for performing a video chat using a network line or a video call using a telephone line, or the like is displayed. The following specifically describes the video call screen.

Fig. 2 is a block diagram schematically showing the overall configuration of the vehicle display device 100 according to the embodiment of the present invention. As shown in fig. 2, the display device 100 for a vehicle includes a display 4, a speaker 5, an in-vehicle camera 6, an input unit 7, a communication unit 8, and an audio device 10.

The communication device 10 includes a computer having an arithmetic unit 11 such as a CPU (central processing unit), a storage unit 12 such as a ROM (read only memory) or a RAM (random access memory), and other peripheral circuits (not shown) such as an I/O (input/output) interface. The storage unit 12 stores various control programs and information such as thresholds used in the programs. The arithmetic unit 11 has a functional configuration including a display control unit 13 for controlling the display 4.

The communication unit 8 is configured to be able to communicate with a terminal device outside the vehicle via a network including a wireless communication network typified by the internet, a mobile phone network, or the like. The network includes not only a public wireless communication network but also a closed communication network set for each prescribed management area, such as a wireless local area network, Wi-Fi (registered trademark), Bluetooth (registered trademark), and the like.

Information on the image and sound acquired by the in-vehicle camera 6 and the input unit 7 can be transmitted to a terminal device outside the vehicle via the communication unit 8 in accordance with a command from the occupant input through the input unit 7. Further, it is possible to display an image on the display 4 and output a sound from the speaker 5 based on information received from a terminal device outside the vehicle via the communication unit 8.

The telephone communication apparatus 10 is configured to be capable of making a telephone call via the speaker 5, the input unit 7, and the communication means 8, and to be capable of displaying on the display 4 an image received via the communication means 8 from a call partner. The passenger in the driver's seat can make a video call using the call device 10. The display control unit 13 controls the display 4 based on the program stored in the storage unit 12 and the information acquired through the communication unit 8 in accordance with the command from the occupant input through the input unit 7.

Fig. 3 is a diagram showing an example of the display screen D1 of the display 4 when the video call is started. As shown in fig. 3, the display control unit 13 controls the display 4 so that an agent image 40 representing AI (artificial intelligence) agents providing various services to an occupant in the driver seat, which is a main user of the vehicle 1, is displayed on the right end of the display 4 closest to the driver seat in the vehicle width direction. The AI agent provides a service according to the preference of the user based on the user information registered in advance and the user information acquired according to the instruction from the user. For example, in-vehicle contents such as music according to the preference of the user, a destination, a travel route, and the like are recommended to the user (a passenger in the driver's seat) who is seated in the vehicle 1, and the video call with the call target is mediated.

The display control unit 13 controls the display 4 so that the information 41 of the call partner is displayed on the vehicle width direction right side 4R of the display 4 on the driver seat side when the call with the call partner through the communication means 8 is started. More specifically, when the incoming information of the video call is acquired by the communication means 8, the display 4 is controlled so as to display the information 41 of the call destination including the last name, icon image, telephone number, and the like of the originator based on the incoming information. When the input unit 7 instructs the call origination of the video call, the display 4 is controlled so as to display information 41 of the call destination including the name or name of the call destination, an icon image, a telephone number, and the like, based on the contact information registered in advance.

In the video call, since the image of the occupant of the driver seat and the image of the vehicle interior around the occupant are transmitted to the call partner and the image of the call partner is displayed in the vehicle, the detailed information of the originator and the destination of the call partner is displayed before the video call is started, and thus the occupant can be given a sense of safety. Further, since the information 41 of the call partner is displayed on the right side 4R in the vehicle width direction of the display 4 near the driver's seat, it is easy for the passenger of the driver's seat to confirm. In this case, no information is displayed on the vehicle width direction left side 4L of the monitor 4, which is distant from the driver's seat.

Fig. 4 is a diagram showing an example of the display screen D2 of the display 4 when the video call is received by the passenger in the driver's seat, and fig. 5 is a diagram showing an example of the display screen D3 of the display 4 during the video call. For example, an instruction to permit a video call can be input through the input unit 7 in response to a broadcast such as "call to o" from the AI agent output through the speaker 5. As shown in fig. 4, the display control unit 13 controls the monitor 4 so that the call destination information 41 displayed on the vehicle width direction right side 4R of the monitor 4 is moved to the vehicle width direction left side 4L and displayed when the call permission is instructed by the occupant. Thereafter, as shown in fig. 5, the display control unit 13 controls the monitor 4 so that the image 42 of the call partner is displayed on the right side 4R of the monitor 4 in the vehicle width direction.

As shown in fig. 4 and 5, the information 41 of the call target displayed on the display screen D1 before the video call starts moves so as to be displayed without disappearing, and shifts to the display screen D3 in the video call. Therefore, even when it takes time to connect to the call partner after the video call is permitted by the passenger in the driver's seat, for example, the passenger does not feel uneasy in the waiting time.

As shown in fig. 5, during the video call, the display control unit 13 controls the display 4 so that the service information 43 is displayed on the left side 4L in the vehicle width direction of the display 4 when the information (service information) related to the provision of the service is acquired from the call partner such as the operator. For example, information of a menu transmitted from a coffee shop employee (call partner) is displayed as the service information 43.

As shown in fig. 4 and 5, when the call destination is a service provider such as an operator, the AI agent displays an agent image 40a in a form corresponding to the standby mode without performing service provision in the video call. In this case, as shown in fig. 3 to 5, when the video call is started, the agent image 40b in the form corresponding to the operation mode in which the AI agent implementation service is provided is changed to the agent image 40a in the form corresponding to the standby mode and displayed.

Fig. 6 is a diagram showing another example of the display screen of the display 4 during the video call, and the display screen D4 is displayed when the call destination is not the service provider but the AI agent is requested to provide the service during the video call in the user information. In this case, as shown in fig. 6, an agent image 40b of a form corresponding to the operation mode is displayed, and the AI agent intervenes in the conversation with the call partner in the video call.

More specifically, in the video call, information is retrieved through the internet based on a keyword spoken by a passenger or a call partner, and information (recommendation information) associated with the keyword is recommended to be displayed on the display 4. In the recommendation service provided by the AI agent, the agent image 40b is displayed in a form that suggests an intervention session according to the contents of a speech header or the like. The display control unit 13 controls the display 4 so that the service information 43 corresponding to the recommendation information is displayed on the vehicle width direction left side 4L of the display 4. For example, a representative image of a personal menu of a restaurant, a shop appearance, or the like searched for by using the name of the restaurant mentioned in the conversation of the video call as a keyword is displayed as the service information 43 corresponding to the recommendation information.

Fig. 7 is a plan view for explaining the seat arrangement of the vehicle 1. AS shown in fig. 7, the vehicle 1 is provided with a driver seat DR disposed on the right side in the vehicle width direction and a passenger seat AS disposed on the left side in the vehicle width direction AS front seats. The monitor 4 is disposed on the dash panel 1a from the front left of the driver's seat DR to the opposite side of the passenger seat AS and extends in the vehicle width direction. Therefore, as shown in fig. 3 to 6, the agent image 40 displayed on the right end of the display 4 in the vehicle width direction is located between the information 41 or the image 42 of the call partner and the occupant of the driver's seat DR. Therefore, the role of the AI agent mediating the video call between the occupant in the driver seat DR and the call partner is clear, and the AI agent can be naturally accepted by the occupant.

As shown in fig. 5, even when the AI agent does not provide a service during a video call, the recommended service can be started by, for example, voice-inputting a predetermined wakeup word through the input unit 7. When the AI agent transitions from the standby mode to the operating mode during a video call, the display control unit 13 controls the display 4 so that the agent image 40a in the form corresponding to the standby mode is changed to the agent image 40b in the form corresponding to the operating mode and displayed.

Fig. 8 is a diagram showing an example of the display screen D5 of the display 4 after the video call is ended. As shown in fig. 8, when the video call is completed, the AI agent resumes providing the general service, and the display control unit 13 controls the display 4 so that the agent image 40b in the form corresponding to the operation mode is displayed on the vehicle width direction right side 4R of the display 4.

A general service after the video call is completed as the AI agent is, for example, to set a destination of the vehicle 1 according to the contents of the conversation in the video call. For example, when a seat reservation is made by a video call with a restaurant, the "desire to go to o coffee shop |" from the AI agent is output via the speaker 5! Go to a coffee shop ", etc., and set the restaurant as the destination of the vehicle 1.

Fig. 9 is a flowchart illustrating an example of processing executed by the vehicle display device according to the embodiment of the present invention. The processing shown in the flowchart is started, for example, when the communication unit 8 acquires incoming information of a video call or when the input unit 7 instructs to initiate a video call. As shown in fig. 9, first, in S1 (S: processing step), the display 4 is controlled to display a display screen D1 (fig. 3) at the start of a video call. Next, in S2, it is determined whether or not the video call is permitted. The routine proceeds to S3 when S2 is affirmative (S2: YES), and ends the process when negative (S2: NO).

At S3, it is determined whether or not recommendation in the video call is required based on the user information and the incoming call information. When the answer at S3 is negative (S3: no), the routine proceeds to S4, and the display 4 is controlled so that the display screen D3 (fig. 5) in the video call is displayed via the display screen D2 (fig. 4) when the video call is permitted. On the other hand, when the answer at S3 is affirmative (S3: YES), the routine proceeds to S5, and the display 4 is controlled so that the display screen D4 (FIG. 6) in the video call is displayed via the display screen D2 (FIG. 4) when the video call is permitted. Next, in S6, it is determined whether or not end of the video call is instructed. If S6 is negative (S6: no), the process returns to S3, if yes (S6: yes), the process proceeds to S7, the display 4 is controlled to display a display screen D5 (fig. 8) after the video call is ended, and the process ends.

The present embodiment can provide the following effects.

(1) The vehicle display device 100 displays information to an occupant in a driver's seat of the vehicle 1 (fig. 3 to 6 and 8). The display device 100 for a vehicle includes: a communication unit 8; a display 4 disposed to face the driver's seat DR and extending in the vehicle width direction; and a calling device 10 configured to be capable of making a call through the communication unit 8 and capable of displaying on the display 4 a video image received from a call partner via the communication unit 8 (fig. 1, 2, and 7).

The telephone apparatus 10 includes a display control unit 13 (fig. 2), and the display control unit 13 controls the display 4 so that, when a call with a call partner through the communication means 8 is started, information 41 (fig. 3) of the call partner is displayed on the right side 4R in the vehicle width direction of the display 4, and then, when an instruction from the occupant is given to permit the call, the information 41 (fig. 4) of the call partner displayed on the right side 4R in the vehicle width direction of the display 4 is moved to the left side 4L in the vehicle width direction and displayed, and thereafter, a video 42 (fig. 5 and 6) of the call partner is displayed on the right side 4R in the vehicle width direction of the display 4.

This makes it possible to appropriately display the information 41 of the call partner to the occupant of the driver's seat of the vehicle 1. That is, by displaying the call partner information 41 before the video call is started, the passenger can be given a sense of safety. Further, since the information 41 of the call partner displayed on the display screen D1 before the start of the video call is moved to the display screens D3 and D4 during the video call while being kept displayed, the user does not feel uneasy about connecting to the call partner.

(2) Since the vehicle width direction right side 4R of the display 4 is the driver seat DR side (fig. 7), it is easy for the occupant of the driver seat to confirm the information 41 of the call partner before the video call starts and to view the image 42 of the call partner during the video call.

(3) The display control unit 13 controls the display 4 so that the agent image 40 is displayed closer to the driver's seat DR than the image 42 of the call partner displayed on the right side 4R of the display 4 in the vehicle width direction during the call by the communication means 8, and the agent image 40 represents an AI agent mediating the call with the call partner (fig. 6). Thus, since the agent image 40 is displayed between the image 42 of the call partner and the passenger at the driver seat DR, the function of the AI agent mediating the video call with the call partner is clear, and the passenger at the driver seat DR is easily served by the AI agent.

(4) The agent image 40 is displayed in any one of a first modality (fig. 3, 6, and 8) corresponding to an operation mode in which the AI agent performs information provision corresponding to the contents of the occupant's speech, and a second modality (fig. 4 and 5) corresponding to a standby mode in which the AI agent does not perform information provision corresponding to the contents of the occupant's speech. When the passenger instructs permission of the call, the display control unit 13 controls the display 4 to display the smart image 40 from the first mode corresponding to the operation mode to the second mode corresponding to the standby mode (fig. 3 to 5). For example, when the call partner is a service provider, the service information 43 transmitted from the call partner is displayed without displaying the recommended information of the AI agent, and appropriate information is presented to the occupant in the driver seat.

In the above-described embodiment, a specific example of the monitor 4 is described in fig. 1 and the like, but any form may be used as long as the monitor is disposed so as to face the driver's seat and extend in the vehicle width direction. Although a specific configuration of the telephone apparatus 10 is shown in fig. 2 and the like, the telephone apparatus is not limited to this, and may be configured to use a user terminal having a telephone function, for example. Although a specific example of the call target information 41 is described with reference to fig. 3 and the like, the call target information is not limited to this.

One or more of the above embodiments and modifications may be arbitrarily combined, or modifications may be combined with each other.

According to the present invention, information can be appropriately displayed to an occupant in a driver's seat of a vehicle.

While the present invention has been described with reference to the preferred embodiments thereof, it will be understood by those skilled in the art that various changes and modifications may be made therein without departing from the scope of the present invention as set forth in the following claims.

Claims

1. A vehicle display device (100) that displays information to an occupant in a driver's seat of a vehicle (1), the vehicle display device (100) comprising:

a communication unit (8);

a display (4) disposed so as to face the driver's seat and extend in the vehicle width direction; and

a calling device (10) configured to be capable of making a call through the communication means (8) and displaying an image from a call partner received via the communication means (8) on the display (4),

the communication device (10) is provided with a display control unit (13), wherein the display control unit (13) controls the display (4) so that when communication with a communication object through the communication unit (8) is started, information of the communication object is displayed on one side of the display (4) in the vehicle width direction, then when permission of communication is instructed from a passenger, the information of the communication object displayed on one side of the display (4) in the vehicle width direction moves to the other side of the vehicle width direction and is displayed, and then, an image of the communication object is displayed on one side of the display (4) in the vehicle width direction.

2. The display device (100) for a vehicle according to claim 1,

one side of the display (4) in the vehicle width direction is the driver seat side.

3. The display device (100) for a vehicle according to claim 2,

the display control unit (13) controls the display (4) so that, when a call is made by the communication means (8), an agent image representing an AI agent mediating the call with the call object is displayed on the driver's seat side of an image of the call object displayed on one side of the display (4) in the vehicle width direction.

4. The display device (100) for a vehicle according to claim 3,

the agent image is displayed in either one of a first modality corresponding to an operation mode in which the AI agent performs information provision corresponding to the contents of the occupant's speech, and a second modality corresponding to a standby mode in which the AI agent does not perform information provision corresponding to the contents of the occupant's speech,

the display control unit (13) controls the display so that the agent image is changed from the first form to the second form and displayed when the permission of the call is instructed from the occupant.

5. The display device (100) for a vehicle according to claim 3,

when the permission of the call is instructed from the occupant, the display control unit (13) determines to display the agent image during the call in either the first mode or the second mode based on information of the call destination.

6. The display device (100) for a vehicle according to claim 5,

the display control unit (13) controls the display so that, when the image of the agent in a call is displayed in the first mode, the image of the agent in the call is displayed in a mode that suggests a conversation between the agent and the call partner.