JP7299262B2 - vehicle display - Google Patents

Description

The present invention relates to a vehicle display device that displays information to an occupant in a driver's seat of a vehicle.

As a device of this type, there is conventionally known a device that displays information about an incoming call to the driver of a vehicle (see, for example, Patent Document 1). The device described in Patent Document 1 cooperates with a mobile device having a telephone function, and displays information such as the caller's name and phone number on the display device provided in the in-vehicle device when the mobile device receives an incoming call. do.

JP 2016-163176 A

In recent years, vehicles equipped with advanced driving assistance such as automatic driving are becoming popular. In such a vehicle, it is preferable to transmit various kinds of information to an occupant in the driver's seat, who is the main user of the vehicle, via an image screen on the display in order to improve convenience.

One aspect of the present invention is a vehicle display device that displays information to an occupant in a driver's seat of a vehicle, wherein a communication unit is arranged facing the driver's seat and extending in the vehicle width direction. A display and a communication device configured to be able to talk via a communication unit and display an image received from a communication partner on the display via the communication unit. When the call device receives a call from or makes a call to the other party via the communication unit, the information of the other party is displayed on one side of the display in the vehicle width direction, and then the passenger issues a call permission command. Then, the information of the other party displayed on one side of the display in the vehicle width direction moves to the other side of the vehicle width direction without disappearing. It has a display control for controlling the display to be displayed. During a call via the communication unit, the display control unit displays an agent image representing an AI agent mediating a call with the other party on the driver's seat side of the image of the other party displayed on one side in the vehicle width direction of the display. As displayed, controlling the display, the agent image is displayed such that the AI agent intervenes in the call between the passenger and the other party and provides recommended information related to the keywords uttered by the passenger or the other party. be done.

Advantageous Effects of Invention According to the present invention, information can be preferably displayed to an occupant in the driver's seat of a vehicle.

1 is a diagram showing an example of a configuration around an instrument panel of a vehicle to which a vehicle display device according to an embodiment of the invention is applied; FIG. 1 is a block diagram schematically showing the overall configuration of a vehicle display device according to an embodiment of the invention; FIG. FIG. 3 shows an example of a display screen of the display of FIGS. 1 and 2 when a video call is started; FIG. FIG. 3 shows an example of a display screen of the display of FIGS. 1 and 2 when a video call is permitted; FIG. 3 shows an example of a display screen of the display of FIGS. 1 and 2 during a video call; FIG. FIG. 3 illustrates another example display screen of the display of FIGS. 1 and 2 during a video call; FIG. 2 is a top view for explaining the seat arrangement of the vehicle in FIG. 1; FIG. 3 is a view showing an example of the display screen of the display of FIGS. 1 and 2 after the end of the video call; FIG. 4 is a flowchart showing an example of processing executed by the vehicle display device according to the embodiment of the present invention;

An embodiment of the present invention will be described below with reference to FIGS. 1 to 9. FIG. A vehicle display device according to an embodiment of the present invention can be applied to a vehicle having a driver's seat, and in particular to a vehicle having advanced driving support functions such as an automatic driving function. Such vehicles include not only vehicles that only run in an automated driving mode that does not require any driving operation by the driver, but also vehicles that can run in both an automated driving mode and a manual driving mode operated by the driver. It also includes vehicles that do.

FIG. 1 is a diagram showing an example of a configuration around an instrument panel 1a of a vehicle 1 to which a vehicle display device according to an embodiment of the invention is applied. As shown in FIG. 1, an instrument panel 1a is arranged in front of the vehicle, and includes a meter display 2, mirror displays 3R and 3L, and an information display (hereinafter simply referred to as "display"). ) 4 are provided.

The meter display 2 is arranged in front of the driver's seat (the right side in the vehicle width direction in the example of FIG. 1) on the instrument panel 1a, and displays information regarding the state of the vehicle 1 such as vehicle speed. The mirror displays 3L and 3R are arranged at the left and right ends of the instrument panel 1a in the vehicle width direction, respectively, and display images corresponding to the left and right rear mirrors of the vehicle 1, respectively. The display 4 is arranged extending in the vehicle width direction near the center in the vehicle width direction on the instrument panel 1a between the meter display 2 and the mirror display 3L, and displays various information to the occupant. do.

In the vicinity of the driver's seat on the instrument panel 1a, a speaker 5 for outputting voice to the driver's seat occupant, an in-vehicle camera 6 for capturing an image of the driver's seat occupant, a microphone for receiving voice input from the driver's seat occupant, etc. An input section 7 is provided (FIG. 2). The input unit 7 may include a touch panel, buttons, and the like for receiving operation input in addition to the microphone.

Various types of information are displayed on the display 4 according to commands from the passenger input via the input unit 7 . For example, a navigation screen for setting the destination of the vehicle 1, guidance on the route to the set destination, etc., a video call screen for video chat using the Internet line, video call using the telephone line, etc. Is displayed. In the following, the video call screen will be described in particular.

FIG. 2 is a block diagram schematically showing the overall configuration of the vehicle display device 100 according to the embodiment of the invention. As shown in FIG. 2 , the vehicle display device 100 includes a display 4 , a speaker 5 , an in-vehicle camera 6 , an input section 7 , a communication unit 8 and a communication device 10 .

The communication device 10 includes a computer having an arithmetic section 11 such as a CPU, a storage section 12 such as ROM and RAM, and other peripheral circuits (not shown) such as an I/O interface. The storage unit 12 stores information such as various control programs and threshold values used in the programs. The computing unit 11 has, as a functional configuration, a display control unit 13 that controls the display 4 .

The communication unit 8 is configured to be able to communicate with a terminal device outside the vehicle via a network including a wireless communication network such as the Internet network and a mobile phone network. The network includes not only a public wireless communication network but also a closed communication network provided for each predetermined management area, such as wireless LAN, Wi-Fi (registered trademark), Bluetooth (registered trademark), and the like.

Transmitting image and audio information obtained through the in-vehicle camera 6 and the input unit 7 to a terminal device outside the vehicle in accordance with commands from the occupant input through the input unit 7 via the communication unit 8. can be done. Further, based on information received from a terminal device outside the vehicle via the communication unit 8, an image can be displayed on the display 4 and sound can be output from the speaker 5. FIG.

The communication device 10 is configured to be able to make a call via the speaker 5 , the input section 7 and the communication unit 8 , and to display an image received from the other party on the display 4 via the communication unit 8 . An occupant in the driver's seat can make a video call via the communication device 10 . The display control unit 13 controls the display 4 based on a program stored in the storage unit 12 and information obtained through the communication unit 8 in response to commands from the passenger input through the input unit 7. .

FIG. 3 is a diagram showing an example of the display screen D1 of the display 4 when a video call is started. As shown in FIG. 3, the display control unit 13 has an AI agent, which provides various services to the occupants in the driver's seat who are the main users of the vehicle 1, at the right end of the display 4 closest to the driver's seat in the vehicle width direction. The display 4 is controlled so that the represented agent image 40 is displayed. The AI agent provides services according to the user's preferences based on pre-registered user information and user information acquired in response to instructions from the user. For example, for a user (passenger in the driver's seat) riding in the vehicle 1, the user can propose in-vehicle contents such as music, the destination of the vehicle 1, the driving route, etc. according to the user's taste, or make a video call with the other party. to mediate.

The display control unit 13 controls the display 4 so that the information 41 of the other party is displayed on the vehicle width direction right side 4R of the display 4 on the driver's seat side when a call with the other party is started via the communication unit 8. to control. More specifically, when incoming call information for a video call is acquired via the communication unit 8, caller information 41 including the caller's name, icon image, phone number, etc. is obtained based on the incoming call information. Control the display 4 to be displayed. Also, when a command to make a video call is issued via the input unit 7, information 41 of the called party, including the name of the called party, icon image, telephone number, etc., is displayed based on pre-registered contact information. Control the display 4 to be displayed.

During a video call, the image of the occupant in the driver's seat and their surroundings in the car is sent to the other party, and the image of the other party is displayed facing the inside of the car. By displaying detailed information about the caller and caller, it is possible to give the occupants a sense of security. In addition, since the information 41 of the caller is displayed on the vehicle width direction right side 4R of the display 4 near the driver's seat, it is easy for the occupant in the driver's seat to check. At this time, no particular information is displayed on the vehicle width direction left side 4L of the display 4 far from the driver's seat.

FIG. 4 is a diagram showing an example of the display screen D2 of the display 4 when the occupant in the driver's seat permits the video call, and FIG. 5 shows an example of the display screen D3 of the display 4 during the video call. It is a diagram. For example, in response to an announcement from the AI agent output via the speaker 5, such as "I'll connect the call to Mr. XX", a command for permitting a video call can be input via the input unit 7. As shown in FIG. 4, the display control unit 13 moves the caller information 41 displayed on the right side 4R in the vehicle width direction of the display 4 to the left side 4L in the vehicle width direction when the occupant issues a call permission command. The display 4 is controlled so that the Thereafter, as shown in FIG. 5, the display control unit 13 controls the display 4 so that the image 42 of the other party is displayed on the right side 4R of the display 4 in the vehicle width direction.

As shown in FIGS. 4 and 5, the caller information 41 displayed on the display screen D1 before the start of the video call moves without disappearing, and the display screen D3 is displayed during the video call. Therefore, even if it takes time to connect with the other party after the driver's seat permits the video call, the driver does not feel uneasy during the waiting time.

As shown in FIG. 5, during a video call, when the display control unit 13 acquires information (service information) about the provided service from the other party such as a business operator, the service information 43 is displayed on the left side 4L of the display 4 in the vehicle width direction. Control the display 4 to be displayed. For example, menu information transmitted from a cafe staff (caller) is displayed as the service information 43 .

As shown in FIGS. 4 and 5, when the other party is a service provider such as a business operator, the AI agent does not provide services during the video call, and an agent image 40a corresponding to the standby mode is displayed. . In this case, as shown in FIGS. 3 to 5, when the video call is started, the agent image 40b corresponding to the active mode in which the AI agent provides services is replaced by the agent image 40b corresponding to the standby mode. 40a and displayed.

FIG. 6 is a diagram showing another example of the display screen of the display 4 during a video call, when the other party is not the service provider and the user information requests the AI agent to provide the service during the video call. shows a display screen D4. In this case, as shown in FIG. 6, an agent image 40b corresponding to the operating mode is displayed, and the AI agent intervenes in the conversation with the other party during the video call.

More specifically, information is retrieved via the Internet according to a keyword uttered by the crew member or the other party during the video call, and information (recommendation information) related to the keyword is displayed on the display 4 to make a recommendation. done. While the AI agent is providing the recommendation service, the agent image 40b is displayed in a manner suggesting intervention in the conversation, such as by nodding in accordance with the content of the utterance. The display control unit 13 controls the display 4 so that the service information 43 corresponding to the recommended information is displayed on the left side 4L of the display 4 in the vehicle width direction. For example, representative images such as popular menus and store exteriors of restaurants searched using keywords such as names of restaurants mentioned in video call conversations are displayed as service information 43 corresponding to recommended information. be.

FIG. 7 is a top view for explaining the seat arrangement of the vehicle 1. FIG. As shown in FIG. 7, the vehicle 1 is provided with, as front seats, a driver's seat DR arranged on the right side in the vehicle width direction and a passenger's seat AS arranged on the left side in the vehicle width direction. The display 4 is arranged on the instrument panel 1a from the front of the front passenger seat AS to the left front of the driver's seat DR so as to extend in the vehicle width direction. Therefore, as shown in FIGS. 3 to 6, the agent image 40 displayed at the right end of the display 4 in the vehicle width direction is positioned between the information 41 of the other party in the conversation, the image 42 of the other party in the conversation, and the occupant in the driver's seat DR. do. Therefore, the role of the AI agent mediating the video call between the occupant in the driver's seat DR and the other party is clarified, and the occupant can naturally accept the AI agent.

As shown in FIG. 5, even if the AI agent does not provide services during a video call, the recommendation service can be started by inputting a predetermined wake-up word through the input unit 7, for example. can start. When the AI agent shifts from the standby mode to the operating mode during the video call, the display control unit 13 changes the agent image 40a corresponding to the standby mode to the agent image 40b corresponding to the operating mode for display. to control the display 4.

FIG. 8 is a diagram showing an example of the display screen D5 of the display 4 after the end of the video call. As shown in FIG. 8, when the video call ends, the normal service provided by the AI agent is resumed, and the display control unit 13 displays the agent image 40b corresponding to the operating mode on the right side 4R of the display 4 in the vehicle width direction. Control the display 4 to be displayed.

As a normal service after the end of the video call by the AI agent, for example, setting of the destination of the vehicle 1 according to the content of the conversation during the video call is performed. For example, when a seat reservation is made through a video call with a restaurant, an announcement such as ``I'm looking forward to XX cafe! is set as the destination of the vehicle 1 .

FIG. 9 is a flow chart showing an example of processing executed by the vehicle display device according to the embodiment of the present invention. The processing shown in this flow chart is started, for example, when incoming video call information is obtained via the communication unit 8 or when a video call origination command is issued via the input unit 7 . As shown in FIG. 9, first, in step S1, the display 4 is controlled so that the display screen D1 (FIG. 3) when the video call is started is displayed. Next, in step S2, it is determined whether or not the video call is permitted. If the result in step S2 is affirmative, the process proceeds to step S3, and if the result is negative, the process ends.

In step S3, based on the user information and the incoming call information, it is determined whether or not a recommendation is requested during the video call. If the result in step S3 is NO, the process proceeds to step S4, and the display screen D3 (FIG. 5) during the video call is displayed via the display screen D2 (FIG. 4) when the video call is permitted. 4 is controlled. On the other hand, if the result in step S3 is affirmative, the process proceeds to step S5 so that the display screen D4 (FIG. 6) during the video call is displayed via the display screen D2 (FIG. 4) when the video call is permitted. to control the display 4. Next, in step S6, it is determined whether or not an instruction to end the video call has been issued. If the result in step S6 is NO, the process returns to step S3, and if the result is YES, the process proceeds to step S7, controls the display 4 so that the display screen D5 (FIG. 8) after the end of the video call is displayed, and ends the process.

According to this embodiment, the following effects can be obtained.
(1) The vehicular display device 100 displays information to an occupant in the driver's seat of the vehicle 1 (FIGS. 3 to 6 and 8). The vehicular display device 100 can communicate with a communication unit 8 and a display 4 arranged to face the driver's seat DR and extend in the vehicle width direction via the communication unit 8, and can communicate with the display 4. and a communication device 10 configured to be able to display an image received from a communication partner via the communication unit 8 (FIGS. 1, 2, and 7).

In the communication device 10, when a call with the other party is started via the communication unit 8, the information 41 of the other party is displayed on the vehicle width direction right side 4R of the display 4 (FIG. 3), and then the passenger makes a call. When permission is commanded, information 41 of the called party displayed on the right side 4R in the vehicle width direction of the display 4 is moved to the left side 4L in the vehicle width direction and displayed (FIG. 4), and then displayed on the display 4 in the vehicle width direction. It has a display control unit 13 that controls the display 4 so that an image 42 of the other party is displayed on the right side 4R (FIGS. 5 and 6) (FIG. 2).

As a result, the information 41 of the calling party can be preferably displayed to the passenger in the driver's seat of the vehicle 1 . In other words, by displaying the information 41 of the caller before starting the video call, it is possible to give the passenger a sense of security. In addition, since the information 41 of the other party displayed on the display screen D1 before the start of the video call moves while being displayed and transitions to the display screens D3 and D4 during the video call, I don't feel uneasy.

(2) Since the vehicle width direction right side 4R of the display 4 is on the driver's seat DR side (Fig. 7), it is easy for the occupant in the driver's seat to check the information 41 of the other party before the video call starts, and during the video call It is easy to see the image 42 of the other party.

(3) During a call through the communication unit 8, the display control unit 13 mediates the call with the other party from the image 42 of the other party displayed on the right side 4R of the display 4 in the vehicle width direction to the driver's seat DR side. The display 4 is controlled so that an agent image 40 representing an AI agent is displayed (FIG. 6). As a result, since the agent image 40 is displayed between the image 42 of the other party and the passenger in the driver's seat DR, the role of the AI agent mediating the video call with the other party becomes clear. It is easy to accept services by AI agents.

(4) The agent image 40 is the first mode (FIGS. 3, 6, and 8) corresponding to the operation mode in which the AI agent provides information according to the utterance content of the passenger, and the AI agent is displayed in one of the second modes (FIGS. 4 and 5) corresponding to the standby mode in which information is not provided according to the The display control unit 13 controls the display 4 so that the agent image 40 is displayed while being changed from the first mode corresponding to the operating mode to the second mode corresponding to the standby mode when the crew member instructs permission to talk. (Figs. 3-5). For example, if the calling party is a service provider, the service information 43 sent from the calling party is displayed instead of the information recommended by the AI agent, and appropriate information is presented to the occupant in the driver's seat.

In the above embodiment, a specific example of the display 4 is shown in FIG. 1 and the like. Anything is fine. Further, although the specific configuration of the communication device 10 has been described with reference to FIG. Further, although a specific example of the information 41 of the calling party is shown in FIG. 3 and the like, the information of the calling party is not limited to this.

The above description is merely an example, and the present invention is not limited by the above-described embodiments and modifications as long as the features of the present invention are not impaired. It is also possible to arbitrarily combine one or more of the above embodiments and modifications, and it is also possible to combine modifications with each other.

1 vehicle, 1a instrument panel, 4 display, 5 speaker, 6 in-vehicle camera, 7 input unit, 8 communication unit, 10 communication device, 11 calculation unit, 12 storage unit, 13 display control unit, DR driver's seat

Claims (3)

A vehicle display device for displaying information to an occupant in a driver's seat of a vehicle,
a communication unit;
a display facing the driver's seat and extending in the vehicle width direction;
a calling device configured to be able to make a call via the communication unit and to display an image received from the other party on the display on the display,
In the communication device, when receiving an incoming call from or making a call to the other party via the communication unit, the information of the other party is displayed on one side in the vehicle width direction of the display, and after that, permission for the call is received from the passenger. When commanded, the caller information displayed on one side of the display in the vehicle width direction moves to the other side in the vehicle width direction without disappearing, and then moves to the one side of the display in the vehicle width direction. Having a display control unit that controls the display so that the image of the other party is displayed,
During a call via the communication unit, the display control unit expresses an AI agent mediating a call with the other party on the driver's seat side of the image of the other party displayed on one side in the vehicle width direction of the display. controlling the display so that the agent image displayed is displayed;
A vehicle display device, wherein the agent image is displayed so that the AI agent intervenes in a call between the passenger and the other party and provides recommended information related to a keyword uttered by the passenger or the other party. . In the vehicle display device according to claim 1,
A vehicle display device, wherein one side of the display in the vehicle width direction is the driver's seat side. In the vehicle display device according to claim 1 or 2,
The agent image corresponds to the first mode corresponding to the operating mode in which the AI agent provides information according to the utterance content of the passenger, and the standby mode in which the AI agent does not provide information according to the utterance content of the passenger. displayed in any of the second modes,
The display control unit controls the display so that the agent image is displayed while being changed from the first mode to the second mode when a call permission is commanded by a passenger. Vehicle display.

Images