JP2019082856A - Display device, display control method, and program - Google Patents

Abstract

To allow a user to conveniently use entertainment content during an automatic operation mode.SOLUTION: A display device 100 is used for a vehicle 2 in which switching between an automatic operation mode and a manual operation mode can be controlled, and includes display means 10 for displaying an image, and a control unit 110 for causing the display means 10 to display a menu image indicating a plurality of content items including an entertainment content item, upon specification of switching from the manual operation mode to the automatic operation mode based on information acquired from the vehicle 2. Upon receiving a selection operation of selecting any one of the plurality of content items in the menu image, the control unit 110 switches the display of the display means 10 from the menu image to a content image displaying content corresponding to the content item selected through the selection operation.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a display device used in a vehicle capable of switching control between an automatic driving mode and a manual driving mode, a display control method, and a program.

  As a related art, in a vehicle capable of switching control between an automatic driving mode and a manual driving mode, the entertainment mode is activated in response to switching to the automatic driving mode, and a predetermined display is performed on a display unit in the vehicle. A technology is disclosed (see, for example, Patent Document 1).

Japanese Patent Application Publication No. 2016-533302

  The technology described in Patent Document 1 merely activates the entertainment mode, so there is room for improvement when the user conveniently uses the entertainment content during the automatic driving mode.

  The present invention has been made in view of the above-described circumstances, and an object thereof is to provide a display device, a display control method, and a program that allow a user to conveniently use entertainment content during an automatic operation mode.

In order to achieve the above object, a display device according to a first aspect of the present invention is:
A display device used in a vehicle capable of switching control between an automatic driving mode and a manual driving mode,
Display means for displaying an image;
A menu image showing a plurality of content items including an entertainment content item is displayed on the display means in response to specifying switching from the manual operation mode to the automatic operation mode based on the information acquired from the vehicle Control means for
The control means is configured to select a display on the display means from the menu image by the selection operation in response to reception of a selection operation for selecting any of the plurality of content items in the menu image. Switch to a content image for displaying content according to the selected content item.

In order to achieve the above object, a display control method according to a second aspect of the present invention is:
A display control method for displaying an image on display means used in a vehicle capable of switching control between an automatic driving mode and a manual driving mode,
A menu image showing a plurality of content items including an entertainment content item is displayed on the display means in response to specifying switching from the manual operation mode to the automatic operation mode based on the information acquired from the vehicle Step of
In response to reception of a selection operation for selecting any of the plurality of content items in the menu image, display on the display means is performed from the menu image according to the content item selected in the selection operation. Switching the content to a content image to be displayed.

In order to achieve the above object, a program according to a third aspect of the present invention is
A program for displaying an image on display means used in a vehicle capable of switching control between an automatic driving mode and a manual driving mode,
On the computer
A menu image showing a plurality of content items including an entertainment content item is displayed on the display means in response to specifying switching from the manual operation mode to the automatic operation mode based on the information acquired from the vehicle Processing, and
In response to reception of a selection operation for selecting any of the plurality of content items in the menu image, display on the display means is performed from the menu image according to the content item selected in the selection operation. Processing to switch to the content image for displaying the selected content;
Run

  According to the present invention, the user can conveniently use the entertainment content during the automatic driving mode.

It is a block diagram of a display system for vehicles concerning one embodiment of the present invention. It is a figure which shows the mounting aspect to the vehicle of the display apparatus which concerns on one Embodiment of this invention. It is a figure which shows an example of the display image which concerns on a normal aspect. (A) shows an example of a menu image, (b) is a figure which shows an example of a content image. It is a figure which shows the structural example of the priority data stored in memory. It is a flowchart which shows an example of the image control processing which concerns on one Embodiment of this invention.

  A display device according to an embodiment of the present invention will be described with reference to the drawings.

  As shown in FIG. 1, the display system 1 for a vehicle according to the present embodiment includes a display device 100, a portable terminal 40, an on-board ECU (Electronic Control Unit) 50, a car navigation (car navigation) system 60, and manual driving. And a intention detection unit 70.

  The display device 100 communicates various parts of the vehicle display system 1 to display various information on the vehicle 2 (hereinafter referred to as vehicle related information) to the driver 4 who has got on the vehicle 2 as shown in FIG. Do. The vehicle related information includes not only the information of the vehicle 2 itself but also the external information of the vehicle 2.

  The vehicle 2 on which the display device 100 according to the present embodiment is mounted can be switched between an automatic driving mode and a manual driving mode by the control of the on-board ECU 50. Here, for example, the automatic operation level when the manual operation mode is set is level 0 or level 1. At level 0, the driver 4 operates all of the main control systems (acceleration, steering, braking). At Level 1, the system assists with any one of acceleration, steering and braking. Also, for example, the automatic driving level when the automatic driving mode is set is level 3 or more. At level 3, the system accelerates, steers and brakes only in limited environments or traffic conditions, and the driver 4 responds when the system requests it.

  The display device 100 is mounted on the vehicle 2 (for example, installed in an instrument panel of the vehicle 2) as shown in FIG. The display device 100 projects the display light L on the windshield 3 (wind shield) of the vehicle 2 to display an image represented by the display light L as a virtual image V in front of the windshield 3 (HUD: Head -Up Display). The image visually recognized as the virtual image V is for notifying vehicle related information. Thereby, the driver 4 can visually recognize the virtual image V superimposed on the real view through the windshield 3. The virtual image V is displayed on the virtual display surface A.

  As shown in FIG. 1, the display device 100 includes a display unit 10, a control unit 110, and an operation unit (not shown).

  The display unit 10 displays an image for notifying vehicle-related information under the control of the control unit 110. The display means 10 includes a liquid crystal display (LCD), a backlight for illuminating the LCD from behind, and the like. The display means 10 is, for example, an organic EL (Electro-Luminescence) display (OLED: Organic Light Emitting Diodes), a DMD (Digital Micromirror Device), a reflective or transmissive LCOS (registered trademark: Liquid Crystal On Silicon), or the like. It may be configured.

  The display device 100 also includes a reflection unit (not shown). The display light L representing the image displayed on the display means 10 is reflected by the reflection part and then travels to the windshield 3. The reflecting portion is constituted of, for example, two mirrors of a plane mirror and a concave mirror. The plane mirror is, for example, a cold mirror, and reflects the display light L from the display means 10 to the concave mirror. The concave mirror reflects the display light L emitted from the display means 10 and reflected by the plane mirror to the windshield 3 while expanding it. As a result, the virtual image V visually recognized by the driver 4 is a magnified image of the image displayed on the display means 10. The reflecting portion may be configured of one or three or more mirrors.

  The display light L is emitted from the display means 10 toward the windshield 3 via the reflection section exemplified above. When the display light L is reflected by the windshield 3 toward the driver 4, a virtual image V is displayed in front of the windshield 3 as viewed from the driver 4.

  The portable terminal 40 is a smartphone, a tablet PC (Personal Computer), etc. which is carried by the user and used in the vehicle 2 and communicates with the display device 100 wirelessly or by wire. The portable terminal 40 transmits, to the control unit 110, entertainment (entertainment) information Ie to be described later. As wireless communication, a method based on standards such as Bluetooth (registered trademark), UWB (Ultra Wide Band), Z-Wave, and ZigBee can be used. Further, as wired communication, a known method such as USB (Universal Serial Bus) can be used.

  The manual driving intention detection unit 70 detects whether or not the driver 4 of the vehicle 2 has an intention to perform the manual driving, and outputs the detection result to the control unit 110 as signals D1 to D4. The manual driving intention detection unit 70 includes a contact detection unit 71, a seat position detection unit 72, an inner camera 73, and a biological information detection unit 74.

  The contact detection unit 71 detects whether there is a touch on a driving operation unit (steering wheel, accelerator pedal or brake pedal) (not shown) operated during manual driving, and detects a detection signal D1 including the detection result. It is output to the control unit 110. For example, the contact detection unit 71 is configured of a touch sensor or a pressure sensor provided in the driving operation unit. The contact detection unit 71 is not limited to a touch sensor or a pressure sensor, and may be an operation detection sensor that detects an operation amount of the driving operation unit. The operation detection sensor is, for example, an accelerator position sensor, a brake position sensor, a steering angle sensor, or a torque sensor (not shown). In this case, the contact detection unit 71 detects a minute operation amount associated with the driver 4 touching the driving operation unit.

  The seat position detection unit 72 detects the position of the driver's seat in the front-rear direction of the vehicle 2 or the angle of the backrest of the driver's seat, and outputs a detection signal D2 including the detection result to the control unit 110.

  The inner camera 73 captures the face of the driver 4 and outputs the captured image signal D3 to the control unit 110.

  The living body information detection unit 74 detects the brain wave, heart rate or muscle movement of the driver 4 and outputs a detection signal D4 including the detection result to the control unit 110. The living body information detection unit 74 is provided, for example, in a wearable terminal (not shown) attached to an arm, a leg, a head or the like of the driver 4. In this case, the living body information detection unit 74 may transmit the detection signal D4 to the control unit 110 as a wireless signal.

The control unit 110 of the display device 100 includes a microcomputer and the like. Specifically, the control unit 110 includes a processing unit 111 including a central processing unit (CPU) and the like, and a memory 112 including a read only memory (ROM) and a random access memory (RAM).
Note that a power supply (not shown) is connected to the display device 100, and for example, operating power is supplied to the control unit 110 when the ignition of the vehicle 2 is turned on. Further, at least a part of the control unit 110 may be configured by a dedicated circuit such as an application specific integrated circuit (ASIC).

  The ROM of the memory 112 stores in advance an operation program (including a program PG for executing image control processing described later) and fixed data (including priority information PE described later). The RAM temporarily stores various calculation results and the like. For example, the RAM stores data indicating the determination result or the determination result in the image control process described later. Also, the memory 112 includes a video memory for storing image data used to generate an image to be displayed on the display means 10.

  The processing unit 111 executes processing for controlling the overall operation of the display device 100 using the operation program and fixed data read from the memory 112. At this time, the fixed data read operation in which the processing unit 111 reads fixed data from the ROM, the data writing operation in which the processing unit 111 writes various data in the RAM of the memory 112 and temporarily stores it, and the processing unit 111 is temporarily stored in the RAM Data reading operation for reading out various data, reception operation for processing unit 111 receiving input of various signals from the outside of control unit 110 via I / F (InterFace), control unit for processing unit 111 via I / F A transmission operation for outputting various signals to the outside of 110 is also performed. Further, the processing unit 111 appropriately counts time by the built-in timer. In particular, in this embodiment, the processing unit 111 executes the program PG stored in the memory 112 to perform display processing according to a flowchart to be described later.

  The processing unit 111 receives an input of an operation signal from an operation unit (not shown). The operation unit includes, for example, a touch panel, a push button, and the like, and supplies the processing unit 111 with an operation signal indicating the content of the operation by the user. The operation includes “selection operation” and “content end operation” described later.

The processing unit 111 is configured to be able to communicate with the in-vehicle ECU 50 via a CAN (Controller Area Network).
The on-vehicle ECU 50 controls each part of the vehicle 2. In this embodiment, in particular, the driving support is performed by switching the operation mode of the vehicle 2 under predetermined conditions. For example, the processing unit 111 acquires vehicle information I such as the driving mode information Im, the remaining fuel information If, the vehicle speed information Is, the proximity distance information Ia, and the like from the in-vehicle ECU 50.

  The driving mode information Im is information indicating whether the vehicle 2 is set to an automatic driving mode or a manual driving mode. As described above, for example, the automatic operation level when set to the manual operation mode is level 0 or level 1. Also, for example, the automatic driving level when the automatic driving mode is set is level 3 or more.

  The proximity distance information Ia is information indicating the proximity distance from the vehicle 2 to an object present around the vehicle 2, and any one of the stereo cameras, sonars, ultrasonic sensors, millimeter wave radars, etc. mounted on the vehicle 2 are not shown. Generated using. The vehicle speed information Is is information indicating the speed of the vehicle 2 and is generated based on the detection result of a vehicle speed sensor (not shown). The remaining fuel information If is information indicating the remaining amount of fuel of the vehicle 2, and is generated based on the detection result of a remaining fuel detection sensor (not shown).

The processing unit 111 also acquires the car navigation information In and the entertainment information Ie from the car navigation system 60.
The car navigation system 60 includes a GPS controller that calculates the position of the vehicle 2 based on a GPS (Global Positioning System) signal received from a satellite or the like. The navigation system has a storage unit for storing map data, reads map data near the current position from the storage unit based on position information from the GPS controller, and determines a guidance route to a destination set by the user Do. Then, the car navigation system 60 outputs information on the current position of the vehicle 2 and the determined guidance route to the processing unit 111. Further, the car navigation system 60 outputs information indicating the name and type of the facility in front of the vehicle 2 and the distance between the facility and the vehicle 2 to the processing unit 111 by referring to the map data. Map data includes road shape information (lanes, width of roads, number of lanes, intersections, curves, branches, etc.), restriction information on road signs such as speed limit, information on each lane when there are multiple lanes, etc. Various information is associated with position data. The car navigation system 60 outputs the various information as car navigation information In to the processing unit 111.

  In addition, the car navigation system 60 has an Internet communication unit, a television (TV) tuner, and a video / music reproducing unit. The Internet communication unit is a communication module capable of directly accessing a WAN (Wide Area Network), a communication module for communicating with an external device (such as a mobile router) capable of accessing a WAN, or an access point of a public wireless LAN (Local Area Network) And supplies information obtainable on the Internet to the control unit 110. The car navigation system 60 also supplies the control unit 110 with the TV information received via the TV tuner. Further, the car navigation system 60 can play back video and music recorded in a recording medium such as a built-in memory, a CD (Compact Disc), a DVD (Digital Video Disk) and the like as a video and music playback unit. The information (work title, author's name, etc.) pertaining to is supplied to the control unit 110 Further, the video / music reproducing unit outputs, for example, the sound reproduced from the speaker provided in the vehicle 2.

  The car navigation system 60 configured as described above outputs information such as a movie, TV, news, browser browsing, a game, music and the like as entertainment content to the processing unit 111 as the entertainment information Ie. Note that at least one of the car navigation information In and the entertainment information Ie may be supplied from the portable terminal 40 to the processing unit 111. In addition, the display device 100 may include an Internet communication unit, a GPS controller, and the like, and be able to acquire the car navigation information In and the entertainment information Ie without passing through the mobile terminal 40 and the car navigation system 60.

  The processing unit 111 has an image processing unit 111a, an operation mode determination unit 111b, and an operation mode switching estimation unit 111c as functions.

  The image processing unit 111 a controls the display of the display unit 10 based on the image data stored in the memory 112. The image processing unit 111a executes display control of the display unit 10 based on image data acquired by communication from the portable terminal 40 or the car navigation system 60, and displays a virtual image V based on the image data. The image processing unit 111a performs control for executing various displays by determining the switching timing of the image to be displayed on the display unit 10 (as a result, the image viewed on the display surface A). In the image processing unit 111a, a layer is assigned to each display element (element included in an image visually recognized as a virtual image V), and individual display control is possible. The display elements are the remaining fuel information image Ca included in the vehicle information image C, the vehicle speed information image Cb, and an image indicating each content item included in the menu image E1. These images will be described later.

  The drive mode determination unit 111b determines whether the current vehicle 2 is in the manual drive mode or in the automatic drive mode based on the drive mode information Im acquired from the in-vehicle ECU 50.

  The driving mode switching estimation unit 111 c estimates that switching from one of the manual driving mode and the automatic driving mode to the other is performed based on information from at least one of the in-vehicle ECU 50 and the car navigation system 60 (i) ) Based on the information from the manual driving intention detection unit 70, it is estimated that the automatic driving mode is switched to the manual driving mode.

First, an example of estimating the switching of the operation mode based on the information from the on-board ECU 50 and the car navigation system 60 will be described.
The driving mode switching estimation unit 111c is based on at least one of the car navigation information In from the car navigation system 60, the vehicle speed information Is from the on-board ECU 50, and the proximity distance information Ia. The position of the vehicle 2 with respect to) is calculated. Then, when the distance to the allowable environment of the vehicle 2 (for example, to the entrance of the expressway) or the required time becomes equal to or less than the predetermined value, the driving mode switching estimation unit 111c switches from the manual driving mode to the automatic driving mode Estimate the switching of On the other hand, when the distance or the required time until the vehicle 2 leaves the allowable environment (for example, to the exit of the expressway) becomes equal to or less than a predetermined value, the driving mode switching estimation unit 111c Estimate switch to mode.

  Note that the vehicle 2 and the display device 100 may have a communication device that wirelessly communicates with an external server, infrastructure, or the like, and switching of the operation mode may be estimated using traffic information acquired by the communication. For example, traffic information can be acquired from a base station of a Driving Safety Support Systems (DSSS) via a roadside wireless device installed as an infrastructure.

Subsequently, an example in which the switching of the operation mode is estimated based on the signals D1 to D4 from the manual driving intention detection unit 70 will be described.
The driving mode switching estimation unit 111c determines whether or not there is a touch on the driving operation unit based on the detection signal D1. Here, the first condition is that the driver 4 is in contact with the driving operation unit.
Based on the detection signal D2, the driving mode switching estimation unit 111c determines whether the driver's seat is adjusted to a state suitable for manual driving. Here, the second condition is that the driver's seat is adjusted to a state suitable for manual operation.
Based on the image signal D3, the driving mode switching estimation unit 111c determines whether the line of sight of the driver 4 is at a position suitable for manual driving. Here, the third condition is that the line of sight of the driver 4 is at a position suitable for manual driving.
Based on the detection signal D4, the driving mode switching estimation unit 111c determines whether the biological information of the driver 4 is suitable for manual driving. Here, the fourth condition is that the biometric information of the driver 4 is in a state suitable for manual driving.

  The driving mode switching estimation unit 111c estimates that switching from the automatic driving mode to the manual driving mode is performed when any one of the first condition, the second condition, the third condition, and the fourth condition is satisfied. . Note that the operation mode switching estimation unit 111c is not limited to this example, and can switch from the automatic operation mode to the manual operation mode when a plurality of conditions among the first condition, the second condition, the third condition, and the fourth condition are satisfied. Estimate to be switched.

  More specifically, with regard to the second condition, the driving mode switching estimation unit 111 c sets the position of the driver's seat in the front-rear direction of the vehicle 2 and / or the driver's seat when the angle of the backrest of the driver's seat is within a preset range. Is determined to be suitable for manual operation, and the driver's seat is suitable for manual operation when the position of the driver's seat in the longitudinal direction of the vehicle 2 and / or the angle of the back of the driver's seat is outside this setting range It is determined that the adjustment has not been made.

  Regarding the third condition, more specifically, the driving mode switching estimation unit 111c detects that the line of sight of the driver 4 detected using a known line-of-sight detection technique is on the traveling road. It is determined that the line of sight is at a position suitable for manual driving, and if the detected line of sight of the driver 4 is not focused on the traveling road, it is determined that the line of sight of the driver 4 is not at a position suitable for manual driving Do.

  More specifically, with regard to the fourth condition, when the driving mode switching estimation unit 111c matches at least one of the detected signal waveforms of the electroencephalogram, the heart rate, and the muscle of the driver 4, the driving preparation pattern matches the preset driving preparation pattern. It is determined that the biological information of the driver 4 is in a state suitable for manual driving, and when the signal waveform does not match the driving preparation pattern, it is determined that the biological information of the driver 4 is not in a state suitable for manual driving . The operation preparation pattern is generated by experiment or simulation.

  In addition, estimation of switching of the driving mode may be performed by the controller on the vehicle 2 side instead of the display device 100. In this case, the control unit 110 of the display device 100 may use information indicating the estimation result acquired from the controller.

  The configuration of the vehicle display system 1 has been described above. The display device 100 can execute display control of the display unit 10 and can display various images for notifying vehicle-related information as the virtual image V, but in the following, FIGS. 3 and 4 (a). After the display mode specific to the present embodiment is described with reference to (b) and the like, the image control process executed to switch the display mode will be described with reference to FIG.

FIG. 3 is a view showing a vehicle information image C which is an example of a display image of the normal mode realized in the manual operation mode.
The vehicle information image C includes a remaining fuel information image Ca representing the remaining amount of fuel by a bar graph, and a vehicle speed information image Cb representing the speed of the vehicle 2 by a number. The control unit 110 updates the vehicle speed information image Cb according to the vehicle speed information Is from the in-vehicle ECU 50, and updates the remaining fuel information image Ca according to the remaining fuel information If from the in-vehicle ECU 50.

FIG. 4A is a view showing a menu image E1 which is an example of a display image of the entertainment mode realized in the automatic driving mode.
The menu image E1 is an image showing a plurality of content items including an entertainment content item. In the illustrated example, “movie”, “TV”, “news”, “Internet (browser browsing)”, “Game”, and “music” are shown as entertainment content items. Content corresponding to the entertainment content is provided by the entertainment information Ie from the car navigation system 60 or the portable terminal 40. Further, in the menu image E1, "car navigation" is shown as an item other than the entertainment content. The content related to the car navigation is provided by the car navigation system 60 or the car navigation information In from the portable terminal 40.

Each content item indicated in the menu image E1 is displayed in a mode according to the priority indicated by the priority information PE stored in the memory 112. As shown in FIG. 5, the priority information PE is data in which content items are associated with priorities. In FIG. 5, the smaller the numerical value indicating the priority, the higher the priority.
As shown in FIG. 4A, display areas H1 to H7 of images showing content items are defined in the menu image E1. These display areas are H1, H2, H3, H4, H5, H6, and H7 in order from the highest priority. In the example of FIG. 4A, these display areas are set to have higher priorities and larger priorities in order from the upper left in the menu image E1. When displaying the menu image E1, the processing unit 111 refers to the priority information PE, and displays an image indicating each content item in the display area according to such priority. For example, referring to the priority information PE, if the priority of “movie” is “1”, an image indicating a content item related to the movie is displayed in the area “H1”.

  In addition, the display aspect of the content item according to the priority is arbitrary, and various aspects are applicable. For example, a content item having a higher priority may be represented by an image having higher brightness and saturation. Also, the recognition of the priority may be enabled by changing the color or the shape between the one with the priority higher than the predetermined rank and the one with the priority lower than the predetermined rank. In addition, horizontally elongated band-like content items may be arranged in the vertical direction, and the higher-priority content items may be displayed on the upper side. In addition, when multiple imaging positions of virtual image V are set, or when three-dimensional computer graphics are possible, the content item with higher priority is displayed closer to the user, or the like, using the depth of the display image The priority may be recognized.

  Further, the priority indicated by the priority information PE can be updated according to the selection frequency of the content item by the user and the selection history. For example, the processing unit 111 updates the priority indicated by the priority information PE according to the high selection frequency. Note that the processing unit 111 may update the priority indicated by the priority information PE in order from the one selected most recently instead of the selection frequency. Further, the processing unit 111 updates the priority indicated by the priority information PE according to the information indicating the user's attributes (sex, age, consumption tendency, browsing tendency, etc.) obtainable via the mobile terminal 40 etc. May be In addition, the processing unit 111 may update the priority indicated by the priority information PE using a known algorithm such as weighting and evaluating a plurality of pieces of information among the selection frequency, the selection history, and the attribute of the user. . Thus, how to update the priority is optional depending on the purpose.

FIG. 4B is a diagram showing a content image E2 which is an example of a display image of the entertainment mode realized in the automatic driving mode.
The content image E2 is an image switched from the menu image E1 in response to the processing unit 111 receiving a selection operation by the user when the menu image E1 is displayed. The selection operation is performed by the user from an operation unit (not shown), and is an operation for selecting any one of the plurality of content items shown in the menu image E1. FIG. 4B shows a content image E2 to which transition is made when the content item of “movie” shown in the display area H1 in the menu image E1 of FIG. 4A is selected by the selection operation. The content image E2 indicates that the selected "movie" is being played back. In addition, when the menu image E1 is switched to the content image E2 corresponding to the selected content item, whether the content is immediately reproduced or not, or whether it can be used is determined according to the content. It may be determined appropriately. For example, the processing unit 111 executes a notification for requesting permission to reproduce the content according to the content item by an image or a sound, and reproduces the content in response to acceptance of the permission operation by the user. May be

  Thus, for example, by displaying the entertainment mode in the level 3 or higher automatic driving mode, when the driver 4 is released from driving, the entertainment content can be conveniently used.

  Subsequently, the image control process will be described with reference to FIG. For example, the processing unit 111 executes an image control process when the display device 100 is powered on in response to the turning on of the ignition of the vehicle 2. In addition, at the time of the start of the said process, the display means 10 assumes that the display in a normal mode as shown in FIG. 3 is performed.

(Image control processing)
First, the processing unit 111 determines whether or not the display means 10 is displaying in the normal mode (step S1), and when displaying in the normal mode (step S1; Yes), executes the process of step S2. Do. On the other hand, when the display is not in the normal mode (step S1; No), the process of step S10 described later is executed.

  In step S2, the processing unit 111 determines whether or not switching to the automatic driving mode can be identified. Here, the specification of switching to the automatic driving mode indicates that (i) the processing unit 111 functions as the driving mode determination unit 111b and the driving mode information Im acquired from the on-vehicle ECU 50 is in the automatic driving mode. Not only when (ii) the function as the operation mode switching estimation unit 111c, as described above, it is also performed when it is estimated that switching from the manual operation mode to the automatic operation mode.

  When the switching to the automatic driving mode can not be specified (step S2; No), the processing unit 111 continues the display of the display means 10 in the normal mode (step S3). On the other hand, when the switching to the automatic operation mode can be specified (step S2; Yes), the processing unit 111 refers to the priority information PE in the memory 112 (step S4) and sets the priority indicated by the priority information PE. In response, the menu item E1 shown in FIG. 4A, in which the content item is arranged, is displayed on the display unit 10 (step S5).

  Subsequently, the processing unit 111 determines whether or not there is a selection operation by the user (mainly the driver 4) (step S6). If there is a selection operation (step S6; Yes), the processing unit 111 stores selection information indicating the content item to be selected by the selection operation in the memory 112, and if necessary, gives priority to the priority information PE. The degree is updated (step S7). As described above, the priority indicated by the priority information PE can be updated according to the selection frequency of the content item by the user and the selection history. On the other hand, when there is no selection operation (step S6; No), the processing unit 111 skips the process to step S9.

  Subsequent to step S7, the processing unit 11 displays a content image E2 indicating the content corresponding to the content item selected and operated in step S6 (step S8). For example, when the content item of "movie" shown in the display area H1 in the menu image E1 is selected by the selection operation, the content image E2 shown in FIG. 4B is displayed.

  Subsequently, the processing unit 111 determines whether or not switching to the manual operation mode can be identified (step S9). Here, the specification of switching to the manual operation mode indicates that (i) the processing unit 111 functions as the operation mode determination unit 111b, and the operation mode information Im acquired from the onboard ECU 50 is in the manual operation mode. Not only when (ii) the function as the operation mode switching estimation unit 111c, as described above, it is also performed when it is estimated that switching from the automatic operation mode to the manual operation mode.

  When switching to the manual operation mode can be specified (step S9; Yes), the processing unit 111 switches the display mode of the display unit 10 from the entertainment mode to the normal mode (step S3), and ends the process. On the other hand, when the switching to the manual operation mode can not be identified (step S9; No), the processing unit 111 ends the processing. Thereafter, the processing unit 111 continuously executes the image control process in a predetermined control cycle until, for example, the power of the display device 100 is turned off.

  Returning to step S1, when the display is not in the normal mode (step S1; No), that is, the menu image E1 is switched in step S5, or the content image E2 is switched in step S8 and displayed in the entertainment mode If it is medium, the processing unit 111 executes the processing of step S10.

  In step S10, it is determined whether or not the content image E2 is being displayed as the entertainment mode, and if the content image E2 is not being displayed (step S10; No), that is, if the menu image E1 is being displayed, the step Execute the process of S6. On the other hand, when the content image E2 is being displayed (step S10; Yes), the processing unit 111 determines whether or not the content end operation has been performed (step S11). When the content end operation has been performed (step S11; Yes), the processes of steps S4 and S5 are executed, and the process returns to the menu image E1.

If it is determined in step S11 that the content end operation has not been performed (step S11; No), the content image E2 is continued as it is, and the processing unit 111 executes the processing of step S9. If the process transitions from step S11 or S8 to S9 and the content image E2 is being displayed, specifying switching to the manual operation mode (step S9; Yes), the processing unit 111 immediately starts from the content image E2 The image is switched to the display image of the normal mode. In addition, when the process transitions to steps S5, S6, and S9 and the menu image E1 is being displayed, when switching to the manual operation mode is specified (step S9; Yes), the processing unit 111 immediately selects the menu image E1. To the display image of the normal mode.
As described above, when the display image is displayed in the entertainment mode, the display mode is normally selected from the entertainment mode, not only when the manual operation mode is actually set, but also when it is estimated that the manual operation mode is set. Since the mode can be switched, the safety of the user (mainly the driver 4) can be secured.

  The present invention is not limited by the above embodiment, modification, and drawings. Changes (including deletion of components) can be made as appropriate without changing the scope of the present invention.

  The projection target of the display light L is not limited to the windshield 3, and may be a combiner configured by a plate-like half mirror, a hologram element, and the like. In addition, the display unit 10 is configured as a head mounted display (HMD: Head Mounted Display) mounted on the head of the driver 4 of the vehicle 2, and the display image displayed by the HMD as a virtual image includes the menu image E1 and the content image. E2 may be displayable. That is, the display means 10 is not limited to the one mounted on the vehicle 2 as long as it is used in the vehicle 2.

  Moreover, although the display means 10 is comprised as HUD and the example which displays the virtual image V was shown in the above embodiment, it is not restricted to this. The display means 10 may be, for example, a display such as an LCD, an OLED, etc. installed on the instrument panel of the vehicle 2.

  Furthermore, although the example has been described above in which the level of the automatic driving when the automatic driving mode is set is level 3 or higher, the present invention is not limited to this as long as the safety of the boarding vehicle of the vehicle 2 can be secured. The automatic driving level when the mode is set may be level 2.

  Further, change, addition, or deletion of each process constituting the image control process shown in FIG. 6 is optional. For example, the switching of the display mode of the display image may be performed only when the driving mode is actually switched without estimating the switching of the driving mode.

  In addition, although the operation program (including the program PG) is assumed to be stored in advance in the ROM of the memory 112, it may be distributed and provided by a removable recording medium. Also, the operation program may be downloaded from another device connected to the display device 100. In addition, the display device 100 may execute each process according to the operation program by exchanging various data with other devices via a telecommunication network or the like.

(1-1) The display device 100 described above is used in the vehicle 2 capable of switching control between the automatic operation mode and the manual operation mode, and the display means 10 for displaying an image (for example, virtual image V); That switching from the manual operation mode to the automatic operation mode has been specified (including estimation) based on the information (operation mode information Im, vehicle speed information Is, proximity distance information Ia, signals D1 to D4, etc.) acquired from And a control unit 110 (an example of a control unit) which causes the display unit 10 to display a menu image E1 in which a plurality of content items including the entertainment content item are indicated. The control unit 110 selects the display on the display unit 10 from the menu image E1 by the selection operation in response to the reception of the selection operation for selecting any of the plurality of content items in the menu image E1. It switches to the content image E2 displaying the content according to the content item.
(1-2) Further, the display control method by the control unit 110 includes a plurality of entertainment content items in response to specifying switching from the manual operation mode to the automatic operation mode based on the information acquired from the vehicle 2. The display unit 10 displays the menu image E1 in which the content item is displayed on the display unit 10, and the display unit 10 receives a selection operation for selecting any of the plurality of content items in the menu image E1. Switching from the menu image E1 to the content image E2 for displaying the content according to the content item selected by the selection operation.
(1-3) In addition, the program PG is for the entertainment content in response to the control unit 110 (an example of the computer) specifying the switching from the manual driving mode to the automatic driving mode based on the information acquired from the vehicle 2 In response to the processing for causing display means 10 to display menu image E1 in which a plurality of content items including an item is shown and the selection operation for selecting any one of the plurality of content items in menu image E1, A process of switching the display on the display means 10 from the menu image E1 to a content image E2 for displaying content corresponding to the content item selected by the selection operation is performed.
Because of this, as described above, the user (mainly the driver 4) can conveniently use the entertainment content during the automatic driving mode.

(2) The display device 100 includes the memory 112 (an example of a storage unit) that stores the priority information PE indicating the priorities of the plurality of content items, and the control unit 110 causes the menu image E1 to display the plurality of content items. You may display in the aspect according to the priority.
(3) Moreover, the said priority may be determined based on the history and / or frequency of selection operation.
In this way, entertainment that reflects the user's preferences can be provided, which is user-friendly.

  In the above description, in order to facilitate understanding of the present invention, the description of known technical matters is appropriately omitted.

DESCRIPTION OF SYMBOLS 1 ... Display system for vehicles 2 ... Vehicles 3 ... Windscreens 4 ... Driver A .. Display surface 100 ... Display device 10 ... Display means 110 ... Control part 111 ... Processing part 111a ... Image processing part, 111b ... Driving mode Discrimination unit, 111 c ... Operation mode switching estimation unit 112 ... Memory, PG ... Program, PE ... Priority information 40 ... Mobile terminal, Ie ... Entertainment information 50 ... On-board ECU
Im ... driving mode information, Is ... vehicle speed information, If ... remaining fuel information, Ia ... proximity distance information 60 ... car navigation system, In ... car navigation information 70 ... manual driving intention detection unit 71 ... contact detection unit D1 ... detection signal 72 ... Seat position detection unit, D2: detection signal 73, in-camera, D3: image signal 74, biological information detection unit, D4, detection signal C: vehicle information image, Ca: remaining fuel information image, Cb: vehicle speed information image E1: menu Image, H1 to H7 ... display area E2 ... content image

Claims (5)

A display device used in a vehicle capable of switching control between an automatic driving mode and a manual driving mode,
Display means for displaying an image;
A menu image showing a plurality of content items including an entertainment content item is displayed on the display means in response to specifying switching from the manual operation mode to the automatic operation mode based on the information acquired from the vehicle Control means for
The control means is configured to select a display on the display means from the menu image by the selection operation in response to reception of a selection operation for selecting any of the plurality of content items in the menu image. Switching to a content image that displays content according to the selected content item,
A display device characterized by Storage means for storing priority information indicating priority of the plurality of content items;
The control means causes the plurality of content items to be displayed in a mode according to the priority in the menu image.
The display device according to claim 1, The priority is determined based on at least one of history and frequency of the selection operation.
The display device according to claim 2, characterized in that: A display control method for displaying an image on display means used in a vehicle capable of switching control between an automatic driving mode and a manual driving mode,
A menu image showing a plurality of content items including an entertainment content item is displayed on the display means in response to specifying switching from the manual operation mode to the automatic operation mode based on the information acquired from the vehicle Step of
In response to reception of a selection operation for selecting any of the plurality of content items in the menu image, display on the display means is performed from the menu image according to the content item selected in the selection operation. Switching to a content image for displaying the selected content;
A display control method characterized in that. A program for displaying an image on display means used in a vehicle capable of switching control between an automatic driving mode and a manual driving mode,
On the computer
A menu image showing a plurality of content items including an entertainment content item is displayed on the display means in response to specifying switching from the manual operation mode to the automatic operation mode based on the information acquired from the vehicle Processing, and
In response to reception of a selection operation for selecting any of the plurality of content items in the menu image, display on the display means is performed from the menu image according to the content item selected in the selection operation. Processing to switch to the content image for displaying the selected content;
A program that runs

Images