JP2018039444A - Display device for vehicle - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device for a vehicle in which a user can organize added information, and which can improve recognition property of information.SOLUTION: A display device for a vehicle 100 allows a user to visually recognize a virtual image which is superposed to a landscape. A control part 10 virtually sets plural display zones in which a position in a depth direction is different, on a front side of a user, identifies a display zone which the user gazes based on gaze position information from a gaze position detection part 20, drives an image formation position adjustment part 80 so that the depth position of the display zone and the image formation position of a virtual image of the display image match, acquires image information which indicates information associated with the identified display zone from a cloud server 200 through a communication part 60, then displays the display image according to the acquired image information on a display unit 70.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a transmissive vehicle display device that allows a user to visually recognize a virtual image superimposed on a landscape.

2. Description of the Related Art Conventionally, a transmissive head mounted display (HMD) device that allows a user to visually recognize a virtual image over a landscape is known (see, for example, Patent Document 1). The HMD device is a display device that is worn on the head, projects display light from a display device to a user using a projection optical system or a light guide, and the like, and displays a virtual image of a display image indicated by the display light to the user. It is to be visually recognized. The user can visually recognize the virtual image obtained by the HMD device by superimposing a front real scene. Further, a technique called augmented reality (AR) can be applied to the HMD device. That is, by displaying an AR image related to a real landscape as a display image, information can be added to the real landscape.
Further, as HMD devices, Patent Documents 2 and 3 disclose techniques capable of changing the imaging position of a virtual image visually recognized by a user. The technique disclosed in Patent Document 2 changes the imaging position of a virtual image by mechanically switching the distance between the display panel and the magnifying optical member by a virtual image distance control means. In addition, the technique disclosed in Patent Document 3 changes the imaging position of a virtual image by image processing by moving an emission region of an image formed by display light from a pair of display driving units.

JP 2014-119786 A Japanese Patent Laid-Open No. 10-262165 JP-A-2015-32131 JP 2010-76524 A

  As described above, a transmissive HMD device can provide information superimposed on a real scene by a virtual image. However, since a virtual image is always visible in the user's field of view, much information is visually recognized. In this case, there is a problem that it is troublesome for the user, and the user cannot organize the information, and the recognizability of each information is lowered. As a vehicle display device, as disclosed in Patent Document 4, a light transmissive display member (combiner (32)) is arranged so as to cover the field of view of a user (driver), and the display member is interposed therebetween. It is known that a virtual image can be visually recognized overlaid with a real landscape. In such a non-wearable vehicle display device as well as the HMD device, since a virtual image is always visible in the user's field of view, if the amount of information to be visually recognized increases, it is troublesome for the user and the user can organize the information. Therefore, there is a problem that the recognizability of each information is lowered.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to provide a vehicle display device that can organize information added by a user and improve information recognizability. To do.

The vehicle display device of the present invention is a vehicle display device that allows a user to visually recognize a virtual image superimposed on a landscape in order to solve the above-described problem,
A gaze position detection unit for detecting a gaze position of the user;
A display that emits display light indicating a display image;
A transmissive display member that is installed in a vehicle so as to cover a field of view of at least one eye of the user, and that causes the display light to enter the user's eye;
A communication unit capable of communicating with an external server;
A control unit that causes the display to display a display image corresponding to image information acquired from the external server via the communication unit;
An imaging position adjustment unit capable of adjusting an imaging position of a virtual image of the display image visually recognized by the user by the display light,
The control unit virtually sets a plurality of display zones with different positions in the depth direction in front of the user, and the display zone in which the user is gazing based on gaze position information from the gaze position detection unit And the imaging position adjustment unit is driven so that the identified depth position of the display zone matches the imaging position of the virtual image of the display image, and is specified from the external server via the communication unit. Acquiring image information indicating information associated with the display zone, and displaying the display image according to the acquired image information on the display;
It is characterized by that.

  According to the present invention, it is possible to organize information added by a user and improve information recognizability.

It is a figure which shows the general view of the display apparatus for vehicles which is 1st embodiment of this invention. It is a block diagram which shows the electric constitution of the display apparatus for vehicles same as the above. It is a figure which shows the state which the user with which the display apparatus for vehicles same as the above boarded. It is a figure which shows an example of the information linked | related with the display zone and display zone which are virtually set in the vehicle display apparatus same as the above. It is a flowchart which shows the display process in the display apparatus for vehicles same as the above. It is a figure which shows the example of a display of the display apparatus for vehicles same as the above. It is a figure which shows the other example of a display of the display apparatus for vehicles same as the above. It is a flowchart which shows the warning display process in the display apparatus for vehicles same as the above. It is a figure which shows the example of a display by the warning display process of the display apparatus for vehicles same as the above.

  Hereinafter, embodiments according to the present invention will be described with reference to the drawings. In addition, this invention is not limited by the following embodiment (The content of drawing is also included). It goes without saying that changes (including deletion of components) can be added to the following embodiments. Moreover, in the following description, in order to make an understanding of this invention easy, description of a known technical matter is abbreviate | omitted suitably.

FIG. 1 is a diagram showing an overview of the vehicle display device 100 according to the first embodiment of the present invention, and FIG. 2 is a diagram showing an electrical configuration of the vehicle display device 100.
The vehicle display device 100 includes a control unit 10, a gaze position detection unit 20, an imaging unit 30, a position information acquisition unit 40, a state information acquisition unit 50, a communication unit 60, a display unit 70, and an imaging. A position adjusting unit 80 and a combiner (display member) 90 are provided.
The vehicle display device 100 is connected to a cloud server (external server) 200 by wireless communication, and constitutes a display system including the vehicle display device 100 and the cloud server 200. The cloud server 200 stores biological information such as personal information and physical information of the user U, map information, and various types of information associated with first, second, and third display zones Z1, Z2, and Z3 described later. The image information shown is accumulated by network communication. The vehicle display device 100 receives arbitrary image information from the cloud server 200 by a display process to be described later, displays a display image indicating various information, and displays a display light indicating the display image using a lens or an optical member (not shown). Then, the image is projected onto the combiner 90, and further incident on the eyes of the user U through the combiner 90, and the user U is made to visually recognize the virtual image of the display image so as to overlap with the scenery in front.

  The control unit 10 is composed of, for example, a microcomputer, and a CPU (Central Processing Unit) that actually performs processing (such as control of the entire vehicle display device 100) executed by the control unit 10 and a RAM ( Random Access Memory), ROM (Read Only Memory) that stores various programs for causing the control unit 10 to execute processes described later, and information (signals) input / output to / from the control unit 10 are digitally converted for the CPU. And various converters that perform analog conversion for output. In addition to the CPU, the control unit 10 may include various dedicated circuits (for example, an image processing circuit) for executing part of the processing performed by the control unit 10 instead of the CPU.

As shown in FIG. 1, the control unit 10 virtually sets first, second, and third display zones Z1, Z2, and Z3 having different depth directions in front of the user U.
The first display zone Z1 is a display zone located between the second display zone Z2 and the third display zone Z3. The second display zone Z2 is a display zone located closer to the depth side (most depth side) than the first display zone Z1. The third display zone Z3 is a display zone located on the user U side (most front side) with respect to the first display zone Z1.
The depth positions of the display zones Z1, Z2, and Z3 are arbitrarily set. As shown in FIG. 3, the user U sits in the driver's seat of the vehicle C and looks at the front of the vehicle C. For example, it can be set as follows. That is, in the third display zone Z3, the vicinity of the steering wheel C1 located between the user U (driver) and the instrument panel C2 is set as the depth position. In the first display zone Z1, the depth position is near the instrument panel C2 on the depth side of the steering C1. The second display zone Z2 has a depth position in the vicinity of a landscape 15 m away from the user U that can be viewed from the windshield, on the depth side of the instrument panel C2. In addition, the above description demonstrated the example of the depth position of 1st, 2nd, 3rd display zone Z1, Z2, Z3, Comprising: 1st, 2nd, 3rd display zone Z1, Z2 , Z3 is not set only for the portions that overlap each part of the vehicle C, but is set to the point where the face of the user U is facing.

  As described above, the cloud server 200 stores image information indicating information associated with the first, second, and third display zones Z1, Z2, and Z3. FIG. 4 shows an example of information associated with the display zones Z1, Z2, and Z3. In the first display zone Z1, the second display zone Z2, and the third display zone Z3, the information having the highest priority in the order of the third display zone Z3, the first display zone Z1, and the second display zone Z2. Associated. That is, with the first display zone Z1 as a reference, information with lower priority is associated with the second display zone Z2, and information with higher priority is associated with the third display zone Z3. The first display zone Z1 has the second highest priority (priority “medium”), for example, the state of the user U (heart rate, pulse, brain wave, etc.) and the state of the vehicle C on which the user U is boarded. Information (first information) related to the user U and the vehicle C such as (traveling speed, engine speed, remaining fuel, etc.) is associated. The second display zone Z2 has the lowest priority (priority “low”), and for example, information is superimposed on the scenery such as neighboring store information, route guidance information, and near-miss information with a predetermined positional relationship. AR information (second information) to be associated with each other. The third display zone Z3 has the highest priority (priority “high”), for example, information related to a warning state with a high degree of urgency such as warning information such as a physical condition of the user U or a failure of the vehicle C (third Information).

  The gaze position detection unit 20 detects the gaze position of the user U by gaze detection or eye axis measurement. In the case of gaze detection, the eyes of the user U are imaged with a CCD camera or the like, and the gaze direction of the user U is detected as a gaze position by pattern matching processing of image processing technology. In the case of the measurement of the axial axis, the user's U's eyeball is irradiated with ultrasonic waves, and the distance to the front lens surface, the rear surface, and the front surface of the retina is calculated from the echo propagation time. The length of the lens including the axial length of the lens and vitreous tissue from the front of the cornea to the front of the retina) and the lens thickness are measured, and the focus position of the user U is detected as the gaze position from the measurement result. The gaze position detection unit 20 transmits gaze position information of the user U to the control unit 10.

  The imaging unit 30 includes, for example, a CCD camera and is installed at a predetermined position (including the combiner 90) of the vehicle C, and images a landscape in front of the user U. The imaging unit 30 transmits imaging information (landscape image information) obtained by imaging a landscape in front of the user U to the control unit 10.

  The position information acquisition unit 40 includes a GPS antenna, for example, and acquires the current position of the user U. The position information acquisition unit 40 transmits position information indicating the current position of the user U to the control unit 10.

  The state information acquisition unit 50 is connected to various sensors that detect the state of the user U and the vehicle C, acquires user state information indicating the state of the user U and vehicle state information indicating the state of the vehicle C, and performs control. To the unit 10. In addition, as a state of the user U, a heart rate, a pulse, a brain wave etc. are mentioned, for example. The state of the vehicle C includes travel speed, engine speed, remaining fuel, travel distance, and the like.

  The communication unit 60 includes a transmission unit and a reception unit that perform wireless communication with the cloud server 200, such as gaze position information from the control unit 10, gaze display zone information, imaging information, position information, and state information described below. Various information is transmitted to the cloud server 200, image information is received from the cloud server 200, and is transmitted to the control unit 10.

  The display device 70 is composed of, for example, a TFT liquid crystal display device or an organic EL display device, displays a predetermined display image, and emits display light representing the display image.

  The imaging position adjustment unit 80 can change the imaging position of the virtual image of the display image visually recognized by the user U. Specifically, as an example, in order to change the optical path length of the display light from the display unit 70 to the user U, the display unit 70 can be moved to change the distance between the display unit 70 and a lens (not shown). It consists of a motor that performs. Further, when an optical member is provided between the display 70 and the lens, the position of the optical member may be changed. Further, the image formation position may be adjusted by performing image processing, such as adjusting the position of the image incident on the left and right eyes in order to change the image formation position according to the left and right parallax, and an arbitrary focus. The image may be displayed so as to be blurred so that the image is clearly visible at a distance. In this case, the control unit 10 may also serve as the imaging position adjustment unit 80. Therefore, the adjustment and change of the imaging position includes the case based on the illusion of the user U.

  The combiner 90 is a light-transmissive display member that is installed on the vehicle C so as to cover the field of view of at least one eye (in this embodiment, the right eye) of the user U. The combiner 90 is made of a highly light-transmitting material such as PC (polycarbonate resin), PMMA (polymethyl methacrylate resin), or glass. Specifically, the combiner 90 is fixed to, for example, the ceiling or seat (seat or headrest) of the vehicle C. The display light emitted from the display device 70 is projected onto the combiner 90 through a lens and an optical member, and is reflected on the combiner 90 to enter the user U's eyes. The vehicle display device 100 includes a head direction detection unit that detects the direction of the head of the user U, and a display member driving unit that moves the combiner 90 according to the direction of the head of the user U. And the control unit 10 determines the direction of the head of the user U based on at least one of gaze position information and head direction information indicating the head direction of the user U acquired from the head direction detection unit. Regardless, the state in which the combiner 90 covers the field of view of the user U may be maintained, and when the user U looks back and forth, or when looking back, other predetermined actions that may contact the combiner 90 When taking the operation, the combiner 90 may be moved so as not to contact the user U. The combiner 90 may be deformable manually or automatically. In addition, an emission direction adjusting unit (for example, including an optical member such as a mirror and a lens and a driving unit that changes the angle of the optical member) that changes the emission direction of the display light of the display unit 70 is provided. Even if the emission direction of the display light is adjusted to be incident on the eyes of the user U via the combiner 90 based on at least one of the gaze position information and the head direction information. Good. Furthermore, both the movement of the combiner 90 and the adjustment of the emission direction of the display light may be performed.

  Next, the normal display process based on the gaze position of the vehicle display device 100 will be described with reference to FIG.

  First, in step S <b> 101, the control unit 10 acquires gaze position information indicating the gaze position of the user U from the gaze position detection unit 20. Note that the acquisition of information includes the case of calculating based on the received information in addition to the case of receiving.

  Next, in step S102, the control unit 10 displays the display zone (hereinafter referred to as the display zone) in which the user U is gazing from the first, second, and third display zones Z1, Z2, and Z3 based on the gaze position information. , Also referred to as a gaze display zone). Specifically, the control unit 10 specifies a display zone whose depth position is closest to the gaze position as the gaze display zone. A case where it is determined that there is no gaze display zone based on the gaze position information may be included.

  In step S <b> 103, the control unit 10 acquires imaging information obtained by imaging a landscape image in front of the user U from the imaging unit 30.

  In step S <b> 104, the control unit 10 acquires position information indicating the current position of the user U from the position information acquisition unit 40.

  Further, in step S105, the control unit 10 transmits user status information and vehicle status information (hereinafter collectively referred to as status information) indicating the status of the moving body moving together with the user U and the user U from the status information acquisition unit 50. ) To get.

  Next, in step S106, the control unit 10 determines whether or not a new warning state has occurred based on the gaze position information, imaging information, and state information acquired in steps S101 and S103 to S105. Note that the warning state in the present embodiment means a state in which the content indicated by the highly urgent information displayed in the third display zone Z3 has occurred. In addition to the information described above, the control unit 10 may receive information indicating the occurrence of a warning state from the outside and determine whether or not a new warning state has occurred. If it is determined in step S106 that a new warning condition has not occurred (step S106; No), the control unit 10 executes the processing from step S107 onward, and if it is determined that a new warning condition has occurred ( In step S106; Yes), the control unit executes warning display processing in step S111. The warning display process will be described in detail later.

In step S107, the control unit 10 cloudes the gaze display zone information indicating the gaze display zone determined in step S102, the gaze position information, the imaging information, and the state information acquired in steps S101 and S103 to S105 via the communication unit 60. Transmit to server 200.
The cloud server 200 that has received these pieces of information from the vehicular display device 100 (the communication unit 60 thereof) has the display zone specified from the image information stored in itself based on the received gaze display zone information and various information. Image information indicating the associated information is extracted. Specifically, when the gaze display zone is the first display zone Z1, the cloud server 200 sets the type of information to be extracted as “information about the user U and the vehicle C” associated with the first display zone Z1. Furthermore, image information to be displayed based on the state information (for example, numbers, characters, designs, etc. representing the value and degree of the state information) is extracted. When the gaze display zone is the second display zone Z2, the cloud server 200 sets the type of information to be extracted as “AR information superimposed on the landscape” associated with the second display zone Z2, and further Image information to be displayed based on the position information, the imaging information, and the position information (for example, store information around the gaze position of the user U, a route guidance mark superimposed on the road, and near-miss information around the current position) is extracted. When the gaze display zone is the third display zone Z3, the cloud server 200 sets the type of information to be extracted as “information related to a warning state with a high degree of urgency” associated with the third display zone Z3. Then, image information to be displayed based on the state information or the like (for example, characters or symbols for notifying the user U of poor physical condition, moving body failure or malfunction) is extracted. The cloud server 200 transmits the extracted image information to the vehicle display device 100.

  Next, in step S <b> 108, the control unit 10 receives the image information extracted by the cloud server 200 via the communication unit 60. In addition, the display apparatus 100 for vehicles receives beforehand some image information which shows the information linked | related with each display zone Z1-Z3 from the cloud server 200, and stores it in an internal memory | storage part (not shown), Of the information associated with the gaze display zone from the storage unit based on the gaze display zone information indicating the gaze display zone determined in step S102, the gaze position information, imaging information, and state information acquired in steps S101 and S103 to S105. Image information to be displayed may be read.

  Next, in step S109, the control unit 10 drives the imaging position adjustment unit 80 so that the depth position of the gaze display zone specified in step S102 matches the imaging position of the virtual image of the display image.

  Next, in step S110, the control unit 10 causes the display device 70 to display a display image corresponding to the image information received from the cloud server 200 in step S107 (updates the display image). At this time, it is desirable to adjust the emission direction of the display light to the combiner 90 so that the user U can visually recognize the virtual image of the display image based on the gaze position information.

  By repeatedly executing the above processing, the vehicle display device 100 can cause the user U to visually recognize information related to the gaze position as a virtual image according to the gaze position of the user U. As a result, information related to the position where the user U is gazing is automatically switched and displayed, so that the information added by the virtual image can be easily arranged by the user U, and the information recognizability is improved. be able to.

  FIG. 6 shows a display example of the vehicle display device 100 when the user U is driving the vehicle C. In addition, in FIG. 6, the virtual image of the display image visually recognized by the user U is shown. FIG. 6A shows an example in which the gaze display zone is the first display zone Z1. In the example shown in FIG. 6A, a display image indicating the traveling speed (60 Km / h) of the vehicle C and the pulse (80 bpm) of the user U is displayed on the display unit 70 as information regarding the user U and the vehicle C. The virtual image V1 of the display image is visually recognized by the user U. FIG. 6B shows an example in which the gaze display zone is the second display zone Z2. In the example shown in FIG. 6B, a display image showing a route guidance mark (arrow mark) and a parking lot mark (icon including “P”) is displayed on the display unit 70 as AR information superimposed on the landscape. The virtual image V2 of the display image is visually recognized by the user U. FIG. 6C shows an example in which the gaze display zone is the third display zone Z3. In the example shown in FIG. 6C, a display showing a text message (letter “fuel reduction. Please refuel”) that informs the decrease of the remaining fuel (warning state) as information on the warning state with a high degree of urgency. The image is displayed on the display 70, and the virtual image V3 of the display image is visually recognized by the user U.

  FIG. 7 shows another display example of the vehicle display device 100 when the user U is driving the vehicle C. In another display example, based on the gaze position information acquired in step S101, information indicating that the virtual image is located in the vicinity of the gaze position P among the information included in the display image is obtained from the vicinity of the gaze position P of the user U. The display image is displayed on the display unit 70 so as to be emphasized with respect to the information located outside. In the present embodiment, the control unit 10 uses the gaze position information and the position of the information in the display image displayed on the display unit 70, so that at least a part of the virtual image includes the gaze position P of the user U. If the virtual image is determined to be located outside the gaze area E, the outside of the vicinity of the gaze position P of the user U is determined. It is determined that it is located in Note that the gaze region E is a circular range that extends in the horizontal direction of the vehicle C (a direction perpendicular to the front-rear direction of the user U) with the gaze position P as the center. In addition, in FIG. 7, the virtual image of the display image visually recognized by the user U is shown. FIG. 7 shows an example in which the gaze display zone is the second display zone Z2. In the example shown in FIG. 7, a display image including a route guidance mark (arrow mark) and a parking lot mark (icon including “P”) is displayed on the display unit 70 as AR information to be superimposed on the landscape. The virtual image V22 is visually recognized by the user U. Further, among the AR information included in the display image, a part of the virtual image of the route guidance mark is located inside the gaze area E, and the parking mark is located outside the gaze area E of the parking lot mark. A display image in which the guidance mark is emphasized more than the parking lot mark is displayed on the display 70. Here, emphasizing specific information over other information means that the specific information is visually recognized by the user U more clearly than the other information. In addition to making the display brightness higher than other information, changing the display color, etc., lowering the display brightness of other information, changing the display color of other information from color to monochrome (black and white), other information There is a method of relatively emphasizing by lowering specific information that emphasizes the visibility of other information, such as blurring display (shifting the focus). In the other display examples, when the gaze display zones are the first and third display zones Z1 and Z3, the information included in the display image is similarly based on the gaze position information acquired in step S101. Among them, information indicating that at least a part of the virtual image is located inside the gaze area E including the gaze position P of the user U, that is, in the vicinity of the gaze position P, is information that the virtual image is located outside the gaze area E of the user U. The display image is displayed on the display unit 70 so as to be emphasized, and the virtual image is visually recognized by the user U.

Next, the warning display process in step S111 will be described with reference to FIG.
First, in step S <b> 121, the control unit 10 transmits warning state occurrence information indicating the occurrence of a warning state, gaze position information, imaging information, and state information acquired in steps S <b> 101 and S <b> 103 to S <b> 105 via the communication unit 60 to the cloud server 200. Send to. At this time, gaze display zone information may also be transmitted.
The cloud server 200 that has received these pieces of information from the vehicle display device 100 (the communication unit 60 thereof), based on the received warning state occurrence information and various information, determines the third display zone Z3 from the image information stored in itself. Image information indicating information associated with is extracted. Specifically, the cloud server 200 sets the type of information to be extracted as “information related to a warning state with a high degree of urgency” associated with the third display zone Z3, and image information to be displayed based on the state information and the like. (Image information related to a newly generated warning state) is extracted. The cloud server 200 transmits the extracted image information to the vehicle display device 100. Moreover, when the cloud server 200 receives the gaze display zone information, the cloud server 200 may also extract image information indicating information associated with the gaze display zone from the image information stored in itself.

  Next, in step S <b> 122, the control unit 10 receives the image information extracted by the cloud server 200 via the communication unit 60. At this time, the image information received from the cloud server 200 is image information indicating “information regarding a warning state with a high degree of urgency” associated with at least the third display zone Z3.

  Next, in step S123, the control unit 10 drives the imaging position adjustment unit 80 so that the depth position of the third display zone Z3 matches the imaging position of the virtual image of the display image.

  Next, in step S124, the control unit 10 causes the display device 70 to receive “information related to a warning state with a high degree of urgency” associated with the third display zone Z3 received from the cloud server 200 in step S122. A display image corresponding to is displayed (the display image is updated).

  By executing the above processing, when the warning state newly occurs, the vehicle display device 100 visually recognizes information with high priority as a virtual image to the user U regardless of the gaze position of the user U. Can be made. As a result, the newly generated high priority information is automatically displayed at the imaging position close to the user U, so that the information added by the virtual image can be easily arranged by the user U, and the information recognizability. Can be improved. When the warning state continues, the control unit 10 repeatedly displays the display image indicating information associated with the gaze display zone of the user U by repeatedly executing the processing from step S101. That is, when the gaze position of the user U is not maintained in the third display zone Z3, the image formation position of the virtual image moves to another display zone, and the display content of the visually recognized virtual image is highly urgent The information related to the warning state is switched to information associated with the gaze display zone of the user U.

  FIG. 9 shows a display example by the warning display process of the vehicle display device 100 when the user U is driving the vehicle C. In addition, in FIG. 8, the virtual image of the display image visually recognized by the user U is shown. In the first example shown in FIG. 9A, information related to a warning state with a high degree of urgency (notification of a decrease in remaining fuel) is issued instead of displaying information according to the gaze position of the user U by warning display processing. A display image including only the text message (letter “fuel reduction. Please refuel”) is displayed on the display 70, and a virtual image V4 of the display image is visually recognized by the user U. In the second example shown in FIG. 9B, display of information associated with the gaze display zone of the user U (AR information superimposed on the landscape (route guidance mark (arrow mark) and parking lot) is performed by warning display processing. Mark (icons including “P”))), a warning message with a high degree of urgency (a text message that informs the reduction of the remaining fuel (a letter “fuel reduction. Please refuel”)) is displayed on the user U. The display image is displayed on the display unit 70 so that the information relating to the warning state with high urgency is emphasized more than the information associated with the gaze display zone of the user U, and a virtual image of the display image. V5 is visually recognized by the user U. As a specific method for emphasizing information, the above-described methods such as making the display brightness higher than other information and changing the display color are used. In the third example shown in FIG. 9C, display of information associated with the gaze display zone of the user U (AR information superimposed on the landscape (route guidance mark (arrow mark) and parking lot) is performed by warning display processing. Mark (icons including “P”))), a warning message with a high degree of urgency (a text message that informs the reduction of the remaining fuel (a letter “fuel reduction. Please refuel”)) is displayed on the user U. The display image is displayed on the display unit 70 so that the information associated with the gaze display zone of the user U is less visible than the information related to the warning state with a high degree of urgency. A virtual image V6 of the image is visually recognized by the user U. Specific methods for lowering the visibility of information include lowering its display brightness compared to other information, lowering saturation and / or brightness, blurring the display (shifting the focus), and part (eg, There are methods such as hiding a portion overlapping with information related to a high warning state and a surrounding portion, and reducing the size. Furthermore, as a method of lowering the visibility of information as in the virtual image V7 of the display image in the example shown in FIG. 9D, information related to the gaze display zone of the user U is information related to a warning state with a high degree of urgency. It may be moved to a display position that does not overlap.

The vehicle display device 100 according to the present embodiment is a vehicle display device that allows a user U to visually recognize a virtual image superimposed on a landscape, a gaze position detection unit 20 that detects a gaze position of the user U, and a display image. A display 70 that emits display light to be displayed, a transmissive combiner 90 that is installed in the vehicle C so as to cover the field of view of at least one eye of the user U, and that makes the display light incident on the eye of the user U; A communication unit 60 capable of communicating with the cloud server 200, a control unit 10 that displays a display image corresponding to image information acquired from the cloud server 200 via the communication unit 60, and a user U by the display light An image forming position adjusting unit 80 capable of adjusting the image forming position of the virtual image of the display image visually recognized by
The control unit 10 virtually sets a plurality of display zones Z1, Z2, and Z3 having different positions in the depth direction in front of the user U, and the user U gazes based on the gaze position information from the gaze position detection unit 20. The display position is determined, and the imaging position adjustment unit 80 is driven so that the depth position of the specified display zone coincides with the imaging position of the virtual image of the display image. Image information indicating information associated with the display zone specified from the server 200 is acquired, and the display image corresponding to the acquired image information is displayed on the display unit 70.

  According to this, since the information related to the position where the user U is gazing is automatically switched and displayed, the information added by the virtual image can be easily arranged by the user U, and the information recognizability is improved. Can be improved. Moreover, since the combiner 90 is installed in a vehicle, the display device 100 for vehicles can reduce the mounting load of the user U compared with the HMD apparatus which the user U mounts | wears directly on a head.

In addition, in the vehicle display device 100, a first display zone Z1 and a second display zone Z2 located on the depth side of the first display zone Z1 are set as a plurality of display zones.
In the cloud server 200, the first information related to the user U and / or the vehicle C is stored in association with the first display zone Z1, and the second information is superimposed on the landscape in association with the second display zone Z2. Is stored.
Furthermore, in the vehicle display device 100, as a plurality of display zones, a third display zone Z3 located further on the front side than the first display zone Z1 is set,
In the cloud server 200, the third information related to the warning state is stored in association with the third display zone Z3.
According to this, since information with different priorities is automatically switched and displayed according to the position where the user U is gazing, the information added by the virtual image can be easily arranged by the user U, and the information is visually recognized. Can be improved.

Further, in the vehicle display device 100, when the control unit 10 causes the display 70 to display the display image corresponding to the acquired image information, the information included in the display image based on the gaze position information. Information displayed on the display unit 70 so that the virtual image is emphasized with respect to information located outside the vicinity of the user's gaze position P. Display an image.
According to this, among the information added by the virtual image by the user U, information closer to the gaze position can be recognized instantaneously, and the visibility of the information can be improved.

Further, in the vehicle display device 100, the control unit 10 determines the occurrence of the warning state, and when it is determined that the warning state has occurred, the virtual image of the display image is determined regardless of the determined display zone. The imaging position adjustment unit 80 is driven so that the imaging position matches the depth position of the third display zone Z3, and image information indicating the third information is acquired from the cloud server 200 via the communication unit 60. Then, the display image corresponding to the image information indicating the acquired third information is displayed on the display unit 70.
According to this, it is possible to preferentially display information related to a newly generated warning state, and it is possible to provide optimal information according to the situation.

Further, in the vehicular display device 100, the control unit 10 determines that the warning state has occurred, and when the display image corresponding to the image information indicating the third information is displayed on the display device 70, the specific information is specified. The display image is displayed on the display unit so as to include the information associated with the display zone and the third information, and to emphasize the third information more than the information.
According to this, when information related to a newly generated warning state is preferentially displayed, it is easy for the user U to recognize high-priority information while recognizing the presence of information related to the gaze position of the user U. Can grasp.

Further, in the vehicular display device 100, the control unit 10 determines that the warning state has occurred, and when the display image corresponding to the image information indicating the third information is displayed on the display device 70, the specific information is specified. The display image is displayed on the display unit so that the information includes the information associated with the display zone and the third information, and the information is less visible than the third information.
According to this, when information related to a newly generated warning state is preferentially displayed, it is easy for the user U to recognize high-priority information while recognizing the presence of information related to the gaze position of the user U. Can grasp.

Further, in the vehicle display device 100, the control unit 10 combines the display light from the display unit 70 based on at least one of the gaze position information and the head direction information indicating the orientation of the head of the user U. The emission direction to 90 is adjusted by the emission direction adjusting unit, and / or the position of the combiner 90 is moved by the display member driving unit.
According to this, even in the configuration in which the display member is installed in the vehicle, the user U can visually recognize the information regardless of the orientation of the user U's head.

  The present invention is suitable for a vehicle display device that allows a user to visually recognize a virtual image superimposed on a landscape.

DESCRIPTION OF SYMBOLS 100 Display apparatus for vehicles 10 Control part 20 Gaze position detection part 30 Imaging part 40 Position information acquisition part 50 State information acquisition part 60 Communication part 70 Display device 80 Imaging position adjustment part 90 Combiner (display member)
C Vehicle U User V1 to V7, V22 Virtual image of display image

Claims (8)

A vehicle display device that allows a user to visually recognize a virtual image superimposed on a landscape,
A gaze position detection unit for detecting a gaze position of the user;
A display that emits display light indicating a display image;
A transmissive display member that is installed in a vehicle so as to cover a field of view of at least one eye of the user, and that causes the display light to enter the user's eye;
A communication unit capable of communicating with an external server;
A control unit that causes the display to display a display image corresponding to image information acquired from the external server via the communication unit;
An imaging position adjustment unit capable of adjusting an imaging position of a virtual image of the display image visually recognized by the user by the display light,
The control unit virtually sets a plurality of display zones with different positions in the depth direction in front of the user, and the display zone in which the user is gazing based on gaze position information from the gaze position detection unit And the imaging position adjustment unit is driven so that the identified depth position of the display zone matches the imaging position of the virtual image of the display image, and is specified from the external server via the communication unit. Acquiring image information indicating information associated with the display zone, and displaying the display image according to the acquired image information on the display;
A display device for a vehicle. As the plurality of display zones, a first display zone and a second display zone located on the depth side of the first display zone are set,
In the external server, first information relating to the user and / or the vehicle is stored in association with the first display zone, and the second information is superimposed on the landscape in association with the second display zone. Information is stored,
The vehicular display device according to claim 1. As the plurality of display zones, a third display zone located further on the front side than the first display zone is set,
In the external server, third information related to a warning state is stored in association with the third display zone.
The vehicle display device according to claim 2. The control unit determines the occurrence of the warning state, and when it is determined that the warning state has occurred, the control unit displays the imaging position of the virtual image of the display image regardless of the determined display zone in the third display. The imaging position adjustment unit is driven to match the depth position of the zone, the image information indicating the third information is acquired from the external server via the communication unit, and the display unit acquires the image information. Displaying the display image according to image information indicating third information;
The vehicular display device according to claim 3. The control unit determines that the warning state has occurred, and displays the display image according to the image information indicating the third information on the display, and the control unit is associated with the specified display zone. Including the information and the third information, and causing the display to display the display image such that the third information is emphasized more than the information.
The vehicular display device according to claim 4. The control unit determines that the warning state has occurred, and displays the display image according to the image information indicating the third information on the display, and the control unit is associated with the specified display zone. Including the information and the third information, and causing the display to display the display image so that the information is less visible than the third information.
The vehicular display device according to claim 4. When the control unit displays the display image corresponding to the acquired image information on the display, the virtual image of the information included in the display image based on the gaze position information is the user's virtual image. Displaying the display image on the display so that the virtual image of the information positioned near the gaze position is emphasized with respect to information positioned outside the gaze position of the user.
The vehicle display device according to claim 1, wherein the display device is a vehicle display device. The control unit outputs an emission direction of the display light from the display to the display member based on at least one of the gaze position information and head direction information indicating the orientation of the user's head. Adjusting by the adjusting unit and / or moving the position of the display member by the display member driving unit;
The vehicular display device according to claim 1.

Images