WO2023199896A1

WO2023199896A1 - Display device

Info

Publication number: WO2023199896A1
Application number: PCT/JP2023/014594
Authority: WO
Inventors: 凌高野
Original assignee: 日本精機株式会社
Priority date: 2022-04-11
Filing date: 2023-04-10
Publication date: 2023-10-19

Abstract

Provided is a display device capable of having visibility adapted to the circumstances of a viewer. A display device according to the present embodiment comprises: a display 11 for displaying one or more images; a stress value acquisition unit 31 for acquiring a stress value, which is information relating to the magnitude of stress of a viewer 4 viewing an image; and a display control unit 33 for controlling the image displayed by the display 11 in accordance with the stress value acquired by the stress value acquisition unit 31. The display control unit 33 may reduce the number of images if the stress value reaches or exceeds a first value and increase the number of images if the stress value reaches a second value, which is less than or equal to the first value.

Description

display device

The present disclosure relates to a display device for vehicles and the like.

A head-up display, which is an example of a display device, supports the driver's driving operations by displaying images that represent information necessary for driving in a manner that allows the driver to intuitively understand the actual scenery that the driver sees. do. In such a head-up display, a technique is conventionally known that improves the visibility of an image including an AR image superimposed on a real object.

Japanese Patent Application Publication No. 2020-142792

A head-up display forms an image so that information is visible in front of the vehicle. For this reason, if too many images are displayed in the direction of the driver's line of sight, there is a risk that this will actually hinder driving.

The present disclosure has been made in consideration of such circumstances, and aims to provide a display device that can have visibility suitable for the viewer's situation.

In order to solve the above-mentioned problems, a display device of the present disclosure includes a display device that displays one or more images, and a stress value that acquires a stress value that is information regarding the magnitude of stress of a viewer viewing the image. The display device includes an acquisition unit, and a display control unit that controls an image to be displayed on the display according to the stress value acquired by the stress value acquisition unit.

The display device of the present disclosure can have visibility suitable for the viewer's situation.

The figure which shows the system configuration example of HUD in this embodiment. FIG. 3 is an explanatory diagram showing a virtual display area formed in front of a vehicle. 5 is a flowchart illustrating display number control processing executed by the HUD. FIG. 4 is an explanatory diagram showing a display area when an image with a low priority is hidden from the display area of FIG. 3; FIG. 7 is an explanatory diagram showing another virtual display area formed in front of the vehicle. FIG. 6 is an explanatory diagram showing a display area when an image with a low priority is hidden from the display area of FIG. 5; FIG. 7 is an explanatory diagram showing yet another virtual display area formed in front of the vehicle. FIG. 8 is an explanatory diagram showing a display area when a part of an image with a low priority is hidden from the display area of FIG. 7; FIG. 9 is an explanatory diagram showing a display area when a part of the image in FIG. 8 is hidden; 10 is an explanatory diagram showing a display area when a part of the image in FIG. 9 is hidden; FIG.

Embodiments of the display device of the present disclosure will be described based on the accompanying drawings. The display device of the present disclosure can be applied to, for example, a display device mounted on a vehicle such as an automobile or a motorcycle, a ship, an aircraft, an agricultural machine, or a construction machine. The present embodiment will be described using an example in which the display device is a head-up display (HUD) that is mounted on a vehicle and displays required information based on various information acquired from the vehicle.

FIG. 1 is a diagram showing an example of the system configuration of the HUD 10 in this embodiment.
FIG. 2 is an explanatory diagram showing a virtual display area 23 formed in front of the vehicle 1. As shown in FIG.

In the following description, "front", "rear", "upper", "lower", "right" and "left" are defined as "Fr.", "Re.", "To." in FIGS. 1 to 10. ”, “Bo.”, “R”, and “L”.

The HUD 10 is mounted within the instrument panel of the vehicle 1. The HUD 10 includes a display 11, a plane mirror 12, a concave mirror 13, a housing 15, and a control unit 30.

The display 11 is, for example, a TFT (Thin Film Transistor) type liquid crystal display or an organic EL (Electroluminescence) display. The display device 11 emits display light L related to an image to be viewed by the driver 4 (viewer) of the vehicle 1, and displays one or more images in the display area 23. Note that the display device 11 may include a projector and a screen that constitutes a display surface.

The plane mirror 12 reflects the display light L emitted by the display 11 toward the concave mirror 13. The concave mirror 13 further reflects the display light L reflected by the plane mirror 12 and emits it toward the windshield 3. The concave mirror 13 has a function as a magnifying glass, magnifies the image displayed on the display 11, and reflects the image toward the windshield 3 (projection member). That is, the virtual image visually recognized by the driver 4 is an enlarged image of the image displayed on the display 11.

The display light L reflected by the concave mirror 13 is irradiated onto the windshield 3 of the vehicle 1. The driver 4 of the vehicle 1 visually recognizes the reflected light of the display light L related to the image on the windshield 3 as a virtual image within the rectangular virtual display area 23 . Thereby, the image is displayed in the display area 23 as a virtual image that is displayed via the windshield 3 (in front of the windshield 3) so as to be superimposed on the actual scene in the field of view of the driver 4. That is, the image can be visually recognized as a so-called AR (Augmented Reality) image that is displayed with the actual scene in front of the vehicle 1 as the background.

The housing 15 accommodates the display 11, the plane mirror 12, and the concave mirror 13 inside the housing 15. Furthermore, the housing 15 houses a control board on which the control unit 30 is mounted.

In particular, the control unit 30 controls the display 11 based on information acquired from each part of the vehicle 1, which will be described later. The control unit 30 is a microprocessor, microcontroller, graphic controller, integrated circuit, etc., and executes predetermined processing. The control unit 30 particularly includes a stress value acquisition unit 31, a priority determination unit 32, and a display control unit 33.

The stress value acquisition unit 31 acquires, for example, a numerical stress value, which is information regarding the magnitude of stress of the driver 4 who visually recognizes the image. The stress value acquisition unit 31 acquires detection results from, for example, the biological sensor 7, posture sensor 8, and camera 9 installed in the vehicle 1, and performs necessary calculations to acquire a numerical stress value. The stress value acquisition unit 31 may perform calculations based on the detection results obtained from any one of the biological sensor 7, the posture sensor 8, and the camera 9, or may perform calculations based on the detection results obtained from the biological sensor 7, the posture sensor 8, and the camera 9. The calculation may be performed based on the detection results obtained.

The biosensor 7 is, for example, a microwave Doppler sensor type, and irradiates microwaves toward the human body and measures the reflected waves. The biosensor 7 detects heart rate fluctuations of the driver 4 by detecting minute vibration speeds on the body surface caused by heartbeats. The posture sensor 8 is disposed on the driver's seat, and measures body movements and posture changes by calculating the pressurization balance of the driver 4. The camera 9 captures an image of the driver's 4 face.

The stress value acquisition unit 31 obtains a stress value from information calculated from at least one of the heart rate fluctuation of the driver 4, the driving posture of the driver 4, and the face image of the driver 4, which are the detection results obtained from these. Calculate. The stress value acquisition unit 31 calculates a stress value based on the heartbeat interval acquired from the biological sensor 7, for example. Further, the stress value acquisition unit 31 calculates the degree of fatigue or stress as a stress value from changes in body movements and posture acquired from the posture sensor 8. The stress value acquisition unit 31 calculates heart rate fluctuation by analyzing temporal changes in the RGB signals of the skin area of the driver's 4 face acquired from the camera 9, and calculates the stress value based on this.

In the following description, it is defined that the larger the stress value, the greater the stress, and the smaller the stress value, the smaller the stress.

The priority determination unit 32 determines the number of images to be displayed in the display area 23 based on the stress value calculated by the stress value acquisition unit 31. Furthermore, the priority determination unit 32 determines the images to be displayed on the display 11 based on the priority assigned to each image in advance and the determined number of displays. The priority determining unit 32 determines the number of displays so that the larger the stress value is, the smaller the display number is, and the smaller the stress value is, the larger the display number is. The priority indicates the degree to which each image is preferentially displayed in the display area 23, and is relatively assigned and set in advance between the images.

The display control unit 33 acquires information from the car navigation system of the vehicle 1 and the vehicle ECU (Electronic Control Unit), and controls the images to be displayed. Specifically, the display control unit 33 acquires information regarding route guidance from the car navigation system, acquires vehicle information necessary for driving the vehicle 1 such as vehicle speed and engine rotation speed from the vehicle ECU, and so on. Generate relevant images. Furthermore, the display control unit 33 controls the image displayed on the display 11 based on the information determined by the priority determination unit 32 in accordance with the stress value acquired by the stress value acquisition unit 31 (for details, see (described later).

Here, the HUD 10 transmits necessary information to the driver 4 via various images depending on the situation of the vehicle 1. However, if an image, especially an AR image superimposed on a real scene, is always displayed in the field of view of the driver 4, there is a risk that the display of the image may be more bothersome. On the other hand, the HUD 10 in this embodiment can perform a display suitable for the situation of the driver 4 by controlling the image displayed in the display area 23 according to the level of stress of the driver 4. . That is, the HUD 10 reduces the number of images displayed as the stress of the driver 4 increases, and increases the number of images displayed as the stress decreases. The process of controlling the number of images displayed by the HUD 10 will be described in detail below.

FIG. 3 is a flowchart illustrating the display number control process executed by the HUD 10. This display number control process is a process that is always executed while the HUD 10 is activated. Furthermore, whether or not to execute the display number control process may be set by the driver 4 at his or her discretion.

In step S1, the stress value acquisition unit 31 acquires required detection results from the biological sensor 7, posture sensor 8, and camera 9, and performs necessary calculations to acquire a stress value. The stress value acquisition unit 31 outputs the acquired stress value to the priority determination unit 32.

In step S2, the priority determining unit 32 determines that the acquired stress value is greater than or equal to a threshold (first value, hereinafter referred to as "non-display determination threshold") for determining whether or not to reduce display of the image. Determine whether or not. When determining that the stress value is equal to or greater than the non-display determination threshold (YES in step S2), the priority determination unit 32 determines the number of images to be displayed in the display area 23 in step S3. That is, when the stress value becomes equal to or greater than the non-display determination threshold, the priority determining unit 32 determines the number subtracted from the currently displayed number of images as the number of images to be displayed.

The priority determination unit 32 may determine the display number to be a predetermined number less than the current display number (for example, the current display number - 1), or a predetermined number (for example, 2). ) may be determined as the display number. Furthermore, the priority determination unit 32 may set the non-display determination threshold in multiple stages, and may determine such that the larger the non-display determination threshold, the smaller the number of items to be displayed. Furthermore, the priority determining unit 32 may gradually reduce the number of displayed items when the stress value is equal to or higher than the non-display determination threshold for a predetermined period of time.

Furthermore, the priority determination unit 32 determines the images to be displayed according to the determined number of displays, based on the priority assigned to the currently displayed image. For example, the

images

21a, 21b, 21c, 21d, and 21e displayed in the display area 23 of FIG. 2 are assigned priorities such as image 21a<image 21b<image 21c<image 21d<image 21e. shall be. When the priority determining unit 32 determines the current display number minus one as the display number, the priority determining unit 32 determines that the image 21a with the lowest priority is an image to be hidden, and the

other images

21b and 21c are , 21d, and 21e are determined as images to be maintained. Furthermore, when determining images to be hidden, the priority determination unit 32 determines the images to be hidden in the order of

lower priority images

21b, 21c, . . . .

In step S4, the display control unit 33 controls the image to be displayed on the display 11 based on the information determined by the priority determination unit 32 in step S3. That is, when the stress value becomes equal to or higher than the non-display determination threshold, the display control unit 33 hides the currently displayed images in descending order of priority.

The display control unit 33 may instantly erase or fade out the image to be hidden.

FIG. 4 is an explanatory diagram showing the display area 23 in the case where the low priority image 21a is hidden from the display area 23 in FIG. 2. In FIG. 4, the image 21a with a low priority is not displayed.

Further, FIG. 5 is an explanatory diagram showing another virtual display area 23 formed in front of the vehicle 1. FIG. 6 is an explanatory diagram showing the display area 23 in a case where a part of the low priority image 21f is hidden from the display area 23 in FIG.

The

images

21b, 21c, 21d, 21e, and 21f displayed in the display area 23 of FIG. 5 are assigned priorities as follows: image 21f<image 21b<image 21c<image 21d<image 21e The determining unit 32 determines the image 21f as an image to be hidden. The image 21f is a plurality of arrow-shaped images 22a, 22b, and 22c that guide the driver 4 to turn right, and each of the images 22a, 22b, and 22c is an image composed of a plurality of elements that can transmit information to the driver 4 by itself. It is. When the image to be hidden is the image 21f, in which information can be transmitted by each image 22a, 22b, 22c alone, the display control unit 33 can transmit priority by assigning priority to each image 22a, 22b, 22c in advance , a part of the image 21f may be hidden.

Specifically, when the images 22a, 22b, and 22c constituting the low-priority image 21f are assigned priorities such as image 22a<image 22b<image 22c, the priority determining unit 32 Instead of hiding the entire image 21f, only the image 22a may be hidden, as shown in FIG. In this case, when the priority determination unit 32 determines the next image to be hidden, it determines the images to be hidden in the order of image 22b, image 22c, image 21b, . . . .

Further, FIG. 7 is an explanatory diagram showing yet another virtual display area 23 formed in front of the vehicle 1. FIG. 8 is an explanatory diagram showing the display area 23 in a case where a part of the low priority image 21g is hidden from the display area 23 in FIG. FIG. 9 is an explanatory diagram showing the display area 23 when a part of the image 21g in FIG. 8 is hidden. FIG. 10 is an explanatory diagram showing the display area 23 when the image 21g in FIG. 9 is not displayed.

The

images

21b, 21c, 21d, 21e, and 21g displayed in the display area 23 of FIG. 7 are assigned priorities as follows: image 21g<image 21b<image 21c<image 21d<image 21e. The determining unit 32 determines the image 21g as an image to be hidden. The image 21g is an image that guides straight forward movement with the actual road surface as the background, and is an AR image that has a sense of perspective such that the upper part of the display area 23 is farther away and the lower part of the display area 23 is closer. When the image to be hidden is an AR image with a sense of perspective, such as the image 21g, when the image is hidden, the display control unit 33 sets the image to be hidden far from the driver 4. It may be possible to sequentially hide the display from the area that is displayed in a superimposed manner on the one side (above the display area 23) to the area that is displayed in a superimposed manner on the near side (below the display area 23). Alternatively, the display control unit 33 may sequentially hide the image from an area that is superimposed and displayed close to the driver 4 to an area that is superimposed and displayed far from the image to be hidden.

Specifically, the priority determination unit 32 sequentially hides the image 21g in FIG. 7 from the upper region visible on the far side as shown in FIGS. 8 and 9, and finally hides the image in FIG. As shown, the entire image 21g may be hidden. Note that in a situation where it is highly necessary for the driver 4 to see the actual scenery around the vehicle 1, the display control unit 33 gradually hides the images to be hidden as shown in FIGS. 7 to 10. It is preferable to immediately hide the display instead of displaying it immediately. Thereby, the display control unit 33 can draw attention to the actual scene without the image blocking the driver's 4 field of view. Under situations where it is highly necessary to visually confirm the actual scene, for example, when other vehicles, pedestrians, obstacles, etc. are detected around vehicle 1, when entering a curve, when changing lanes, etc., the direction indicator is activated. This applies to cases where it is necessary to ensure forward visibility.

After that, the process returns to stress value acquisition step S1, and the subsequent processes are repeated.

On the other hand, if the priority determination unit 32 determines in step S2 that the stress value is not equal to or higher than the non-display determination threshold (NO in step S2), the priority determination unit 32 determines whether the acquired stress value increases the display of the image or not in step S5. It is determined whether or not it is less than or equal to a threshold value (second value, hereinafter referred to as "appearance determination threshold value"). The appearance determination threshold is set to a value less than or equal to the non-display determination threshold. The appearance determination threshold is a value smaller than the non-display determination threshold, which has hysteresis with respect to the non-display determination threshold, and is different from the non-display determination threshold in order to avoid frequent repetition of hiding and appearing of images. It is preferable.

If the priority determining unit 32 determines that the stress value is not below the appearance determination threshold (NO in step S5), the priority determining unit 32 maintains the number of images displayed in normal times and returns to the stress value acquisition step S1. On the other hand, when determining that the stress value is less than or equal to the appearance determination threshold (YES in step S5), the priority determination unit 32 determines the number of images to be displayed in the display area 23 in step S6. That is, when the stress value becomes less than or equal to the appearance determination threshold, the priority determination unit 32 determines the number of images that is increased from the number of images currently displayed as the number of images to be displayed.

The priority determining unit 32 may decide to increase the display number by a predetermined number from the current display number (for example, the current display number + 1), or may decide to increase the display number by a predetermined number (for example, 2). etc.) may be determined as the display number. Furthermore, the priority determination unit 32 may set the appearance determination threshold in multiple stages, and may determine such that the smaller the appearance determination threshold, the larger the number of items to be displayed. Further, the priority determination unit 32 may gradually increase the number of displayed items when the stress value is equal to or lower than the appearance determination threshold for a predetermined period of time.

Furthermore, the priority determination unit 32 determines the images to be displayed according to the determined number of displays, based on the priority assigned to images that would normally be displayed but are currently hidden.

In step S7, the display control unit 33 controls the image to be displayed on the display 11 based on the information determined by the priority determination unit 32 in step S6. That is, when the stress value becomes equal to or less than the appearance determination threshold, the display control unit 33 causes the images to appear in order of priority among images that would normally be displayed but are currently hidden. For example, the display control unit 33 may cause the image to appear in step S4 in a manner reverse to the manner in which the image is hidden as described using FIGS. 2 and 4 to 10.

For example, the display control unit 33 may cause the images to appear sequentially from an area that is superimposed and displayed close to the driver 4 to an area that is superimposed and displayed that is far away from the driver 4. Alternatively, the display control unit 33 may cause the images to appear sequentially from an area that is displayed in a superimposed manner far from the driver 4 to an area that is displayed in a superimposed manner close to the driver 4 . Further, the display control unit 33 may cause the image to appear instantaneously in order to quickly provide the driver 4 with necessary information.

The HUD 10 in this embodiment controls the image displayed in the display area 23 according to the stress value of the driver 4 who is the viewer. Thereby, the HUD 10 can provide visibility according to the driver's 4 situation, and can reduce unnecessarily obstructing the driver's 4's visibility during driving.

Furthermore, the HUD 10 decreases the number of images to be displayed as the stress value increases, and increases the number of images to be displayed as the stress value decreases. Thereby, the HUD 10 can eliminate the trouble caused by the large number of images, and can contribute to reducing the stress of the driver 4.

Additionally, the HUD 10 can reliably provide the driver 4 with the necessary information by considering the priority assigned to the image when hiding or appearing the image.

Furthermore, by hiding and making images appear in a manner appropriate to the type of image, the HUD 10 can reduce the sense of discomfort given to the driver 4 due to non-display and appearance.

Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and changes can be made without departing from the gist of the invention. These embodiments and their modifications are included within the scope and gist of the invention, as well as within the scope of the invention described in the claims and its equivalents.

Although an example has been described in which the projection member of the HUD 10 is the windshield 3, a combiner may be used instead of or in addition to this.

1 Vehicle 3 Windshield 4 Driver (visible person)
7 Biological sensor 8 Posture sensor 9 Camera 10 HUD (display device)
11 Display 12 Plane mirror 13 Concave mirror 15

Housings

21a, 21b, 21c, 21d, 21e, 21f, 21g, 22a, 22b, 22c Image 23 Display area 30 Control section 31 Stress value acquisition section 32 Priority determination section 33 Display control section L Display light

Claims

a display device that displays one or more images;
a stress value acquisition unit that acquires a stress value that is information regarding the magnitude of stress of a viewer viewing the image;
A display device comprising: a display control section that controls the image to be displayed on the display according to the stress value acquired by the stress value acquisition section.
The display control unit reduces the number of images when the stress value is a first value or more, and reduces the number of images when the stress value reaches a second value that is less than or equal to the first value. The display device according to claim 1, wherein the display device increases .
each said image has information regarding display priority;
3. The display control unit hides the images in order from the lowest priority when decreasing the number of images, and causes the images to appear in order from the highest priority when increasing the number of images. display device.
The display device according to claim 1, wherein the display device displays a virtual image that is displayed superimposed on the actual scene in the visual field of the viewer.
The display control section includes:
When reducing the number of images, the images are sequentially hidden from the area that is displayed in a superimposed manner far from the viewer to the area that is displayed in a superimposed manner close to the viewer. When increasing the number of images, the images are made to appear sequentially from an area that is displayed in a superimposed manner close to the viewer to an area that is displayed in a superimposed manner that is far away from the viewer, or
When reducing the number of images, the images are sequentially hidden from an area that is displayed in a superimposed manner close to the viewer to an area that is displayed in a superimposed manner that is far away from the viewer. 5. The display device according to claim 4, wherein when increasing the number of images, the images are made to appear sequentially from an area superimposed and displayed on an area far from the viewer to an area superimposed and displayed close to the viewer. .
The stress value acquisition unit acquires the stress value from information calculated from at least one of the viewer's heart rate fluctuation, the viewer's driving posture, and the viewer's face image. Display device.