JP2022181848A - Display controller, display unit and display control method - Google Patents

Abstract

To suppress a decrease in near image/far image discriminability and then make a display image easier to see.SOLUTION: A display controller which performs display control over images has a control part 140 which controls display modes of the images, which include a near image (D1 to D3) displayed closer based upon a viewer and a far image (F1 to F3) displayed farther. The control part 140 performs visual separation processing including at least one of forms in which: the non-display area between the near image and far image is increased by putting the near image far away from the far image; the near image is not displayed; the near image is reduced; the near image is reduced by changing the display mode; and spaces between display contents arranged adjacently are widened when the near image includes a plurality of display contents.SELECTED DRAWING: Figure 7

Description

The present invention relates to a display control device, a display device, a display control method, and the like, which are mounted on a vehicle such as an automobile.

Patent Document 1 discloses a control device and a control method for a multi-display device having a plurality of display devices.

In the multi-display device of Patent Document 1 (for example, FIGS. 1 and 19), a CID (Center Information Display) that displays map information, the current position of the vehicle, etc., and an ICD (Instrumental Cluster Display) that displays a speedometer, etc. and a HUD (Head-Up Display) device is used.

In [0002] of this patent document 1, "Conventionally, in a system that uses a plurality of display devices in conjunction, when attention is directed to information displayed on one display device, another display device There was a problem that even if there was a change in the displayed information, it was difficult for the user to notice it.In addition, when the information displayed on each display device was related to each other, it was difficult to grasp the relationship." Have been described.

As a solution to this problem, for example, claim 1 describes "addition of consciousness-inducing information (information for emphasizing a specific image)".

JP 2017-71398 A

The inventors of the present invention have studied a technique for displaying images in a plurality of display areas with different display distances (near/far mixed display technique). , it was found that it is sometimes difficult to distinguish between images seen in the distance (distant images).

For example, it may be the case that the far image is placed close to the near image. In addition, when both the near image and the distant image include, for example, a plurality of display contents set up against the road surface, each display content is grasped individually, and the perspective is poor. In some cases, the distinguishability between the displayed content at the distance and the displayed content at a distance may be deteriorated.

In this case, the viewer may feel visual annoyance. In addition, ADAS (Driving Safety Assistance System) information, warning marks superimposed on preceding vehicles that require attention (distant information), and the vehicle speed display etc. seen on the near side are mixed and perceived, which is important. It cannot be said that the perception of information is delayed.

Here, as in the technique of Patent Document 1, even if consciousness-inducing information is added, it becomes difficult to distinguish between near and far images. does not become

In addition, when there are a plurality of display contents, it becomes difficult to distinguish which of them is a near image and which is a distant image, and each display content is perceived separately, resulting in visual annoyance. Such problems cannot be solved fundamentally.

One of the objects of the present invention is to suppress deterioration in distinguishability between a near image and a distant image, and to improve visibility of a displayed image.

Other objects of the present invention will become apparent to those skilled in the art by referring to the following exemplary aspects and best mode, as well as the accompanying drawings.

In order to facilitate an understanding of the general outline of the invention, the following illustrates embodiments in accordance with the invention.

In a first aspect of the present invention, the display control device is a display control device that executes image display control,
Having a control unit for controlling the display mode of the image,
The image includes a near image that is displayed closer to the viewer and a far image that is displayed farther,
The control unit
When it is determined that the identifiability between the near image and the distant image is degraded, or when it is determined that the identifiability should be improved,
widening the distance between the near image and the far image by moving the near image further away from the far image;
Hiding the neighboring image;
shrinking the neighboring image;
shrinking the neighboring image by changing the display mode;
when the neighboring image includes a plurality of display contents, widening the interval between the display contents arranged adjacently;
perform a visual separation process including at least one of

Since the human field of vision has a predetermined extent, for example, even when the viewer sees a distant image, a near image may also be included in the field of vision. A distant image and a near image have different display distances (for example, the distance to the image or the display surface of the image based on the viewpoint of the viewer). In many cases, the distance difference between the two images is relatively small.

Further, for example, when there are a plurality of display contents as distant images and they are collectively displayed, it becomes difficult to distinguish them from the plurality of display contents as near images seen on the near side. .

In such a case, for example, by moving the near image further away from the far image and widening the interval between the two images, both images are spatially separated, making it easier to visually separate the near image from the far image. .

Also, temporarily erasing the near image is substantially the same as moving the near image out of the viewer's field of view. In other words, the near image is visually well separated from the far image.

In addition, by reducing the size of the nearby image (for example, by reducing the size of icons such as figures and characters that constitute the nearby image), the visibility of the nearby image is suppressed, and the near image is visually visible from the distant image. easily separated into Also, for example, when the distant image and the near image include the same type of display content (icon, etc.), the difference in size makes it easier for the near image to be perceived as being visually separated from the far image. Reducing the size of the near image also has the effect of widening the distance from the far image.

In addition, when reducing the neighboring images, changing the display mode of the neighboring images (preferably broadly interpreted including the background) can further promote the visual separation of the neighboring images. Examples of changing the display mode include changing the design of characters and graphics, and changing the color, luminance, saturation, etc. of constituent elements and backgrounds.

In addition, by widening the interval between the display contents for the near image, the annoyance caused by the feeling that a plurality of display contents are densely arranged is reduced. promote separation into For example, assuming a case where a distant image also includes a plurality of display contents, when the display contents of the far image are densely arranged and the display contents of the near image are similarly densely arranged, it is difficult to distinguish between the distant image and the near image. It is assumed that it will be difficult to stick. At this time, by arranging the display contents of the near image in a distributed manner, the difference in density from the arrangement of the far image is clarified, and the near image can be easily separated visually from the far image.

By performing the visual separation process, it is easy to visually separate a near image (a group of near images when there are multiple display contents) from a far image without causing discomfort. be. Therefore, even if the near image enters the visual field range, the viewer can gaze at the distant image without being particularly conscious of the near image, thereby alleviating annoyance. Therefore, an easy-to-see display is realized.

In a second aspect dependent on the first aspect,
When it is determined that the identifiability between the near image and the distant image is degraded, or when it is determined that the identifiability should be improved,
When the number of display contents included in the distant image exceeds a predetermined threshold,
or
When at least one predetermined display content having high importance is displayed as the distant image, or when more than a predetermined threshold is displayed,
or
When it is detected that the importance of at least one display content displayed as the distant image has increased,
may be

In the second aspect, a case where the number of displayed contents as a distant image exceeds a threshold is exemplified as a case where it is determined that the distinguishability between the near image and the distant image is degraded. Further, as a case where it is determined that the distinguishability should be improved, a case where the importance (display priority) of the display content as the distant image is increased will be exemplified.

In the exemplified situation, it is desirable for a viewer (such as a driver) to pay attention to the information presented by the distant image, and it is necessary to avoid that the near image enters the field of view and becomes difficult to see. Therefore, visual separation processing is performed on the near image to enhance the distinguishability of the near image from the distant image. As a result, it is possible to present various types of information in an easy-to-read display.

In a third aspect depending on the second aspect,
The predetermined display content with high importance is
AR display content displayed superimposed on the actual scene,
or
display content (ADAS display content) of driving support information by an advanced driving support system (ADAS);
may be

In the third aspect, the AR display content and the ADAS display content handle the distant image as highly important display content. Since these displays contribute to safe driving, etc. and often present important information, they are treated as important display contents.

In a fourth aspect depending on the second aspect,
If it is detected that the at least one displayed content has increased importance,
When the navigation display is displayed, if the distance to the branch point that requires steering is within a predetermined distance,
or
If the already displayed ADAS display content increases the risk to safe driving,
may be

The fourth aspect illustrates a case where it can be determined that the importance of display content as a distant image has increased. When approaching a point where steering (operation of the steering wheel, etc.) is required, or when the danger of the ADAS display content increases, a warning display, warning display, etc. is displayed, and the viewer (driver, etc.) must quickly pay attention to the display and take appropriate action. Therefore, it is preferable to suppress the annoyance caused by the neighboring image coming into the field of view. Therefore, in the above case, visual separation processing is performed on the neighboring images.

In a fifth aspect depending on any one of the first to fourth aspects,
The display control device is mounted on a vehicle,
Let the height direction of the vehicle be the vertical direction or the vertical direction, the width direction of the vehicle be the horizontal direction or the horizontal direction, and the direction orthogonal to the vertical direction and the horizontal direction be the depth direction,
the neighboring image includes first and second display contents arranged in a horizontal direction;
and when the first and second display contents are located below the display area of the distant image,
The visual separation process includes:
The first display content is moved to the left along the horizontal direction and the second display content is moved to the right along the horizontal direction to widen the space between the first and second display contents. with
When the display area for the first display content is the left display area and the display area for the second display content is the right display area,
A process for preventing the display area of the distant image from overlapping in the vertical direction with the left display area and the right display area of the near image;
or
A process of preventing the display area of the far image and the right display area of the near image from overlapping in the vertical direction, but not overlapping the left area;
or
The display area of the distant image and the left display area of the near image overlap in the vertical direction, but processing may be performed so that the right area does not overlap.

In the fifth aspect, a preferred example of "a process of widening the interval between adjacently arranged display contents when a neighboring image includes a plurality of display contents" in the first aspect is specifically illustrated. there is

Widening the interval can be realized by moving some of the displayed contents to the left along the horizontal direction (horizontal direction) and moving other displayed contents to the right along the horizontal direction (horizontal direction). . The display area of the display content to be moved to the left is the "left display area", and the display area of the display content to be moved to the right is the "right display area".

In other words, widening the interval between displayed contents means providing a non-display area (in other words, space) where no image is displayed between the left display area and the right display area.

Then, the display area of the distant image is located above this non-display area. By increasing the area of the non-display area to some extent, the display area of the distant image and the left/right display areas can be prevented from overlapping each other in the vertical direction (vertical direction).

It is also possible to make it so that only one of the left and right display areas does not overlap the display area of the distant image in the vertical direction.

It should be noted that “not overlapping in the vertical direction” means that even if the display area of the distant image located on the upper side is moved (shifted) to the position on the lower side where the near image is located, both areas will not overlap. It means that there is no duplication.

One of the causes of visual annoyance is considered to be that the upper distant image and the lower near image are recognized as "a set of images of the same type that are coherent". By distributing the displayed content of the near image to the left and right and inserting a relatively large space between them, it is difficult for the viewer to perceive the distant image and the near image as "a set of images of the same type that are cohesive." , and the near image is more likely to be visually separated from the far image.

In addition, if only one of the left and right display areas overlaps the display area of the far image in the vertical direction, but the other does not overlap, the display content of the near image tends to be arranged asymmetrically in the left and right directions. The horizontal direction (horizontal direction) is innovative, while the vertical direction (vertical direction) gives the impression that it is difficult to perceive the relationship with the distant image. As a result, the viewer is less likely to perceive the image as one coherent set of images including the distant image. This helps visually separate the near image from the far image.

In a sixth aspect depending on the fifth aspect,
Although the display area of the far image and the right display area of the near image overlap in the vertical direction, the area of the right display area when processing is executed so that the left area does not overlap is the left side larger than the area of the display area,
Although the display area of the distant image and the left display area of the near image overlap in the vertical direction, the area of the left display area when processing is executed so that the right area does not overlap is the area of the right side image. It may be larger than the area of the display area.

In the sixth aspect, in the fifth aspect, when only one of the left/right display regions vertically overlaps the display region of the distant image, but the other does not overlap, the overlapping direction The area of the display area is set larger than the area of the non-overlapping display area. A large display area is advantageous in terms of increasing the number of display contents, and it is possible to arrange display contents that are long in the horizontal direction, and in that case, the advantage is that the degree of freedom in arrangement is high. There is

For example, when there are four display contents as neighboring images, one display content is displayed in a non-overlapping display area, and the other three display contents are displayed in an overlapping display area having a larger area. Thus, it is possible to arrange display contents asymmetrically to the left and right.

A display in which the display contents of neighboring images are arranged asymmetrically to the left and right has a kind of design. , a viewer naturally tends to distinguish a near image from a far image and perceive it. In addition, this left-right asymmetrical display, including the non-display area (space area), can be regarded as a kind of design arrangement, and in the horizontal direction, it is easy to give a novel, coherent design visual. . On the other hand, in the vertical direction (vertical direction), an impression is given that it is difficult to perceive the relationship with the distant image.

Therefore, the viewer is less likely to perceive the set of images including the distant image as one cohesive set. This helps visually separate the near image from the far image.

In a seventh aspect depending on any one of the first to sixth aspects,
The visual separation process includes:
The method may further include a process of changing the near-field image to display mainly in achromatic colors for the distant image mainly in chromatic colors.

In the eighth mode, it is clarified that the display mode can be changed so that the achromatic color display is dominant in the visual separation processing for the neighboring images.

The distant image includes an AR image, an ADAS image, and the like, and is often displayed in chromatic colors such as red, yellow, and blue so as to easily attract the viewer's attention. This is because the road surfaces on which vehicles travel are often achromatic (for example, dark colors), and the white lines drawn on the road surface are also achromatic. This is because it is difficult to attract attention.

Focusing on this point, the near image (including the background) is colored mainly with achromatic colors (eg, gray, black, white, and gradation using these colors), so that the far image and the distant image are colored. can give different impressions. This makes the near image more intuitively distinguishable from the far image.

For example, it is conceivable that the background of the display area of the plurality of display contents is colored in a dark color such as gray, while the majority of the display contents are represented by, for example, white characters or figures. (However, it is an example and is not limited to this). This contributes to realizing an easy-to-see display without causing discomfort.

In an eighth aspect, the display device comprises
a head-up display device that displays a distant image;
a display device or a head-up display device that displays a nearby image under display control by the display control device according to any one of the first to seventh aspects;
including.

According to the eighth aspect, it is possible to provide a display device capable of suppressing deterioration in distinguishability between a near image and a distant image and improving visibility of the displayed image.

In a ninth aspect, the display control method includes:
A display control method for controlling display of a near image displayed closer and a far image displayed farther from the viewer, comprising:
a step of determining whether or not the identifiability between the near image and the distant image is reduced, or determining whether or not the identifiability should be improved;
When the result of the determination is affirmative, the near image is moved further away from the far image, thereby increasing the non-display area between the near image and the far image, and hiding the near image. reducing the size of the neighboring image; reducing the size of the neighboring image by changing a display mode; and widening the interval between adjacently arranged display contents when the neighboring image includes a plurality of display contents. performing a visual separation process comprising at least one;
including.

According to the ninth aspect, it is possible to suppress deterioration in distinguishability between the near image/distant image and improve the viewability of the displayed image by a relatively simple technique.

Those skilled in the art will readily appreciate that the illustrated embodiments in accordance with the present invention may be further modified without departing from the spirit of the invention.

FIG. 1 is a diagram showing a configuration example of an example of a display device (in-vehicle display device including a display device and a HUD device) and a setting example of a virtual image display surface by the HUD device. FIGS. 2A and 2B are diagrams showing other examples of the display device using the display device and the HUD device. FIG. 3 is a diagram showing an example of display by the display device shown in FIGS. 2A and 2B. FIG. 4 is a diagram showing a configuration example of a display device using two HUD devices. FIG. 5 is a diagram showing an example of display by the display device shown in FIG. FIG. 6A shows a display example of a near image and a distant image before visual separation processing, and FIG. 6B shows a display example of a near image and a distant image after visual separation processing. It is a diagram. FIG. 7A is a diagram showing a display example of a near image and a distant image before visual separation processing, and FIGS. FIG. 10 is a diagram showing another example of display; FIG. 8A is a diagram showing a display example of a near image and a distant image before visual separation processing, and FIG. 8B is a display example of the near image and distant image after visual separation processing. FIG. 10 is a diagram showing another example; FIG. 9A is a diagram showing a display example of a near image and a distant image before visual separation processing, and FIGS. FIG. 10 is a diagram showing still another example of display (modification of FIG. 8B); FIG. 10A is a diagram showing a display example of a near image and a distant image before visual separation processing, and FIGS. It is a figure which shows that a display mode changes in steps. FIGS. 11A and 11B are diagrams showing an example of a distant image determined to be of high importance and an example of a near image after visual separation processing. FIG. 12(A) is a diagram showing a driving scene in which both the near image before visual separation processing and the far image are visible through the windshield, and FIG. FIG. 11 shows an example of a driving scene that has been augmented and has undergone visual separation processing on neighboring images; FIG. 13 is a diagram illustrating a configuration example of a system that controls display on a display device. FIG. 14 is a flow chart showing an example of a display control procedure for a nearby image.

The best mode described below is used for easy understanding of the invention. Accordingly, those skilled in the art should note that the present invention is not unduly limited by the embodiments described below.

Please refer to FIG. FIG. 1 is a diagram showing a configuration example of an example of a display device (in-vehicle display device including a display device and a HUD device) and a setting example of a virtual image display surface by the HUD device.

In FIG. 1, the direction along the line segment connecting the left and right eyes of the viewer (in other words, the width direction of the vehicle 1) is defined as the left-right direction (or lateral direction), and is perpendicular to the left-right direction and corresponds to the ground. The vertical direction (or vertical direction or height direction) is defined as the direction along the line segment orthogonal to the surface (here, the road surface 6), and the direction along the line segment orthogonal to each of the horizontal direction and the vertical direction (vehicle 1) is defined as the front-rear direction. Also, the forward direction may be referred to as the depth direction. The horizontal direction can also be written as the X direction, the vertical direction as the Y direction, and the front-back direction as the Z direction.

In addition, in this specification, the expression near image/distant image is used, but the near image is an image displayed on the near side as seen from the viewer, and the far image is displayed on the back side of the near image. This is an image that will be The distance (display distance) from the viewpoint position of the viewer to each image is different.
In other words, the image displayed in the display area (display surface) closer to the viewer is the near image, and the image displayed in the display area (display surface) further back is the far image. A nearby image can also be called a near-arranged image or a near-side image. A distant image can also be called a far-side arranged image or a far-side image.

The display device is an in-vehicle display device mounted on the vehicle 1 here. This in-vehicle display device includes a display device (including a control unit 140, a display control unit 107, and a display (display device) 108 such as a liquid crystal panel), and a head-up display (HUD) device 100 (control unit 140 , including the device body 120). Both are mounted on the vehicle 1 in the example of FIG.

The HUD device 100 is installed in a dashboard (in other words, an instrument panel) 41, for example.

The device body 120 has a display device 150 such as a liquid crystal panel, a screen (display unit) 160 having a display surface 164 , and a curved mirror (such as a concave mirror) 170 having a light reflecting surface 179 .

A curved mirror (such as a concave mirror) 170 reflects the light from the screen 160 and projects (projects) the display light K onto the windshield (projection target member) 2 provided in the vehicle 1 . Part of the display light K is reflected by the windshield (projection target member) 2 and is incident on the visual point (eyes) A of the viewer (driver or the like), and apparent lights E1 to E3 corresponding to each incident light are generated. , the virtual image is displayed on the virtual image display surface PS by forming an image at an imaging point in front of the viewer. The virtual image display plane PS is a virtual (apparent) plane set in the real space in front of the viewer corresponding to the display plane 164 on the screen 160 .

The virtual image display surface PS includes, for example, an upright surface a perpendicular to the road surface 6, inclined surfaces b and c inclined with respect to the road surface 6, a road superimposed surface d superimposed on the road surface 6, and a side closer to the viewer. There is a surface e which is a surface (including a pseudo-elevation surface) and has an inclined surface on the far side. In display using surfaces other than the vertical surface a, the display distance of the virtual image varies depending on the display position on the virtual image display surface, and therefore 3D display is possible.

Next, refer to FIG. FIGS. 2A and 2B are diagrams showing other examples of the display device using the display device and the HUD device. In FIG. 2, parts common to those in FIG. 1 are given the same reference numerals. This point also applies to other drawings.

The examples of FIGS. 2A and 2B are common in that the distant image V1 is displayed by the HUD device 100 and the near image V2 is displayed by the display (display device) 108 installed in the vehicle. .

However, the display (display device) 108 in FIG. 2(B) is provided closer to the viewer (driver) than in FIG. 2(A) (closer to the steering wheel 4). . In this respect, there is a structural difference.

In addition, in FIGS. 2A and 2B, the HUD device 100 is provided with a display 151 for displaying the original image. However, an optical system for guiding the display light from the display 151 to the curved mirror (concave mirror or the like) 170 is omitted.

Next, refer to FIG. FIG. 3 is a diagram showing an example of display by the display device shown in FIGS. 2A and 2B.

In FIG. 3, on the display (display device) 108, three display contents are displayed as neighboring images arranged in a line in the horizontal direction (horizontal direction) at intervals. Arranged at the left end is a bar code display D1 indicating various information (for example, vehicle temperature and rotation speed data), and arranged at the center is a vehicle speed display (“80 km/h” display). ) D2, and what is arranged at the right end is a display indicating the current time (display of "12:56 pm") D3.

Further, in front of the vehicle 1, a navigation display F1 as an AR display and a fuel gauge display F2 are displayed so as to be superimposed on the actual scene. These are displayed on a virtual image display screen 111 set in front of the vehicle 1 .

The distant images F1 and F2 are visually recognized by the driver (viewer) through the windshield 2 . The display areas of the near images D1 to D3 are located below the distant images F1 and F2 as seen from the viewer (driver), and the distance in the vertical direction is small. A viewer looking far away can view the near images D1 to D3 by slightly lowering the line of sight. However, since the field of view is wide, it can be assumed that even when the viewer is viewing the distant images F1 and F2, the near images D1 to D3 are often within the field of view.

Reference is now made to FIG. FIG. 4 is a diagram showing a configuration example of a display device using two HUD devices. In FIG. 4, the near image V2 is displayed by the HUD device 101 as a virtual image. Also, the near image V2 is displayed on the far side of the windshield 2 as seen from the viewer.

The distant image V1 is displayed as a virtual image by the HUD device 100, as in the example of FIG. One of the HUD devices can be referred to as a "first HUD device" and the other can be referred to as a "second HUD device".

Reference is now made to FIG. FIG. 5 is a diagram showing an example of display by the display device shown in FIG. The displayed contents are the same as those in FIG. However, in FIG. 4, the display (display device) 108 of FIG. 3 is not provided. A display area 113 is set on the instrument panel 41 for convenience, and the neighboring images D1 to D3 are displayed in the display area 113. FIG.

Next, refer to FIG. FIG. 6A shows a display example of a near image and a distant image before visual separation processing, and FIG. 6B shows a display example of a near image and a distant image after visual separation processing. It is a diagram.

In the example of FIG. 6, the control unit 140 (see FIG. 1) can perform visual separation processing on neighboring images. Visual separation processing can be performed, for example, when it is determined that the identifiability between the near image and the distant image is degraded, or when it is determined that the identifiability should be improved.

In the visual separation processing, for example, by moving the near image further away from the far image, the distance between the near image and the far image is widened, the near image is hidden, the near image is reduced, the near image is Display control including at least one of reducing by changing the display mode and widening the interval between adjacently arranged display contents when a neighboring image includes a plurality of display contents can be performed.

FIG. 6A shows a normal display mode (display mode before visual separation processing) of the neighboring image. This display mode is the same as that shown in FIG.

In FIG. 6(B), in addition to F1 and F2, the distant image includes speed limit information F3, a warning display (characters "Beware of strong winds") F4, and information F5 indicating the distance to the vehicle in front. It is F3 can be regarded as an important navigation display, and F4 and F5 can be regarded as driving assistance information (ADAS information, ADAS image) by an advanced driving assistance system (ADAS).

Here, let m (here, m=2) be a predetermined threshold for the number of display contents as a distant image.

In the state of FIG. 6A, the number of display contents included in the distant image does not exceed the threshold (m=2), but it exceeds the threshold in the state of FIG. 6B. When the number of displayed contents of the distant image exceeds the threshold, the burden on the viewer (driver) to see each displayed content and grasp the meaning and content thereof increases.

Here, when the viewer sees the distant images F1 to F5, if the near images D1 to D3 enter the visual field (visual field), the burden on the viewer is further increased. In particular, when D1 to D3 are grasped (perceived) separately (discretely), the viewer feels annoyed. In addition, since it is necessary to individually recognize the information presented by each display content, the recognition burden on the viewer increases.

Therefore, the control unit 140 performs visual separation processing on the neighboring images. In FIG. 6B, the display contents D1 to D3 of the neighboring image are shifted downward (-Y direction). In other words, the display contents D1 to D3 of the near images are further separated from the display contents F1 to F5 of the far images to widen the vertical interval (non-display area or space area) between the two images.

This results in positional separation of the far image and the near image. Therefore, it becomes easier to visually separate the near image from the far image.

Next, refer to FIG. FIG. 7A is a diagram showing a display example of a near image and a distant image before visual separation processing, and FIGS. FIG. 10 is a diagram showing another example of display;

FIG. 7A is the same as FIG. 6A. In FIG. 7B, the display contents D1 to D3 of the neighboring images are temporarily erased as visual separation processing. Temporarily erasing the near image is essentially the same as moving the near image out of the viewer's field of view. In other words, the near image is visually well separated from the far image.

In FIG. 7C, processing for reducing the size (size) of the display content of the neighboring image is performed. By reducing the size of the near image (more specifically, for example, by reducing the size of the icons and characters of the figures that make up the near image), the visibility of the near image is suppressed, and the near image is separated from the distant image. Easier to visually separate. Also, for example, when the distant image and the near image include the same type of display content (icon, etc.), the difference in size makes it easier for the near image to be perceived as being visually separated from the far image. Reducing the size of the near image also has the effect of widening the distance from the far image.

FIG. 7D is common to FIG. 7C in that the neighboring image is reduced. However, in FIG. 7D, when the neighboring image is reduced, the display mode of the neighboring image (preferably broadly interpreted including the background) is changed. Visual separation of neighboring images can be further facilitated. Examples of changing the display mode include changing the design of characters and graphics, and changing the color, luminance, saturation, etc. of constituent elements and backgrounds. In FIG. 7D, the vehicle speed display D2 is changed to a white display. Also, the bar code display D1 and the time display D3 are changed from chromatic display to achromatic display. Comparing FIG. 7(C) and FIG. 7(D), FIG. 7(D) shows that the visibility of the display contents D1 to D3 in the near image is suppressed, and the visibility from the distant image is reduced accordingly. segregation is promoted.

Also, in FIG. 7E, the positions of the display contents D1 to D3 in the neighboring image are moved to widen the intervals between the adjacent display contents. This reduces the annoyance of having multiple displayed contents appear to be closely spaced, which helps visually separate the near image from the far image.

In FIG. 7E, the distant image also includes a plurality of display contents, and the arrangement of the display contents of the distant image is fairly dense. If the display contents of the near image are similarly densely arranged, it is assumed that it becomes difficult to distinguish between the distant image and the near image. In FIG. 7(E), the display contents D1 to D3 of the near image are arranged in a distributed manner, so that the difference in density from the arrangement of the far image is clarified, and the near image is visually separated from the far image. becomes easier. Note that the displayed content D1 has been moved to the left, the displayed content D2 has been moved to the lower side, and the displayed content D3 has been moved to the right.

In this way, by performing the visual separation process, it is possible to visually separate a near image (a group of near images when there are multiple display contents) from a far image without causing discomfort. is facilitated. Therefore, even if the near image enters the visual field range, the viewer can gaze at the distant image without being particularly conscious of the near image, thereby alleviating annoyance. Therefore, an easy-to-see display is realized.

Reference is now made to FIG. FIG. 8A is a diagram showing a display example of a near image and a distant image before visual separation processing, and FIG. 8B is a display example of the near image and distant image after visual separation processing. FIG. 10 is a diagram showing another example;

In FIG. 8A, the display of the distant image is the same as in FIGS. A navigation display F1 as an AR display and a fuel gauge display F2 are displayed.

On the other hand, the nearby image is displayed in a predetermined display area on the dashboard (instrument panel) 41 . In FIG. 8A, the left display area 119 displays an arrow icon display D4 and a remaining battery level display D5, and the right display area 121 displays a vehicle speed display D6. The left display area 119 and the right display area 121 are arranged adjacent to each other at a predetermined interval.

Also, in FIG. 8A, a1, a2, a3, and a4 are indicated, which indicate the positions of the ends of the display area. a1 indicates the left edge position of the near image left display area 119, a2 indicates the left edge position of the far image display area 111, a3 indicates the right edge position of the far image display area 111, and a4. indicates the position of the right end of the right display area 121 of the neighboring image.

In the example of FIG. 8A, a1 and a2 have substantially the same horizontal position (horizontal direction, direction along the X-axis), and a3 and a4 have substantially the same horizontal position. If the position of the end of the display area 111 for the distant image is aligned with the position of the end of the display areas 119 and 121 for the near image, the viewer will perceive the far image and the near image as cohesive images of the same type. may be recognized as a set of This can contribute to annoyance.

In other words, in the example of FIG. 8A, the display area 111 of the distant image (or the display contents F1 and F2 of the distant image) is replaced by the display areas 119 and 121 of the near image (or the display contents D5 and D5 of the near image). D6) and the vertical direction (vertical direction, direction along the Y-axis). This can contribute to visual annoyance.

It should be noted that "overlapping in the vertical direction" means, in concrete terms, that the display area (or display content) of the distant image positioned above is moved (shifted) to the position below where the near image is positioned. , overlap (including partial overlap) occurs in both areas (both contents).

Next, FIG. 8B will be referred to. In FIG. 8B, as a result of the visual separation processing, the left display area 119 (or display contents D4 and D5: first display contents) is moved to the left along the horizontal direction (horizontal direction) and moved to the right. The display area 121 (or the display content D6: the second display content) is moved to the right along the horizontal direction (horizontal direction). As a result, a laterally long and fairly large non-display area (space area, empty area) 123 is provided between the left display area 119 and the right display area 121 .

Above the non-display area (space area) 123, the display area 111 for the distant image is positioned. As in the example of FIG. 8B, if the area of the non-display area 123 is increased to some extent, the display area 111 of the distant image and the left/right display areas 110 and 121 of the near image are vertically oriented. (vertical direction).

In FIG. 8B, a1 is positioned to the left of a2, and a4 is positioned to the right of a3. Therefore, even if the display area 111 of the distant image located on the upper side is moved (shifted) to the position of the lower side where the near image is located, the display area 111 of the distant image fits within the non-display area 123 and is displayed on the left side. There is no overlap between the area 119 and the right display area 121 . In other words, the display contents F1 to F5 of the distant image do not vertically overlap the display contents D4 to D6 of the near image.

It is also possible to make it so that only one of the left/right display areas (119 or 121) does not vertically overlap the distant image display area 111. FIG. An example of this will be described later.

As described above, one of the causes of visual annoyance is thought to be that the upper distant image and the lower near image are recognized as "a group of images of the same type that are cohesive." By dispersing the display contents of the near image to the left and right and inserting a relatively large space between them, it is difficult for the viewer to perceive the distant image and the near image as "a group of images of the same type that are cohesive." , and the near image is more likely to be visually separated vertically from the far image. Therefore, it becomes easy to distinguish between the distant image and the near image, and the annoyance is suppressed.

Reference is now made to FIG. FIG. 9A is a diagram showing a display example of a near image and a distant image before visual separation processing, and FIGS. FIG. 10 is a diagram showing still another example of display (modification of FIG. 8B);

FIG. 9A is the same as FIG. 8A. In FIG. 9B, as a result of the visual separation processing, the left display area 119 (or the display contents D4 and D5: the first display contents) is moved left along the horizontal direction (horizontal direction), and moved to the right. The display area 125 (or the display contents D7 and D6: the second display contents) is moved to the right along the horizontal direction (horizontal direction). As a result, the distance between the left display area 119 and the right display area 125 is widened. Note that the display content D7 is a fuel gauge that indicates the amount of remaining fuel.

However, in FIG. 9B, the display area 111 of the distant image and the right display area 125 of the near image overlap in the vertical direction, but the left area 119 does not overlap. A non-display area (space area) 127 is provided between the left display area 119 and the right display area 125 .

In FIG. 9B, a1 is positioned to the left of a2, and a4 is positioned to the left of a3.

In FIG. 9B, the area of the vertically overlapping right display area 125 is set larger than the area of the non-overlapping left display area 119 . A large display area is advantageous in terms of increasing the number of display contents, and it is possible to arrange long display contents in the horizontal direction, and in that case, there is a high degree of freedom in arrangement. There is The display contents displayed in the left display area 119 are two, D4 and D5, and the display contents displayed in the right display area 125 are two, D7 and D6, and the number of contents is the same. However, in the right display area 125, a considerably oblong remaining fuel gauge D7 is displayed in a size that is easy to see.

In FIG. 9C, the display area 111 of the distant image and the left display area 131 of the near image overlap in the vertical direction, but the right area 121 does not overlap. A non-display area (space area) 129 is provided between the left display area 131 and the right display area 121 .

The left display area 131 displays an arrow icon D4, a time display D8, a meter display D9 indicating the remaining battery level, and a meter display D10 indicating the remaining fuel level. A vehicle speed display D6 is displayed in the right display area.

In FIG. 9C, the area of the vertically overlapping left display area 131 is set larger than the area of the non-overlapping right display area 121 . A large display area is advantageous in terms of increasing the number of display contents, and it is possible to arrange display contents that are long in the horizontal direction, and in that case, the advantage is that the degree of freedom in arrangement is high. There is The display contents displayed in the left display area 131 are four, D4, D8, D9, and D10, and the display content displayed in the right display area 121 is one, D6.

As in the examples of FIGS. 9B and 9C, if only one of the left and right display areas overlaps the display area of the distant image in the vertical direction, but the other does not overlap, the near image is displayed. The content tends to be arranged asymmetrically to the left and right, and the horizontal direction (horizontal direction) is novel, while the vertical direction (vertical direction) gives an impression that it is difficult to perceive the relationship with the distant image. As a result, the viewer is less likely to perceive the image as one coherent set of images including the distant image. This helps visually separate the near image vertically from the far image.

Further, by making the areas of the left display area and the right display area different, it is possible to arrange display content asymmetrically in the left and right directions, as shown in FIGS. 9B and 9C, for example.

The asymmetrical arrangement of the display contents of the neighboring images has a kind of design, and it gives the viewer the feeling that the images are not only scattered but also of the same kind with novelty. , a viewer naturally tends to distinguish a near image from a far image and perceive it.

In addition, this left-right asymmetric arrangement, including the non-display area (space area), can be regarded as a kind of design arrangement, and it is easy to give a coherent design vision in the horizontal direction. On the other hand, in the vertical direction (vertical direction), an impression is given that it is difficult to perceive the relationship with the distant image.

Therefore, the viewer is less likely to perceive the set of images including the distant image as one cohesive set. This helps visually separate the near image from the far image.

Reference is now made to FIG. FIG. 10A is a diagram showing a display example of a near image and a distant image before visual separation processing, and FIGS. It is a figure which shows that a display mode changes in steps.

In FIG. 10A, an expressway exit 904 can be seen in the distance through the windshield 2 . This expressway exit 904 corresponds to a branch point where steering of the vehicle is required. A HUD device displays a pointer J1 for calling attention to the exit 904 (or for guiding the viewpoint). Nearby displays (display contents D1 to D3) are displayed normally.

In FIG. 10B, the vehicle is approaching the exit 904 and the distance to the exit 904 is within a predetermined threshold. As a result, an indicator display (AR display) 906 that more clearly indicates the exit 904 is displayed. Along with this, visual separation processing is performed on the neighboring images. In FIG. 10B, by moving the display content D1 to the left and moving the display content D3 to the right, the interval between the adjacent display contents is widened. Since the display contents of the near image are dispersed and are no longer arranged densely, even if the near display is included in the field of view (field of view) when the user is gazing at the distant image, the near image is It is naturally separated from the image and annoyance is suppressed.

In FIG. 10(C), the vehicle is closer to the exit 904 . As a result, an indication 907 for guiding the progress of the vehicle is displayed on the road surface. Along with this, the display mode of the neighboring image is changed. In FIG. 10C, only the display content D2 is given a gradation background to impress the viewer (driver, etc.) with the highly important vehicle speed information. Further, the perspective of the display content D2 of the near image and the display 907 for guiding the vehicle on the road surface (displayed with a unique perspective) as the far image are matched, and natural vision is achieved. maintained. On the other hand, by adding a gradation background only to the display content D2, the display content D1 to D3 of the near images are more innovative in terms of design, and the intuitive distinguishability between the distant display and the near display is improved. Therefore, the display becomes easy to see.

Reference is now made to FIG. FIGS. 11A and 11B are diagrams showing an example of a distant image determined to be of high importance and an example of a near image after visual separation processing.

In FIG. 11A, a speed limit display LS1 is displayed as an AR display. In addition, a warning mark M1 is displayed superimposed on the forward vehicle G1 by ADAS. This alert mark M1 corresponds to a distant image of high importance.

Corresponding to this, visual separation processing is performed on the neighboring images, and the display mode is changed to that of FIG. 7(D) shown above. However, although the speed limit and vehicle speed are 80 km/h in FIG. 7(D), they are 60 km/h in FIG. 11(A).

Also, in FIG. 11B, the preceding vehicle G2 is located far away, and there is no particular problem. However, a person B1 is entering the road, and a frame C1 is displayed as a warning display by ADAS. The frame C1 as this warning display corresponds to a distant image of high importance.

Correspondingly, visual separation processing is performed on the neighboring images, and the display mode is changed to the same as in FIG. 11(A).

Reference is now made to FIG. FIG. 12(A) is a diagram showing a driving scene in which both the near image before visual separation processing and the far image are visible through the windshield, and FIG. FIG. 11 shows an example of a driving scene that has been augmented and has undergone visual separation processing on neighboring images;

In FIG. 12(A), both the near image and the far image are seen through the windshield 2 in front of the vehicle. A preceding vehicle G3 can be seen in the distance in front of the vehicle. Also, a speed limit display (AR display) LS1 is displayed as a distant image.

FIG. 12(B) is a driving scene that requires more attention than FIG. 12(A). The road ahead of the vehicle curves to the left. Also, the vehicle is traveling at high speed. In addition, there are G4, G5, and G6 as preceding vehicles, and it is particularly necessary to pay attention to the inter-vehicle distance to the nearest preceding vehicle G4.

The distant image includes a speed limit display LS2, a mark U1 to call attention to the preceding vehicle G4, a mark (inter-vehicle distance mark) W1 useful for maintaining a distance between vehicles, and a display of a plurality of arrows that guide the route of the vehicle. W2 and are displayed. A plurality of arrow displays W2 are arranged along the white line 9 on the road surface 6. - 特許庁The number of display contents as distant images has increased considerably, and the importance of display (priority of display) has also increased.

In addition, since the near image is arranged directly below the distant image, when the near image comes into the field of view, there is a high possibility that the viewer's recognition burden will increase.

Therefore, visual separation processing is applied to the neighboring images. Here, for the three display contents D1 to D3 as neighboring images, a process of dispersing the dense arrangement to a coarse arrangement is performed by widening the interval between the adjacent display contents. In addition to this, the three display contents D1 to D3 are surrounded by a frame Q10, and the inside thereof is colored to provide a background as a whole. This facilitates a natural visual separation of the near image from the far image.

Also, in FIG. 12B, the neighborhood image after visual separation processing is displayed mainly in achromatic colors. The reason is as follows.

The distant image includes an AR image, an ADAS image, etc., as clearly shown in FIG. In many cases, chromatic display is performed.

This is because the road surface 6 on which the vehicle travels is often achromatic (for example, a dark color), and the white lines 9 and the like drawn on the road are also achromatic. This is because it is difficult to get people's attention.

Focusing on this point, the near image (including the background) is colored mainly with achromatic colors (eg, gray, black, white, and gradation using these colors), so that the far image and the distant image are colored. can give different impressions. This makes the near image more intuitively distinguishable from the far image.

In the example of FIG. 12B, the background color S1 of the neighboring image is, for example, light gray (gray), the barcode display D1 is white and black (or a cold color that is a receding color), and the vehicle speed is The display D2 is a white display, so that the display is mainly composed of achromatic colors. As a result, the near image can be distinguished from the distant image in a natural manner without causing discomfort, and the burden on the viewer is reduced.

Reference is now made to FIG. FIG. 13 is a diagram illustrating a configuration example of a system that controls display on a display device.

An in-vehicle display device (display device) 180 includes an I/O interface 30, a processor (control device) 172 having a control unit (display control unit) 140, an image processing unit 210, an image display unit 230, and a storage unit ( memory) 350 and an external communication connection device 420 .

The image display unit 230 includes the display controller 107 and the display 108 shown in FIG. 1, and the display 150 and the display controller 163 (not shown in FIG. 1), which are components of the HUD device 100. have.

The I/O interface 30 includes a road information database 403, an own vehicle position detection unit 405, an outside sensor 407, a gaze direction detection unit 409, an eye position detection unit 411, a mobile information terminal 413, and a vehicle ECU 415. , are connected.

Vehicle ECU 415 is appropriately provided with necessary information from various sensors such as pitch angle sensor 417 and steering angle sensor 419 . Also, the I/O interface 420 is connected to an external communication connection device 420 .

The storage unit (memory) 350 stores, for example, a real object and its position detection module 510, an ambient environment detection module 512, a vehicle condition detection module 514, an image type determination module 516, and an image layout determination module 518. , a graphics display module 520 and a display mode determination module 522 .

The display mode determination module 522 includes a near image (near display) display mode determination module 327 and a distant image (distant display) display mode determination module 329 .

The display mode determination module 327 also has a visual separation processing execution module 328 that executes visual separation processing.

The processor 172 operates according to each of the modules described above, thereby constructing, for example, the control unit 140 as a functional block, various processing units, and the like. The control unit 140 controls the above-described visual separation processing of neighboring images and the like.

Reference is now made to FIG. FIG. 14 is a flow chart showing an example of a display control procedure for a nearby image.

In step S1, the driving condition of the vehicle, the surrounding environment, etc. are detected, and various kinds of information are acquired. In step S2, the display content of the neighboring image is determined based on the acquired various information.

In step S3, it is determined whether or not visual separation processing is necessary when displaying the display content of the neighboring image. In other words, it is determined whether or not the conditions for changing the display mode are satisfied. If the answer is Y, at step 4, a process for changing the display mode is performed. Visual separation processing includes, for example, increasing the distance from the distant image, hiding, reducing the size of, changing the display mode to make the near image smaller, changing at least one of the display and the background color to achromatic color. Processing such as changing to the subject, increasing the distance between a plurality of display contents and distributing them, etc. may be included.

When N in step S3, the normal display mode is displayed in step S5. At step S6, a determination is made to end the process. If N, the process returns to step S1.

As described above, according to the present invention, it is possible to suppress deterioration in distinguishability between the near image and the distant image, and improve the visibility of the displayed image.

Various modifications and applications are possible for the present invention. For example, the visual separation processing for neighboring images is not limited to the examples given in the above embodiments, and various display modes can be employed as appropriate.

Moreover, in this specification, the term vehicle can be broadly interpreted as a vehicle. Terms relating to navigation (for example, AR display, ADAS display, etc.) shall also be interpreted in a broad sense. HUD devices and display devices (and display devices in a broad sense) also include those used as simulators (for example, aircraft simulators, simulators as game devices, etc.).

The invention is not limited to the exemplary embodiments described above, and the person skilled in the art will easily be able to modify the exemplary embodiments described above to the extent that they fall within the scope of the claims. .

DESCRIPTION OF SYMBOLS 1... Vehicle (self-vehicle), 2... Windshield (projected member), 6... Road surface, 30... I/O interface, 41... Instrument panel (dashboard), 100 ... HUD device, 108 ... display (liquid crystal panel, etc.), 109 ... display surface of display, 120 ... main body of HUD device, 140 ... control unit (display control unit), 160... HUD device display (liquid crystal panel, etc.), 160... screen, 164... display surface of screen, 170... curved mirror (concave mirror, etc.), 179... reflecting surface of curved mirror , 210... Image processing unit, 230... Image display unit, 350... Storage unit, 522... Display mode determination module, 327... Near image display mode determination module, 329... Far away Image display mode determination module 328 Visual separation processing execution module K Display light PS Image display surface

Claims (9)

A display control device that performs image display control,
Having a control unit for controlling the display mode of the image,
The image includes a near image that is displayed closer to the viewer and a far image that is displayed farther,
The control unit
When it is determined that the identifiability between the near image and the distant image is degraded, or when it is determined that the identifiability should be improved,
widening the distance between the near image and the far image by moving the near image further away from the far image;
Hiding the neighboring image;
shrinking the neighboring image;
shrinking the neighboring image by changing the display mode;
when the neighboring image includes a plurality of display contents, widening the interval between the display contents arranged adjacently;
perform a visual isolation process including at least one of
Display controller. When it is determined that the identifiability between the near image and the distant image is degraded, or when it is determined that the identifiability should be improved,
When the number of display contents included in the distant image exceeds a predetermined threshold,
or
When at least one predetermined display content having high importance is displayed as the distant image, or when more than a predetermined threshold is displayed,
or
When it is detected that the importance of at least one display content displayed as the distant image has increased,
The display control device according to claim 1, wherein: The predetermined display content with high importance is
AR display content displayed superimposed on the actual scene,
or
display content (ADAS display content) of driving support information by an advanced driving support system (ADAS);
3. The display control device according to claim 2, wherein: If it is detected that the at least one displayed content has increased importance,
When the navigation display is displayed, if the distance to the branch point that requires steering is within a predetermined distance,
or
If the already displayed ADAS display content increases the risk to safe driving,
3. The display control device according to claim 2, wherein: The display control device is mounted on a vehicle,
Let the height direction of the vehicle be the vertical direction or the vertical direction, the width direction of the vehicle be the horizontal direction or the horizontal direction, and the direction orthogonal to the vertical direction and the horizontal direction be the depth direction,
the neighboring image includes first and second display contents arranged in a horizontal direction;
and when the first and second display contents are located below the display area of the distant image,
The visual separation process includes:
The first display content is moved to the left along the horizontal direction and the second display content is moved to the right along the horizontal direction to widen the space between the first and second display contents. with
When the display area for the first display content is the left display area and the display area for the second display content is the right display area,
A process for preventing the display area of the distant image from overlapping in the vertical direction with the left display area and the right display area of the near image;
or
A process of preventing the display area of the far image and the right display area of the near image from overlapping in the vertical direction, but not overlapping the left area;
or
The display area of the far image and the left display area of the near image overlap in the vertical direction, but the right area does not overlap.
The display control device according to any one of claims 1 to 4. Although the display area of the far image and the right display area of the near image overlap in the vertical direction, the area of the right display area when processing is executed so that the left area does not overlap is the left side larger than the area of the display area,
Although the display area of the distant image and the left display area of the near image overlap in the vertical direction, the area of the left display area when processing is executed so that the right area does not overlap is the area of the right side image. larger than the area of the display area,
The display control device according to claim 5. The visual separation process includes:
Further comprising a process of changing the near-field image to display mainly in achromatic colors with respect to the distant image mainly in chromatic colors,
The display control device according to any one of claims 1 to 6. a head-up display device that displays a distant image;
A display device or a head-up display device for displaying a nearby image by display control by the display control device according to any one of claims 1 to 7;
Display device including. A display control method for controlling display of a near image displayed closer and a far image displayed farther from the viewer, comprising:
a step of determining whether or not the identifiability between the near image and the distant image is reduced, or determining whether or not the identifiability should be improved;
When the result of the determination is affirmative, the near image is moved further away from the far image, thereby increasing the non-display area between the near image and the far image, and hiding the near image. reducing the size of the neighboring image; reducing the size of the neighboring image by changing a display mode; and widening the interval between adjacently arranged display contents when the neighboring image includes a plurality of display contents. performing a visual separation process comprising at least one;
display control methods, including

Images