WO2019123976A1

WO2019123976A1 - Display control method, display control device, and heads-up display device

Info

Publication number: WO2019123976A1
Application number: PCT/JP2018/043322
Authority: WO
Inventors: 瑞翔神保
Original assignee: 日本精機株式会社
Priority date: 2017-12-21
Filing date: 2018-11-26
Publication date: 2019-06-27
Also published as: JPWO2019123976A1; DE112018006514T5; JP7216898B2

Abstract

In order to improve the recognizability of an object existing in an actual view, in the present invention an object information acquisition unit 30 acquires first object information for a first object 311 existing in the vicinity of a vehicle, said information including at least the position 311 of the first object, and second object information for a second object 312, said information including at least the position of the second object. Furthermore, a determination unit 21 determines whether a moving condition for moving a moving image 200 has been satisfied. Furthermore, when the moving condition has been satisfied a display processing unit 22 switches an information image 210 included in the moving image 200 from a first information image 211 related to the first object information to a second information image 212 related to the second object information, and moves the moving image 200 along a movement path 400 separated from the first object 311.

Description

Display control method, display control device and head-up display device

The present invention relates to a display control method of a virtual image superimposed on a foreground of a vehicle for visual recognition, a display control device, and a head-up display device for displaying a virtual image.

The head-up display device disclosed in Patent Document 1 adds information to an object or emphasizes an object by displaying a virtual image for the object existing in the foreground. (AR: Augmented Reality) ) Is generated.

JP, 2006-242859, A

However, as shown in FIG. 10 of Patent Document 1, when virtual images are displayed for a plurality of objects, it may be difficult to know which virtual image the attention is directed to, and it may be difficult to recognize the virtual image itself and the objects corresponding to the virtual image. was there.

The present invention has been made in view of the above problems, and its object is to improve the recognizability of objects existing in a real scene.

The display control method of the first embodiment of the present invention is a display control method of a moving image (200) to be viewed superimposed on the foreground of the host vehicle (1),
Regarding the first object (311) existing around the vehicle, the first object information including at least the position of the first object, and the second object (312) existing around the vehicle An information acquisition step (S10, S110, S310) of acquiring second object information including at least a position of the second object;
A determination step (S20, S120, S320) for determining whether a movement condition for moving the moving image is satisfied;
It has the following steps to be performed when the movement condition is satisfied, ie,
An information image for switching an information image (210) included in the moving image from a first information image (211) related to the first object information to a second information image (212) related to the second object information Updating steps (S40, S140, S340),
Moving step (S50, S160) for moving the moving image along a moving path (400) away from the first object based on at least one of the acquired position of the first object and the position of the second object , S350) and.

Further, the display control apparatus according to the second embodiment of the present invention is a display control apparatus for displaying an information image (200) visually recognized superimposed on the foreground of the host vehicle (1).
With respect to the first object (311) existing around the host vehicle, at least the second with respect to the first object information including the position (311) of the first object and the second object (312) An object information acquisition unit (30) for acquiring second object information including the position of the object of
A determination unit (21) that determines whether a movement condition for moving the image is satisfied;
When the movement condition is satisfied, the information image (210) included in the movement image is converted from a first information image (211) related to the first object information to a second one related to the second object information. And a display processing unit (22) for switching to the information image (212) and moving the moving image along a moving path (400) away from the first object.

Further, a head-up display device according to a third embodiment of the present invention includes the display control device (90) according to the second aspect;
And a display (10) for displaying the moving image under the control of the display control device (90).

It is a block diagram which shows functionally the composition of the head up display device concerning the embodiment of the present invention. It is a figure which shows the example of a mode that the moving image which the head-up display apparatus of the said embodiment displays, and a real view are visually recognized, when a driver | operator goes ahead of the own vehicle. It is a figure which shows the example of the moving image which the head-up display apparatus of the said embodiment displays. It is a flowchart which shows operation | movement of the head-up display apparatus of the said embodiment. It is a figure which shows a mode that the moving image which the head-up display apparatus of the said embodiment displays moves. It is a figure which shows a mode that the moving image which the head-up display apparatus in the modification of this invention displays moves. It is a flowchart which shows operation | movement of the head-up display apparatus in the modification of this invention. It is a figure which shows a mode that the moving image which the head-up display apparatus of the said embodiment displays moves. It is a flowchart which shows operation | movement of the head-up display apparatus in the modification of this invention. It is a figure which shows a mode that the moving image which the head-up display apparatus of the said embodiment displays moves.

Hereinafter, embodiments according to the present invention will be described with reference to the drawings. The present invention is not limited by the following embodiments (including the contents of the drawings). Of course, modifications (including deletion of components) can be added to the following embodiments. Further, in the following description, in order to facilitate understanding of the present invention, the description of known technical matters is appropriately omitted.

In this specification, the function of the object information acquisition unit 30 for acquiring the position of the object 310 present in the periphery 300 of the vehicle 1 and the moving image 200 are moved, and the information image 210 included in the moving image 200 is switched. A device provided with the function of the display processing unit 22 is called a display control device according to the present invention. As one example, since the object information acquisition unit 30 and the display processing unit 22 are provided, the unit indicated by reference numeral 90 in FIG. 1 can be called a display control device. In addition, since the display control device essentially has a function (display processing unit 22) for moving the moving image 200 and switching the information image 210 included in the moving image 200, the display A function (image generation unit 24) for generating display data for displaying a display image may be separately provided. In other words, the display control device 90 of FIG. 1 can be called a display control device according to the present invention even when there is no function of the image generation unit 24 that generates display data.

In addition, a device provided with a display control device (for example, reference numeral 90 in FIG. 1) according to the present embodiment and a display 10 for displaying a display image including the moving image 200 generated by the display control device 90 is the present invention. Can be referred to as a head-up display device according to

FIG. 1 is a block diagram showing the overall configuration of a head-up display device 100 (hereinafter referred to as a HUD device) in the present embodiment. For example, the HUD device 100 projects the display light L of the display 10 on a part of the front windshield (an example of the projection target 2) of the host vehicle 1. The to-be-projected part 2 produces | generates the predetermined | prescribed eye box 3 by reflecting the display light L toward the viewer side. The viewer (the driver of the host vehicle 1) places the eye point 4 (the position of the eye of the viewer) in the eye box 3 to display the display area 101 of the HUD device 100 in front of the projection part 2. A virtual image can be viewed within the (see FIG. 2).

The HUD device 100 displays the display 10 for displaying the display image M and the display light L of the display image M displayed by the display 10 on the projection portion 2 of the host vehicle 1 (for example, the front windshield of the host vehicle 1). A processing unit that changes the virtual image (moving image 200) visually recognized by the viewer by controlling the relay optical unit 11 (the plane mirror 12 and the concave mirror 13 in FIG. 1) and the display image M displayed by the display 10 20, an object information acquisition unit 30, an operation information acquisition unit 40, and an input / output interface 70.

The processing unit 20 receives an external device (periphery monitoring unit 31, operation detection unit 41, navigation system 500, cloud server (input device) through an input interface (object information acquisition unit 30, operation information acquisition unit 40, and input / output interface 70). External server) 600, vehicle ECU 700, and other on-vehicle devices in the host vehicle 1 (not shown), portable devices in the host vehicle 1, other vehicles (inter-vehicle communication V2 V), communication infrastructure on the road (inter-vehicle communication V2 I), walking It is communicably connected to a person's portable device (communication V2P between vehicle and pedestrian). The input interface may include wired communication functionality, such as, for example, a USB port, a serial port, a parallel port, an OBDII, and / or any other suitable wired communication port. In another embodiment, the input interface is, for example, Bluetooth (registered trademark) communication protocol, IEEE 802.11 protocol, IEEE 1002.11 protocol, IEEE 1002.16 protocol, DSRC (Dedicated Short Range Communications) protocol, shared wireless access A wireless input interface using a protocol, a wireless USB protocol, and / or any other suitable wireless technology may be included.

The object information acquisition unit 30 is an input interface for acquiring data (object information) including at least position information of a specific object 310 present in the periphery 300 including at least the front of the own vehicle 1. The object information is acquired from the periphery monitoring unit 31 including the single or plural cameras or sensors, and is output to the processing unit 20. For example, the periphery monitoring unit 31 captures (detects) the periphery 300 of the vehicle 1, analyzes the imaging (detection) data, and detects position information (object 310) of the object 310 in the periphery 300 of the vehicle 1. And / or an analysis unit (not shown) that generates positional information of the object 310 in the display area 101 of the HUD device 100 (may also include distance information to the object 310) Have. In this case, the object information acquired by the object information acquiring unit 30 is the actual coordinates of the periphery 300 of the vehicle 1 or the coordinates (position information) of the object 310 in the display area 101. The analysis unit as described above may be provided in the HUD device 100. Specifically, the analysis unit may be provided in the processing unit 20. In this case, the object information acquired by the object information acquisition unit 30 is an imaging (detection) of the periphery 300 by the periphery monitoring unit 31 ( Detection) data.

Further, the object information acquisition unit 30 may acquire type information of the object 310 that the periphery monitoring unit 31 observes the periphery 300 of the host vehicle 1 and identifies with the type identification unit (not shown). The type of the object 310 is, for example, an obstacle (other vehicle, person, animal, or thing), a road sign, a road, a building or the like, but is present in the periphery 300 and is not limited thereto as long as it can be identified. That is, the object information acquisition unit 30 may acquire object information (position information of the object 310, distance information, type information) and output the acquired information to the processing unit 20.

In another embodiment, instead of the object information acquisition unit 30 or together with the object information acquisition unit 30, the input / output interface 70 capable of communicating with an external device may function as the object information acquisition unit 30. In other words, the input / output interface 70 includes the navigation system 500, the cloud server 600, the vehicle ECU 700, other in-vehicle devices in the host vehicle 1 (not shown), portable devices in the host vehicle 1, other vehicles (inter-vehicle communication V2V), The object information may be acquired from the communication infrastructure on the road (road-to-vehicle communication V2I) and the portable device of the pedestrian (communication V2P between the vehicle and the pedestrian). The input / output interface 70 can obtain, for example, from the navigation system 500, the cloud server 600, and the vehicle ECU 700, along with map information, positional information, type information, etc. of objects 310 such as road signs, roads, buildings, etc. Obstacles (other vehicles, people, animals, things) from other vehicles (inter-vehicle communication V2V), communication infrastructures on the road (road-to-vehicle communication V2I), portable devices of pedestrians (communications V2P between vehicles and pedestrians) , Road signs, position information such as roads, type information, etc. can be acquired. The processing unit 20 outputs position information of the host vehicle 1 or the HUD device 100 (which may add direction information of the host vehicle 1) to the external device via the input / output interface 70, and the external device Based on the input position information (additional direction information) of the host vehicle 1 or the HUD device 100, the object information including the position information and type information of the object 310 present in the periphery 300 of the host vehicle 1 is output to the input / output interface 70 You may

The operation information acquisition unit 40 acquires, for example, operation information on a portion of the vehicle 1 detected by the operation detection unit 41 such as steering, accelerator, brake, blinker, and headlight, and outputs the operation information to the processing unit 20.

In another embodiment, the input / output interface 70 capable of communicating with an external device may function as the operation information acquisition unit 40 instead of the operation information acquisition unit 40 or together with the operation information acquisition unit 40. In other words, the input / output interface 70 may obtain the operation information regarding the vehicle 1 from the cloud server 600, the vehicle ECU 700, and the communication infrastructure (road-to-vehicle communication V2I) on the road (not shown).

The processing unit 20 determines a determination unit 21 that determines whether a moving condition of the moving image 200 described later is satisfied, a display processing unit 22 that changes the moving image 200, a program that the display processing unit 22 executes, and image element data And an image generation unit 24 that generates display data for causing the display 10 to display a display image based on the calculation result of the display processing unit 22.

The determination unit 21 determines, for the object 310, the priority to be notified to the viewer (hereinafter also referred to as notification priority), compares the notification priorities of the plurality of objects 310, and associates the moving image 200. When the notification priority of the other object 310 is higher than the notification priority of one object 310, it is determined that the movement condition for moving the moving image 200 is satisfied. The “informing priority” is, for the object 310, the degree of risk derived from the degree of the seriousness of the object 310, the degree of urgency derived from the length of the response time required to take a response action, etc. It may be determined based on only the object information acquired by the object information acquisition unit 30. In addition to the object information, the determination is made based on the operation information acquired by the operation information acquisition unit 40 and various information acquired by the input / output interface 70. It may be done. Note that the determination unit 21 essentially does not have to have the function of determining the notification priority, as long as it has the function of determining whether the movement condition is satisfied based on the notification priority. Alternatively, part or all of the function of determining the notification priority may be provided outside the processing unit 20 or outside the display control device 90. In addition, determination of a movement condition is not limited to the method of using the said danger degree or the said emergency degree. Below, a modification is shown.

For example, as a modification, the determination unit 21 determines that the moving condition for moving the moving image 200 toward the newly detected object 310 is satisfied by setting the notification priority to the newly detected object 310 high. May be In other words, the freshness of the information may be used to determine the movement conditions instead of or in addition to the degree of risk or the degree of urgency. Specifically, this is a case where the degree of risk (urgency) of one object 310 to which the moving image 200 is associated is higher than the degree of risk (urgency) of the other object 310 detected after this object 310. However, it may be determined that the movement condition for moving the moving image 200 toward the other object 310 is satisfied in consideration of the newness of the information.

As another modification, the determining unit 21 determines that the moving condition for moving the moving image 200 toward the other object 310 is satisfied by lowering the notification priority for the object 310 to which the moving image 200 is continuously associated. You may judge. In other words, the duration of the moving image 200 may be used to determine the movement condition instead of or in addition to the degree of danger or the degree of urgency. Specifically, when the moving image 200 is continuously displayed for the same object 310 for a predetermined threshold time or longer, a moving condition for moving the moving image 200 toward the other object 310 is satisfied. It may be determined that the The determination method of the movement condition is not limited to the above example, and the determination unit 21 newly adds, for example, via the input interface (the object information acquisition unit 30, the operation information acquisition unit 40, and the input / output interface 70). If the acquired information is a predetermined type of information, or the acquired information is information satisfying a predetermined condition, or if a predetermined combination of the acquired plurality of information is established, the driver is placed The movement condition may be determined by comprehensively judging the situation in which the user is present and changing the notification priority.

When the display processing unit 22 determines that the movement condition is satisfied, the display processing unit 22 moves the moving image 200, and the first information image 211 (based on the first object information included in the moving image 200) 5A is switched to the second information image 212 (see FIG. 5B) based on the second object information. The display processing unit 22 has a function (moving route determination unit 22a) that determines a moving route 400 from the position (moving start point 401) where the moving image 200 was originally displayed to the position (moving end point 402) to move the moving image 200. And a function (information image determination unit 22b) for determining the information image 210 of the moving image 200.

The movement path determination unit 22a determines the movement path 400 of the movement image 200 based on the position where the movement image 200 is currently displayed and the position of the second object 312 included in the second object information. . For example, the movement path 400 is directed from the position where the movement image 200 is currently displayed (the movement start point 401) to a predetermined position (the movement end point 402) around the second object 312 included in the second object information. The display processing unit 22 determines a movement path 400 toward a predetermined position (end point of movement 402) outside the bounding box surrounding the outline of the second object 312 or the second object 312. The movement end point 402 is set at a position not overlapping the outline of the second object 312 to be moved or the bounding box surrounding the second object 312 when the movement image 200 moves in the straight movement path 400. Is preferred. In other words, the movement path determination unit 22a may determine the movement path 400 so that the movement image 200 does not overlap the second object 312. However, the movement end point 402 may be set inside the outline of the second object 312 (the movement path determination unit 22a causes the movement path 400 to move so that the movement image 200 overlaps the second object 312. You may decide). In this case, when the moving image 200 overlaps the first object 311 or the second object 312 as the moving image 200 moves, the display processing unit 22 may reduce the visibility of the moving image 200. Specifically, when the moving image 200 overlaps with the first object 311 or the second object 312 as the moving image 200 moves, the display processing unit 22 reduces the visibility of the information image 210 of the moving image 200 and the painted image 220. However, the visibility may be reduced by reducing the visibility of the information image 210 and maintaining the visibility of the painted image 220, or by reducing the degree to a lower visibility of the information image 210. In addition, the movement path 400 may not be a mere straight line, but may be a visually elaborated curve.

The information image determining unit 22b determines an information image 210, which will be described later, included in the moving image 200, based on object information (position information, distance information, type information) of the object 310 with which the moving image 200 is associated. The information image determining unit 22b may determine the information image 210 in consideration of the operation information acquired from the operation information acquiring unit 40 and various information acquired from the input / output interface 70 in the object information.

Next, the moving image 200 displayed by the HUD device 100 will be described using FIGS. 2 and 3. FIG. 2 is a diagram showing an example of how the moving image 200 displayed by the HUD device 100 and the real view are viewed when the driver faces the front of the host vehicle 1. The HUD device 100 displays the moving image 200 at a predetermined position in the display area 101 of the projection target 2. In FIG. 2, the display area 101 is described by a rectangular area surrounded by a dotted line, and the other vehicle 311 (an example of the object 310) located in front of the host vehicle 1 is located in the display area 101. The HUD device 100 displays a moving image 200 drawn as “front caution” that calls attention to the other vehicle 311 in the vicinity of the other vehicle 311 (in the vertical direction below the other vehicle 311 in FIG. 2). Thereby, the viewer gives visual attention to the displayed moving image 200, and recognizes that it is a situation where attention needs to be paid to the "front attention" which is the information image 210 drawn on the moving image 200, And, it is possible to quickly recognize that the target of which attention must be made is the other vehicle 311 near the moving image 200. The position (coordinates) at which the moving image 200 is displayed may be fixed or dynamic with respect to the position change of the object 310. That is, the position at which the moving image 200 is displayed is determined by the rough position of the object 310, and may not be changed (it may be fixed) in a non-large position change of the object 310. Further, the position where the moving image 200 is displayed may be changed according to the change of the position information of the object 310 (it may be changed continuously so that the relative change of position with the object 310 is reduced). In other words, the position of the object 310 may be tracked).

FIG. 3 is a diagram for explaining the configuration of the moving image 200. As shown in FIG. The moving image 200 is a color such as white, orange, yellow, yellowish green, blue, red, etc., and as shown in FIG. 3A, an information image 210 which is a text image of about 4 characters such as "forward warning". And a paint image 220 which is rectangular (shape is one example) surrounding the information image 210 and is filled with a color having a hue different from that of the information image 210. Incidentally, since the moving image 200 is a virtual image displayed overlapping with the real view, the viewer visually recognizes a mixed color of the real view and the moving image 200. FIG. 3B is a view showing a state in which the moving image 200 having the painted image 220 overlaps the visual obstacle 320 (for example, a white line on the road) in the real view, for example, the information image 210 Example of white color (R255, G255, B255 in RGB value), yellow-green (R153, G255, B102 in RGB value) for painted image 220, and white (R255, G255, B255 in RGB value) for visual obstacle 320 It is. Further, FIG. 3C is a diagram showing a state in which the moving image 200 without the painted image 220 overlaps the visual obstacle 320 (for example, a white line on a road, etc.) in the real scene. As described above, when the color of the information image 210 and the color of the visual obstacle 320 are the same or approximate colors, in the moving image 200 which does not have the painted image 220 shown in FIG. It is difficult to distinguish between the image 210 and the visual obstacle 320, and the visibility of the information image 210 is reduced. On the other hand, in the moving image 200 having the paint image 220 shown in FIG. 3B, the color of the visual obstacle 320 overlapping the paint image 220 is visually recognized as a different color due to color mixture with the paint image 220. This makes it easy to distinguish from the visual obstacle 320, and the visibility of the information image 210 is improved. In this embodiment, in order to move the moving image 200, the frequency of overlapping the moving image 200 with various visual obstacles 320 on the real view increases, but by providing the paint image 220 on the moving image 200, Visibility can be improved.

FIG. 3D shows a state where the information image 210 of the moving image 200 is switched, one of which is the information image 210a marked as “right side caution”, and the other of which is the information image noted as “vehicle approaching”. 210b. The moving image 200 has a plurality of (two types in the example of FIG. 3D) information images 210 of the information image 210a and the information image 210b, and the information images 210 in the moving image 200 are sequentially or reciprocally continuous. It may be switched.

As another example of the moving image 200, the moving image 200 may not have the fill image 220. In other words, the moving image 200 may be configured by adding only the information image 210 or an image element different from the filling image 220. In addition, the information image 210 and the fill image 220 are not limited to a single color, and may be configured in a plurality of colors. Also, the fill image 220 may be an image element surrounding the edge of each character of the information image 210. Also, although it is preferable that the fill image 220 entirely surround the information image 210, it does not have to surround part of the information image 210.

The first to third embodiments will be specifically described below with reference to FIGS. 4 to 8.
First Embodiment
First, FIG. 4 and FIG. 5 will be referred to. FIG. 4 is a flow chart showing the main operation procedure of the HUD device 100 in the first and second embodiments, and FIG. 5 is a table of the moving image 200 of the first embodiment corresponding to the flow chart of FIG. It is a figure showing an example of indication. FIG. 5 (a) shows a display example of the moving image 200 before moving, and FIG. 5 (b) shows the moving image 200 after steps S40 and S50 in FIG. 4 are executed when the moving condition is satisfied. Shows a display example of.

In step S10 (information acquisition process) of FIG. 4, the determination unit 21 acquires object information from the periphery monitoring unit 31 via the object information acquisition unit 30. The object information is position information on the actual coordinates of the object 310 in the vicinity 300 of the own vehicle 1 (may include distance information to the object 310) or / and of the object 310 in the display area 101 of the HUD device 100. At least position information (which may include distance information to the object 310). In the information acquisition process, the determination unit 21 receives the operation information of the own vehicle 1 from the operation detection unit 41 via the operation information acquisition unit 40, the external device via the input / output interface 70 (navigation system 500, cloud server 600, various information including information from the vehicle ECU 700) may be acquired.

Subsequently, in step S20 (determination step), the determination unit 21 determines whether the movement condition of the moving image 200 is satisfied based on the various information acquired in step S10. For example, when the determination unit 21 acquires the operation information of the blinker that changes the course to the driver's right lane in step S10, the first object 311 traveling in front of the host vehicle 1 (see FIG. The moving condition is satisfied by setting the notification priority for the second object 312 (see FIG. 5B) traveling in the right lane of the host vehicle 1 higher than the notification priority for 5 (a)). It is determined that

When the movement condition is not satisfied (NO in step S20), the display processing unit 22 updates the display without moving the moving image 200 in the direction away from the first object 311 (step S30). In other words, the display processing unit 22 maintains the object 310 associated with the moving image 200 without changing it. Here, "do not move the moving image 200 away from the object 310" is not only simply not changing the position (coordinates) at which the moving image 200 is displayed in the display area 101 of the HUD device 100. , And keeping the position of the moving image 200 changed by tracking the position of the object 310.

When the movement condition is satisfied (YES in step S20), the process proceeds to step S40 (information image updating step), and the display processing unit 22 or the information image determining unit 22b performs the second process based on the various information input in step S10. The second information image 212 related to the object 312 is determined, the image generation unit 24 generates display data, and switches the information image 210 from the first information image 211 to the second information image 212. The display processing unit 22 or the information image determination unit 22 b may, for example, change the information image 210 from “forward warning” (see FIG. 5A), which is a first information image 211 related to the first object 311. It switches to the "right side attention" (refer FIG.5 (b)) which is the 2nd information image 212 relevant to the object 312. FIG.

Subsequently, the process proceeds to step S50 (movement step), and the display processing unit 22 or the movement path determination unit 22a moves the moving image 200 closer to the second object 312 based on the position of the second object 312 (in other words, The movement path 400 is determined such that the movement image 200 is separated from the first object 311, the image generation unit 24 generates display data, and moves the information image 210 along the movement path 400. For example, the display processing unit 22 or the movement path determination unit 22a sets the position at which the movement image 200 is currently displayed as the movement start point 401, and moves the predetermined position determined based on the position of the second object 312 The end point 402 is set, and a line segment connecting the movement start point 401 and the movement end point 402 is determined as the movement path 400.

Although steps S40 and S50 may be performed out of order or simultaneously, the processing unit 20 or the display processing unit 22 may complete the movement of the moving image 200 (step S50 (moving step)). Preferably, the switching of the information image 210 to the second information image 212 (step S40 (information image updating step)) is completed. In other words, it is preferable that the switching of the information image 210 be completed while the moving image 200 moves along the moving path 400 or before the moving starts. According to this, since the new information image 210 (second information image 212) can be visually recognized before the moving image 200 moves, it becomes possible to take an action intended by the information image 210 more quickly.

Second Embodiment
Next, a second embodiment will be described with reference to FIGS. 4 and 6. In the second embodiment, the moving image 200 is moved from the movement start point 401 via the movement relay point 403 (first movement stroke) to the movement end point 402 (second movement stroke) according to the above embodiment. It is different. FIG. 6 is a view showing a display example of the moving image 200 according to the second embodiment. 6 (a) shows a display example of the moving image 200 before moving, and FIG. 6 (b) shows a display example of the moving image 200 moving from the moving start point 401 to the moving relay point 403. c) shows a display example of the moving image 200 moving from the moving relay point 403 to the moving end point 402.

First, the determination unit 21 acquires the object information of the objects 310 of the objects 300 around the host vehicle 1 in step S10 of FIG. 4 and updates the display in step S30 when the movement condition is not satisfied (NO in step S20). Do. If the processing unit 20 or the display processing unit 22 has a high notification priority for the first object 311 located in front of the host vehicle 1, as shown in FIG. 6A, the first information on the first object 311 The moving image 200 including the image 211 is displayed.

Thereafter, the determination unit 21 acquires the object information of the objects 310 in the vicinity 300 of the vehicle 1 in step S10 of FIG. 4 again, and based on the notification priority for the first object 311 located in front of the vehicle 1 It is determined that the moving condition of the moving image 200 is satisfied when the notification priority for the other second object 312 is high (or when the notification priority for the first object 311 is lower than a predetermined threshold) (YES in step S20 of FIG. 4). Subsequently, in step S40, the information image determination unit 22b determines the second information image 212 related to the second object 312, and the information image 210 is displayed as the first information image 211 (“forward warning” in FIG. 6A). Is switched to the second information image 212 (“right side attention” in FIG. 6B), and in step S50, the movement path determination unit 22a determines the first movement path 410 heading from the movement start point 401 to the movement relay point 403 The processing unit 20 or the display processing unit 22 moves the moving image 200 to the moving relay point 403 along the first moving path 410, as shown in FIG. 6 (b).

Thereafter, the determination unit 21 acquires the object information of the objects 310 in the vicinity 300 of the vehicle 1 in step S110 of FIG. 4, and the notification priority for the second object 312 is further increased and exceeds a predetermined threshold. In this case, it is determined that the movement condition of the moving image 200 is satisfied (YES in step S120 in FIG. 4). Subsequently, in step S140, the information image determination unit 22b updates the information image 210, but the information image 210 has already been changed to the second information image 212 regarding the second object 312 by the previous processing (step S40). In step S150, the movement path determination unit 22a determines the second movement path 420 from the movement relay point 403 to the movement end point 402, as shown in FIG. 6C. As such, the moving image 200 is moved along the second moving path 420 to the moving end point 402.

In the above embodiment, the individual movement conditions are determined when going from the movement start point 401 to the movement relay point 403 and when going from the movement relay point 403 to the movement end point 402 (see FIG. 4). Although both steps S20 and S120 are being performed), the determination step (step S120) when moving from the mobile relay point 403 to the mobile end point 402 may be omitted. In this case, when moving condition is satisfied when moving from moving start point 401 to moving relay point 403, moving image 200 passes from moving start point 401 to moving relay point 403, and then automatically moves from moving relay point 403 to moving end point 402. You may move it to The moving image 200 may be moved toward the moving end point 402 after being stopped at the moving relay point 403 for a predetermined time (for example, 10 seconds).

Since the movement relay point 403 is a specific position on the display area 101 stored in advance in the storage unit 23, the movement path 400 between the movement start point 401 and the movement end point 402 changing for each situation is The movement path determination unit 22a or the memory is more than a memory 22 stores and reads in advance all movement paths 400 between all movement start points 401 and movement end points 402 that can be calculated or obtained. The load on the part 23 can be reduced. The mobile relay point 403 is not limited to a single one, and may be a plurality of positions on the display area 101 stored in advance in the storage unit 23. In this case, the closest moving relay point 403 may be selected from among the plurality according to the position where the moving image 200 was originally displayed, and according to the position of the second object 312, the closest among the plurality A near mobile relay point 403 may be selected.

Third Embodiment
Next, FIG. 7 and FIG. 8 will be referred to. The third embodiment is different from the above embodiment in that an instruction image 250 directed from the moving image 200 to the second object 312 is displayed. FIG. 7 is a flowchart showing the main operation procedure of the HUD device 100 in the third embodiment, and FIG. 8 is a diagram showing a display example of the moving image 200 in the third embodiment. 8 (a) shows a display example of the moving image 200 before moving, FIG. 8 (b) shows a display example of the instruction image 250, and FIG. 8 (c) shows after the instruction image 250 is displayed. Or, a display example of the moving image 200 moving from the moving start point 401 to the moving end point 402 while displaying the instruction image 250 is shown.

In step S210 (information acquisition process) of FIG. 7, the determination unit 21 acquires object information from the periphery monitoring unit 31 via the object information acquisition unit 30, and the determination unit 21 is based on the various information acquired in step S210. It is then determined whether the moving condition of the moving image 200 is satisfied (step S220 (determination step)).

When the movement condition is not satisfied (NO in step S220), the display processing unit 22 updates the display without moving the moving image 200 in the direction away from the first object 311 (step S230).

If the movement condition is satisfied (YES in step S220), the process proceeds to step S240 (information image updating step), and the display processing unit 22 or the information image determining unit 22b performs second processing based on the various information input in step S210. The second information image 212 related to the object 312 is determined, the image generation unit 24 generates display data, and switches the information image 210 from the first information image 211 to the second information image 212. The display processing unit 22 or the information image determination unit 22 b may, for example, change the information image 210 from “forward warning” (see FIG. 8A), which is a first information image 211 related to the first object 311. It switches to the "right side attention" (refer FIG.8 (b)) which is the 2nd information image 212 relevant to the object 312. FIG.

Subsequently, the process proceeds to step S250 (instruction image display process), and the display processing unit 22 or the image generation unit 24 determines the position at which the moving image 200 is currently displayed based on the position of the second object 312. The position and the shape of the instruction image 250 are determined so as to indicate the second object 312, and the image generation unit 24 generates display data and displays the instruction image 250. For example, the display processing unit 22 determines the instruction image 250 as a ripple-like image directed from the position where the moving image 200 is currently displayed to the second object 312. Note that the instruction image 250 may be any image that associates the moving image 200 with the position where the second object 312 is present, and thus is not limited to the ripple-like image. For example, the moving image 200 and the second object 312 And a line image, a dotted line, a group image including a plurality of images, and the like. In addition, the instruction image 250 may be a moving image in which one or more images move between the moving image 200 and the second object 312. For example, a ripple is directed from the moving image 200 to the second object 312. It may be a moving video.

Subsequently, the process proceeds to step S 260 (movement step), and the display processing unit 22 or the movement path determination unit 22 a moves the moving image 200 closer to the second object 312 based on the position of the second object 312 (in other words, The movement path 400 is determined such that the movement image 200 is separated from the first object 311, the image generation unit 24 generates display data, and moves the information image 210 along the movement path 400. For example, the display processing unit 22 or the movement path determination unit 22a sets the position at which the movement image 200 is currently displayed as the movement start point 401, and moves the predetermined position determined based on the position of the second object 312 The end point 402 is set, and a line segment connecting the movement start point 401 and the movement end point 402 is determined as the movement path 400.

If the instruction image 250 in step S250 is displayed before the movement of the moving image 200 in step S260 is completed, steps S240 to S260 may be executed out of order of movement or may be executed simultaneously. The processing unit 20 or the display processing unit 22 switches the information image 210 to the second information image 212 before the movement of the moving image 200 (step S260 (moving step)) is completed (step S240 (information image updating step) Is preferred to complete. According to this, since the new information image 210 (second information image 212) can be visually recognized before the moving image 200 moves, it becomes possible to take an action intended by the information image 210 more quickly. The processing unit 20 or the display processing unit 22 displays the instruction image 250 (step S250 (instruction image) after the switching of the information image 210 to the second information image 212 (step S240 (information image update step)) is completed. It is preferable to start the display step)). According to this, since the instruction image 250 can be viewed after the information image 210 is switched, it is possible to immediately recognize the reason why the instruction image 250 is displayed and the like by the information image 210.

Fourth Embodiment
Next, FIG. 9 and FIG. 10 will be referred to. The fourth embodiment is different from the above embodiment in that the moving image 200 is displayed from the moving start point 401 via the moving relay point 403 to the instruction image 250 directed from the moving image 200 to the second object 312. It is different. FIG. 9 is a flowchart showing the main operation procedure of the HUD device 100 according to the fourth embodiment, and FIG. 10 is a diagram showing a display example of the moving image 200 according to the fourth embodiment. 10 (a) shows a display example of the moving image 200 before moving, FIG. 10 (b) shows a display example of the moving image 200 moving from the moving start point 401 to the moving relay point 403, and FIG. c) shows a display example of the indication image 250, and FIG. 10 (d) shows a movement image 200 moving from the movement relay point 403 to the movement end point 402 after the indication image 250 is displayed or while the indication image 250 is displayed. Shows a display example of.

The determination unit 21 acquires object information of the objects 310 in the vicinity 300 of the host vehicle 1 in step S310 in FIG. 9, and the second other than the notification priority for the first object 311 located in front of the host vehicle 1. It is determined that the movement condition of the moving image 200 is satisfied (FIG. 9) when the notification priority for the object 312 of (1) becomes high (or the notification priority for the first object 311 becomes lower than a predetermined threshold). (YES in step S320). Subsequently, in step S340, the information image determination unit 22b determines the second information image 212 regarding the second object 312, and the information image 210 is displayed as the first information image 211 ("Forward Caution" in FIG. 10A). Is switched to the second information image 212 (“right side attention” in FIG. 10B), and the movement path determination unit 22a determines the first movement path 410 from the movement start point 401 to the movement relay point 403 in step S350. Then, as shown in FIG. 10B, the processing unit 20 or the display processing unit 22 moves the moving image 200 to the moving relay point 403 along the first moving path 410.

Subsequently, the process proceeds to step S360 (instruction image display process), and the display processing unit 22 or the image generation unit 24 displays a position (movement) at which the moving image 200 is currently displayed based on the position of the second object 312. The position and the shape of the instruction image 250 are determined so that the second object 312 is indicated from the relay point 403), the image generation unit 24 generates display data, and the instruction image 250 is displayed.

Thereafter, the determination unit 21 acquires the object information of the objects 310 of the objects 300 in the vicinity 300 of the vehicle 1 in step S410 in FIG. 9, and the notification priority for the second object 312 becomes higher and exceeds the predetermined threshold. In this case, it is determined that the movement condition of the moving image 200 is satisfied (YES in step S420 in FIG. 9). Subsequently, in step S440, the information image determination unit 22b updates the information image 210, but the information image 210 has already been changed to the second information image 212 regarding the second object 312 by the previous processing (step S340). In step S450, the movement path determination unit 22a determines the second movement path 420 from the movement relay point 403 to the movement end point 402, as shown in FIG. 10 (d). As such, the moving image 200 is moved along the second moving path 420 to the moving end point 402. When moving the moving image 200, the instruction image 250 may be hidden, or may be moved while the instruction image 250 is displayed.

Since the movement relay point 403 is a specific position on the display area 101 stored in advance in the storage unit 23, the display processing unit 22 displays the instruction image 250 between the movement start point 401 and the movement end point 402 changing for each situation. Display processing rather than storing (in the storage unit 23) and reading out all instruction images 250 between all the moving start points 401 and the moving end points 402 that can be generated or acquired (image generation unit 24) The load on the unit 22 or the storage unit 23 can be reduced. The mobile relay point 403 is not limited to a single one, and may be a plurality of positions on the display area 101 stored in advance in the storage unit 23. In this case, the closest moving relay point 403 may be selected from among the plurality according to the position where the moving image 200 was originally displayed, and according to the position of the second object 312, the closest among the plurality A near mobile relay point 403 may be selected.
[Modification]

The present invention is not limited by the above embodiments and drawings. It is possible to add changes (including deletion of components) to the embodiment and the drawings as appropriate without departing from the scope of the present invention. Below, an example of a modification is described.

In the above embodiment, the display processing unit 22 or the movement path determination unit 22a determines the movement path 400 based on the position of the second object 312. However, the present invention is not limited to this. As a modification, the display processing unit 22 or the movement path determination unit 22a may determine the movement path 400 such that the movement image 200 is separated from the first object 311 based on the position of the first object 311. By moving the moving image 200 away from the first object 311 and switching the information image 210 from the first information image 211 to the second information image 212, visual attention is given from the first object 311. Attention can be directed to the second object 312 shown by the second information image 212 which is released and present at another position.

1: Vehicle 2: Projected part 3: Eye box 4: Eye point 10: Display 20: Processing unit 21: Judgment part 22: Display processing part 22 a: Movement path determination part 22 b: Information image determination part 23: Storage part 24: Image generation unit 30: Object information acquisition unit 31: Peripheral monitoring unit 40: Operation information acquisition unit 41: Operation detection unit 70: Input / output interface (object information acquisition unit, operation information acquisition unit)
90: Display control device 100: Head-up display device (HUD device)
101: Display area 200: Moving image 210: Information image 211: First information image 212: Second information image 220: Filled image 250: Instruction image 300: Peripheral 310: Object 311: First object 312: Second object 320: Visual obstacle 400: Movement path 401: Movement start point 402: Movement end point 403: Movement relay point 500: Navigation system (external device)
600: Cloud server (external device)
700: Vehicle ECU (external device)
L: Display light M: Display image

Claims

A display control method of a moving image (200) to be viewed superimposed on the foreground of a vehicle (1),
With respect to the first object (311) existing around the vehicle, at least first object information including the position of the first object, and the second object (312) existing around the vehicle An information acquisition step (S10, S110, S210, S310, S410) of acquiring second object information including the position of the second object;
A determination step (S20, S120, S220, S320, S420) for determining whether a movement condition for moving the moving image is satisfied;
It has the following steps to be performed when the movement condition is satisfied, ie,
An information image for switching an information image (210) included in the moving image from a first information image (211) related to the first object information to a second information image (212) related to the second object information Updating steps (S40, S140, S240, S340, S440),
Moving step (S50, S150) for moving the moving image along a moving path (400) away from the first object based on at least one of the acquired position of the first object and the position of the second object , S260, S350, S450), and a display control method.
An instruction image display step (S250, S360, S460) for displaying an instruction image (250) indicating the position where the second object is present in the vicinity of the moving image until the moving step is completed. The display control method according to claim 1.
A first moving step (S50, S350) in which the moving step moves the moving image to a moving relay point (403) away from the first object; and from the moving relay point toward the second object The display control method according to claim 1, further comprising: a second moving step (S <b> 150, S <b> 450) for moving the moving image.
The instruction image display step (S360) for displaying an instruction image (250) for instructing a position where the second object is present in the vicinity of the moving image after the first moving step. Display control method.
The display control method according to any one of claims 1 to 4, wherein the information image updating step is completed until the moving step is completed.
The display control method according to claim 5, wherein the information image updating step is completed before the moving step is started.
The display control method according to any one of claims 1 to 6, wherein, in the moving step, when the moving image overlaps the first object or the second object, the visibility of the moving image is reduced.
A display control apparatus for displaying a moving image (200) to be viewed superimposed on the foreground of a vehicle (1),
With respect to the first object (311) existing around the vehicle, the first object information including at least the position (311) of the first object and the second object with respect to the second object (312) An object information acquisition unit (30) for acquiring second object information including the position of the object;
A determination unit (21) that determines whether a movement condition for moving the moving image is satisfied;
When the movement condition is satisfied, the information image (210) included in the movement image is converted from a first information image (211) related to the first object information to a second one related to the second object information. A display processing unit (22) for switching to an information image (212) and moving the movement image along a movement path (400) away from the first object.
The display processing unit (22) moves the moving image to the moving relay point (403) away from the first object (311) when moving the moving image, and then the second object from the moving relay point The display control apparatus according to claim 8, wherein the moving image is moved toward.
10. The display control device according to claim 8, wherein the display processing unit (22) displays an instruction image that indicates a position at which the second object is present in the vicinity of the moving image.
The display processing unit (22) according to claim 10, wherein the display processing unit (22) displays an instruction image indicating a position where the second object is present in the vicinity of the moving image until the movement of the moving image is completed. Display control device.
The display control device according to any one of claims 8 to 11, wherein the display processing unit completes the switching of the information image until the movement of the moving image is completed.
The display control device according to claim 12, wherein the display processing unit completes the switching of the information image before the movement of the moving image starts.
The display processing unit reduces the visibility of the moving image when it is determined that the moving image overlaps the first object or the second object in the movement path. The display control device according to any one.
A display control device (90) according to any of claims 8 to 14,
And a display (10) for displaying the moving image under control of the display control device (90).