WO2019142364A1

WO2019142364A1 - Display control device, display control system, and display control method

Info

Publication number: WO2019142364A1
Application number: PCT/JP2018/001815
Authority: WO
Inventors: 聖崇加藤
Original assignee: 三菱電機株式会社
Priority date: 2018-01-22
Filing date: 2018-01-22
Publication date: 2019-07-25

Abstract

Provided is a display control device (100) comprising: an object information acquisition part (31) for acquiring object information including information relating to one or more objects present around a vehicle (1); a visually-induced motion sickness inference part (32) for, using the object information, executing a process for inferring whether visually-induced motion sickness has been induced by a first video group including one or more videos corresponding to the one or more objects; and a display control part (33) for, using the object information, executing control for causing a heads-up display (2) to display a second video group including at least a portion of the one or more videos. The display control part (33) varies the display state of the second video group according to a result of the inference process performed by the visually-induced motion sickness inference part (32).

Description

Display control apparatus, display control system and display control method

The present invention relates to a display control device, a display control system, and a display control method.

Conventionally, a head-up display (hereinafter sometimes referred to as “HUD”) for mobiles has been developed. In addition, a technology has been developed to determine the likelihood of occurrence of so-called “video sickness” by analyzing the content of the video displayed on the HUD (see, for example, Patent Document 1). Symptoms of motion sickness include, for example, nausea, dizziness, headache or eye strain.

JP, 2006-40056, A

In recent years, HUDs (hereinafter sometimes referred to as “AR-HUD”) corresponding to so-called AR (Augmented Reality) display have been developed. In AR-HUD, images are displayed so that images corresponding to various objects (hereinafter referred to as “objects”) present around the moving object are superimposed at positions near each object in the user's field of view. Be done.

Usually, the positional relationship between the moving object and each object changes as the moving object moves. As a result, the number of objects included in the field of view of the user, the range occupied by the object in the field of view of the user, and the like change. As a result, the number of images displayed on the AR-HUD, the size of the area in which images on the AR-HUD are displayed, and the like also change.

Here, the more the number of images displayed on the AR-HUD, the more likely to be an image sickness. In addition, as the size of the area in the AR-HUD in which the video is displayed is larger, the video sickness is more likely to occur. That is, in AR-HUD, the likelihood of occurrence of video sickness varies depending on the number of objects included in the field of view of the user, the range occupied by the object in the field of view of the user, and the like.

On the other hand, the image display device described in Patent Document 1 determines the likelihood of occurrence of video sickness using the analysis result of the contents of the video. That is, the image display device described in Patent Document 1 does not use information on an object when determining the likelihood of occurrence of video sickness. For this reason, when the image display device described in Patent Document 1 is used for AR-HUD, there is a problem that the determination accuracy of the susceptibility to video sickness is low.

The present invention has been made to solve the problems as described above, and it is an object of the present invention to estimate with high accuracy the presence or absence of the occurrence of motion sickness in an AR-HUD.

A display control apparatus according to the present invention includes an object information acquisition unit that acquires object information including information on one or more objects existing around a mobile object, and one or more objects corresponding to one or more objects. A video sickness estimation unit that executes processing to estimate the presence or absence of video sickness due to the first video group including one or more videos, and at least a part of the video of one or more videos using the object information And a display control unit that executes control to cause the head-up display to display the second image group including the display group, and the display control unit changes the display mode of the second image group according to the result of estimation processing by the video sickness estimation unit. It is a thing.

According to the present invention, as configured as described above, it is possible to estimate with high accuracy the presence or absence of video sickness in the AR-HUD.

It is a block diagram which shows the state in which the control apparatus containing the display control apparatus which concerns on Embodiment 1 of this invention is provided in the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS It is explanatory drawing which shows the state in which the control apparatus containing the display control apparatus which concerns on Embodiment 1 of this invention is provided in the vehicle. FIG. 3A is an explanatory view showing an example of an object. FIG. 3B is an explanatory view showing an example of a displayable area, an object area, and an object group area. It is an explanatory view showing an example of object information. FIG. 5A is a block diagram showing a hardware configuration of a control device including the display control device according to Embodiment 1 of the present invention. FIG. 5B is a block diagram showing another hardware configuration of a control device including the display control device according to Embodiment 1 of the present invention. It is a flowchart which shows operation | movement of the display control apparatus which concerns on Embodiment 1 of this invention. It is a flowchart which shows detailed operation | movement of the imaging sickness estimation part of the display control apparatuses which concern on Embodiment 1 of this invention. It is a flowchart which shows the detailed operation | movement of the display control part among the display control apparatuses which concern on Embodiment 1 of this invention. FIG. 9A is an explanatory view showing an example of a displayable area, a display target area, and a first image group. FIG. 9B is an explanatory diagram showing an example of a state in which the second image group is displayed on the head-up display. FIG. 10A is an explanatory view showing another example of the displayable area, the display target area, and the first image group. FIG. 10B is an explanatory view showing another example of the state in which the second image group is displayed on the head-up display. FIG. 11A is an explanatory view showing another example of the displayable area, the display target area, and the first image group. FIG. 11B is an explanatory view showing another example of the state in which the second image group is displayed on the head-up display. FIG. 12A is an explanatory view showing another example of the displayable area, the display target area, and the first image group. FIG. 12B is an explanatory view showing another example of the state in which the second image group is displayed on the head-up display. FIG. 13A is an explanatory view showing another example of the object. FIG. 13B is an explanatory view showing another example of the displayable area and the first image group. FIG. 13C is an explanatory view showing another example of the state in which the second image group is displayed on the head-up display. FIG. 14A is an explanatory view showing another example of the object. FIG. 14B is an explanatory view showing another example of the displayable area and the first image group. FIG. 14C is an explanatory view showing another example of the state in which the second image group is displayed on the head-up display. It is a block diagram showing an important section of a display control system concerning Embodiment 1 of the present invention. FIG. 16A is a block diagram showing a system configuration of a display control system according to Embodiment 1 of the present invention. FIG. 16B is a block diagram showing another system configuration of the display control system according to Embodiment 1 of the present invention. FIG. 16C is a block diagram showing another system configuration of the display control system according to Embodiment 1 of the present invention. FIG. 16D is a block diagram showing another system configuration of the display control system according to Embodiment 1 of the present invention. It is a block diagram which shows the state in which the control apparatus containing the display control apparatus which concerns on Embodiment 2 of this invention is provided in the vehicle. It is a flowchart which shows operation | movement of the display control apparatus which concerns on Embodiment 2 of this invention. It is a block diagram which shows the principal part of the display control system which concerns on Embodiment 2 of this invention. It is a block diagram which shows the state in which the control apparatus containing the display control apparatus which concerns on Embodiment 3 of this invention is provided in the vehicle. It is a flowchart which shows operation | movement of the display control apparatus which concerns on Embodiment 3 of this invention. It is a block diagram which shows the principal part of the display control system which concerns on Embodiment 3 of this invention. It is a block diagram which shows the state in which the control apparatus containing the display control apparatus which concerns on Embodiment 4 of this invention is provided in the vehicle. It is a flowchart which shows operation | movement of the display control apparatus which concerns on Embodiment 4 of this invention. It is a block diagram which shows the principal part of the display control system which concerns on Embodiment 4 of this invention.

Hereinafter, in order to explain the present invention in more detail, a mode for carrying out the present invention will be described according to the attached drawings.

Embodiment 1
FIG. 1 is a block diagram showing a state in which a control device including a display control device according to the first embodiment is provided in a vehicle. FIG. 2 is an explanatory view showing a state in which a control device including the display control device according to the first embodiment is provided in a vehicle. The display control apparatus 100 according to the first embodiment will be described with reference to FIGS. 1 and 2.

As shown in FIG. 1, the vehicle 1 has a head-up display 2. The head-up display 2 is configured of, for example, a windshield AR-HUD.

That is, the head-up display device 3 is provided on the dashboard of the vehicle 1. The head-up display device 3 has a display for displaying a video for AR display, and an optical system for projecting visible light corresponding to the video displayed on the display onto the windshield 4. The display is configured of, for example, a display such as a liquid crystal display (LCD) or an organic electro luminescence display (OLED), or a projector such as a DLP (registered trademark) or a laser projector. The optical system is configured of, for example, any two or more of a concave mirror, a convex mirror, and a plane mirror.

As shown in FIG. 2, visible light reflected by the windshield 4 is incident on the eye E of the driver of the vehicle 1 (hereinafter sometimes simply referred to as “driver”), thereby displaying an image for AR display. The corresponding virtual image VI is viewed by the driver. In the figure, OP1 indicates the optical path of visible light corresponding to the image for AR display, and OP2 indicates the optical path of the visible light perceived by the driver. P indicates the position of the virtual image VI perceived by the driver.

The image displayed on the head-up display 2 includes, for example, an image emphasizing a white line on the road on which the vehicle 1 is traveling. This image is displayed, for example, in a state of being superimposed on a position near the white line in the driver's field of vision. This video is for presenting the presence of the white line to the driver of the vehicle 1 to prevent the vehicle 1 from deviating from the lane in which the vehicle is traveling.

Further, the image displayed on the head-up display 2 includes, for example, an image emphasizing an obstacle present in a lane in which the vehicle 1 is traveling. This image is displayed, for example, in a state of being superimposed at a position near the obstacle in the driver's field of vision. This image is for urging the driver of the vehicle 1 to pay attention to the obstacle to prevent the vehicle 1 from colliding with the obstacle.

Further, the image displayed on the head-up display 2 includes, for example, an image showing a traveling route being guided by a navigation system (not shown) for the vehicle 1. This image includes, for example, an arrow-shaped image indicating the direction in which the vehicle 1 should travel, and an image for guiding the lane in which the vehicle 1 should travel.

In addition, the image displayed on the head-up display 2 includes, for example, an image emphasizing another vehicle (hereinafter referred to as “front vehicle”) traveling in front of the vehicle 1. More specifically, when the vehicle 1 is traveling by so-called "adaptive cruise control", it includes an image emphasizing a preceding vehicle to be followed by the vehicle 1. This image is for making the driver of the vehicle 1 recognize the preceding vehicle to be followed.

Further, the video displayed on the head-up display 2 includes, for example, a video indicating the inter-vehicle distance between the vehicle 1 and the preceding vehicle. This image is displayed, for example, in a state of being superimposed on the lane between the vehicle 1 and the preceding vehicle in the field of view of the driver. This image is for causing the driver of the vehicle 1 to recognize the inter-vehicle distance between the vehicle 1 and the vehicle in front.

Further, the video displayed on the head-up display 2 includes, for example, a video indicating information on a building included in the front scenery of the vehicle 1.

The vehicle 1 has a camera 5 for imaging outside the vehicle and a sensor 6 for obstacle detection. The camera 5 is configured by, for example, a so-called "front camera". The sensor 6 is configured by, for example, at least one of a millimeter wave radar sensor, a rider sensor, or an ultrasonic sensor provided at the front end of the vehicle 1.

The object information generation unit 21 executes an image recognition process on an image captured by the camera 5. The object information generation unit 21 detects various objects existing around the vehicle 1 (more specifically, in front of the vehicle 1), that is, an object, using the result of the image recognition process and the detection value by the sensor 6 To do. The object information generation unit 21 generates information on the detected object (hereinafter referred to as “object information”) using the result of the image recognition process and the detection value by the sensor 6. Hereinafter, the number of objects detected by the object information generation unit 21 may be described as “N”. That is, N is an integer of 1 or more.

The objects to be detected by the object information generation unit 21 are, for example, obstacles, white lines on roads, signs, traffic lights, buildings, and the like. The obstacles include, for example, other vehicles or pedestrians. The white line of the road includes, for example, a center line or a boundary between a road and a roadside. The signs include, for example, guide signs or traffic signs. The building includes, for example, a gas station.

Here, a specific example of the object information will be described with reference to FIGS. 3 and 4.

FIG. 3A shows an example of a state in which the front scenery of the vehicle 1 is viewed through the windshield 4. As shown in FIG. 3A, it is assumed that _seven objects O ₁ to O ₇ are detected by the object information generation unit 21. Objects O ₁ to O ₃ correspond to other vehicles, object O ₄ corresponds to a guide sign, object O ₅ corresponds to a traffic sign, and objects O ₆ and O ₇ are centers It corresponds to the line.

Hereinafter, an area A1 capable of displaying an image on the head-up display 2 (more specifically, a display in the head-up display device 3) will be referred to as a "displayable area". Further, in the displayable area A1, an area corresponding to each object detected by the object information generation unit 21 is referred to as an "object area". Further, in the displayable area A1, an area including all object areas is referred to as an “object group area”. The shape of the displayable area A1 is a shape corresponding to the shape of the windshield 4 and is, for example, a rectangular shape. The shape of each object area is, for example, rectangular. The shape of the object group area is, for example, rectangular.

3B is a display area A1, and seven objects _O 1 ~ _{O 7} corresponding seven object area _OA 1 ~ OA ₇ in a lateral range Rh object group region, a longitudinal width Rv object group region An example is shown. In the example shown in FIG. 3B, the lateral range Rh object group region is a value corresponding to the distance between the right end portion of the left end and the object area OA ₅ of the object area OA _1. The vertical width Rv object group region is a value corresponding to the distance between the lower ends of the upper and object area OA ₆ of the object area OA _4.

FIG. 4 shows an example of object information generated by the object information generation unit 21 in the state shown in FIG. As shown in FIG. 4, the object information includes the number of objects detected by the object information generation unit 21 (ie, N), identifiers assigned to the individual objects (“ID” in the drawing), and ones corresponding to the individual objects. It includes video data ("option" in the figure) showing types, positions of individual objects, and images corresponding to individual objects.

In the figure, “p1, p2, p3, p4” indicate position coordinates of four corners of each of the _seven object areas OA ₁ to OA ₇ in the displayable area A1. In the figure, “z001” to “z007” indicate the distances between the vehicle 1 and the seven objects O ₁ to O ₇ respectively. These distances are calculated, for example, by the object information generation unit 21 using the detection value of the sensor 6. Alternatively, for example, these distances are measured by the object information generation unit 21 using a captured image by the camera 5 according to a method such as TOF (Time of Flight) method or triangulation (so-called “stereo vision”) method. is there.

The object information acquisition unit 31 acquires object information generated by the object information generation unit 21. The object information acquisition unit 31 outputs the acquired object information to the video sickness estimation unit 32 and the display control unit 33.

Hereinafter, a video group including videos corresponding to the N objects detected by the object information generation unit 21, that is, a video group to be subjected to estimation processing by the video sickness estimation unit 32 will be referred to as a “first video group”. The video sickness estimation unit 32 uses the object information output from the object information acquisition unit 31 to temporarily detect the presence or absence of video sickness due to the first video group when the first video group is displayed on the head-up display 2. It performs processing to estimate. A specific example of the estimation process by the motion sickness estimation unit 32 will be described later with reference to the flowchart of FIG.

The display control unit 33 uses the object information output from the object information acquisition unit 31 to display an image including at least a part of the image corresponding to the N objects detected by the object information generation unit 21. Control for displaying a group (hereinafter referred to as "second video group") on the head-up display 2 is executed. Hereinafter, the number of objects corresponding to the images included in the second image group may be described as “N ′”. That is, N 'is an integer of 1 or more and N or less. Further, an area A2 which is a display target of the second image group in the displayable area A1 is referred to as a "display target area".

Here, the display control unit 33 changes the display mode of the second video group according to the result of the estimation process by the video sickness estimation unit 32. Specifically, for example, according to the result of estimation processing by the video sickness estimation unit 32, the number N ′ of objects corresponding to the video included in the second video group, the horizontal width Rh ′ of the display target area A2, and the display target area The vertical width Rv 'of A2 is different. A specific example of control by the display control unit 33 will be described later with reference to the flowchart of FIG.

The object information acquisition unit 31, the motion sickness estimation unit 32, and the display control unit 33 constitute a main part of the display control apparatus 100. Further, the object information generation unit 21, the object information acquisition unit 31, the motion sickness estimation unit 32, and the display control unit 33 constitute a main part of the control device 7.

Next, the hardware configuration of the main part of the control device 7 will be described with reference to FIG.

As shown in FIG. 5A, the control device 7 is configured by a computer, and the computer has a processor 41 and a memory 42. The memory 42 stores programs for causing the computer to function as an object information generation unit 21, an object information acquisition unit 31, a motion sickness estimation unit 32, and a display control unit 33. The processor 41 reads out and executes the program stored in the memory 42, whereby the functions of the object information generation unit 21, the object information acquisition unit 31, the video sickness estimation unit 32, and the display control unit 33 are realized.

The processor 41 uses, for example, a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor, a microcontroller, or a digital signal processor (DSP). The memory 42 is, for example, a semiconductor memory such as a random access memory (RAM), a read only memory (ROM), a flash memory, an erasable programmable read only memory (EPROM), or an electrically erasable programmable read only memory (EEPROM). An optical disk or a magneto-optical disk is used.

Alternatively, as shown in FIG. 5B, the functions of the object information generation unit 21, the object information acquisition unit 31, the video sickness estimation unit 32, and the display control unit 33 may be realized by a dedicated processing circuit 43. The processing circuit 43 may be, for example, an application specific integrated circuit (ASIC), a programmable logic device (PLD), a field-programmable gate array (FPGA), a system-on-a-chip (SoC), or a system LSI (Large-Scale Integration). Etc. are used.

Alternatively, some functions of the object information generation unit 21, the object information acquisition unit 31, the video sickness estimation unit 32, and the display control unit 33 are realized by the processor 41 and the memory 42, and the remaining functions are performed by the processing circuit 43. It may be realized.

Next, the operation of the display control device 100 will be described with reference to the flowchart of FIG.

First, in step ST1, the object information acquisition unit 31 acquires object information generated by the object information generation unit 21. The object information acquisition unit 31 outputs the acquired object information to the video sickness estimation unit 32 and the display control unit 33.

Next, at step ST2, the video sickness estimating unit 32 uses the object information output from the object information acquiring unit 31 to temporarily display the first video group on the head-up display 2 and use the first video group. Execute processing to estimate the presence or absence of video sickness. A specific example of the estimation process in step ST2 will be described later with reference to the flowchart of FIG.

Next, in step ST3, the display control unit 33 executes control to display the second image group on the head-up display 2 using the object information output from the object information acquisition unit 31. At this time, the display control unit 33 is configured to make the display mode of the second video group different according to the result of the estimation process by the video sickness estimation unit 32. A specific example of control in step ST3 will be described later with reference to the flowchart of FIG.

Next, with reference to the flowchart in FIG. 7, a specific example of the estimation process by the video sickness estimation unit 32 in step ST2 will be described.

First, at step ST11, the video sickness estimating unit 32 calculates a threshold Rh_th to be compared against the horizontal width Rh of the object group area, a threshold Rv_th to be compared against the vertical width Rv of the object group area, and the number N of objects. A threshold N_th to be compared is set.

The threshold value Rh_th is set to, for example, a value equal to the horizontal width of the displayable area A1, a half of the horizontal width of the displayable area A1, or a quarter of the horizontal width of the displayable area A1. . The threshold value Rv_th has, for example, a value equal to the vertical width of the displayable area A1, a half of the vertical width of the displayable area A1, or a quarter of the vertical width of the displayable area A1. It is set. The threshold N_th is set to, for example, an integer of 1 or more.

Next, in step ST12, the video sickness estimating unit 32 calculates the horizontal width Rh of the object group area and the vertical width Rv of the object group area using the object information output from the object information acquisition unit 31.

Next, at step ST13, the video sickness estimating unit 32 compares Rh calculated at step ST12 with Rh_th set at step ST11. If Rh is equal to or less than Rh_th ("NO" in step ST13), the video sickness estimating unit 32 sets Rh 'to the same value as Rh in step ST14. On the other hand, if Rh exceeds Rh_th ("YES" in step ST13), the video sickness estimating unit 32 sets Rh 'to the same value as Rh_th in step ST15.

Next, at step ST16, the video sickness estimating unit 32 compares Rv calculated at step ST12 with Rv_th set at step ST11. If Rv is equal to or less than Rv_th ("NO" at step ST16), the video sickness estimating unit 32 sets Rv 'to the same value as Rv at step ST17. On the other hand, when Rv exceeds Rv_th ("YES" in step ST16), the video sickness estimating unit 32 sets Rv 'to the same value as Rv_th in step ST18.

Next, at step ST19, the video sickness estimating unit 32 compares N indicated by the object information with N_th set at step ST11. If N is equal to or less than N_th ("NO" at step ST19), the video sickness estimating unit 32 sets N 'to the same value as N at step ST20. On the other hand, if N exceeds N_th ("YES" in step ST19), the video sickness estimation unit 32 sets N 'to the same value as N_th in step ST21.

Next, at step ST22, the video sickness estimating unit 32 determines the value of Rh 'set at step ST14 or step ST15, the value of Rv' set at step ST17 or step ST18, and the value at step ST20 or step ST21. The set value of N ′ is output to the display control unit 33.

That is, when Rh ′ = Rh and Rv ′ = Rv and N ′ = N, the value output by the video sickness estimation unit 32 is “absent” as the result of the estimation process is the occurrence of video sickness due to the first video group. It shows that there is. If not, the value output by the video sickness estimation unit 32 indicates that the result of the estimation process is "presence" of the occurrence of video sickness due to the first video group.

Next, a specific example of control by the display control unit 33 in step ST3 will be described with reference to the flowchart in FIG.

First, in step ST31, the display control unit 33 acquires the values of Rh ', Rv', and N 'output from the motion sickness estimation unit 32.

Next, in step ST32, the display control unit 33 sets a display target area A2 with a size of Rh ′ × Rv ′.

At this time, the display control unit 33 may set the position of the display target area A2 in the displayable area A1. Specifically, for example, the display control unit 33 may set the position coordinates of the central portion C of the display target area A2 in the displayable area A1. However, the position of the display target area A2 in the displayable area A1 may be set by the operation input to the operation input device (not shown). That is, the position of the display target area A2 in the displayable area A1 can be set to an arbitrary position.

Next, in step ST33, the display control unit 33 uses the object information output from the object information acquisition unit 31 to select N 'objects among the N objects. That is, when N '= N, all objects among the N objects detected by the object information generation unit 21 are selected. On the other hand, if N ′ <N, part of the N objects detected by the object information generation unit 21 is selected.

Here, if N ′ <N, the display control unit 33 may select N ′ objects based on the priorities according to the types of objects corresponding to the individual objects. This priority may be preset in the display control unit 33, or may be set by an operation input to an operation input device (not shown).

Specifically, for example, the priority is set to be lower in the order of the object corresponding to the other vehicle, the object corresponding to the center line, the object corresponding to the road sign, and the object corresponding to the guide sign. That is, the priority of the object corresponding to the other vehicle is set to the highest, and the priority of the object corresponding to the guide sign is set to the lowest.

Next, in step ST34, the display control unit 33 generates video corresponding to the object selected in step ST33, using the video data in the object information output from the object information acquisition unit 31.

Specifically, for example, the display control unit 33 generates N 'pieces of video corresponding to N' pieces of objects one by one. Each of the N 'images is, for example, a rectangular frame image by a dotted line. The size of each of the N 'images is, for example, equal to the size of the object area of the corresponding object among the N' objects. Each of the N 'images is an image for marking a corresponding one of the N' objects.

Next, in step ST35, the display control unit 33 displays on the head-up display 2 one of the images generated in step ST34 (that is, the second image group) in the display target area A2 set in step ST32. Execute control.

Here, in the display control unit 33, information indicating an estimated value of the position of the driver's eye in the real space is stored in advance. This estimated value is, for example, estimated based on the position of the driver's seat in the vehicle compartment of the vehicle 1 or the like. The display control unit 33 uses the object information output by the object information acquisition unit 31 to calculate the position of each of N ′ objects in the real space. The display control unit 33 determines, based on the positional relationship between the driver's eyes and each of the N ′ objects, that each of the N ′ objects has a corresponding image among the N ′ images in the driver's field of vision. The position of each of the N 'images in the displayable area A1 is set so as to be in the marked state.

The second image group is displayed on the head-up display 2 by the control of step ST35. That is, when the display target area A2 includes the entire object group area and N ′ = N, the second image group displayed on the head-up display 2 is the same as the first image group. Become. Otherwise, the second image group displayed on the head-up display 2 is different from the first image group.

Next, with reference to FIG. 3 and FIG. 9, an example of the first image group and the second image group displayed on the head-up display 2 will be described.

As shown in FIG. 3A, it is assumed that _seven objects O ₁ to O ₇ are detected by the object information generation unit 21. FIG. 9A shows an example of the first image group in this case. As shown in FIG. 9A, the first image group includes seven images V ₁ to V ₇ corresponding to seven objects O ₁ to O ₇ .

Each of the _seven images V ₁ to V ₇ is an image in a rectangular frame shape by a dotted line. The size of each of the _seven images V ₁ to V ₇ is equal to the size of the object area of the corresponding one of the _seven objects O ₁ to O ₇ . Each of the seven images V ₁ to V ₇ is an image for marking the corresponding one of the _seven objects O ₁ to O ₇ .

In contrast, threshold Rh_th is set to the same value as the horizontal width of displayable area A1, and threshold Rv_th is set to the same value as the vertical width of displayable area A1, and N_th = 8. It is assumed that it has been set (step ST11). In this case, since Rh ≦ Rh_th, Rh ′ = Rh is set (step ST14), and since Rv ≦ Rv_th, Rv ′ = Rv is set (step ST17), and N ≦ N_th. Therefore, N '= N = 7 is set (step ST20).

FIG. 9A shows an example of the display target area A2 in this case. In step ST32, for example, a display target area A2 shown in FIG. 9A is set. Further, N '= order is N, all objects _O 1 ~ _{O 7} of the step ST33 7 amino object _O 1 ~ _{O 7} is selected. As a result, all video _V 1 ~ _{V 7} of the step ST34 7 amino image _V 1 ~ _{V 7} are generated.

By the control of step ST35, as shown in FIG. 9B, the head up display 2 displays the one in the display target area A2 of the _seven videos V ₁ to V ₇ (that is, the second video group). In this case, the second image group displayed on the head-up display 2 is the same as the first image group shown in FIG. 9A.

Next, with reference to FIGS. 3 and 10, another example of the first image group and the second image group displayed on the head-up display 2 will be described.

As shown in FIG. 3A, it is assumed that _seven objects O ₁ to O ₇ are detected by the object information generation unit 21. FIG. 10A shows an example of the first image group in this case. As shown in FIG. 10A, the first image group includes seven images V ₁ to V ₇ corresponding to seven objects O ₁ to O ₇ .

On the other hand, the threshold Rh_th is set to a half of the horizontal width of the displayable area A1, and the threshold Rv_th is set to a half of the vertical width of the displayable area A1, Also, it is assumed that N_th = 8 is set (step ST11). In this case, since Rh> Rh_th, Rh ′ is set to Rh_th (step ST15), and since Rv> Rv_th, Rv ′ is set to Rv_th (step ST18), and N ≦ N_th. Therefore, N '= N = 7 is set (step ST20).

FIG. 10A shows an example of the display target area A2 in this case. In step ST32, for example, a display target area A2 shown in FIG. 10A is set. Further, N '= order is N, all objects _O 1 ~ _{O 7} of the step ST33 7 amino object _O 1 ~ _{O 7} is selected. As a result, all video _V 1 ~ _{V 7} of the step ST34 7 amino image _V 1 ~ _{V 7} are generated.

By the control of step ST35, as shown in FIG. 10B, the head up display 2 displays the image in the display target area A2 of the _seven images V ₁ to V ₇ (that is, the second image group). In this case, the second image group displayed on the head-up display 2 is different from the first image group shown in FIG. 10A.

Next, another example of the first image group and the second image group displayed on the head-up display 2 will be described with reference to FIGS. 3 and 11.

As shown in FIG. 3A, it is assumed that _seven objects O ₁ to O ₇ are detected by the object information generation unit 21. FIG. 11A shows an example of the first image group in this case. As shown in FIG. 11A, the first image group includes seven images V ₁ to V ₇ corresponding to seven objects O ₁ to O ₇ .

On the other hand, the threshold Rh_th is set to a half of the horizontal width of the displayable area A1, and the threshold Rv_th is set to a half of the vertical width of the displayable area A1, Also, it is assumed that N_th = 3 is set (step ST11). In this case, since Rh> Rh_th, Rh ′ is set to Rh_th (step ST15), and since Rv> Rv_th, Rv ′ is set to Rv_th (step ST18), and N> N_th. Therefore, N '= N_th = 3 is set (step ST21).

FIG. 11A shows an example of the display target area A2 in this case. In step ST32, for example, a display target area A2 shown in FIG. 11A is set. The display target area A2 shown in FIG. 11A is different from the display target area A2 shown in FIG. 10A in the position coordinates of the central portion C.

Further, since N ′ <N, in step ST33, the display control unit 33 selects any three objects among the _seven objects O ₁ to O ₇ . For example, the display control unit 33 selects _three objects O ₁ to O ₃ corresponding to other vehicles based on the priority. As a result, in step ST34, the seven three video _V 1 ~ _{V 3} in the video _V 1 ~ _{V 7} are generated.

By the control of step ST35, as shown in FIG. 11B, the head up display 2 displays the one in the display target area A2 of the _three videos V ₁ to V ₃ (that is, the second video group). That is, the images V ₆ and V ₇ for marking the center line are excluded from the display targets of the head-up display 2 while being located within the display target area A 2. In this case, the second image group displayed on the head-up display 2 is different from the first image group shown in FIG. 11A.

Next, another example of the first image group and the second image group displayed on the head-up display 2 will be described with reference to FIGS. 3 and 12.

As shown in FIG. 3A, it is assumed that _seven objects O ₁ to O ₇ are detected by the object information generation unit 21. FIG. 12A shows an example of the first image group in this case. As shown in FIG. 12A, the first image group includes seven images V ₁ to V ₇ corresponding to seven objects O ₁ to O ₇ .

On the other hand, the threshold Rh_th is set to a half of the horizontal width of the displayable area A1, and the threshold Rv_th is set to a quarter of the vertical width of the displayable area A1, Also, it is assumed that N_th = 8 is set (step ST11). In this case, since Rh> Rh_th, Rh ′ is set to Rh_th (step ST15), and since Rv> Rv_th, Rv ′ is set to Rv_th (step ST18), and N ≦ N_th. Therefore, N '= N = 7 is set (step ST20).

FIG. 12A shows an example of the display target area A2 in this case. In step ST32, for example, a display target area A2 shown in FIG. 12A is set. Further, N '= order is N, all objects _O 1 ~ _{O 7} of the step ST33 7 amino object _O 1 ~ _{O 7} is selected. As a result, all video _V 1 ~ _{V 7} of the step ST34 7 amino image _V 1 ~ _{V 7} are generated.

By the control of step ST35, as shown in FIG. 12B, the head up display 2 displays the one in the display target area A2 of the _seven videos V ₁ to V ₇ (that is, the second video group). In this case, the second image group displayed on the head-up display 2 is different from the first image group shown in FIG. 12A.

As described above, the number N ′ of objects corresponding to the video included in the second video group differs according to the result of the estimation processing by the video sickness estimation unit 32. More specifically, when the number N of objects detected by the object information generation unit 21 is large (N> N_th), the result of the estimation process indicates the occurrence of presence of video sickness due to the first video group, and The number N ′ of objects corresponding to the video included in the second video group is reduced (N ′ = N_th). Thereby, the occurrence of video sickness by the driver of the vehicle 1 can be suppressed. In addition, it is possible to reduce the tiredness of the driver's eyes.

Further, the size (Rh ′ × Rv ′) of the display target area A2 differs according to the result of the estimation process by the video sickness estimation unit 32. More specifically, when the horizontal width Rh of the object group area is large (Rh> Rh_th), the result of the estimation process indicates that the first video group is "present" in the occurrence of video sickness, and the horizontal width Rh of the display target area A2 'Is reduced (Rh' = Rh_th). Similarly, when the vertical width Rv of the object group area is large (Rv> Rv_th), the result of the estimation processing indicates occurrence of video sickness due to the first video group, and the vertical width Rv ′ of the display target area A2 Is reduced (Rv '= Rv_th). Thereby, the occurrence of video sickness by the driver of the vehicle 1 can be suppressed. In addition, it is possible to reduce eyestrain of the driving car.

The object information may indicate the movement (more specifically, the movement speed and movement amount) of the video corresponding to each object. The video sickness estimating unit 32 may estimate the presence or absence of video sickness due to the first video group by comparing the moving speed and the moving amount of the video with predetermined threshold values. Also, the motion sickness estimation unit 32 may set the values of Rh ′, Rv ′, and N ′ according to the result of the comparison.

Further, when the video sickness estimating unit 32 sets the threshold in step ST11, the video sickness estimating unit 32 may store the set threshold. The video sickness estimating unit 32 may set a new threshold value based on the stored threshold value in step ST11 after the next time. Further, the threshold value in the video sickness estimation unit 32 may be set to a different value for each driver.

Further, the threshold value in the motion sickness estimation unit 32 may be set by the operation input to the operation input device (not shown). This operation may be performed by the driver of the vehicle 1 or by a passenger of the vehicle 1.

Moreover, the priority used when N '<N is not limited to the above specific example. The priority of each object may be set by any setting. For example, the priority may be set to be higher for an object having a higher degree of importance to the driver of the vehicle 1.

Also, the video for marking individual objects is not limited to the video in the form of a rectangular frame by dotted lines. The image for marking individual objects may be any image as long as it can be drawn by existing CG (Computer Graphics). For example, a linear image along the edge of an individual object, an image obtained by filling the area surrounded by the lines with a predetermined color, or an image using α blending may be used. Also, it may be a video including text or an icon.

Also, the video corresponding to each object is not limited to the video for marking. Hereinafter, with reference to FIG. 13 and FIG. 14, another example of the video corresponding to each object will be described.

For example, as shown in FIG. 13A, it is assumed that _eight objects O ₁ to O ₈ are detected by the object information generation unit 21. The object O ₈ corresponds to the lane to be guided by the navigation system (not shown) for the vehicle 1, that is, the lane in which the vehicle 1 should travel. As shown in FIG. 13B, the first image group includes eight images V ₁ to V ₈ corresponding to eight objects O ₁ to O ₈ in a one-to-one manner. Video V ₈ corresponding to the object O ₈ (more specifically, by triangular images that are arranged in along the said lane) image for guiding the lane may be. FIG. 13B shows an example of a second image group displayed on the head-up display 2 in this case.

Alternatively, for example, as shown in FIG. 14A, it is assumed that eight objects O ₁ to O ₂ , O ₄ to O ₇ , O ₉ to O ₁₀ are detected by the object information generation unit 21. The object O ₉ corresponds to another vehicle. The object O ₁₀ corresponds to a building existing in front of the vehicle 1, more specifically, a gas station. As shown in FIG. 14B, the first image group includes eight images V ₁ to V ₂ , V corresponding to eight objects O ₁ to O ₂ , O ₄ to O ₇ , O ₉ to O ₁₀ in a one-to-one manner. ₄ to V ₇ and V ₉ to V ₁₀ are included. Video V ₁₀ corresponding to the object O ₁₀ may be a (video containing text indicating that more specifically the building is a gas station) images containing text indicating information about the building. FIG. 14B shows an example of a second image group displayed on the head-up display 2 in this case.

Further, the display mode to be changed by the display control unit 33 may be any one as long as it relates to the ease of occurrence of video sickness in AR-HUD, and the number N of objects corresponding to the video included in the second video group It is not limited to 'and the size of display target area A2 (Rh' × Rv '). For example, the display control unit 33 may change the position coordinates of the central portion C of the display target area A2 according to the result of the estimation process by the video sickness estimation unit 32. Alternatively, for example, if the display control unit 33 determines that the motions of the individual videos included in the second video group (more specifically, the moving speed and the moving amount) differ according to the result of the estimation process by the video sickness estimating unit 32. It may be confusing. That is, the display control unit 33 determines the number N ′ of objects corresponding to the images included in the second image group and the individual images included in the second image group according to the result of the estimation process by the video sickness estimation unit 32. Move at least one of movement (more specifically, movement speed and movement amount), size of display target area A2 (Rh ′ × Rv ′), or position coordinates of central portion C of display target area A2 It may be something.

In addition, the display control unit 33 may measure the amount of solar radiation in the compartment of the vehicle 1 using an illuminance sensor (not shown) provided in the vehicle 1. Even if the display control unit 33 adjusts the brightness and contrast ratio of the video displayed on the head-up display 2 (that is, the video included in the second video group) in accordance with the measured amount of solar radiation. good. Thereby, the legibility of the image displayed on the head-up display 2 can be improved.

Further, as shown in FIG. 15, the main part of the display control system 200 may be configured by the object information acquisition unit 31, the motion sickness estimation unit 32, and the display control unit 33. In this case, each of the object information acquisition unit 31, the motion sickness estimation unit 32, and the display control unit 33 may be an on-vehicle information device 51 that can be mounted on the vehicle 1, a portable information terminal 52 such as a smartphone that can be carried on the vehicle 1, or It may be provided in any of the on-vehicle information device 51 or the server device 53 capable of communicating with the portable information terminal 52.

Each of FIGS. 16A to 16D shows the system configuration of the main part of the display control system 200. As shown in FIGS. 16A to 16D, any function of the display control system 200 may be realized by cooperation of any two or more of the in-vehicle information device 51, the portable information terminal 52, and the server device 53.

Also, the head-up display 2 is not limited to the windshield type, and may be a combiner type. However, the combiner usually occupies a smaller area in the driver's field of view than the windshield. For this reason, the AR-HUD of the combiner type is less likely to cause video sickness than the AR-HUD of the windshield type. Therefore, it is particularly preferable to use the display control apparatus 100 and the display control system 200 for controlling the windshield AR-HUD.

The head-up display 2 may be provided on a moving body different from the vehicle 1. The head-up display 2 may be provided on any moving object such as a car, a rail car, an aircraft or a ship.

As described above, the display control apparatus 100 according to the first embodiment includes the object information acquisition unit 31 that acquires object information including information on one or more objects existing around the mobile object (vehicle 1), and the object information Using the object information and the video sickness estimation unit 32, which executes processing to estimate the presence or absence of video sickness due to the first video group including one or more videos corresponding to one or more objects, using And a display control unit 33 for executing control to cause the head-up display 2 to display a second video group including at least a part of one or more videos. The display mode of the second image group is made different according to the result of the estimation process by By using object information, it is possible to estimate with high accuracy the presence or absence of video sickness in AR-HUD. Further, by making the display mode of the second video group different, it is possible to suppress the occurrence of video sickness while continuing the AR display by the head-up display 2.

Further, the display control unit 33 controls the number of videos included in the second video group, the motion of each video included in the second video group, or the head-up display 2 according to the result of the estimation processing by the video sickness estimation unit 32. And at least one of the areas (display target area A2) in which the second image group is displayed is different. This makes it possible to suppress the occurrence of video sickness.

In addition, the display control system 200 according to the first embodiment uses the object information acquisition unit 31 that acquires object information including information on one or more objects existing around the mobile object (vehicle 1). Using the object information, the video sickness estimation unit 32 that executes processing for estimating the presence or absence of video sickness due to the first video group including one or more videos corresponding to one or more objects; And a display control unit 33 for executing control to cause the head-up display 2 to display a second image group including at least a part of the images of the images, and the display control unit 33 performs an estimation process by the video sickness estimation unit 32 The display mode of the second image group is made different according to the result of. Thereby, the same effect as the above-mentioned effect by display control 100 can be acquired.

In the display control method according to the first embodiment, the object information acquisition unit 31 acquires object information including information on one or more objects existing around the mobile object (vehicle 1); Step ST2 in which the estimation unit 32 executes a process of estimating the presence or absence of video sickness due to the first video group including one or more videos corresponding to one or more objects using object information; And a step ST3 of performing control to cause the head-up display 2 to display a second video group including at least a part of one or more videos using the object information, and the display control unit 33 changes the display mode of the second image group according to the result of the estimation processing by the video sickness estimation unit 32. Thereby, the same effect as the above-mentioned effect by display control 100 can be acquired.

Second Embodiment
FIG. 17 is a block diagram showing a state where a control device including a display control device according to Embodiment 2 is provided in a vehicle. The display control device 100a according to the second embodiment will be described with reference to FIG. Note that, in FIG. 17, the same blocks as the blocks shown in FIG.

The vehicle 1 has a camera 8 for imaging in the passenger compartment. The camera 8 is configured by, for example, a visible light camera or an infrared camera. The camera 8 is disposed in the front of the vehicle compartment of the vehicle 1 and captures an image of a range including the face of the driver sitting in the driver's seat.

The vehicle 1 has a sensor 9. The sensor 9 is configured by a contact or non-contact type biometric sensor. When the sensor 9 is constituted by a contact-type biological sensor, the sensor 9 is provided on the steering wheel or the driver's seat of the vehicle 1 or the like. When the sensor 9 is configured by a noncontact biometric sensor, the sensor 9 is disposed in the cabin of the vehicle 1.

The driver information generation unit 22 executes an image recognition process on an image captured by the camera 8. The driver information generation unit 22 generates information on the driver of the vehicle 1 (hereinafter referred to as “driver information”) using at least one of the result of the image recognition process or the detection value by the sensor 9. is there.

The driver information generated using the result of the image recognition process is, for example, the position of the driver's head, the position of the driver's face, the driver's viewpoint movement amount, the driver's face color, the driver's eye opening degree Alternatively, it indicates at least one of the number of blinks of the driver. The position of the driver's head and the position of the driver's face are, for example, measured by a method such as TOF method or triangulation method.

The driver information generated using the detection value by the sensor 9 is, for example, the heart rate of the driver, the pulse rate of the driver, the blood pressure of the driver, the temperature of the driver, the body temperature of the driver, the amount of sweat of the driver or the brain wave of the driver. It is information indicating at least one of them, that is, biological information.

The driver information acquisition unit 34 acquires the driver information generated by the driver information generation unit 22. The driver information acquisition unit 34 outputs the acquired driver information to the video sickness estimation unit 32a.

The video sickness estimating unit 32a temporarily displays the first video group on the head-up display 2 using the object information output by the object information acquiring unit 31 and the driver information output by the driver information acquiring unit 34. The presence or absence of the occurrence of video sickness due to the first video group in the case is estimated. More specifically, the motion sickness estimation unit 32a executes the same process as that described with reference to FIG. 7 in the first embodiment, and sets the threshold value Rh_th, Rv_th, and N_th to the driver. It uses information.

That is, the video sickness estimation unit 32a determines whether the driver of the vehicle 1 is in poor health or not using the driver information. When it is determined that the driver is in poor physical condition “present”, the video sickness estimating unit 32 a is at least one of the thresholds Rh_th, Rv_th, and N_th, as compared with the case where the driver is determined to be in poor physical condition “absent”. Is set to a low value (for example, 0.5 times the value).

For example, it is assumed that the driver information indicates the heart rate of the driver. A range of values (hereinafter referred to as a “reference range”, for example, a range of 50 to 90 bpm) including the heart rate (for example, 65 bpm) of the driver at normal times is set in the video sickness estimating unit 32a. The motion sickness estimation unit 32a determines whether the heart rate indicated by the driver information is within the reference range.

If the heart rate indicated by the driver information is within the reference range, the video sickness estimating unit 32a sets the threshold Rv_th to a value that is half the vertical width of the displayable area A1. On the other hand, when the heart rate indicated by the driver information is a value outside the reference range, the video sickness estimating unit 32a sets the threshold Rv_th to a value that is one fourth of the vertical width of the displayable area A1.

As the threshold value Rh_th decreases, the width Rh ′ of the display target area A2 in the case of Rh> Rh_th also decreases. Due to the decrease of the threshold value Rv_th, the vertical width Rv ′ of the display target area A2 in the case of Rv> Rv_th also decreases. As the threshold value N_th decreases, the number N ′ of objects corresponding to the images included in the second image group in the case of N> N_th also decreases. As a result, it is possible to suppress the occurrence of the video sickness even in the state where the video sickness is easily generated due to the driver's poor physical condition.

The object information acquisition unit 31, the visual sickness estimation unit 32a, the display control unit 33, and the driver information acquisition unit 34 constitute a main part of the display control apparatus 100a. The object information generation unit 21, the driver information generation unit 22, the object information acquisition unit 31, the video sickness estimation unit 32a, the display control unit 33, and the driver information acquisition unit 34 constitute the main part of the control device 7a. There is.

The hardware configuration of the main part of the control device 7a is the same as that described in the first embodiment with reference to FIG. That is, the functions of the driver information generation unit 22, the video sickness estimation unit 32a, and the driver information acquisition unit 34 may be realized by the processor 41 and the memory 42, or may be realized by the processing circuit 43. It may be

Next, the operation of the display control device 100a will be described with reference to the flowchart of FIG.

First, in step ST1, the object information acquisition unit 31 acquires object information generated by the object information generation unit 21. The object information acquisition unit 31 outputs the acquired object information to the video sickness estimation unit 32a and the display control unit 33.

Next, in step ST4, the driver information acquisition unit 34 acquires the driver information generated by the driver information generation unit 22. The driver information acquisition unit 34 outputs the acquired driver information to the video sickness estimation unit 32a.

Next, at step ST2a, the video sickness estimating unit 32a temporarily uses the object information output by the object information acquiring unit 31 and the driver information output by the driver information acquiring unit 34 to temporarily generate the first image group as a head. A process of estimating the occurrence of video sickness due to the first video group when displayed on the up display 2 is executed.

The specific example of the estimation process in step ST2a is the same as that described in the first embodiment with reference to the flowchart of FIG. However, when setting the thresholds Rh_th, Rv_th, and N_th (that is, when executing the process corresponding to the process of step ST11 shown in FIG. 7), the video sickness estimating unit 32a uses the driver information as described above. It has become.

Next, in step ST3, the display control unit 33 executes control to display the second image group on the head-up display 2 using the object information output from the object information acquisition unit 31. At this time, the display control unit 33 is configured to make the display mode of the second image group different according to the result of the estimation process by the video sickness estimation unit 32a. The specific example of control in step ST3 is the same as that described in the first embodiment with reference to the flowchart of FIG.

When the heart rate indicated by the driver information is out of the reference range, the video sickness estimating unit 32a compares the threshold value Rv_th with that in the case where the heart rate indicated by the driver information is within the reference range. The threshold value Rh_th may be set to a low value (for example, 0.5 times value) instead of or in addition to setting to a low value (for example, 0.5 times value). Moreover, the magnification at this time is not limited to 0.5 times, and may be any magnification.

Further, when the heart rate indicated by the driver information is a value outside the reference range, the video sickness estimating unit 32a compares the threshold N_th with the threshold value indicated by the driver information by a threshold value within the reference range. It may be set to a low value.

In addition, when the driver information indicates the position of the driver's head or the position of the driver's eyes, the display control unit 33 calculates the position of the driver's eyes in real space using these pieces of information. It may be When the display control unit 33 sets the position of each of the N 'images in the displayable area A1, the information stored in advance (that is, information indicating the estimated value of the position of the driver's eye in real space) Instead of the position of the driver's eyes shown, the calculated position of the driver's eyes may be used.

In addition, if the driver information indicates the blood pressure of the driver, the video sickness estimating unit 32a determines whether the blood pressure indicated by the driver information is within the reference range, as in the above example related to the heart rate. It may be determined whether or not. If the blood pressure indicated by the driver information is a value outside the reference range, the visual sickness estimation unit 32a has the threshold Rh_th, Rv_th, and N_th compared to when the blood pressure indicated by the driver information is a value within the reference range. Alternatively, at least one of the above may be set to a low value.

If the driver information indicates the pulse of the driver, the video sickness estimating unit 32a determines whether the pulse indicated by the driver information is within the reference range, as in the above example relating to the heart rate. It may be determined whether or not. When the pulse indicated by the driver information is a value outside the reference range, the video sickness estimating unit 32a has the threshold Rh_th, Rv_th, and N_th among the thresholds Rh_th, Rv_th, and N_th when the pulse indicated by the driver information is a value within the reference range. Alternatively, at least one of the above may be set to a low value.

Also, if the driver information indicates the driver's complexion, the video sickness estimating unit 32a may compare the complexion indicated by the driver information with the driver's complexion in normal times. If the complexion indicated by the driver information indicates that the complexion indicated by the driver information is flushing or pale compared with the complexion of the driver in the normal case, the threshold value Rh_th, Rv_th, and N_th of the thresholds are compared. At least one may be set to a low value.

In addition, when the driver information indicates the driver's viewpoint movement amount, the video sickness estimation unit 32a is, in the same manner as the above example related to the complexion, the driver in normal times the viewpoint movement amount indicated by the driver information. It may be compared with the viewpoint movement amount of

In addition, when the driver information indicates the degree of eye opening of the driver, the video sickness estimating unit 32a opens the degree of eye opening indicated by the driver information in the normal time, as in the above example related to the complexion. It may be compared with the degree.

Further, the content of the driver information is not limited to the above specific example. The driver information is information that can be generated using at least one of the result of the image recognition process on the captured image by the camera 8 or the detection value by the sensor 9, and determines whether the driver of the vehicle 1 has poor physical condition As long as it is possible information, any information may be included.

Also, the video sickness estimation unit 32a may use the driver information in the process of estimating the presence or absence of video sickness due to the first video group, and the method of using the driver information in the process is the above specific example. It is not limited to

Further, the display control device 100a can adopt various modifications similar to those described in the first embodiment, that is, various modifications similar to the display control 100.

Further, as shown in FIG. 19, even if the main part of the display control system 200a is configured by the object information acquisition unit 31, the video sickness estimation unit 32a, the display control unit 33, and the driver information acquisition unit 34. good. The system configuration of the main part of the display control system 200a is the same as that described in the first embodiment with reference to FIG. That is, any function of the display control system 200a may be realized by cooperation of any two or more of the in-vehicle information device 51, the portable information terminal 52, and the server device 53.

As described above, the display control device 100a according to the second embodiment includes the driver information acquisition unit 34 for acquiring driver information including information on the driver of the vehicle 1, and the video sickness estimation unit 32a includes object information and The driver information is used to estimate the presence or absence of video sickness. Thereby, when estimating the presence or absence of generation | occurrence | production of imaging sickness, a driver's physical condition can be considered, for example. As a result, it is possible to further improve the estimation accuracy of the occurrence of video sickness. In addition, even in a state in which video sickness is likely to occur due to the driver's poor physical condition, it is possible to suppress the occurrence of video sickness.

Third Embodiment
FIG. 20 is a block diagram showing a state where a control device including a display control device according to Embodiment 3 is provided in a vehicle. The display control device 100b according to the third embodiment will be described with reference to FIG. In FIG. 20, the blocks similar to the blocks shown in FIG.

The vehicle information generation unit 23 is connected to the in-vehicle network 10. The vehicle information generation unit 23 is output by various systems (for example, a car navigation system) connected to the in-vehicle network 10 or various ECUs (Electronic Control Unit) connected to the in-vehicle network 10 via the in-vehicle network 10 Information is obtained. The vehicle information generation unit 23 generates information on the vehicle 1 (hereinafter referred to as “vehicle information”) using the acquired information.

The vehicle information includes, for example, information indicating the position of the vehicle 1, information indicating the traveling direction of the vehicle 1, information indicating the traveling speed of the vehicle 1, information indicating the acceleration of the vehicle 1, information indicating the vibration number of the vehicle 1, time Information related to various warnings, information related to various control signals (such as wiper on / off signal, light lighting signal, parking signal and back signal), or navigation information (congestion information, information indicating facility name, information for guidance) And at least one of the information indicating the guidance and the information indicating the route of the guidance target.

The vehicle information acquisition unit 35 acquires vehicle information generated by the vehicle information generation unit 23. The vehicle information acquisition unit 35 outputs the acquired vehicle information to the video sickness estimation unit 32 b.

In the case where the first image group is temporarily displayed on the head-up display 2 using the object information output by the object information acquisition unit 31 and the vehicle information output by the vehicle information acquisition unit 35, the video sickness estimation unit 32b The presence or absence of the occurrence of video sickness due to the first video group is estimated. More specifically, the motion sickness estimation unit 32b executes the same process as that described with reference to FIG. 7 in the first embodiment, and sets the threshold Rh_th, Rv_th, and N_th to vehicle information. Is used.

That is, the video sickness estimation unit 32b determines whether the driving environment of the vehicle 1 is a driving environment that is likely to cause video sickness, using the vehicle information. When it is determined that the driving environment of the vehicle 1 is a driving environment that is likely to cause video sickness, the video sickness estimating unit 32b lowers at least one of the thresholds Rh_th, Rv_th, and N_th compared to the case where it is not so. Set to a value (for example, 0.5 times the value).

For example, when the information indicating the traveling speed of the vehicle 1, the information indicating the acceleration of the vehicle 1, and the information indicating the frequency of the vehicle 1 are included in the vehicle information, the video sickness estimating unit 32b uses the vehicle information. The driving environment on the road on which the vehicle 1 is traveling is a driving environment in which it is easy to generate a video sickness (for example, an environment on a rough road, an environment on a sharp curve, a rapid acceleration) Environment, or an environment where rapid deceleration is taking place, etc.). When it is determined that the driving environment on the road is a driving environment that is likely to cause video sickness, the video sickness estimating unit 32b lowers at least one of the thresholds Rh_th, Rv_th, and N_th compared to the case where it is not so. Set to a value (for example, 0.5 times the value).

Alternatively, for example, when the information indicating the traveling speed of the vehicle 1 and the information indicating the acceleration of the vehicle 1 are included in the vehicle information, the video sickness estimating unit 32b uses the vehicle information to set the vehicle 1 within the predetermined time. Calculate the amount of change in traveling speed. When the calculated change amount exceeds a predetermined amount (for example, ± 30 kilometers per hour), the video sickness estimation unit 32b determines the threshold value Rh_th, Rv_th compared to the case where the calculated change amount is equal to or less than the predetermined amount. , N_th is set to a low value (for example, 0.5 times the value).

Alternatively, for example, when navigation information is included in the vehicle information, the video sickness estimation unit 32b uses the vehicle information to drive the driving environment in which the driving environment on the road on which the vehicle 1 is to travel is likely to generate video sickness (for example, It is determined whether or not the environment is such that the curve is continuous on a mountain road, or the environment such that acceleration and deceleration are continuous on a slope. When it is determined that the driving environment on the road is a driving environment that is likely to cause video sickness, the video sickness estimating unit 32b lowers at least one of the thresholds Rh_th, Rv_th, and N_th compared to the case where it is not so. Set to a value (for example, 0.5 times the value).

Alternatively, for example, when navigation information is included in the vehicle information, the video sickness estimating unit 32b determines whether the curvature of the curve on which the vehicle 1 is to travel exceeds the predetermined value using the vehicle information. . If the curvature is greater than a predetermined value, the motion sickness estimation unit 32b lowers at least one of the thresholds Rh_th, Rv_th, and N_th (for example, 0. 0.) when the curvature is less than or equal to the predetermined value. Set to 5 times the value).

Alternatively, for example, when the information on the lighting signal of the light, the information indicating the time, and the information on various warnings are included in the vehicle information, the video sickness estimating unit 32b uses the vehicle information to display the driving environment of the vehicle 1 It is determined whether or not there is a driving environment (such as an environment in which a plurality of warnings are output during night travel) that is likely to cause drunkenness. When it is determined that the driving environment of the vehicle 1 is a driving environment that is likely to cause video sickness, the video sickness estimating unit 32b lowers at least one of the thresholds Rh_th, Rv_th, and N_th compared to the case where it is not so. Set to a value (for example, 0.5 times the value).

As the threshold value Rh_th decreases, the width Rh ′ of the display target area A2 in the case of Rh> Rh_th also decreases. Due to the decrease of the threshold value Rv_th, the vertical width Rv ′ of the display target area A2 in the case of Rv> Rv_th also decreases. As the threshold value N_th decreases, the number N ′ of objects corresponding to the images included in the second image group in the case of N> N_th also decreases. As a result, it is possible to suppress the occurrence of video sickness even in a driving environment where video sickness is likely to occur.

The object information acquisition unit 31, the visual sickness estimation unit 32b, the display control unit 33, and the vehicle information acquisition unit 35 constitute a main part of the display control device 100b. Further, the object information generation unit 21, the vehicle information generation unit 23, the object information acquisition unit 31, the video sickness estimation unit 32b, the display control unit 33, and the vehicle information acquisition unit 35 constitute a main part of the control device 7b.

The hardware configuration of the main part of the control device 7b is the same as that described in the first embodiment with reference to FIG. That is, the functions of the vehicle information generation unit 23, the video sickness estimation unit 32b, and the vehicle information acquisition unit 35 may be realized by the processor 41 and the memory 42, or may be realized by the processing circuit 43. It is good.

Next, the operation of the display control device 100b will be described with reference to the flowchart of FIG.

First, in step ST1, the object information acquisition unit 31 acquires object information generated by the object information generation unit 21. The object information acquisition unit 31 outputs the acquired object information to the video sickness estimation unit 32 b and the display control unit 33.

Next, in step ST5, the vehicle information acquisition unit 35 acquires the vehicle information generated by the vehicle information generation unit 23. The vehicle information acquisition unit 35 outputs the acquired vehicle information to the video sickness estimation unit 32 b.

Next, at step ST2b, the video sickness estimating unit 32b temporarily uses the object information output by the object information acquiring unit 31 and the vehicle information output by the vehicle information acquiring unit 35 to temporarily display the head-up display of the first image group. A process is performed to estimate the presence or absence of video sickness due to the first video group when it is displayed in 2.

The specific example of the estimation process in step ST2b is the same as that described in the first embodiment with reference to the flowchart of FIG. However, when setting the thresholds Rh_th, Rv_th, and N_th (that is, when executing the process corresponding to the process of step ST11 shown in FIG. 7), the video sickness estimating unit 32b uses the vehicle information as described above. ing.

Next, in step ST3, the display control unit 33 executes control to display the second image group on the head-up display 2 using the object information output from the object information acquisition unit 31. At this time, the display control unit 33 is configured to make the display mode of the second video group different according to the result of the estimation process by the video sickness estimation unit 32b. The specific example of control in step ST3 is the same as that described in the first embodiment with reference to the flowchart of FIG.

The vehicle information may be information regarding the vehicle 1 and includes information that can be acquired via the in-vehicle network 10, and the content of the vehicle information is not limited to the above specific example. In addition, the video sickness estimation unit 32b may be any device that estimates the presence or absence of video sickness due to the first video group using the object information and the vehicle information (more specifically, for the thresholds Rh_th, Rv_th, and N_th). The content of the estimation processing by the video sickness estimation unit 32b is not limited to the above specific example, as long as vehicle information is used for setting).

Further, the display control device 100b can adopt various modifications similar to those described in the first embodiment, that is, various modifications similar to the display control 100.

Further, as shown in FIG. 22, the main part of the display control system 200b may be configured by the object information acquisition unit 31, the video sickness estimation unit 32b, the display control unit 33, and the vehicle information acquisition unit 35. . The system configuration of the main part of the display control system 200b is the same as that described in the first embodiment with reference to FIG. That is, any function of the display control system 200b may be realized by cooperation of any two or more of the in-vehicle information device 51, the portable information terminal 52, and the server device 53.

Further, the display control device 100 b may have the same driver information acquisition unit 34 as the display control device 100 a of the second embodiment. In this case, the video sickness estimation unit 32b uses the object information output by the object information acquisition unit 31, the driver information output by the driver information acquisition unit 34, and the vehicle information output by the vehicle information acquisition unit 35. The presence or absence of the occurrence of video sickness due to the first video group may be estimated. More specifically, the motion sickness estimation unit 32b may use driver information and vehicle information for setting the thresholds Rh_th, Rv_th, and N_th. The same applies to the display control system 200b.

As described above, the display control device 100b according to the third embodiment includes the vehicle information acquisition unit 35 that acquires vehicle information including information related to the vehicle 1, and the video sickness estimation unit 32b uses object information and vehicle information. Estimate the presence or absence of video sickness. Thereby, when estimating the presence or absence of generation | occurrence | production of video sickness, the driving environment of the vehicle 1 can be considered, for example. As a result, it is possible to further improve the estimation accuracy of the occurrence of video sickness. In addition, even in a driving environment where video sickness is likely to occur, the occurrence of video sickness can be suppressed.

Fourth Embodiment
FIG. 23 is a block diagram showing a state in which a control device including a display control device according to Embodiment 4 is provided in a vehicle. The display control device 100c according to the fourth embodiment will be described with reference to FIG. In FIG. 23, the same blocks as the blocks shown in FIG. 1 are assigned the same reference numerals and descriptions thereof will be omitted.

The vehicle 1 has a communication device 11. The communication device 11 includes, for example, a transmitter and a receiver for Internet connection, a transmitter and a receiver for inter-vehicle communication, or a transmitter and a receiver for road-to-vehicle communication.

The outside environment information generation unit 24 uses information received by the communication device 11 from a server device, another vehicle, or a roadside device (all not shown), etc., to obtain information on the outside environment of the vehicle 1 (hereinafter referred to as "outside environment information") .) Is generated. The outside environment information indicates, for example, at least one of the weather around the vehicle 1, the temperature around the vehicle 1, the humidity around the vehicle 1, or the degree of congestion of the road around the vehicle 1.

The outside environment information acquisition unit 36 acquires outside environment information generated by the outside environment information generation unit 24. The outside environment information acquisition unit 36 outputs the acquired outside environment information to the video sickness estimation unit 32c.

The video sickness estimating unit 32 c temporarily displays the first image group on the head-up display 2 using the object information output by the object information acquiring unit 31 and the external environment information output by the external environment information acquiring unit 36. The presence or absence of the occurrence of video sickness due to the first video group in the case is estimated. More specifically, the motion sickness estimation unit 32c executes the same process as that described with reference to FIG. 7 in the first embodiment, and sets the thresholds Rh_th, Rv_th, and N_th in the environment outside the vehicle. It uses information.

That is, the video sickness estimation unit 32c determines whether the driving environment of the vehicle 1 is a driving environment that is likely to cause video sickness, using the environment information outside the vehicle. When it is determined that the driving environment of the vehicle 1 is a driving environment that is likely to cause video sickness, the video sickness estimating unit 32c lowers at least one of the thresholds Rh_th, Rv_th, and N_th compared to the case where it is not so. Set to a value (for example, 0.5 times the value).

For example, when the outside environment information includes information indicating the weather around the vehicle 1, the video sickness estimating unit 32c uses the outside environment information to drive the driving environment in which the vehicle 1 is likely to generate video sickness (for example, It is determined whether or not the environment is such that many warnings are output due to bad weather such as heavy rain or heavy snow. When it is determined that the driving environment of the vehicle 1 is a driving environment that is likely to cause video sickness, the video sickness estimating unit 32c lowers at least one of the thresholds Rh_th, Rv_th, and N_th compared to the case where it is not so. Set to a value (for example, 0.5 times the value).

Alternatively, for example, when the outside environment information includes information indicating the degree of congestion of the road around the vehicle 1, the video sickness estimating unit 32c causes the driving environment of the vehicle 1 to generate video sickness using the outside environment information. Whether the driving environment is easy (for example, an environment where many other vehicles exist around the vehicle 1 at an intersection and the number N of objects detected by the object information generation unit 21 increases) judge. When it is determined that the driving environment of the vehicle 1 is a driving environment that is likely to cause video sickness, the video sickness estimating unit 32c lowers at least one of the thresholds Rh_th, Rv_th, and N_th compared to the case where it is not so. Set to a value (for example, 0.5 times the value).

Alternatively, for example, when the outside environment information includes the information indicating the weather around the vehicle 1, the video sickness estimating unit 32c uses the outside environment information to easily drive the driving environment of the vehicle 1 to generate video sickness. (For example, an environment in which the difference in luminance of the image displayed on the head-up display 2 with respect to the brightness of the front scenery seen through the windshield 4 is large, or an environment in which the contrast ratio of these images is high) It is determined whether the When it is determined that the driving environment of the vehicle 1 is a driving environment that is likely to cause video sickness, the video sickness estimating unit 32c lowers at least one of the thresholds Rh_th, Rv_th, and N_th compared to the case where it is not so. Set to a value (for example, 0.5 times the value).

The object information acquisition unit 31, the visual sickness estimation unit 32c, the display control unit 33, and the external environment information acquisition unit 36 constitute a main part of the display control device 100c. Further, the object information generation unit 21, the outside environment information generation unit 24, the object information acquisition unit 31, the video sickness estimation unit 32c, the display control unit 33, and the outside environment information acquisition unit 36 constitute a main part of the control device 7c. There is.

The hardware configuration of the main part of the control device 7c is the same as that described in the first embodiment with reference to FIG. That is, the functions of the external environment information generation unit 24, the video sickness estimation unit 32c, and the external environment information acquisition unit 36 may be realized by the processor 41 and the memory 42, or realized by the processing circuit 43. It may be

Next, the operation of the display control device 100c will be described with reference to the flowchart of FIG.

First, in step ST1, the object information acquisition unit 31 acquires object information generated by the object information generation unit 21. The object information acquisition unit 31 outputs the acquired object information to the video sickness estimation unit 32 c and the display control unit 33.

Next, in step ST6, the outside environment information acquiring unit 36 acquires outside environment information generated by the outside environment information generating unit 24. The outside environment information acquisition unit 36 outputs the acquired outside environment information to the video sickness estimation unit 32c.

Next, in step ST2c, the video sickness estimating unit 32c temporarily uses the object information output by the object information acquiring unit 31 and the external environment information output by the external environment information acquiring unit 36 to temporarily generate the first image group as a head. A process of estimating the occurrence of video sickness due to the first video group when displayed on the up display 2 is executed.

The specific example of the estimation process in step ST2c is the same as that described in the first embodiment with reference to the flowchart of FIG. However, when setting the thresholds Rh_th, Rv_th, and N_th (that is, when executing the process corresponding to the process of step ST11 shown in FIG. 7), the video sickness estimating unit 32c uses the environment information outside the vehicle as described above. It has become.

Next, in step ST3, the display control unit 33 executes control to display the second image group on the head-up display 2 using the object information output from the object information acquisition unit 31. At this time, the display control unit 33 is configured to make the display mode of the second video group different according to the result of the estimation process by the video sickness estimation unit 32c. The specific example of control in step ST3 is the same as that described in the first embodiment with reference to the flowchart of FIG.

The outside environment information may be any information regarding the outside environment of the vehicle 1 and may include information that can be received by the communication device 11, and the contents of the outside environment information are not limited to the above specific example. . Also, the video sickness estimation unit 32c may be any device that estimates the presence or absence of video sickness due to the first video group using the object information and the environment outside the vehicle (more specifically, the thresholds Rh_th, Rv_th, N_th The contents of the estimation process by the video sickness estimation unit 32c are not limited to the above specific example, as long as the environment outside the vehicle is used for setting (1).

Further, the display control device 100c can adopt various modifications similar to those described in the first embodiment, that is, various modifications similar to the display control 100.

Further, as shown in FIG. 25, even if the main part of the display control system 200c is configured by the object information acquisition unit 31, the video sickness estimation unit 32c, the display control unit 33, and the external environment information acquisition unit 36. good. The system configuration of the main part of the display control system 200c is the same as that described in the first embodiment with reference to FIG. That is, any function of the display control system 200c may be realized by cooperation of any two or more of the in-vehicle information device 51, the portable information terminal 52, and the server device 53.

Further, the display control device 100 c may have the same driver information acquisition unit 34 as the display control device 100 a of the second embodiment. In this case, the video sickness estimation unit 32c calculates the object information output by the object information acquisition unit 31, the driver information output by the driver information acquisition unit 34, and the outside environment information output by the outside environment information acquisition unit 36. It may be used to estimate the presence or absence of video sickness due to the first video group. More specifically, the video sickness estimating unit 32c may use driver information and outside environment information for setting the thresholds Rh_th, Rv_th, and N_th. The same applies to the display control system 200c.

Further, the display control device 100c may have the same vehicle information acquisition unit 35 as the display control device 100b of the third embodiment. In this case, the video sickness estimation unit 32 c uses the object information output by the object information acquisition unit 31, the vehicle information output by the vehicle information acquisition unit 35, and the outside environment information output by the outside environment information acquisition unit 36. The presence or absence of the occurrence of video sickness due to the first video group may be estimated. More specifically, the video sickness estimating unit 32c may use vehicle information and outside environment information for setting the thresholds Rh_th, Rv_th, and N_th. The same applies to the display control system 200c.

Further, the display control device 100c has a driver information acquisition unit 34 similar to the display control device 100a of the second embodiment and a vehicle information acquisition unit 35 similar to the display control device 100b of the third embodiment, Also good. In this case, the video sickness estimation unit 32c determines the object information output by the object information acquisition unit 31, the driver information output by the driver information acquisition unit 34, the vehicle information output by the vehicle information acquisition unit 35, and the environment outside the vehicle It is also possible to estimate the presence or absence of the occurrence of video sickness due to the first video group using the external environment information output by the information acquisition unit 36. More specifically, the video sickness estimating unit 32c may use driver information, vehicle information, and external environment information for setting the thresholds Rh_th, Rv_th, and N_th. The same applies to the display control system 200c.

As described above, the display control device 100c according to the fourth embodiment includes the outside environment information acquisition unit 36 that acquires outside environment information including information related to the outside environment of the vehicle 1, and the video sickness estimation unit 32c includes object information and The presence or absence of video sickness is estimated using the environment information outside the vehicle. Thereby, when estimating the presence or absence of generation | occurrence | production of video sickness, the driving environment of the vehicle 1 can be considered, for example. As a result, it is possible to further improve the estimation accuracy of the occurrence of video sickness. In addition, even in a driving environment where video sickness is likely to occur, the occurrence of video sickness can be suppressed.

In the scope of the invention, the present invention allows free combination of each embodiment, or modification of any component of each embodiment, or omission of any component in each embodiment. .

The display control device of the present invention can be used, for example, to control a windshield AR-HUD.

Reference Signs List 1 vehicle 2 head up display 3 head up display device 4 windshield 5 camera 6 sensor 7 7a 7b 7c control device 8 camera 9 sensor 10 in-vehicle network 11 communication device 21 object Information generation unit, 22 Driver information generation unit, 23 Vehicle information generation unit, 24 Vehicle external information generation unit, 31 Object information acquisition unit, 32, 32a, 32b, 32c Video sickness estimation unit, 33 Display control unit, 34 Driver Information acquisition unit, 35 Vehicle information acquisition unit, 36 Vehicle external environment information acquisition unit, 41 processor, 42 memory, 43 processing circuit, 51 vehicle information device, 52 portable information terminal, 53 server device, 100, 100a, 100b, 100c Display control Device, 200, 200a, 20 b, 200c display control system.

Claims

An object information acquisition unit that acquires object information including information on one or more objects existing around the mobile object;
A video sickness estimation unit that executes processing of estimating presence or absence of video sickness due to a first video group including one or more videos corresponding to the one or more objects using the object information;
A display control unit that executes control to cause a head-up display to display a second video group including at least a part of the one or more videos using the object information;
The display control unit is configured to make the display mode of the second image group different according to the result of the estimation process by the video sickness estimation unit.
The display control unit controls the number of videos included in the second video group, the motion of each video included in the second video group, or the head-up display according to the result of the estimation process performed by the video sickness estimation unit. The display control device according to claim 1, wherein at least one of the regions in which the second image group is displayed is different.
The display control apparatus according to claim 1, wherein the moving body is a vehicle.
A driver information acquisition unit configured to acquire driver information including information on a driver of the vehicle;
The display control device according to claim 3, wherein the video sickness estimation unit performs a process of estimating the presence or absence of the video sickness occurrence using the object information and the driver information.
The driver information indicates at least one of the position of the driver's head, the amount of viewpoint movement of the driver, the face color of the driver, the degree of eye opening of the driver, and the number of blinks of the driver. The display control apparatus according to claim 4, wherein the display control apparatus is a digital camera.
The display control device according to claim 4, wherein the driver information indicates at least one of a heart rate of the driver and a blood pressure of the driver.
A vehicle information acquisition unit that acquires vehicle information including information on the vehicle;
The display control device according to claim 3, wherein the video sickness estimation unit performs a process of estimating the presence or absence of the video sickness occurrence using the object information and the vehicle information.
The display control device according to claim 7, wherein the vehicle information indicates at least one of a traveling speed of the vehicle, an acceleration of the vehicle, or a frequency of the vehicle.
An external environment information acquisition unit for acquiring external environment information including information on the external environment of the vehicle;
The display control device according to claim 3, wherein the video sickness estimation unit performs a process of estimating the presence or absence of the video sickness occurrence using the object information and the external environment information.
The outside environment information indicates at least one of the weather around the vehicle, the temperature around the vehicle, the humidity around the vehicle, and the degree of congestion of the road around the vehicle. The display control device according to claim 9, wherein
The display control device according to claim 3, wherein the head-up display is a windshield type.
An object information acquisition unit that acquires object information including information on one or more objects existing around the mobile object;
A video sickness estimation unit that executes processing of estimating presence or absence of video sickness due to a first video group including one or more videos corresponding to the one or more objects using the object information;
A display control unit that executes control to cause a head-up display to display a second video group including at least a part of the one or more videos using the object information;
The display control unit is configured to make the display mode of the second image group different according to a result of estimation processing by the video sickness estimation unit.
The object information acquisition unit acquires object information including information on one or more objects existing around the mobile object;
Performing a process of estimating the presence or absence of occurrence of video sickness by a first video group including one or more videos corresponding to the one or more objects using the object information;
Performing a control of causing the head-up display to display a second video group including at least a part of the one or more videos using the object information;
The display control unit is configured to make the display mode of the second image group different according to the result of the estimation process by the video sickness estimation unit.