JP2017174043A - Display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device capable of switching video seamlessly according to ambient conditions.SOLUTION: In a display device, a translucent type display 9 can display at least video during automatic driving, a driving prediction unit 5 acquires information from an external sensor 1 or the like detecting the situation of the outside of a vehicle, and in the case of the situation in which a driver needs to visually recognize the situation of the outside thereof, the driving prediction unit 5 and a synthesis processing unit 7 performs control so that visibility of video being displayed on the translucent type display 9 is reduced.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a display device that displays an image.

  2. Description of the Related Art A display device that projects video on a windshield of a vehicle such as an automobile and presents various information to a driver is known.

  For example, Patent Literature 1 describes that route guidance information, alert information, and the like are displayed on a windshield.

JP 2014-71024 A

  In recent years, research and development of autonomous driving of automobiles and the like have been conducted, and it is thought that they will be put into practical use in the near future. Even during automatic driving, if an event that requires attention has occurred around the vehicle, it may be necessary for humans to intervene. However, there is a problem that the information displayed on the windshield is obstructed so that the situation in front of the vehicle cannot be visually recognized or the information on the displayed information is concentrated and it is difficult to notice the above-mentioned cautionary events. is there.

  Therefore, in view of the above-described problems, an object of the present invention is to provide a display device capable of seamlessly switching images according to surrounding conditions, for example.

  In order to solve the above-described problem, the invention described in claim 1 includes a display unit capable of displaying and transmitting a video during automatic driving, a situation acquisition unit for acquiring a situation outside the vehicle during the automatic driving, It is determined whether the situation is a situation to be visually recognized by the driver, and when the situation is a situation to be visually recognized by the driver, control is performed so as to reduce the visibility of the video displayed on the display means. And a control means.

  The invention described in claim 10 is a display control method of display means capable of displaying and transmitting images during automatic driving, wherein the situation detecting means for detecting a situation outside the vehicle during the automatic driving is detected. When the situation is a situation to be visually recognized by the driver, the display control method includes a control step of controlling to reduce the visibility of the video displayed on the display means.

  The invention described in claim 11 is a display control program that causes a computer to execute the display control method according to claim 10.

  The invention described in claim 12 is a computer-readable recording medium in which the display control program according to claim 11 is stored.

1 is a schematic block configuration diagram of an in-vehicle system including a display device according to a first embodiment of the present invention. It is a flowchart of the danger prediction process of the display apparatus shown by FIG. It is a flowchart of the status determination process of the display apparatus shown by FIG. It is a flowchart of the parameter check process of the display apparatus shown by FIG. It is a flowchart of the video switching process at the time of danger prediction of the display apparatus shown by FIG. It is a flowchart of the status determination process of the display apparatus concerning 2nd Example of this invention.

  Hereinafter, a display device according to an embodiment of the present invention will be described. A display device according to an embodiment of the present invention includes a display unit capable of displaying and transmitting a video during automatic driving, a situation acquisition unit for acquiring a situation outside the vehicle during automatic driving, and the situation visually recognized by the driver. Control means for determining whether or not the situation should be determined and when the situation is to be visually recognized by the driver, the control means for controlling so as to reduce the visibility of the video displayed on the display means. . By doing in this way, when the situation outside the vehicle is to be visually recognized during automatic driving, the visibility of the video can be reduced even if a video such as various information is displayed on the display means. it can. Therefore, video display can be seamlessly switched according to the surrounding situation.

  The display means may project an image on a screen portion provided on the windshield of the vehicle. By doing in this way, even if various information is displayed on the screen part of the windshield of a vehicle, a picture can be changed seamlessly.

  The control means may select and control at least one of the change in the transmittance of the display means and the change in the reduction ratio of the displayed video according to the situation. By doing in this way, it is possible to perform video switching and the like with appropriate control according to the surrounding situation.

  The control means may not decrease the current transmittance when updating the transmittance, and may not increase the size of the currently displayed video when updating the reduction rate. In this way, if a situation that should be visually recognized once occurs, control is performed so as to improve the visibility of the video until all the situations are finished, and the driver is informed of the situation and judges it. Can focus on.

  In addition, when a situation with high importance is detected, the control unit may not perform control corresponding to another situation until the situation ends. In this way, it is possible to set the priority order and maintain the display state without being affected by the occurrence of other situations for the more important situations.

  Further, the camera may further include line-of-sight detection means for detecting the driver's line of sight, and the control means may perform control based on the line of sight. By doing in this way, it becomes possible to perform further control, such as increase in transmittance, depending on whether the driver's line of sight is visually recognizing an image or an external situation.

  In addition, driving detection means for detecting a driving operation by the driver may be further provided, and the control means may stop displaying the video when the driving operation is detected. In this way, when the driver performs a driving operation, the display of the video can be stopped so that the driver can concentrate on driving.

  The control means may stop the display of the video when the driving operation is detected after performing the control for reducing the visibility of the video at least once. By doing so, the video is gradually switched, and the video display can be switched seamlessly.

  Further, the control means may highlight the portion of the display means where the situation is observed. In this way, the driver can easily recognize the situation.

  In addition, the display control method according to the embodiment of the present invention is displayed on the transmissive display means when the driver should visually recognize the situation detected by the situation detection means for detecting the situation outside the vehicle. And a control process for controlling to reduce the visibility of the video. By doing in this way, when the situation outside a vehicle is a situation which should be visually recognized, the visibility of the picture currently displayed on a display means can be reduced. Therefore, the video can be switched seamlessly according to the surrounding situation.

  The display control method described above may be executed by a computer as a display control program. By doing in this way, the visibility of the image | video currently displayed on the display means can be reduced when the situation outside a vehicle should be visually recognized using a computer. Therefore, the video can be switched seamlessly according to the surrounding situation.

  Further, the display control program described above may be stored in a computer-readable recording medium. In this way, the program can be distributed as a single unit in addition to being incorporated in the device, and version upgrades can be easily performed.

  A display device according to a first embodiment of the present invention will be described with reference to FIGS. FIG. 1 is a schematic configuration diagram of an in-vehicle system 100 including a display device 50 according to the present embodiment.

  As shown in FIG. 1, the in-vehicle system 100 includes an external sensor 1, a navigation unit 2, an in-vehicle camera 3, an in-vehicle camera 4, a driving prediction unit 5, a vehicle control unit 6, a synthesis processing unit 7, The vehicle is equipped with an AV device 8 and a transmissive display 9, and is mounted on a vehicle such as an automobile capable of traveling by automatic driving.

  The external sensor 1 is a sensor for detecting the situation of the external environment (external) of the vehicle such as in front of the vehicle, and is configured by, for example, LIDAR (Light Detection and Ranging, Laser Imaging Detection and Ranging). That is, the situation outside the vehicle during automatic driving is detected.

  The navigation unit 2 searches for a route from the current position to the destination and generates route information. And the vehicle control part 6 makes a vehicle drive | work based on the said route information. Further, the route information generated by the navigation unit 2 is output to the synthesis processing unit 7 and displayed on the transmissive display 9.

  The vehicle exterior camera 3 includes a front camera, a rear camera, a side camera, and the like of the vehicle, and images the front, rear, and side surfaces (left and right) of the vehicle. That is, at least the front shooting camera detects the situation outside the vehicle (front) during automatic driving.

  The in-vehicle camera 4 is a camera that is installed in the vehicle and shoots a rear seat of the vehicle.

  The driving prediction unit 5 as a situation acquisition unit and a control unit is mounted on the vehicle input to the output of the external sensor 1, guidance information and current position information of the navigation unit 2, images taken by the vehicle camera 3, and the vehicle control unit 6. The information obtained from the various sensors is acquired, the situation around the vehicle is judged on the basis of the output and video, etc., and the driving information corresponding to the situation is output to the vehicle control unit 6, and the synthesis process The event information based on the situation is output to the unit 7 to change the display of the transmissive display 9 described later.

  Based on the driving information, route information, and the like from the driving prediction unit 5, the vehicle control unit 6 autonomously operates the accelerator, the brake, the handle, and the like to automatically drive the vehicle.

  The synthesizing processing unit 7 as a control means displays images of the navigation unit 2, the vehicle outside camera 3, the vehicle interior camera 4, the AV device 8, and the like based on an operation from a passenger such as a driver or a control from the driving prediction unit 5. Output to the transmissive display 9. Further, the display mode of the currently displayed video is changed based on the event information from the driving prediction unit 5. The contents of the change include, for example, change of transmittance, reduction or enlargement, partial erasure, separate screen display, switching of the source (navigation unit 2, vehicle outside camera 3, vehicle camera 4 and AV equipment 8), and screens of a plurality of sources. And so on. Note that the driver in the present embodiment refers to a passenger who is seated in a seat that can be operated by a steering wheel, an accelerator, a brake, or the like when switched to manual driving. In other words, in the present embodiment, the transmissive display 9 displays information output from any one of the navigation unit 2, the vehicle camera 3, the vehicle camera 4, and the AV device 8. The transmissive display 9 may display information other than these, for example, various information related to automatic driving.

  The AV device 8 is a device that receives or reproduces AV (Audio Visual) information such as a television broadcast receiver or a recording medium reproducing device. Note that AV information stored in an external server or the like may be received and reproduced via a mobile phone network or the Internet. In the following description, the AV information is described as entertainment information, but other entertainment information may be information such as a game, a WEB browser, an electronic book, an email, a messenger, and the like.

  The transmissive display 9 as a display unit includes a display unit configured by a windshield of the vehicle and a projection unit that projects video information output from the synthesis processing unit 7 onto the windshield, and is output from the synthesis processing unit 7. Displayed video information. The display unit is configured, for example, by superimposing a dimming screen or the like that changes a scattering state and a transparent transmission state with small scattering of incident light on a windshield. Or it is good also as a structure from which the windshield itself changes to the state used as a screen, and a permeation | transmission state. That is, the transmissive display 9 is a display means that can display an image and can change to a transmissive state, and is a screen portion in which the above-described dimming screen or the like is provided on the windshield. Further, the transmissive display 9 increases the transmittance of the display unit (makes it more transparent) or stops the display so that the driver can visually recognize the scenery in front of the transmissive display 9. .

  The display device 50 in this embodiment includes an operation prediction unit 5, a composition processing unit 7, and a transmissive display 9.

  Next, the operation of the display device 50 having the above-described configuration will be described with reference to FIGS. The flowcharts shown in FIGS. 2 to 4 are executed by the driving prediction unit 5, and the flowchart shown in FIG. Therefore, the driving prediction unit 5 and the synthesis processing unit 7 are configured as a computer including a CPU, a memory, and the like, and the operations of the flowcharts illustrated in FIGS. 2 to 4 are performed as a computer program (display control program) that operates on the computer. It may be configured.

  First, the flowchart shown in FIG. 2 will be described. The flowchart shown in FIG. 2 is an operation related to the risk prediction process. First, in step S101, a danger detection process is performed and the process proceeds to step S102. In this step, based on the output of the external sensor 1 or the image taken by the camera 3 outside the vehicle, a sudden stop of the vehicle ahead, popping out of passersby or animals, detection of crossers or motorcycles at intersections, or accidents Detect highly urgent events such as other abnormalities such as on-site and submerged roads.

  Next, in step S102, it is determined whether or not a danger is detected as a result of the process in step S101. If a danger is detected (YES), the process proceeds to step S103, and no danger is detected (NO). Returns to step S101.

  Next, in step S103, since it is determined that a danger is detected in step S102, a danger avoidance event is transmitted as event information to the synthesis processing unit 7, and the process proceeds to step S104.

  Next, in step S104, a danger elimination detection process is performed, and the process proceeds to step S105. In this step, it is detected that the event of high urgency detected in step S101 has been resolved.

  Next, in step S105, it is determined whether or not the danger has been eliminated as a result of the process in step S104. If the danger is eliminated (in the case of YES), the process proceeds to step S106, and the danger is not eliminated (in the case of NO). ) Returns to Step S104.

  Next, in step S106, the danger detection process is performed again and the process proceeds to step S107. In this step, an event with a high degree of urgency is detected as in step S101, but it is confirmed whether an event different from the event detected in step S101 has been detected.

  Next, in step S107, it is determined whether or not a danger is detected as a result of the process in step S106. If a danger is detected (in the case of YES), the process returns to step S104, and no danger is detected (in the case of NO). ) Proceeds to step S108.

  Next, in step S108, since no danger is detected in step S107, the danger avoidance return event is transmitted as event information to the composition processing unit 7 and the process returns to step S101.

  Next, the flowchart shown in FIG. 3 will be described. The flowchart shown in FIG. 3 is an operation related to the situation determination process. The situation determination process is a process for detecting an event related to a situation that does not correspond to the event of high urgency shown in FIG. 2 and the flowchart of FIG. 3 are executed in parallel. First, in step S201, normal operation is set as an initial value of the current situation, and the process proceeds to step S202. The normal operation indicates an initial state in which the situation described below does not occur.

  Next, in step S202, a situation determination process is performed, and the process proceeds to step S203. In this step, based on images taken by the external sensor 1, the camera 3 outside the vehicle, the camera 4 inside the vehicle, etc., for example, the situation concerning guidance, the situation concerning waiting for action, the situation concerning subsequent actions, the situation concerning roads, the situation concerning consideration for surroundings, etc. The situation that the driver should visually recognize is detected.

  The situation regarding guidance includes arrival near the destination, prompting the passenger to set the destination, confirmation of the parking position, situation judgment of whether to give the route to other vehicles or not. The situation related to waiting for action includes instructions at a toll booth, drive-through, and the like. Situations relating to the follow-up measures include puncture, gas shortage, various vehicle troubles, etc. when an accident occurs (a rear-end collision from the rear vehicle). Road conditions include driving conditions such as narrow roads, highways, tunnels, and nighttime. Situations regarding consideration for the surroundings include water splashing, distance to pedestrians, and turning right when turning right.

  Next, in step S203, all the detected situations are stored in the current situation, and the process proceeds to step S204. In this step, all the situations detected in step S202 are stored in a memory or the like. That is, since the situation of step S202 may generate a plurality of situations as exemplified above, all the situations that have occurred are stored and used in the subsequent processing.

  Next, in step S204, parameter check processing is performed, and the process proceeds to step S205. The parameter check process will be described later.

  Next, in step S205, the event determined in the parameter check process is transmitted as event information to the composition processing unit 7, and the process returns to step S202.

  Next, the flowchart shown in FIG. 4 will be described. The flowchart shown in FIG. 4 is a parameter check process, that is, an operation according to step S204 in FIG. First, in step S301, parameters are initialized. The parameters are parameters relating to the display mode of the transmissive value display 9, and are, for example, the transmittance of the screen portion, the reduction ratio of the video, the display coordinates on the screen portion, the partial erase coordinates, the partial erase shape, and the like. In this step, the transmittance is minimized by initialization (the front scenery cannot be seen through the windshield), the reduction ratio is none (displayed on the windshield without being shrunk), and the display coordinates are the initial values (front of the driver's seat). Position, center of windshield, etc.), partial erase coordinates = none, and partial erase shape = none.

  Next, in step S302, it is determined whether or not the situation (current situation) stored in the memory or the like in step S203 in FIG. 3 is normal operation only. If normal operation is only (YES), the process proceeds to step S303. If not (NO), the process proceeds to step S305.

  Next, in step S303, since the current situation is only normal operation, the parameters are cleared (initialized), and the process proceeds to step S304.

  In step S304, the video return event is returned as an issue event. That is, an event for returning to the normal display mode during automatic driving is issued.

  On the other hand, in step S305, it is determined whether or not all current conditions have been checked. If the check is completed (YES), the process returns. If the check is not completed (NO), the process returns to step S306. move on. Note that “check” refers to processing in steps S306 to S309 described below.

  Next, in step S306, one situation is selected from the memory or the like stored as the current situation, and parameters corresponding to the situation are extracted. For example, when arriving near the destination, 16 times as the reduction ratio parameter (1/16 from the current display size) is extracted, and when the toll gate, 2 times as the transmittance parameter is extracted. Etc.

  Next, in step S307, it is determined whether or not the value of the parameter extracted in step S306 is different from the value of the parameter so far (updated). If updated (if YES) Advances to step S308, and if there is no update (NO), returns to step S305. In this step, it may be determined that there is an update only when the parameter is updated to a larger value (changed so as to increase). For example, when a parameter corresponding to a situation where the transmittance is doubled is extracted in a state where the transmittance is four times, it may be ignored. That is, you may update only in the direction which reduces the visibility of an image | video. That is, when updating the transmittance, the current transmittance may not be decreased, and when the reduction rate is updated, the size of the currently displayed image may not be enlarged.

  Next, in step S308, since it is determined that there is a parameter update in step S307, the parameter is updated, and the process proceeds to step S309.

  Next, in step S309, the process returns to step S305 with the event corresponding to the parameter updated in step S308 as an issue event. In other words, when the transparency is updated, the video transparency event becomes the issue event, when the reduction rate is updated, the video reduction event becomes the issue event, and when the partial erase is updated, the video partial erase event becomes the issue event. When switching is updated, another screen switching event becomes an issue event. In step S306, another situation is selected again, parameters corresponding to the situation are extracted, and step S307 and subsequent steps are repeated.

  Next, the flowchart shown in FIG. 5 will be described. The flowchart shown in FIG. 5 is an operation related to the video switching process at the time of danger prediction. As described above, this flowchart is executed by the synthesis processing unit 7 based on the processing results (event information) of the flowcharts of FIGS. 2 to 4 executed by the driving prediction unit 5.

  First, in step S401, it is determined whether or not the current image is displayed on the transmissive display 9, and if it is displayed (YES), the process proceeds to step S402, and if not displayed (NO). Waits at this step.

  Next, in step S402, event information is received from the driving | operation prediction part 5, and it progresses to step S403.

  Next, in step S403, it is determined whether event information has been received in step S402. If received (YES), the process proceeds to step S404. If not received (NO), the process returns to step S401.

  Next, in step S404, processing according to the received event information is performed. If the received event information is video transmission, the process proceeds to step S405, where video transmission processing, that is, the transmittance of the video displayed on the transmissive display 9 is changed, and the process returns to step S401. If the received event is video reduction, the process proceeds to step S406, where video reduction processing, that is, the reduction ratio of the video displayed on the transmissive display 9 is changed, and the process returns to step S401.

  If the received event is video partial erasure, the process proceeds to step S407, where video partial erasure processing, that is, a state where the video is partially erased by changing the shape of the video displayed on the transmissive display 9, etc. The process returns to step S401. If the received event is another screen switching, the process proceeds to step S408, and another screen switching process (different screen display), that is, the video displayed on the transmissive display 9 is switched to another source (AV device 8). To the outside camera 3 etc.) The process returns to step S401. If the received event is video restoration, the process proceeds to step S409, where video restoration processing is performed, that is, the video displayed on the transmissive display 9 is restored to the original video (reset to the original source, parameters such as transmittance). ) And return to step S401.

  If the received event is danger avoidance, the process proceeds to step S410 to delete the image currently displayed on the transmissive display 9, and the process proceeds to step S411.

  Next, in step S411, event information is received from the driving | operation prediction part 5, and it progresses to step S412.

  Next, in step S412, it is determined whether or not the danger avoidance return event transmitted in step S411 of FIG. 2 is received in step S411. If received (YES), the process proceeds to step S413, and if not received If (NO), the process returns to step S411.

  In step S413, the image displayed on the transmissive display 9 is restored to the original image (the erased source is displayed again), and the process returns to step S401.

  Steps S410 to S413 are processes performed as a result of the risk prediction process shown in FIG. 2, and are in a high importance situation. Therefore, during the execution of these steps, it may be locked and ignored even if an event due to another situation occurs. That is, when a situation with high importance is detected, control corresponding to another situation may not be performed until the situation ends.

  As is clear from the above description, it is determined whether or not the situation should be visually recognized by the driver in the flowcharts of FIGS. 2 to 4 executed by the driving prediction unit 5, and the situation should be visually recognized by the driver. In some cases, control is performed so as to reduce the visibility of the video displayed on the over-molding display means in the flowchart of FIG. Accordingly, when the flow charts of FIGS. 2 to 5 show a situation in which the driver should visually recognize the situation outside the vehicle during automatic driving, the visibility of the video displayed on the transmissive display 9 (display means) is improved. It functions as a control process for controlling to decrease.

  According to the present embodiment, a transmission type display 9 that can display images such as AV information during automatic driving, and a driving prediction unit 5 that acquires information from the outside sensor 1 that detects a situation outside the vehicle during automatic driving. And if the situation is a situation that the driver should visually recognize, and if the situation is a situation that the driver should visually recognize, the visibility of the image displayed on the transmissive display 9 is reduced. An operation predicting unit 5 and a synthesis processing unit 7 to be controlled are provided. In this way, when the situation outside the vehicle is a situation to be visually recognized, even if a video not related to automatic driving such as AV information is displayed on the transmissive display 9, the visibility of the video is reduced. Can be made. Therefore, video display can be seamlessly switched according to the surrounding situation.

  The transmissive display 9 is configured to project an image on the windshield of the vehicle. In this way, even when AV information or the like is displayed on the windshield of the vehicle, the video can be switched seamlessly.

  In addition, the composition processing unit 7 selects and controls any one of control of increase in video transmittance, increase in reduction rate, partial erasure, separate screen display, and danger avoidance according to the situation. By doing in this way, it is possible to perform video switching and the like with appropriate control according to the surrounding situation.

  Further, when the danger avoidance event information is input, the synthesis processing unit 7 may not perform control corresponding to the event information related to another situation until the situation related to the event ends. In this way, it is possible to set the priority order and maintain the display state without being affected by the occurrence of other situations for the more important situations.

  Further, the composition processing unit 7 may not reduce the current transmittance when updating the transmittance, and may not increase the size of the currently displayed video when updating the reduction rate. . That is, you may update in the direction which makes a driver | operator pay more attention to the external condition. In this way, control is performed to improve the visibility of the image. If a situation that should be visually recognized once occurs, the driver will be informed of the situation until all the situations are completed. Focus on judgment.

  Next, a display device according to a second embodiment of the present invention will be described with reference to FIG. The same parts as those in the first embodiment described above are denoted by the same reference numerals and the description thereof is omitted.

  In the present embodiment, when an external situation is detected once, the video display is changed in consideration of whether the driver recognizes the situation or copes with the situation.

  FIG. 6 shows a flowchart of the situation determination process according to the present embodiment. In FIG. 6, steps S201 to S205 are the same as those in FIG. In step S211 proceeding from step S201, it is determined whether or not the current situation is normal operation only. If only normal operation is performed (YES), the process proceeds to step S202. If not (NO), the process proceeds to step S212. move on. If the process proceeds to step S202, the process proceeds to steps S203, S204, and S205 as in FIG. 3 and returns to step S211.

  On the other hand, in step S212, since the current situation is not only normal operation, some situation such as a situation relating to guidance and a situation relating to waiting for an action has occurred. Therefore, in order to detect whether the driver is viewing the situation, the driver's line of sight is detected, and it is determined whether the direction of the line of sight does not match the direction of the situation. Proceeding to step S213, if they match (in the case of NO), the process proceeds to step S214. Here, the driver's line of sight is provided, for example, in addition to a camera that shoots the driver's seat in addition to the in-vehicle camera 4 that shoots the rear seat, and the driver's line of sight is detected by shooting the driver's face. That's fine. That is, the in-vehicle camera 4 functions as a line-of-sight detection unit. The direction of the situation may be estimated from the driver's seat based on the detection result of the external sensor 1 or the video taken by the vehicle camera 3. In addition, the determination in this step is not limited to a case where they do not completely match, and a case where the line of sight and the direction of the situation are shifted by a predetermined range or more may be regarded as a mismatch.

  Next, in step S213, the line-of-sight mismatch is stored in the current situation, and the process proceeds to step S204.

  On the other hand, in step S214, it is determined whether or not the operation has been switched to manual operation. If the operation has been switched to manual operation (in the case of YES), the process proceeds to step S215. Proceed to Here, the switching to the manual operation may be determined, for example, by the vehicle control unit 6 detecting that an operation related to vehicle traveling such as a steering wheel, an accelerator, a brake, a blinker, and a wiper is performed. That is, the vehicle control unit 6 functions as driving detection means.

  Next, in step S215, the manual operation is stored in the current situation, and the process proceeds to step S204.

  Therefore, when the line of sight does not match or when the operation is switched to manual operation, only those situations are processed in the parameter check process. Further, even if the current situation is not only normal operation, if the line of sight coincides or the manual operation cannot be switched, the processing from step S202 is executed as in FIG.

  When the line-of-sight mismatch is stored as the current situation in the flowchart of FIG. 6, the parameter extracted in step S306 of the flowchart of FIG. 4 is not a specific value but is further advanced by one step. For example, when the transmittance is doubled, it is increased to four times. That is, the driving prediction unit 5 and the synthesis processing unit 7 perform control based on the line of sight. In this way, in the case of line-of-sight mismatch, the transmittance can be further increased to make it easier to check the external situation.

  Further, when the manual operation is stored as the current situation in the flowchart of FIG. 6, the parameter extracted in step S306 of the flowchart of FIG. That is, when the driving operation is detected, the driving prediction unit 5 and the composition processing unit 7 stop displaying the video. Further, since the situation has once occurred in step S211, the image can be gradually switched such that the image is erased after the transmittance is once reduced. That is, the driving prediction unit 5 and the synthesis processing unit 7 stop displaying the video when the driving operation is detected after performing the control to reduce the visibility of the video at least once.

  In the flowchart of FIG. 6, both the line-of-sight mismatch and the manual operation are performed, but only one of them may be performed.

  According to the present embodiment, the in-vehicle camera 4 that detects the driver's line of sight is provided, and the driving prediction unit 5 and the synthesis processing unit 7 perform control based on the line of sight. By doing in this way, it becomes possible to perform further control, such as increase in transmittance, depending on whether the driver's line of sight is visually recognizing an image or an external situation.

  Moreover, the vehicle control part 6 which detects the driving operation by a driver | operator is provided, and the driving | operation prediction part 5 and the synthetic | combination process part 7 are made to stop the display of an image | video, when a driving operation is detected. In this way, when the driver performs a driving operation, the display of the video can be stopped so that the driver can concentrate on driving.

  In addition, the composition processing unit 7 stops the display of the video when the driving operation is detected after performing the control for reducing the visibility of the video at least once. By doing so, the video is gradually switched, and the video display can be switched seamlessly.

  In the above-described two embodiments, when an external situation is detected, a display (emphasis display) is performed so as to emphasize the position (the part where the situation is observed) of the situation in the transmissive display 9. Also good. Examples of the highlight display include surrounding the range of the situation with a frame or instructing with an arrow or the like.

  Further, the present invention is not limited to the above embodiment. That is, those skilled in the art can implement various modifications in accordance with conventionally known knowledge without departing from the scope of the present invention. Of course, such modifications are included in the scope of the present invention as long as the configuration of the display device of the present invention is provided.

1 External sensor 3 Outside camera 4 Inside camera (line of sight detection means)
5 Driving prediction unit (status acquisition means, control means)
6 Vehicle control unit (driving detection means)
7 Compositing processing unit (control means)
9 Transmission type display (display means)
50 Display device

Claims (12)

Display means capable of displaying and transmitting images during automatic operation;
A situation acquisition means for acquiring a situation outside the vehicle at the time of the automatic driving;
It is determined whether the situation is a situation to be visually recognized by the driver, and when the situation is a situation to be visually recognized by the driver, control is performed so as to reduce the visibility of the video displayed on the display means. Control means to
A display device comprising:   The display device according to claim 1, wherein the display unit is displayed by projecting an image on a screen unit provided on a windshield of the vehicle.   3. The control unit according to claim 1, wherein the control unit selects and controls at least one of a change in the transmittance of the display unit and a change in the reduction rate of the displayed video according to the situation. The display device described in 1.   The control means does not decrease the current transmittance when updating the transmittance, and does not increase the size of the currently displayed image when updating the reduction rate. Item 4. The display device according to Item 3.   5. The control unit according to claim 1, wherein when the situation having a high importance level is detected, the control unit does not perform control corresponding to the other situation until the situation ends. The display device described in 1. It further comprises gaze detection means for detecting the gaze of the driver,
The display device according to claim 1, wherein the control unit performs the control based on the line of sight. Further comprising driving detection means for detecting a driving operation by the driver;
The display device according to claim 1, wherein the control unit stops displaying the video when the driving operation is detected.   The display device according to claim 7, wherein the control unit stops the display of the video when the driving operation is detected after performing the control for reducing the visibility of the video at least once.   The display device according to claim 1, wherein the control unit highlights a portion of the display unit where the situation is observed. A display control method for display means capable of displaying and transmitting images during automatic operation,
When the situation detected by the situation detection means for detecting the situation outside the vehicle during the automatic driving is a situation that the driver should visually recognize, the visibility of the image displayed on the display means is reduced. A display control method comprising a control step of controlling.   A display control program for causing a computer to execute the display control method according to claim 10.   A computer-readable recording medium storing the display control program according to claim 11.

Images