WO2020066963A1 - Dispositif d'affichage - Google Patents

Dispositif d'affichage Download PDF

Info

Publication number
WO2020066963A1
WO2020066963A1 PCT/JP2019/037169 JP2019037169W WO2020066963A1 WO 2020066963 A1 WO2020066963 A1 WO 2020066963A1 JP 2019037169 W JP2019037169 W JP 2019037169W WO 2020066963 A1 WO2020066963 A1 WO 2020066963A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
display
ratio
vehicle
notification
Prior art date
Application number
PCT/JP2019/037169
Other languages
English (en)
Japanese (ja)
Inventor
誠 秦
Original Assignee
日本精機株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本精機株式会社 filed Critical 日本精機株式会社
Priority to JP2020549185A priority Critical patent/JP7338632B2/ja
Publication of WO2020066963A1 publication Critical patent/WO2020066963A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/22—Display screens
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/23—Head-up displays [HUD]
    • B60K35/235—Head-up displays [HUD] with means for detecting the driver's gaze direction or eye points
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/80—Arrangements for controlling instruments
    • B60K35/81—Arrangements for controlling instruments for controlling displays
    • G—PHYSICS
    • G02—OPTICS
    • G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
    • G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
    • G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour 
    • G02F1/13—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour  based on liquid crystals, e.g. single liquid crystal display cells
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F9/00—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory

Definitions

  • the present disclosure relates to a display device.
  • Patent Literature 1 discloses an image display device that displays an image visually recognized by a viewer (mainly, a driver of the vehicle) as a virtual image overlapping a scene in front of the vehicle.
  • the display device disclosed in Patent Literature 1 controls the relative height and the like of a notification image for notifying the front target according to the distance from the vehicle to the front target.
  • Patent Document 1 If the technique disclosed in Patent Document 1 is used to simultaneously display a plurality of notification images as described above, similar display control is performed on each notification image according to the distance from the vehicle. However, there is room for improvement in effectively displaying one of the plurality of notification images that is assumed to have higher priority for the viewer.
  • the present disclosure has been made in view of the above circumstances, and has as its object to provide a display device that can effectively display an image that is assumed to have a high priority among a plurality of notification images.
  • the display device of the present disclosure includes: A display device that displays a superimposed image visually recognized by a viewer as a virtual image overlapping a scene in front of the vehicle, Acquisition means for acquiring a distance from the vehicle to a front object in front of the vehicle, A display control unit that two-dimensionally controls display of a notification image that notifies a forward target in the display region of the superimposed image, A storage unit for storing reference control information for determining a display ratio of the notification image with respect to a predetermined reference size, the display ratio being smaller as the distance is longer, in accordance with the distance acquired by the acquisition unit.
  • the display control means As the notification image, it is possible to display a plurality of images including a first image and a second image for notifying a forward target whose distance is longer than the first image, When the display ratio of the first image is equal to or greater than a first threshold while the display ratio of each of the first image and the second image is being changed and controlled based on the reference control information, An enlargement process for displaying the two images at a ratio larger than the display ratio determined based on the reference control information is executed.
  • the display device of the present disclosure it is possible to effectively display, of a plurality of notification images, an image that is assumed to have a high priority.
  • FIG. It is a block diagram of a display system for vehicles. It is a flowchart which shows a notification image special control process.
  • (A) is a diagram of a function indicated by reference control information
  • (b) and (c) are diagrams illustrating a specific example of a notification image.
  • (A)-(c) is a figure for demonstrating the notification image special control processing.
  • (A)-(c) is a figure which shows the example of transition of the notification image at the time of performing notification image special control processing.
  • A)-(c) is a figure for demonstrating the modification of an expansion process.
  • (A)-(c) is a figure which shows the modification of the function which reference
  • the display device is the HUD (Head-Up Display) device 10 included in the vehicle display system 100 shown in FIG.
  • the HUD device 10 is provided inside the dashboard 2 of the vehicle 1 and integrates not only information on the vehicle 1 (hereinafter, referred to as vehicle information) but also information other than the vehicle information. Notify the driver 4.
  • vehicle information includes not only information on the vehicle 1 itself but also information on the outside of the vehicle 1 related to the operation of the vehicle 1.
  • the vehicle display system 100 is a system configured in the vehicle 1, and includes a HUD device 10, a peripheral information acquisition unit 40, a forward information acquisition unit 50, a line-of-sight detection unit 60, and an ECU (Electronic Control Unit) 70. And a car navigation (car navigation) device 80.
  • the HUD device 10 emits the display light L toward the windshield 3 as shown in FIG.
  • the display light L reflected by the windshield 3 travels to the driver 4 side.
  • the driver 4 can visually recognize the image represented by the display light L displayed in front of the windshield 3 as a virtual image V. Thereby, the driver 4 can observe the virtual image V in a manner superimposed on the front scenery.
  • the HUD device 10 displays the virtual image V two-dimensionally on a virtual plane set in front of the vehicle 1 as shown in FIG.
  • the virtual plane is set at a position separated by a predetermined distance P (for example, about 5 to 10 m) in front of the vehicle 1 from a viewpoint position 4a when the driver 4 places the viewpoint in the eye box E.
  • the virtual surface corresponds to a display surface of an image on the display unit 20.
  • the virtual surface and the eye box E are set based on the size of the display surface and various mirrors in the HUD device 10 and an optical system including the windshield 3.
  • the HUD device 10 includes the display unit 20 and the control device 30 illustrated in FIG. 2, and a reflection unit (not illustrated).
  • the display unit 20 displays a superimposed image visually recognized by the driver 4 as the virtual image V under the control of the control device 30.
  • the display unit 20 has, for example, a TFT (Thin Film Transistor) type LCD (Liquid Crystal Display) and a backlight that illuminates the LCD from behind.
  • the backlight is composed of, for example, an LED (Light Emitting Diode).
  • the display unit 20 generates the display light L by the LCD illuminated by the backlight displaying an image under the control of the control device 30.
  • the generated display light L is emitted toward the windshield 3 after being reflected by the reflector.
  • the reflector is composed of, for example, two mirrors, a folding mirror and a concave mirror.
  • the turning mirror turns the display light L emitted from the display unit 20 back to the concave mirror.
  • the concave mirror reflects the display light L from the folding mirror toward the windshield 3 while expanding the display light L.
  • the virtual image V visually recognized by the driver 4 is an enlarged image of the image displayed on the display unit 20. Note that the number of mirrors constituting the reflecting section can be arbitrarily changed according to the design.
  • the display unit 20 is not limited to one using an LCD as long as it can display a superimposed image, and may be an OLED (Organic Light Emitting Diodes), a DMD (Digital Micro Mirror Device), an LCOS (Liquid Crystal On Silicon), or the like. A display device may be used.
  • OLED Organic Light Emitting Diodes
  • DMD Digital Micro Mirror Device
  • LCOS Liquid Crystal On Silicon
  • the control device 30 includes a microcomputer that controls the entire operation of the HUD device 10, and includes a control unit 31, a read only memory (ROM) 32, and a random access memory (RAM) 33.
  • the control device 30 includes a drive circuit and an input / output circuit for communicating with various systems in the vehicle 1 as a configuration (not shown).
  • the ROM 32 stores an operation program and various image data in advance.
  • the RAM 33 temporarily stores various calculation results and the like.
  • the control unit 31 includes a CPU (Central Processing Unit) 31a that executes an operation program stored in the ROM 32, and a GDC (Graphics Display Controller) 31b that executes image processing in cooperation with the CPU 31a.
  • the GDC 31b includes, for example, a GPU (Graphics Processing Unit), an FPGA (Field-Programmable Gate Array), and an ASIC (Application Specific Integrated Circuit).
  • the ROM 32 stores an operation program for performing a notification image special control process described later and data of reference control information BD.
  • the configurations of the control device 30 and the control unit 31 are arbitrary as long as the functions described below are satisfied.
  • the control unit 31 controls the driving of the display unit 20.
  • the control unit 31 drives and controls the backlight of the display unit 20 with the CPU 31a, and drives and controls the LCD of the display unit 20 with the GDC 31b that operates in cooperation with the CPU 31a.
  • the CPU 31a of the control unit 31 controls the superimposed image based on various image data stored in the ROM 32 in cooperation with the GDC 31b.
  • the GDC 31b determines the control content of the display operation of the display unit 20 based on the display control command from the CPU 31a.
  • the GDC 31b reads, from the ROM 32, image part data necessary to compose one screen to be displayed on the display unit 20, and transfers the image part data to the RAM 33.
  • the GDC 31b uses the RAM 33 to create picture data for one screen based on image part data and various image data received from the outside of the HUD device 10 by communication.
  • the GDC 31b completes the picture data for one screen in the RAM 33, the GDC 31b transfers the picture data to the display unit 20 in synchronization with the image update timing.
  • a superimposed image visually recognized by the driver 4 as the virtual image V is displayed on the display unit 20.
  • a layer is assigned in advance to each image constituting the image visually recognized as the virtual image V, and the control unit 31 can perform individual display control of each image.
  • the control unit 31 controls the display position and size of the content image in the display area of the virtual image V.
  • the control unit 31 controls the size of a notification image, which will be described later, included in the content image according to the distance from the vehicle 1 to the front target to which the notification image notifies.
  • the function and control of the notification image will be described later in detail.
  • the dotted frame indicated by the virtual image V in FIG. 1B and FIGS. 6A to 6C indicates the display area of the virtual image V, and the content image is visually recognized as the virtual image V in the display area. Image to be displayed. This is equivalent to displaying the content image in the display area of the superimposed image on the display unit 20 that displays the superimposed image visually recognized by the driver 4 as the virtual image V.
  • the control unit 31 communicates with each of the peripheral information acquisition unit 40, the forward information acquisition unit 50, the line-of-sight detection unit 60, the ECU 70, and the car navigation device 80.
  • communication for example, communication systems such as CAN (Controller Area Network), Ethernet, MOST (Media Oriented Systems Transport), and LVDS (Low Voltage Differential Signaling) can be applied.
  • CAN Controller Area Network
  • Ethernet Ethernet
  • MOST Media Oriented Systems Transport
  • LVDS Low Voltage Differential Signaling
  • the peripheral information acquisition unit 40 acquires information on the periphery (external) of the vehicle 1 and performs communication between the vehicle 1 and a wireless network (V2N: Vehicle To Cellular Network) and communication between the vehicle 1 and another vehicle (V2V). : Vehicle To Vehicle), communication between the vehicle 1 and a pedestrian (V2P: Vehicle To Pedestrian), and communication between the vehicle 1 and a roadside infrastructure (V2I: Vehicle To roadside Infrastructure). That is, the peripheral information acquisition unit 40 enables communication by V2X (Vehicle @ To ⁇ Everything) between the vehicle 1 and the outside of the vehicle 1.
  • V2N Vehicle To Cellular Network
  • V2V Vehicle To Vehicle
  • V2P Vehicle To Pedestrian
  • V2I Vehicle To roadside Infrastructure
  • the peripheral information acquisition unit 40 includes a communication module that can directly access a WAN (Wide Area Network), an external device (such as a mobile router) that can access the WAN, and an access point of a public wireless LAN (Local Area Network). It has a communication module for communication and performs Internet communication.
  • the peripheral information acquisition unit 40 includes a GPS controller that calculates the position of the vehicle 1 based on a GPS (Global Positioning System) signal received from an artificial satellite or the like. With these configurations, communication by V2N is enabled.
  • the peripheral information acquisition unit 40 includes a wireless communication module that conforms to a predetermined wireless communication standard, and performs communication using V2V or V2P.
  • the peripheral information acquisition unit 40 has a communication device that wirelessly communicates with the roadside infrastructure, and is installed as an infrastructure from a base station of a driving safety support system (DSSS: Driving Safety Support Systems), for example. Object information and traffic information around the vehicle 1 are acquired via the roadside apparatus. Thereby, communication by V2I becomes possible.
  • DSSS Driving Safety Support Systems
  • the peripheral information acquisition unit 40 acquires object information indicating the position, size, attributes, and the like of various objects such as vehicles, traffic lights, and pedestrians outside the vehicle 1 by V2I, and controls the control unit 31. To supply.
  • the object information is not limited to V2I, and may be obtained by any communication among V2X.
  • the peripheral information acquisition unit 40 acquires traffic information including the position and shape of the peripheral road of the vehicle 1 by V2I, and supplies the traffic information to the control unit 31.
  • the control unit 31 calculates the position of the vehicle 1 based on information from the GPS controller of the surrounding information acquisition unit 40.
  • These various types of information include information indicating the content of the forward target, which will be described later, and information for the control unit 31 to specify the distance from the vehicle 1 to the forward target.
  • the forward information acquisition unit 50 is a ranging camera such as a stereo camera that captures an image of the scenery ahead of the vehicle 1 or a LIDAR (Laser Imaging Detection And Ranging) that measures the distance from the vehicle 1 to an object located in front of the vehicle 1. It comprises a sensor, a sonar for detecting an object located in front of the vehicle 1, an ultrasonic sensor, a millimeter wave radar, and the like.
  • a ranging camera such as a stereo camera that captures an image of the scenery ahead of the vehicle 1 or a LIDAR (Laser Imaging Detection And Ranging) that measures the distance from the vehicle 1 to an object located in front of the vehicle 1. It comprises a sensor, a sonar for detecting an object located in front of the vehicle 1, an ultrasonic sensor, a millimeter wave radar, and the like.
  • LIDAR Laser Imaging Detection And Ranging
  • the forward information acquisition unit 50 transmits the forward image data indicating the front landscape image captured by the stereo camera, the data indicating the distance to the object measured by the distance measurement sensor, and other detection data. Send to These various types of information include information indicating the content of the forward target, which will be described later, and information for the control unit 31 to specify the distance from the vehicle 1 to the forward target.
  • the line-of-sight detection unit 60 includes, for example, an imaging unit (for example, a stereo camera) that images the face of the driver 4 and generates image data, and an image processing unit that performs image processing of the image data. Is detected.
  • the line-of-sight detection unit 60 detects the line-of-sight direction of the driver 4 by a known image analysis method such as a pattern matching method, and transmits detection data indicating a detection result to the CPU 31a.
  • the CPU 31a refers to table data in which the line of sight direction and the position of the viewing target are stored in advance in the ROM 32 and specifies the target that the driver 4 is currently viewing.
  • the gaze direction may be detected based on, for example, one of the eyes of the driver 4, or may be detected as the center of gravity of the eyes. As long as the CPU 31a can identify the target visually recognized by the driver 4, the detection data is arbitrary.
  • the line-of-sight detection unit 60 may detect the direction of the face of the driver 4 by a known image analysis method and use the data as detection data.
  • the CPU 31a refers to the table data in which the face direction and the position of the visual recognition target are stored in advance in the ROM 32, and specifies the target that the driver 4 is currently viewing.
  • the position of the visual recognition target may be obtained from the line of sight by a mathematical formula.
  • the data indicating the mathematical expression may be stored in the ROM 32 in advance.
  • the gaze detection unit 60 may be an imaging unit, an electro-oculogram sensor, or a motion sensor mounted on a wearable device worn by the driver 4 on the head.
  • the direction of the line of sight and the direction of the face can be detected in the same manner as described above, based on the image data obtained by the imaging means.
  • the electro-oculography sensor detects the gaze direction of the driver 4 based on the measured electro-oculography.
  • the motion sensor includes, for example, one or a combination of an acceleration sensor, a gyro sensor, and a geomagnetic sensor, and detects the direction of the face of the driver 4.
  • the CPU 31a may be configured to detect the gaze direction and the face direction of the driver 4 based on signals from the imaging unit and various sensors. As long as the CPU 31a can specify the target visually recognized by the driver 4, the detection method and detection configuration of the driver's 4 gaze direction and face direction are arbitrary.
  • the ECU 70 controls each unit of the vehicle 1, and transmits, for example, vehicle speed information indicating the current vehicle speed of the vehicle 1 to the CPU 31a.
  • the CPU 31a may acquire vehicle speed information from a vehicle speed sensor.
  • the ECU 70 transmits to the CPU 31a measurement amounts such as the engine speed, warning information of the vehicle 1 itself (such as low fuel and abnormal engine oil pressure), and other vehicle information.
  • the CPU 31a can also display an image indicating the vehicle speed, the engine speed, various warnings, and the like on the display unit 20 via the GDC 31b. That is, in the display area of the virtual image V, an image indicating vehicle information other than a notification image described later can also be displayed.
  • the car navigation device 80 includes a GPS controller that calculates the position of the vehicle 1 based on a GPS signal received from an artificial satellite or the like.
  • the car navigation device 80 has a storage unit for storing map data, reads out map data near the current position from the storage unit based on position information from the GPS controller, and displays a guide route to a destination set by the user. decide. Then, the car navigation device 80 outputs information on the current position of the vehicle 1 and the determined guidance route to the control unit 31. In addition, the car navigation device 80 outputs information indicating the name and type of the facility in front of the vehicle 1 and the distance between the facility and the vehicle 1 to the control unit 31 by referring to the map data.
  • the map data includes road shape information (lane, road width, number of lanes, intersections, curves, branch roads, etc.), regulation information on road signs such as speed limits, and information on each lane when there are multiple lanes.
  • Various information is associated with the position data.
  • the car navigation device 80 outputs these various types of information to the control unit 31. These various types of information include information indicating the content of the forward target, which will be described later, and information for the control unit 31 to specify the distance from the vehicle 1 to the forward target.
  • the car navigation device 80 is not limited to the one mounted on the vehicle 1, and performs wired or wireless communication with the control unit 31 and has a car navigation function such as a mobile terminal (smartphone, tablet PC (Personal Computer), etc.). ).
  • the notification image displayed in the display area of the virtual image V is an image for notifying the front target in front of the vehicle 1.
  • the forward object includes not only an actual object (hereinafter, referred to as an actual object) but also information in a scene in front of the vehicle 1.
  • the notification image can be roughly classified into a display in an “emphasis mode” for emphasizing a real object and a display in a “visualization mode” for visualizing information that is not visually recognized in the scenery ahead.
  • the notification image of the emphasis mode is displayed at a position corresponding to a real object such as a preceding vehicle, a pedestrian, a road sign, or a building existing in front of the vehicle 1.
  • the notification image of the emphasis mode is displayed, for example, superimposed on the real object or in the vicinity of the real object, and notifies the existence of the real object by emphasizing it. That is, the “position corresponding to the real object” as the display position of the notification image in the emphasized mode is not limited to a position that is superimposed on the real object and visually recognized, and may be a position near the real object.
  • the emphasis mode is arbitrary as long as it does not hinder the visual recognition of the real object.
  • the notification image of the visualization mode is, for example, an image imitating a road sign for notifying various information at the place where the road sign is not installed, or the driver 4 preset in the car navigation device 80 or the like,
  • the image includes a POI (Point of Interest) such as a destination and a facility.
  • the road sign includes all kinds of information such as a guide sign, a warning sign, a regulation sign, and an instruction sign. That is, the notification image that can be displayed in this embodiment includes an image imitating a road sign.
  • FIGS. 4B and 4C an example of a notification image in a visualization mode imitating a road sign is shown in FIGS. 4B and 4C.
  • the notification image shown in FIG. 4B is an image imitating a guide sign.
  • the notification image shown in FIG. 4C is an image simulating a regulation sign indicating a speed limit.
  • the control unit 31 notifies the notification so that the display size of the notification image decreases as the distance X from the vehicle 1 to the forward target increases (in other words, the display size of the notification image increases as the distance X decreases). Performs image display control. Thereby, a pseudo perspective can be given to the notification image.
  • the control unit 31 acquires the distance X to the forward target based on information transmitted from at least one of the peripheral information acquisition unit 40, the forward information acquisition unit 50, and the car navigation device 80 (hereinafter, referred to as a specific configuration). .
  • the control unit 31 may obtain information indicating the distance X from the specific configuration, or may obtain coordinate information of a forward target from the specific configuration, and calculate the distance X based on the coordinate information.
  • the distance X to the forward target which is the notification target of the notification image in the visualization mode, is determined by the representative position of the forward target specified based on information from the peripheral information acquisition unit 40 or the car navigation device 80 (for example, the start of the restricted section). (A position or a position predetermined as a position suitable for road guidance) can be obtained or calculated.
  • the control unit 31 determines the display ratio Y based on the obtainable distance X and the reference control information BD as described above, and displays the notification image at the determined display ratio Y.
  • the reference control information BD is data of a function F (formula) indicating the relationship between the distance X and the display ratio Y.
  • the constant ⁇ is determined by, for example, a predetermined distance P from the virtual plane to the eye box E and a reference size described later.
  • Magnification Y is a display ratio of the notification image for the reference size, the size to be displayed on the virtual surface and S, if a reference size as S 0, is represented by S / S 0.
  • Reference size is stored in advance in the ROM32 as the size of the broadcast image in the predetermined distance X 0. Incidentally, how to set the predetermined distance X 0 is arbitrary.
  • the reference size is predetermined in accordance with the type of the notification image.
  • FIG. 4B shows a notification image of a reference size having a horizontal length of A and a vertical length of B as a rectangular notification image.
  • the length referred to here can be defined, for example, in pixels.
  • the notification image shown in FIG. 4B has a horizontal length of 2A, a vertical length of 2B, and a standard size. It will be displayed enlarged.
  • the notification image shown in FIG. 4C has a size of 1 / 2C in width and 1 / 2D in height, The image is displayed after being reduced from the reference size. As described above, enlargement or reduction of the notification image is performed while maintaining the aspect ratio of the notification image of the reference size.
  • the shape of the notification image is not limited to a rectangle or a circle, but may be another shape such as a triangle or a polygon, and the concept of enlargement or reduction is the same for other shapes.
  • the configuration of the notification image is arbitrary as long as information on the forward target can be notified, and may be, for example, a character, a symbol, a graphic, an icon, or a combination thereof.
  • the virtual image V is displayed two-dimensionally on the virtual plane, so that the notification image displayed in the display area of the virtual image V is also displayed two-dimensionally.
  • the virtual surface is set facing the driver 4, and the notification image is also displayed facing the driver 4.
  • the virtual surface is set to be inclined forward with respect to the vertical direction of the vehicle 1. May be.
  • the notification image can be viewed directly facing the driver 4 in consideration of the projection from the virtual plane set obliquely to the facing plane. Therefore, even when the virtual plane of the virtual image V is set obliquely, the concept of enlarging or reducing the notification image visually recognized by the driver 4 is the same as described above.
  • the control unit 31 controls the display of the notification image.
  • the control unit 31 can display a plurality of notification images within the same period (simultaneously).
  • the display ratio of the notification image determined based on the reference control information BD becomes equal to or more than the predetermined value TM
  • the notification image may be deleted.
  • an image that notifies a forward target whose distance X from the vehicle 1 is the closest is referred to as a first image V1
  • an image that notifies a forward object whose distance X is farther than the first image V1 is a first image V1.
  • the plurality of notification images are subjected to the control based on the reference control information BD (hereinafter, referred to as normal control) in the order from the largest display size to the smallest display size.
  • One image V1, the second image V2, and the third image V3 are obtained.
  • the control unit 31 executes a notification image special control process shown in FIG.
  • the control unit 31 When the control unit 31 specifies a plurality of forward targets during the normal control based on the reference control information BD, the control unit 31 performs display control of a plurality of notification images for notifying the forward targets. Then, the control unit 31 repeatedly executes the notification image special control process at a predetermined control cycle during a period in which a plurality of notification images are displayed. That is, the notification image special control process is executed at least during a period in which both the first image V1 and the second image V2 are displayed.
  • the control unit 31 determines whether the display ratio of the first image V1 is equal to or more than the first threshold T1 (Step S1).
  • the first threshold value T1 is predetermined as a display ratio corresponding to the distance X when the forward target is sufficiently close to the vehicle 1 and the forward target is expected to pass soon, and is stored in the ROM 32. .
  • Step S1 If the display ratio of the first image V1 is equal to or greater than the first threshold value T1 (Step S1; Yes), the control unit 31 executes the process of Step S2. On the other hand, when the display ratio of the first image V1 is less than the first threshold value T1 (Step S1; No), the control unit 31 causes the driver 4 to display the first image V1 based on the line-of-sight information acquired from the line-of-sight detection unit 60. It is determined whether or not is visually recognized (step S3).
  • Step S3; No When the driver 4 does not visually recognize the first image V1 (Step S3; No), the control unit 31 terminates the notification image special control process, while the driver 4 visually recognizes the first image V1. In this case (Step S3; Yes), the processing of Step S2 is executed. By doing so, even if the display ratio of the first image V1 is less than the first threshold value T1, it is assumed that the driver 4 has recognized the first image V1 and the importance of the first image V1 has already been reduced. In this case, an enlarging process for ensuring the visibility of the second image V2 can be executed as described later.
  • step S2 the control unit 31 determines whether the erasing condition of the first image V1 is satisfied. For example, when the display ratio of the first image V1 is equal to or more than the predetermined value TM, the control unit 31 determines that the erasing condition is satisfied (Step S2; Yes), and sets the first image V1 within the display range of the virtual image V. (Step S4).
  • the predetermined value TM is, for example, predetermined as a value larger than the first threshold value T1, and is stored in the ROM 32.
  • step S5 the control unit 31 determines whether the display ratio of the second image V2 is less than the second threshold value T2.
  • the second threshold value T2 is a value smaller than the first threshold value T1, and a distance in a case where it is assumed that the front object is far from the vehicle 1 and the second image V2 indicating the front object becomes difficult for the driver 4 to visually recognize.
  • the display ratio corresponding to X is predetermined and stored in the ROM 32.
  • Step S5 When the display ratio of the second image V2 is equal to or greater than the second threshold T2 (Step S5; No), the control unit 31 ends the notification image special control process.
  • the second image V2 is displayed according to the normal control based on the reference control information BD, that is, the function F.
  • the control unit 31 executes an enlargement process on the second image V2 (Step S6).
  • the control unit 31 displays the second image V2 at a ratio larger than the display ratio R (see FIGS. 5B and 5C) determined based on the reference control information BD.
  • FIG. 6 (a) and 6 (b) show an example of image transition when the enlargement process is executed.
  • the second image V2 displayed by the normal control as shown in FIG. 6A is enlarged as shown in FIG. 6B.
  • the notification target of the first image V1 will soon pass, and the second image V2 that is assumed to have a higher importance of notification than the first image V1 will be displayed. It can be displayed easily.
  • the control unit 31 may display the second image V2 above the driver 4 as compared to before the execution.
  • the driver 4 can be provided with a view necessary for driving.
  • the control of moving the second image V2 upward and displaying the image together with the enlargement processing as described above is particularly useful when the second image V2 is a notification image in a visualization mode imitating a road sign. This is because the normal road sign is displayed above the front road surface, so that the driver 4 can visually recognize the second image V2 as if he / she were looking at an actual road sign.
  • the control unit 31 when displaying the third image V3 that notifies the forward target whose distance X is farther than the second image V2, the control unit 31 performs the enlargement process on the second image V2.
  • the display of the third image V3 is continued under the control based on the reference control information BD.
  • the second image V2 becomes relatively more prominent than the third image V3, and the second image V2 having a higher importance of notification than the third image V3 can be effectively displayed in the latest. .
  • the notification image displayed smaller than the third image V3 that is, the distance X is longer than the notification target of the third image V3.
  • the display based on the control based on the reference control information BD is also continued for the image notifying the forward target.
  • step S1 or S2 the control unit 31 determines whether or not a part of the first image V1 is out of the display area of the virtual image V, as shown in FIG. If so, and if it is determined Yes in step S5, the enlargement process may be executed. Even in this case, the notification target of the first image V1 will soon pass, and the second image V2, which is assumed to have a higher importance of notification than the first image V1, can be displayed in an easily recognizable manner.
  • control unit 31 determines whether or not a predetermined period (for example, several seconds) has elapsed from the start of the execution of the enlargement process (step S7).
  • a predetermined period for example, several seconds
  • the control unit 31 executes a return process of returning the display control of the second image V2 to the control based on the reference control information BD (Step S8), and outputs the notification image.
  • the special control processing ends.
  • FIGS. 6B to 6C show an example of image transition when the return process is executed.
  • the second image V2 which has been enlarged and displayed as shown in FIG. 6B, is displayed by control based on the reference control information BD as shown in FIG. 6C.
  • FIG. 6C shows an example in which the display ratio changes in the Y direction when the enlargement process or the return process is executed.
  • the display ratio is gradually reduced. May be changed.
  • the point (X, Y) indicating the second image V2 moves from the function F to the special function Fs in a diagonally upper left direction in the Y direction when the enlargement processing is performed.
  • the special function Fs moves to the function F obliquely downward and leftward in the Y direction.
  • Step S7 the control unit 31 uses the line-of-sight information acquired from the line-of-sight detection unit 60 to display the second image V2 displayed by the driver 4 in an enlarged display. It is determined whether or not is visually recognized (step S9).
  • Step S9; No When the driver 4 is not visually recognizing the second image V2 (Step S9; No), the control unit 31 terminates the notification image special control process, while the driver 4 is visually recognizing the second image V2. In this case (Step S9; Yes), the return process of Step S8 is executed.
  • the display control of the second image V2 can be returned to the control based on the reference control information BD, For the driver 4, it is possible to suppress the second image V ⁇ b> 2 whose importance has already been reduced from continuing to be enlarged. This is the end of the description of the notification image special control processing.
  • the present invention is not limited to this.
  • the display of the second image V2 may be controlled at a constant display ratio Y independent of the distance X.
  • the point (X, Y) representing the second image V2 is ideally restored as shown in FIG. Is rarely located on the function F at the start of the operation. Therefore, as shown in FIG.
  • the return function passes through the point representing the second image V2 at the start point, and the proportionality constant of the function F is reduced by a predetermined value.
  • the display control of the second image V2 may be performed using Fb.
  • the control using the return function Fb can be said to be an example of control of the display ratio of the second image V2 based on the reference control information BD.
  • the display ratio which is a constant value until the enlargement process is executed and the return process starts, may be changed based on the function F from the start time. Good. Also in these modified examples, the display ratio may be gradually changed at the time of executing the enlargement processing or the return processing as described above.
  • the constant display ratio Y intersects with the function F.
  • the return process may be started at the point of time. That is, the predetermined period from when the enlargement process is performed on the second image V2 to when the return process is started may not be a predetermined period.
  • the special function Fs is obtained by increasing the proportional constant of the function F
  • the return function Fb is obtained by decreasing the proportional constant of the function F.
  • the function F may be an algebraic function or an elementary function including a polynomial function, and may represent a curve. Further, the function F may be configured by a plurality of linear functions having different slopes. For example, as shown in FIG. 8B, the function F may represent a curve in which the larger the distance X, the larger the display ratio Y than the direct proportional relationship. Further, as shown in FIG. 8B, the function F is represented by a plurality of straight lines, and the plurality of straight lines have a gentler gradient when the distance is equal to or longer than a predetermined distance X than when the distance is shorter than the distance X. May be included.
  • the examples of the function F shown in FIGS. 8B and 8C are useful when it is difficult to visually recognize a distant landscape during rain or dense fog, or when the sunshine is so strong that a notification image is difficult to see.
  • the reference control information BD is data representing a mathematical expression of the function F.
  • the reference control information BD is a table configured to determine the display ratio Y corresponding to the acquired distance X. It may be data. That is, the reference control information BD can determine the display ratio Y that decreases as the distance X increases (in other words, the display ratio Y increases as the distance X decreases) in accordance with the acquired distance X. , Or may be table data, and the configuration is arbitrary.
  • the control unit 31 determines that the erasing condition is satisfied (step S2 of the notification image special control process illustrated in FIG. 3). ) Is not limited to this. For example, when the target visually recognized by the driver 4 is the first image V1, the control unit 31 determines that the erasing condition is satisfied (step S2 of the notification image special control process illustrated in FIG. 3; Yes). May be.
  • step S3 steps S2 and S4, and step S9 may be omitted.
  • step S5 may be omitted in the notification image special control process.
  • the projection target of the display light L is not limited to the windshield 3, but may be a combiner including a plate-shaped half mirror, a hologram element, and the like.
  • the display device that executes the above-described notification image special control process is not limited to the HUD device 10.
  • the display device may be configured as a head mounted display (HMD: Head Mounted Display) mounted on the head of the driver 4 of the vehicle 1. Then, in the image displayed by the HMD as a virtual image, the display control of the notification image may be executed by the same method as described above. That is, the display device is not limited to the display device mounted on the vehicle 1 and may be any display device used in the vehicle 1.
  • the display device described above displays a superimposed image visually recognized by the driver 4 (an example of a viewer) as a virtual image V overlapping a scene in front of the vehicle 1.
  • the HUD device 10 includes an acquisition unit (for example, the control unit 31) for acquiring a distance X from the vehicle 1 to a front target in front of the vehicle 1, and a notification image for notifying the front target in the display region of the superimposed image.
  • a display control unit (for example, the control unit 31 or the display unit 20) that performs display control in two dimensions and obtains a display ratio Y of the notification image with respect to a predetermined reference size, which becomes smaller as the distance X becomes longer.
  • Storage means for example, ROM 32 for storing reference control information BD for determining according to the distance X acquired by the means.
  • the display control means can display a plurality of images including the first image V1 and the second image V2 for notifying a forward target whose distance X is longer than the first image V1. Further, the display control means controls the display ratio Y of the first image V1 to be equal to the first threshold value T1 when the display ratio Y of each of the first image V1 and the second image V2 is controlled to be changed based on the reference control information BD. In the case described above, it is determined whether or not the display ratio Y of the second image V2 is smaller than the second threshold T2 which is smaller than the first threshold T1.
  • the display control unit controls the display ratio Y of the second image V2 based on the reference control information BD.
  • the display ratio Y is less than the second threshold T2
  • Execute By executing the enlargement process on the second image V2 in this manner, as described above, the notification target of the first image V1 is likely to pass soon, and the importance of the notification becomes higher than that of the first image V1.
  • the second image V2 can be displayed so as to be easily recognized. That is, according to the display device described above, it is possible to effectively display an image that is assumed to have a high priority among a plurality of notification images.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Combustion & Propulsion (AREA)
  • Theoretical Computer Science (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Computer Hardware Design (AREA)
  • Nonlinear Science (AREA)
  • Crystallography & Structural Chemistry (AREA)
  • Optics & Photonics (AREA)
  • Instrument Panels (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

L'objectif de la présente invention est d'afficher efficacement une image de notification supposée présenter une priorité élevée parmi une pluralité d'images de notification. Ce dispositif d'affichage affiche une image superposée qui est reconnue visuellement par un conducteur d'un véhicule en tant qu'image virtuelle. Le dispositif d'affichage est pourvu d'un moyen de commande d'affichage permettant d'effectuer une commande d'affichage, en deux dimensions, d'images de notification fournissant une notification d'un objet devant le véhicule, et d'un moyen de mémoire permettant d'enregistrer des informations de commande de référence afin de déterminer, en fonction d'une distance acquise, un rapport d'affichage qui diminue à mesure que la distance jusqu'à l'objet de devant augmente. Lorsque le moyen de commande d'affichage effectue une commande permettant de faire varier les rapports d'affichage d'une première image V1 et d'une seconde image V2, servant d'images de notification, sur la base des informations de commande de référence, si le rapport d'affichage de la première image V1 augmente jusqu'à un premier seuil T1 ou dépasse ce dernier, le moyen de commande d'affichage exécute un processus d'agrandissement permettant d'afficher la seconde image V2 présentant un rapport supérieur à un rapport d'affichage R déterminé sur la base des informations de commande de référence. Le processus d'agrandissement peut également être exécuté à condition que le rapport d'affichage de la seconde image V2 soit inférieur à un second seuil T2.
PCT/JP2019/037169 2018-09-27 2019-09-24 Dispositif d'affichage WO2020066963A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2020549185A JP7338632B2 (ja) 2018-09-27 2019-09-24 表示装置

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018181968 2018-09-27
JP2018-181968 2018-09-27

Publications (1)

Publication Number Publication Date
WO2020066963A1 true WO2020066963A1 (fr) 2020-04-02

Family

ID=69949455

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/037169 WO2020066963A1 (fr) 2018-09-27 2019-09-24 Dispositif d'affichage

Country Status (2)

Country Link
JP (1) JP7338632B2 (fr)
WO (1) WO2020066963A1 (fr)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004187139A (ja) * 2002-12-05 2004-07-02 Denso Corp 車両用表示装置
WO2014208164A1 (fr) * 2013-06-28 2014-12-31 アイシン・エィ・ダブリュ株式会社 Dispositif d'affichage tête haute
JP2015104930A (ja) * 2013-11-28 2015-06-08 株式会社デンソー ヘッドアップディスプレイ装置
JP2017035972A (ja) * 2015-08-10 2017-02-16 三菱電機株式会社 表示制御装置、表示装置および表示制御方法
WO2017138428A1 (fr) * 2016-02-08 2017-08-17 株式会社リコー Appareil d'affichage d'informations
US20180105040A1 (en) * 2015-07-01 2018-04-19 Lg Electronics Inc. Assistance Apparatus For Driving Of A Vehicle, Method Thereof, And Vehicle Having The Same
WO2018116588A1 (fr) * 2016-12-22 2018-06-28 カルソニックカンセイ株式会社 Dispositif de commande d'affichage d'image

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004187139A (ja) * 2002-12-05 2004-07-02 Denso Corp 車両用表示装置
WO2014208164A1 (fr) * 2013-06-28 2014-12-31 アイシン・エィ・ダブリュ株式会社 Dispositif d'affichage tête haute
JP2015104930A (ja) * 2013-11-28 2015-06-08 株式会社デンソー ヘッドアップディスプレイ装置
US20180105040A1 (en) * 2015-07-01 2018-04-19 Lg Electronics Inc. Assistance Apparatus For Driving Of A Vehicle, Method Thereof, And Vehicle Having The Same
JP2017035972A (ja) * 2015-08-10 2017-02-16 三菱電機株式会社 表示制御装置、表示装置および表示制御方法
WO2017138428A1 (fr) * 2016-02-08 2017-08-17 株式会社リコー Appareil d'affichage d'informations
WO2018116588A1 (fr) * 2016-12-22 2018-06-28 カルソニックカンセイ株式会社 Dispositif de commande d'affichage d'image

Also Published As

Publication number Publication date
JPWO2020066963A1 (ja) 2021-10-21
JP7338632B2 (ja) 2023-09-05

Similar Documents

Publication Publication Date Title
JP6861375B2 (ja) 表示システム、情報提示システム、表示システムの制御方法、プログラム、及び移動体
US9818206B2 (en) Display device
US8536995B2 (en) Information display apparatus and information display method
JP2019012237A (ja) 表示システム、情報提示システム、表示システムの制御方法、プログラム、及び移動体
JP2015099469A (ja) 車両情報投影システム
JP2019202589A (ja) 表示装置
JP6796806B2 (ja) 表示システム、情報提示システム、表示システムの制御方法、プログラム、及び移動体
JP2015120395A (ja) 車両情報投影システム
JP2021075219A (ja) 表示制御装置及び表示制御プログラム
JP6186905B2 (ja) 車載表示装置およびプログラム
JP2020047153A (ja) 表示装置
JP2019206262A (ja) 表示装置
WO2021039762A1 (fr) Dispositif d'affichage
WO2020040276A1 (fr) Dispositif d'affichage
JP2024010261A (ja) ヘッドアップディスプレイ装置
JP2024048432A (ja) 表示システム
WO2020066963A1 (fr) Dispositif d'affichage
JP7435465B2 (ja) 表示装置
JP2019207632A (ja) 表示装置
JP7379945B2 (ja) 表示装置
JP7379946B2 (ja) 表示装置
JP2019121140A (ja) 表示制御装置、ヘッドアップディスプレイ装置
JP2019219895A (ja) 表示装置
WO2021200913A1 (fr) Dispositif de commande d'affichage, dispositif d'affichage d'image et procédé
JP7434894B2 (ja) 車両用表示装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19865863

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2020549185

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19865863

Country of ref document: EP

Kind code of ref document: A1