WO2020246114A1 - Display control device and display control program - Google Patents

Display control device and display control program Download PDF

Info

Publication number
WO2020246114A1
WO2020246114A1 PCT/JP2020/012383 JP2020012383W WO2020246114A1 WO 2020246114 A1 WO2020246114 A1 WO 2020246114A1 JP 2020012383 W JP2020012383 W JP 2020012383W WO 2020246114 A1 WO2020246114 A1 WO 2020246114A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
display control
content
vehicle
superimposed
Prior art date
Application number
PCT/JP2020/012383
Other languages
French (fr)
Japanese (ja)
Inventor
神谷 玲朗
大祐 竹森
基宏 福本
一輝 小島
Original Assignee
株式会社デンソー
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社デンソー filed Critical 株式会社デンソー
Publication of WO2020246114A1 publication Critical patent/WO2020246114A1/en

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Arrangement of adaptations of instruments
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34Route searching; Route guidance
    • G01C21/36Input/output arrangements for on-board computers
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/37Details of the operation on graphic patterns
    • G09G5/377Details of the operation on graphic patterns for mixing or overlaying two or more graphic patterns
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00Aspects of display data processing
    • G09G2340/04Changes in size, position or resolution of an image
    • G09G2340/0464Positioning

Definitions

  • the present disclosure relates to a display control device and a display control program that control the display of a virtual image.
  • Patent Document 1 proposes a display device for vehicles that superimposes and displays contents by a head-up display. This vehicle display device superimposes and displays the content indicating the route from the traveling position of the own vehicle to the guidance point in the front view of the driver.
  • Patent Document 1 It is considered that the technique of Patent Document 1 is premised on superimposing the content on the area visible to the occupant in the foreground. However, depending on the surrounding conditions such as the road structure, information on both the area visible to the occupant and the area invisible to the occupant in the foreground may be presented by the content. It is not proposed in Patent Document 1 to display the contents in an easy-to-understand manner even in such a situation.
  • An object of the present disclosure is to provide a display control device and a display control program capable of displaying in an easy-to-understand manner for occupants.
  • the display control device is used in a vehicle and controls the superimposed display of contents by a head-up display.
  • the display control device includes an estimation unit that estimates an invisible area that is visible to the occupants of the vehicle and an invisible area that is invisible to the occupants of the road surface in the foreground, and a planned travel route of the vehicle at a specific point.
  • the display control unit is provided with a display control unit that superimposes and displays the route content on the road surface, and the display control unit stops the superimposition display of the route content on the non-visual area when a specific point is included in the non-visual area.
  • the non-visual information content that presents information about a specific point is superimposed and displayed on a display position associated with a predetermined position on the planned traveling route at a display height at least a part of which is displayed above the visible area.
  • the display control program is used in the vehicle and controls the superimposed display of the content by the head-up display.
  • the display control program estimates to at least one processing unit an invisible area visible to the occupants of the vehicle and an invisible area invisible to the occupants of the road surface in the foreground, and the specific point is not visible.
  • the non-visual information content that is superimposed on the road surface and presents the planned route of the vehicle at a specific point, stops the superimposed display on the non-visible area, and presents information about the specific point. Is superimposed on the display position associated with the predetermined position on the scheduled travel path at the display height at which at least a part of the display is displayed above the visible area.
  • the superimposed display of the route content on the non-visible area is stopped, and at least a part of the non-visible information content is positioned above the visible area. Is superimposed and displayed. Therefore, the occupant can recognize the information about the specific point separately from the route content superimposed on the visible area. Then, since the non-visual information content is superimposed and displayed on the display position associated with the predetermined position on the scheduled travel route, it is easy for the occupant to recognize that the information on the scheduled travel route is presented. As described above, it is possible to provide a display control device and a display control program capable of displaying in an easy-to-understand manner for the occupant.
  • FIG. 1 is a diagram showing an overall image of an in-vehicle network including an HCU according to the first embodiment of the present disclosure.
  • FIG. 2 is a diagram showing an example of a head-up display mounted on a vehicle.
  • FIG. 3 is a diagram showing an example of a schematic configuration of the HCU.
  • FIG. 4 is a diagram that visualizes and shows an example of a display layout simulation performed by the display generation unit.
  • FIG. 5 is a diagram showing an example of a guidance display.
  • FIG. 6 is a diagram showing an example of a guidance display.
  • FIG. 7 is a diagram showing an example of a guidance display.
  • FIG. 1 is a diagram showing an overall image of an in-vehicle network including an HCU according to the first embodiment of the present disclosure.
  • FIG. 2 is a diagram showing an example of a head-up display mounted on a vehicle.
  • FIG. 3 is a diagram showing an example of a schematic configuration of the HCU.
  • FIG. 4 is
  • FIG. 8 is a flowchart showing the display control method of the first embodiment.
  • FIG. 9 is a diagram showing an example of the guidance display of the second embodiment.
  • FIG. 10 is a diagram showing an example of a guidance display according to the third embodiment.
  • FIG. 11 is a diagram showing an example of the guidance display of the fourth embodiment.
  • FIG. 12 is a diagram that visualizes and shows an example of a display layout simulation performed by the display generation unit of the fifth embodiment.
  • FIG. 13 is a diagram showing an example of the guidance display of the fifth embodiment.
  • FIG. 14 is a diagram that visualizes and shows an example of a display layout simulation performed by the display generation unit of another embodiment.
  • FIG. 15 is a diagram showing an example of a guidance display of another embodiment.
  • the function of the display control device according to the first embodiment of the present disclosure is realized by the HCU (Human Machine Interface Control Unit) 100 shown in FIGS. 1 and 2.
  • the HCU 100 comprises an HMI (Human Machine Interface) system 10 used in the vehicle A together with a head-up display (hereinafter, “HUD”) 20 and the like.
  • the HMI system 10 further includes an operation device 26, a DSM (Drive Status Monitor) 27, and the like.
  • the HMI system 10 has an input interface function for accepting user operations by an occupant (for example, a driver) of the vehicle A, and an output interface function for presenting information to the driver.
  • the HMI system 10 is communicably connected to the communication bus 99 of the vehicle-mounted network 1 mounted on the vehicle A.
  • the HMI system 10 is one of a plurality of nodes provided in the vehicle-mounted network 1.
  • a peripheral monitoring sensor 30, a locator 40, a DCM49, a driving support ECU (Electronic Control Unit) 50, a navigation device 60, and the like are connected to the communication bus 99 of the vehicle-mounted network 1 as nodes. These nodes connected to the communication bus 99 can communicate with each other.
  • the peripheral monitoring sensor 30 is an autonomous sensor that monitors the surrounding environment of the vehicle A. From the detection range around the own vehicle, the peripheral monitoring sensor 30 includes moving objects such as pedestrians, cyclists, non-human animals, and other vehicles, as well as falling objects, guardrails, curbs, road markings, traveling lane markings, and the like. It is possible to detect road markings and stationary objects such as roadside structures.
  • the peripheral monitoring sensor 30 provides the detection information of detecting an object around the vehicle A to the driving support ECU 50 and the like through the communication bus 99.
  • the peripheral monitoring sensor 30 has a front camera 31 and a millimeter wave radar 32 as a detection configuration for object detection.
  • the front camera 31 outputs at least one of the imaging data obtained by photographing the front range of the vehicle A and the analysis result of the imaging data as detection information.
  • a plurality of millimeter-wave radars 32 are arranged, for example, on the front and rear bumpers of the vehicle A at intervals from each other.
  • the millimeter wave radar 32 irradiates the millimeter wave or the quasi-millimeter wave toward the front range, the front side range, the rear range, the rear side range, and the like of the vehicle A.
  • the millimeter wave radar 32 generates detection information by a process of receiving reflected waves reflected by a moving object, a stationary object, or the like.
  • the peripheral monitoring sensor 30 may include detection configurations such as a rider and sonar.
  • the locator 40 generates highly accurate position information of vehicle A and the like by compound positioning that combines a plurality of acquired information.
  • the locator 40 can specify, for example, the lane in which the vehicle A travels among a plurality of lanes.
  • the locator 40 includes a GNSS (Global Navigation Satellite System) receiver 41, an inertial sensor 42, a high-precision map database (hereinafter, “high-precision map DB”) 43, and a locator ECU 44.
  • GNSS Global Navigation Satellite System
  • the GNSS receiver 41 receives positioning signals transmitted from a plurality of artificial satellites (positioning satellites).
  • the GNSS receiver 41 can receive a positioning signal from each positioning satellite of at least one satellite positioning system among satellite positioning systems such as GPS, GLONASS, Galileo, IRNSS, QZSS, and Beidou.
  • the inertial sensor 42 has, for example, a gyro sensor and an acceleration sensor.
  • the high-precision map DB 43 is mainly composed of a non-volatile memory, and stores map data with higher accuracy than that used for normal navigation (hereinafter, “high-precision map data”).
  • the high-precision map data holds detailed information at least for information in the height (z) direction.
  • High-precision map data includes information that can be used for advanced driving support and autonomous driving, such as three-dimensional shape information of roads (road structure information), number of lanes, and information indicating the direction of travel allowed for each lane. ing.
  • the locator ECU 44 has a configuration mainly including a microcomputer provided with a processor, a RAM, a storage unit, an input / output interface, a bus connecting these, and the like.
  • the locator ECU 44 combines the positioning signal received by the GNSS receiver 41, the measurement result of the inertial sensor 42, the vehicle speed information output to the communication bus 99, and the like, and sequentially positions the own vehicle position and the traveling direction of the vehicle A.
  • the locator ECU 44 provides the position information and the direction information of the vehicle A based on the positioning result to the HCU 100, the driving support ECU 50, and the like through the communication bus 99.
  • the vehicle speed information is information indicating the current traveling speed of the vehicle A, and is generated based on the detection signal of the wheel speed sensor provided in the hub portion of each wheel of the vehicle A.
  • the node (ECU) that generates vehicle speed information and outputs it to the communication bus 99 may be appropriately changed.
  • a brake control ECU that controls the distribution of braking force for each wheel, or an in-vehicle ECU such as the HCU100, is electrically connected to the wheel speed sensor of each wheel to generate vehicle speed information and output to the communication bus 99.
  • the locator ECU 44 determines whether or not the required high-precision map data is in the high-precision map DB 43 in response to a request from the HCU 100, the driving support ECU 50, and the like. When the requested high-precision map data is in the high-precision map DB 43, the locator ECU 44 reads the corresponding high-precision map data from the high-precision map DB 43 and provides it to the request source ECU.
  • the DCM (Data Communication Module) 49 is a communication module mounted on the vehicle A.
  • the DCM49 transmits and receives radio waves to and from base stations around the vehicle A by wireless communication in accordance with communication standards such as LTE (Long Term Evolution) and 5G.
  • LTE Long Term Evolution
  • the operation support ECU 50 has a configuration mainly including a computer including a processor, a RAM, a storage unit, an input / output interface, and a bus connecting these.
  • the driving support ECU 50 has a driving support function that supports the driving operation of the driver. As an example, at the automatic driving level specified by the American Society of Automotive Engineers of Japan, the driving support ECU 50 enables partially automatic driving control (advanced driving support) of level 2 or lower.
  • the driving support ECU 50 recognizes the driving environment around the vehicle A based on the detection information acquired from the peripheral monitoring sensor 30.
  • the driving support ECU 50 provides the HCU 100 with the analysis result of the detection information carried out for recognizing the driving environment as the analyzed detection information.
  • the driving support ECU 50 can provide the HCU 100 with the relative positions of the left and right lane markings or road edges of the lane in which the vehicle A is currently traveling (hereinafter, "own lane Lns", see FIG. 4).
  • the left-right direction is a direction that coincides with the width direction of the vehicle A stationary on the horizontal plane, and is set with reference to the traveling direction of the vehicle A.
  • the driving support ECU 50 can exert a plurality of functions for realizing advanced driving support by executing the program stored in the storage unit by the processor.
  • the driving support ECU 50 has an ACC (Adaptive Cruise Control) control unit and an LTC control unit.
  • the ACC control unit is a functional unit that realizes the functions of the ACC.
  • the ACC control unit causes the vehicle A to travel at a constant speed at the target vehicle speed, or causes the vehicle A to follow the vehicle A while maintaining the inter-vehicle distance from the vehicle in front.
  • the LTC control unit is a functional unit that realizes the function of the LTC (Lane Trace Control).
  • the LTC control unit causes the vehicle A to travel in the own lane in cooperation with the ACC control unit according to the planned traveling line generated along the running own lane Lns.
  • the navigation device 60 searches for a route to the set destination and guides the traveling along the searched route.
  • the navigation device 60 includes a navigation map database (hereinafter, navigation map DB) 61 and a navigation ECU 62.
  • the navigation ECU 62 is mainly composed of a microcomputer provided with a processor, RAM, a storage unit, an input / output interface, a bus connecting these, and the like.
  • the navigation ECU 62 acquires the position information and the direction information of the vehicle A (own vehicle) from the locator ECU 44 through the communication bus 99.
  • the navigation ECU 62 acquires the operation information input to the operation device 26 through the communication bus 99 and the HCU 100, and sets the destination based on the driver operation.
  • the navigation ECU 62 searches for a plurality of routes to the destination so as to satisfy conditions such as time priority and distance priority. When one of the plurality of searched routes is selected, the navigation ECU 62 provides the route information based on the set route to the HCU 100 through the communication bus 99 together with the related navigation map data.
  • the navigation ECU 62 sequentially outputs a guidance implementation request toward the HCU 100.
  • the guide point GP is set near the center of each of the intersection section and the branchable section as an example.
  • the guide point GP may be set on the front side or the back side of each of the intersection section and the branchable section.
  • the guide point GP is an example of a specific point.
  • the guidance implementation request is guidance information used for route guidance to the driver, and specifically includes information on the position of the guidance point GP and information indicating the direction in which the vehicle A should proceed at the guidance point GP. ..
  • the guidance implementation request is output when the remaining distance Lr (see FIG. 4) from the vehicle A to the guidance point GP becomes less than the first threshold value (for example, about 300 m).
  • the HCU 100 presents information related to route guidance based on the acquisition of the guidance implementation request from the navigation ECU 62.
  • the operation device 26 is an input unit that accepts user operations by a driver or the like.
  • a user operation for switching between starting and stopping is input to the operation device 26, for example, for a driving support function and an automatic driving function.
  • the operation device 26 includes a steering switch provided on the spoke portion of the steering wheel, an operation lever provided on the steering column portion 8, a voice input device for detecting the driver's utterance, and the like.
  • the DSM27 has a configuration including a near-infrared light source, a near-infrared camera, and a control unit for controlling them.
  • the DSM 27 is installed in a posture in which the near-infrared camera is directed toward the headrest portion of the driver's seat, for example, on the upper surface of the steering column portion 8 or the upper surface of the instrument panel 9.
  • the DSM27 uses a near-infrared camera to photograph the head of the driver irradiated with near-infrared light by a near-infrared light source.
  • the image captured by the near-infrared camera is image-analyzed by the control unit.
  • the control unit extracts information such as the position of the eye point EP and the line-of-sight direction from the captured image, and sequentially outputs the extracted state information to the HCU 100.
  • the HUD 20 is mounted on the vehicle A as one of a plurality of in-vehicle display devices together with a meter display, a center information display, and the like.
  • the HUD 20 is electrically connected to the HCU 100 and sequentially acquires video data generated by the HCU 100. Based on the video data, the HUD 20 presents various information related to the vehicle A, such as route information, sign information, and control information of each vehicle-mounted function, to the driver using the virtual image Vi.
  • the HUD 20 is housed in the storage space inside the instrument panel 9 below the windshield WS.
  • the HUD 20 projects the light formed as a virtual image Vi toward the projection range PA of the windshield WS.
  • the light projected on the windshield WS is reflected toward the driver's seat side in the projection range PA and is perceived by the driver.
  • the driver visually recognizes the display in which the virtual image Vi is superimposed on the foreground seen through the projection range PA.
  • the HUD 20 includes a projector 21 and a magnifying optical system 22.
  • the projector 21 has an LCD (Liquid Crystal Display) panel and a backlight.
  • the projector 21 is fixed to the housing of the HUD 20 with the display surface of the LCD panel facing the magnifying optical system 22.
  • the projector 21 displays each frame image of video data on the display surface of the LCD panel, and transmits and illuminates the display surface with a backlight to emit light formed as a virtual image Vi toward the magnifying optical system 22.
  • the magnifying optical system 22 is configured to include at least one concave mirror in which a metal such as aluminum is vapor-deposited on the surface of a base material made of synthetic resin or glass.
  • the magnifying optical system 22 projects the light emitted from the projector 21 onto the upper projection range PA while spreading it by reflection.
  • the angle of view VA is set for the above HUD20. Assuming that the virtual range in the space where the virtual image Vi can be imaged by the HUD 20 is the image plane IS, the angle of view VA is defined based on the virtual line connecting the driver's eye point EP and the outer edge of the image plane IS. The viewing angle.
  • the angle of view VA is an angle range in which the driver can visually recognize the virtual image Vi when viewed from the eye point EP. In HUD20, the horizontal angle of view in the horizontal direction is larger than the vertical angle of view in the vertical direction. When viewed from the eye point EP, the front range that overlaps with the image plane IS is the range within the angle of view VA.
  • the HUD 20 displays superimposed content CTs (see FIG. 6 and the like) and non-superimposed content as virtual image Vi.
  • Superimposed content CTs are AR display objects used for augmented reality (hereinafter referred to as “AR”) display.
  • the display position of the superimposed content CTs is associated with a specific superimposed object existing in the foreground, such as a specific position on the road surface, a vehicle in front, a pedestrian, and a road sign.
  • the superimposed content CTs are superimposed and displayed on a specific superimposed object in the foreground, and can be moved in the appearance of the driver following the superimposed object so as to be relatively fixed to the superimposed object.
  • the shape of the superimposed content CTs may be continuously updated at a predetermined cycle according to the relative position and shape of the superimposed object.
  • the superimposed content CTs are displayed in a posture closer to horizontal than the non-superimposed content, and have a display shape extending in the depth direction (traveling direction) as seen from the driver, for example.
  • the non-superimposed content is a non-AR display object excluding the superimposed content CTs among the display objects superimposed and displayed in the foreground. Unlike the superimposed content CTs, the non-superimposed content is displayed superimposed on the foreground without specifying the superimposed target.
  • the non-superimposed content is displayed at a fixed position in the projection range PA, so that it is displayed as if it is relatively fixed to the vehicle configuration such as the windshield WS.
  • the HCU 100 is an electronic control device that integrally controls the display by a plurality of in-vehicle display devices including the HUD 20 in the HMI system 10.
  • the HCU 100 mainly includes a computer including a processing unit 11, a RAM 12, a storage unit 13, an input / output interface 14, and a bus connecting them.
  • the processing unit 11 is hardware for arithmetic processing combined with the RAM 12.
  • the processing unit 11 has a configuration including at least one arithmetic core such as a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit).
  • the processing unit 11 may be configured to further include an FPGA (Field-Programmable Gate Array) and an IP core having other dedicated functions.
  • the RAM 12 may be configured to include a video RAM for video generation.
  • the processing unit 11 executes various processes for realizing the functions of the functional units described later.
  • the storage unit 13 is configured to include a non-volatile storage medium.
  • Various programs (display control programs, etc.) executed by the processing unit 11 are stored in the storage unit 13.
  • the HCU 100 shown in FIGS. 1 to 3 has a plurality of functional units for controlling the superimposed display of the content by the HUD 20 by executing the display control program stored in the storage unit 13 by the processing unit 11.
  • the HCU 100 is constructed with functional units such as a viewpoint position specifying unit 71, a locator information acquisition unit 72, a guidance information acquisition unit 73, a virtual layout unit 75, and a display generation unit 76.
  • the viewpoint position specifying unit 71 identifies the position of the eye point EP of the driver seated in the driver's seat based on the state information acquired from the DSM 27.
  • the viewpoint position specifying unit 71 generates three-dimensional coordinates (hereinafter, “eye point coordinates”) indicating the position of the eye point EP, and sequentially provides the generated eye point coordinates to the virtual layout unit 75.
  • the locator information acquisition unit 72 acquires the latest position information and direction information about the vehicle A from the locator ECU 44 as own vehicle position information. In addition, the locator information acquisition unit 72 acquires high-precision map data of the peripheral range of the vehicle A from the locator ECU 44. The locator information acquisition unit 72 sequentially provides the acquired vehicle position information and high-precision map data to the virtual layout unit 75.
  • the external world information acquisition unit 74 acquires detection information about the peripheral range of the vehicle A, particularly the front range, from the driving support ECU 50. Specifically, the outside world information acquisition unit 74 acquires detection information indicating the relative positions of the left and right lane markings or road edges of the own lane Lns. The external world information acquisition unit 74 sequentially provides the acquired detection information to the virtual layout unit 75. The external world information acquisition unit 74 may acquire the imaging data of the front camera 31 as the detection information instead of the detection information as the analysis result acquired from the driving support ECU 50.
  • the virtual layout unit 75 has a function of selecting contents to be used for information presentation based on various acquired information and a function of simulating the display layout of superimposed contents CTs (see FIG. 6 and the like).
  • the virtual layout unit 75 selects the content to be used for route guidance at the guidance point GP when the guidance implementation request is acquired from the navigation device 60. Specifically, content that guides a right or left turn at a branch point such as an intersection, content that guides a straight ahead of a predetermined distance, content that guides a lane change, and the like are appropriately selected.
  • the virtual layout unit 75 executes a virtual layout function that simulates the display layout of the superimposed content CTs based on various provided information.
  • the virtual layout unit 75 reproduces the current traveling environment of the vehicle A in the virtual space based on the own vehicle position information, high-precision map data, detection information, and the like.
  • the display generation unit 76 sets the own vehicle object AO at the reference position in the virtual three-dimensional space.
  • the display generation unit 76 maps the road model of the shape indicated by the high-precision map data to the three-dimensional space in association with the own vehicle object AO based on the own vehicle position information.
  • the display generation unit 76 sets a planned travel route based on the guidance information on the road model.
  • the display generation unit 76 sets the virtual camera position CP and the superimposition range SA in association with the own vehicle object AO.
  • the virtual camera position CP is a virtual position corresponding to the driver's eye point EP.
  • the display generation unit 76 sequentially corrects the virtual camera position CP with respect to the own vehicle object AO based on the latest eye point coordinates acquired by the viewpoint position specifying unit 71.
  • the superimposition range SA is a range in which the virtual image Vi can be superposed and displayed. When the display generation unit 76 looks forward from the virtual camera position CP based on the virtual camera position CP and the outer edge position (coordinates) information of the projection range PA stored in advance in the storage unit 13 (see FIG. 1) or the like.
  • the front range inside the projection range PA is set as the superimposition range SA.
  • the superimposition range SA corresponds to the angle of view VA of HUD20.
  • the virtual layout unit 75 arranges the first virtual object V1 and the second virtual object V2 in the virtual space.
  • the first virtual object V1 is arranged so as to overlap the planned travel route arranged on the road surface of the road model in the three-dimensional space.
  • the first virtual object V1 is set in the virtual space when the path content CTr described later is displayed as a virtual image.
  • the first virtual object V1 is a strip-shaped object arranged so as to cover the virtual road surface of the planned travel route in a plane.
  • the first virtual object V1 is arranged in a traveling section including at least the guide point GP.
  • the first virtual object V1 has a curved shape connecting the approach lane and the exit lane as shown in FIG. 4 in the right / left turn scene at the intersection.
  • the first virtual object V1 defines the position and shape of the route content CTr. That is, the shape of the first virtual object V1 seen from the virtual camera position CP becomes the virtual image shape of the path content CTr visually recognized from the eye point EP.
  • the virtual layout unit 75 sets the visible in-visible area Av visible to the driver and the invisible non-visible area Ai in the virtual space on the road surface in the foreground. Estimate based on virtual camera position CP and road structure model.
  • the virtual layout unit 75 estimates the visible area Av and the non-visible area Ai with respect to the range in which at least the first virtual object V1 is arranged on the virtual road surface. For example, as shown in FIG. 4, the virtual layout unit 75 sets the virtual road surface intersecting the straight line extended from the virtual camera position CP in the superimposition range SA as the visible area Av, and within the range in which the first virtual object V1 is arranged.
  • the virtual road surface that does not intersect the straight line is defined as the non-visual area Ai.
  • the virtual layout unit 75 estimates the visible object portion and the invisible object portion from the virtual camera position CP in the first virtual object V1 arranged on the virtual road surface, so that each area Av, Ai May be configured to indirectly estimate.
  • the virtual layout unit 75 estimates that the virtual road surface of the uphill road is the visible area Av and the virtual road surface of the flat road is the non-visual area Ai.
  • the virtual road surface ahead of the uphill road in front can be visually recognized. It can be the outer area Ai.
  • the virtual layout unit 75 is an example of an estimation unit.
  • the second virtual object V2 is set in the virtual space when the non-visual information content CTi, which will be described later, is displayed as a virtual image. More specifically, the second virtual object V2 is arranged when the guide point GP is included in the invisible non-visible area Ai from the virtual camera position CP.
  • the second virtual object V2 is a plane-shaped object that floats on the virtual road surface.
  • the second virtual object V2 is arranged with the plane of the plane shape facing the own vehicle object side.
  • the second virtual object V2 is arranged above the guide point GP set on the virtual road surface. More specifically, the second virtual object V2 sets the position (x, y) on the two-dimensional coordinates parallel to the horizontal plane in the virtual space to be the same as the position on the two-dimensional coordinates of the guide point GP.
  • the position of the second virtual object V2 in the height (z) direction is a height position where the entire second virtual object V2 can be visually recognized from the virtual camera position CP. That is, the lower edge of the second virtual object V2 is positioned above the straight line connecting the virtual camera position CP and the top of the road surface.
  • the upper edge of the second virtual object V2 is positioned below the upper edge of the superposition range SA. When the second virtual object V2 protrudes above the upper edge of the superposition range SA with a preset initial size, the size in the vertical direction is set to be smaller than the upper edge of the superimposition range SA. Adjusted to fit below.
  • the virtual layout unit 75 estimates the position of the visible point VP at which the guide point GP can be visually recognized from the driver. Based on the driver's field of view range set in advance, the virtual layout unit 75 estimates that the point where the guide point GP enters the field of view range when viewed from the virtual camera position CP is the visible point VP.
  • the visible point VP is a point where the guide point GP can be kept visible between the time of passing and the time of entering the guide point GP.
  • the virtual layout unit 75 does not presume that the point where the guide point GP becomes invisible again after passing due to the road structure or the like is the visible point VP.
  • the virtual layout unit 75 may be configured to consider that the guide point GP is maintained in a visible state when the distance of the section in which the guide point GP cannot be seen again is less than the threshold value.
  • the virtual layout unit 75 may simply estimate the visible point VP based on the road structure.
  • the visible point VP is a point in the section from the vehicle A to the guide point GP where the amount of change in the gradient is equal to or greater than a predetermined amount.
  • a point where the magnitude of the gradient is equal to or less than a predetermined value may be regarded as a visible point VP.
  • the highest altitude point in the section from the vehicle A to the guide point GP may be regarded as the visible point VP.
  • the display generation unit 76 controls the presentation of information to the driver by the HUD 20 by a process of generating video data that is sequentially output to the HUD 20.
  • the display generation unit 76 is an example of a display control unit.
  • the display generation unit 76 has a function of drawing the content and a function of controlling the display period of the content based on various acquired information.
  • the display generation unit 76 determines the original image to be drawn in each frame image constituting the video data based on the selection result of the content acquired from the virtual layout unit 75.
  • the display generation unit 76 draws the drawing position and drawing shape of the original image in the frame image according to the eye point EP and each position of the overlay target. To correct.
  • the superimposed content CTs are displayed at the position and shape correctly superimposed on the superimposed object when viewed from the eye point EP.
  • the display generation unit 76 selects the content to be drawn on the video data based on the content selection result of the virtual layout unit 75 and the layout information as the simulation result using the virtual space. As an example, the display generation unit 76 draws the route content CTr (see FIGS. 5 to 7) and the non-visual information content CTi (see FIG. 6), which are contents related to the route guidance processing, and presents them to the driver.
  • Route content CTr is content used to display the planned travel route of vehicle A.
  • the route content CTr is the superimposed content CTs for which the road surface of the planned travel route is superimposed, and the drawing shape is determined based on the first virtual object V1 arranged in the display simulation.
  • the route content CTr is drawn in a shape along the planned travel route, and indicates the lane in which vehicle A should travel, the point where right / left turn and lane change are required, and the like.
  • the route content CTr is a drawing shape that imitates the shape of the lane of the planned travel route, and is a seat shape that extends in a strip shape along the traveling direction of the vehicle A.
  • the route content CTr has a linear shape
  • the route content CTr has a mode that connects the approach lane and the exit lane on the planned travel route within the intersection.
  • the route content CTr updates the drawing shape at a predetermined update cycle so as to match the road surface shape seen from the eye point EP according to the traveling of the vehicle A.
  • the display generation unit 76 stops the superimposed display of the route content CTr on the non-visible area Ai when the guide point GP is included in the non-visible area Ai. That is, the display generation unit 76 superimposes the route content CTr only on the visible area Av, and does not present information on the non-visual area Ai by the route content CTr. Based on the result of the display simulation, the display generation unit 76 generates only the content portion corresponding to the object portion arranged in the visible area Av of the first virtual object V1 as the route content CTr.
  • the non-visible information content CTi is a content that presents information about the non-visible area Ai, particularly the guide point GP, to the driver in a content mode different from the route content CTr.
  • the non-visual information content CTi is superimposed content CTs that superimpose the space on the road surface of the planned travel route, and the drawing shape and drawing position are determined based on the second virtual object V2 arranged in the display simulation. ..
  • the non-visual information content CTi is imaged at a position on the image plane IS where the virtual lines connecting the virtual camera position CP and each point of the second virtual object V2 intersect.
  • the non-visual information content CTi is drawn at the display position associated with the position of the guide point GP, which is a point on the planned travel route.
  • the non-visible information content CTi is generated when the guide point GP is in the non-visible area Ai and the distance from the visible point VP to the guide point GP is less than the threshold value.
  • the non-visual information content CTi presents the direction in which the vehicle A should travel at the guidance point GP as information regarding the guidance point GP.
  • the non-visual information content CTi is a content in which an arrow (an arrow curved in the left turn direction) that simply indicates the shape of the traveling path near the guide point GP is drawn on the surface of the rectangular object. It is drawn.
  • the non-visual information content CTi is drawn at a display height away from the road surface in the visible area Av, and is displayed at a display position that does not overlap with the route content CTr.
  • the non-visual information content CTi is displayed above the guide point GP as if it were floating from the road surface at a height visible to the driver.
  • the non-visual information content CTi is updated in drawing shape and drawing position at a predetermined update cycle so that it stays in the space position above the guide point GP seen from the eye point EP and is displayed according to the traveling of the vehicle A. To.
  • the display generation unit 76 changes the display state of the above-mentioned route content CTr and non-visual information content CTi according to the remaining distance Lr to the guide point GP of the vehicle A. This change in the display state will be described below with reference to FIGS. 4 to 7.
  • the display generation unit 76 displays only the route content CTr prior to the non-visual information content CTi in the traveling section where the remaining distance Lr to the guide point GP is less than the first threshold value and the second threshold value (for example, about 100 m) or more (for example, about 100 m). (See FIG. 5).
  • the display generation unit 76 hides the non-visual information content CTi even when the guide point GP is included in the non-visual area Ai. As a result, the display generation unit 76 presents only the planned travel route on the road surface visible to the driver to the driver at the stage relatively far from the guide point GP.
  • the display generation unit 76 displays both the route content CTr and the non-visual information content CTi (see FIG. 6). As a result, the display generation unit 76 presents the information of the guide point GP, which cannot be seen by the driver, to the driver at the stage when the guide point GP is relatively close to the guide point GP.
  • the non-visual information content CTi indicates that a left turn is required beyond the visible area Av.
  • the display generation unit 76 hides the non-visual information content CTi when the guide point GP becomes visible as the vehicle A travels. Then, the display generation unit 76 presents the planned travel route at the guide point GP that is included in the visible area Av by generating the route content CTr superimposed on the guide point GP (see FIG. 7). .. For example, when the vehicle A moves from an uphill road to a flat road, the guide point GP becomes visible. The display generation unit 76 determines that the vehicle A has become visible when the vehicle A reaches the visible point VP.
  • the display control process shown in FIG. 8 is started by the HCU 100 that has completed the start-up process or the like, for example, by switching the vehicle power supply to the on state.
  • the HCU 100 determines in S10 whether or not the destination is set based on the information from the navigation ECU 62. If it is determined that the destination has not been set, the determination in S10 is repeated until the destination is set. If it is determined that the destination has been set, the process proceeds to S20.
  • S20 it is determined whether or not there is a guidance implementation request from the navigation ECU 62. In other words, it is determined whether or not the remaining distance Lr from the vehicle A to the guide point GP is less than the first threshold value. If it is determined that there is no guidance implementation request, the determination in S20 is repeated until the guidance implementation request is obtained. On the other hand, if it is determined that there is a guidance implementation request, the process proceeds to S30.
  • the display layout is simulated to estimate the visible area Av and the non-visible area Ai of the road surface.
  • the process proceeds to S40, and the route content CTr is superimposed and displayed only on the visible area Av. That is, the superimposition of the route content CTr on the non-visual area Ai is interrupted.
  • the process proceeds to S50.
  • S50 it is determined whether or not the remaining distance Lr from the vehicle A to the guide point GP is less than the second threshold value based on the own vehicle position information from the locator ECU 44 and the position information of the guide point GP from the navigation ECU 62. While it is determined that the remaining distance Lr is equal to or higher than the second threshold value, the processes of S30 and S40 are repeated, and the drawing shape of the route content CTr is updated according to the change of each area Av and Ai accompanying the running. .. On the other hand, if it is determined that the remaining distance Lr is less than the second threshold value, the process proceeds to S60.
  • S60 the estimation of each area Av and Ai is performed again, and the process proceeds to S70.
  • S70 it is determined whether or not the guide point GP is included in the visible area Av based on the respective areas Av and Ai estimated in S60 and the position information of the guide point GP.
  • the process proceeds to S80, and the route content CTr is superimposed and displayed on the visible area Av in the same manner as S40, and the process proceeds to S110.
  • the process proceeds to S90.
  • S90 it is determined whether or not the distance from the guide point GP to the visible point VP is less than the threshold value. If it is determined that the threshold value is equal to or higher than the threshold value, the process proceeds to S80. That is, when the visible point VP is relatively far from the guide point GP, the display of the non-visible information content CTi is stopped. On the other hand, if it is determined that the distance from the guide point GP to the visible point VP is less than the threshold value, the process proceeds to S100.
  • S110 it is determined whether or not the end condition of the route guidance display is satisfied. It is determined that the end condition is satisfied based on, for example, the passage of the guide point GP or the passage of the guide end point set ahead of the guide point GP in the traveling direction. While it is determined that the end condition is not satisfied, the processes of S60 to S100 are repeated to update the drawing shape and display state of the superimposed content CTs (route content CTr and non-visual information content CTi) related to the route guidance. I will do it. On the other hand, when it is determined that the end condition is satisfied, the process proceeds to S120, the superimposed content CTs related to the route guidance are hidden, and the series of processes is ended.
  • the process proceeds to S120, the superimposed content CTs related to the route guidance are hidden, and the series of processes is ended.
  • the display generation unit 76 of the HCU 100 stops the superimposed display of the route content CTr on the non-visible area Ai.
  • the display generation unit 76 superimposes and displays the non-visual information content CTi on the display position associated with the guide point GP at the display height displayed above the visible area Av.
  • the guidance point GP when the guidance point GP is included in the non-visible area Ai, the superimposed display of the route content CTr on the non-visible area Ai is stopped, and the non-visible information content CTi is positioned above the visible area Av. Is superimposed and displayed. Therefore, the driver who is a occupant can recognize the information about the guide point GP separately from the route content CTr superimposed on the visible area Av. Then, since the non-visual information content CTi is superimposed and displayed on the display position associated with the guide point GP which is a predetermined position on the scheduled travel route, the occupant recognizes that the information on the scheduled travel route is presented. Easy to do.
  • the HCU 100 and the display control program capable of displaying the driver in an easy-to-understand manner. Moreover, since the information of the guide point GP located in the non-visible area Ai can be presented to the driver in advance by the non-visible information content CTi, the HCU 100 can be displayed with high convenience.
  • the display generation unit 76 displays the non-visual information content CTi when the distance from the visible point VP to the guide point GP is less than the threshold value. Therefore, the display generation unit 76 can surely present the information of the guide point GP in advance under the situation that the time from when the guide point GP becomes visible to the time when the guide point GP is reached is relatively short. Therefore, the display generation unit 76 can give a sense of security to the driver.
  • the display generation unit 76 stops the display of the non-visible information content CTi. According to this, the display generation unit 76 can avoid the display of the non-visual information content CTi in a situation where the need to present the information of the guide point GP in advance is relatively small. Therefore, the display generation unit 76 can prevent the inside of the angle of view VA from becoming complicated by the displayed object.
  • the display generation unit 76 displays the entire non-visual information content CTi at a display position above the route content CTr superimposed on the visible area Av and not overlapping the route content CTr. According to this, since the non-visual information content CTi and the route content CTr are displayed apart from each other, the display generation unit 76 can provide a display that is easier to see. In particular, since the non-visual information content CTi of the first embodiment is displayed directly above the upper edge of the route content CTr, it is easy to understand that the information on the route continuous with the route content CTr is presented.
  • the display generation unit 76 superimposes and displays the non-visual information content CTi on the display position associated with the position of the guide point GP. According to this, it is possible to more clearly present that the non-visual information content CTi is a display related to the guide point GP.
  • the display generation unit 76 hides the non-visual information content CTi when the driver can visually recognize the guide point GP. According to this, the display generation unit 76 hides the non-visual information content CTi when it is no longer needed, so that it is possible to prevent the inside of the angle of view VA from becoming complicated by the displayed object.
  • the display generation unit 76 displays the route content CTr prior to the non-visual information content CTi. According to this, the display generation unit 76 can display the non-visual information content CTi, which is displayed on the side farther from the vehicle A, behind the route content CTr. Therefore, it is possible to avoid that the non-visual information content CTi is displayed at a stage where it is relatively far from the non-visual area Ai and the necessity is small, and the inside of the angle of view VA becomes complicated.
  • the display generation unit 76 of the second embodiment implements an animation display of the non-visual information content CTi.
  • the non-visual information content CTi is a content having a linear arrow shape pointing to the left direction, which is the planned traveling direction at the guide point GP (see FIG. 9).
  • the non-visual information content CTi is animated and displayed so as to move in the traveling direction at the guidance point GP.
  • the non-visual information content CTi is drawn so as to continuously and smoothly move to the left from the movement start position indicated by the dotted line.
  • the non-visual information content CTi disappears and reappears at the movement start position, or moves so as to return to the movement start position faster than the movement to the left, and then moves to the left again.
  • Animated to move is
  • the non-visual information content CTi has the movement start position as the upper position of the guide point GP, and is displayed so as to move from this position as the starting point.
  • the non-visual information content CTi may have the movement end position as a position above the guide point GP, or may be displayed so as to pass above the guide point GP between the movement start position and the movement end position. Good.
  • the display generation unit 76 of the second embodiment animates the non-visual information content CTi so as to move toward the scheduled direction of travel at the guidance point GP, the guidance information is displayed using the movement of the non-visual information content CTi. Can be presented to the driver. Therefore, the display generation unit 76 can present information in a more intuitive and easy-to-understand manner.
  • the non-visual information content CTi presents the road shape of the guidance point GP as guidance information.
  • the non-visual information content CTi is content that schematically illustrates a plan view from the sky of an intersection where the guide point GP is set.
  • the non-visual information content CTi presents a warning as guidance information that the road surface including the guidance point GP cannot be seen by the driver.
  • the non-visual information content CTi is drawn as content in which an exclamation mark is drawn on the surface of an object having a circular shape.
  • the virtual layout unit 75 arranges the second virtual object V2 having a shape that follows the planned travel route in the same manner as the first virtual object V1 (see FIG. 12).
  • the second virtual object V2 is a band-shaped object that floats above the non-visible area Ai.
  • the tip of the second virtual object V2 has an arrow shape that fits within the superposition range SA.
  • the second virtual object V2 is arranged in a posture in which a strip-shaped object arranged so as to cover the virtual road surface of the planned travel route in the non-visible area Ai in a plane is lifted from the virtual camera position CP to a visible position. ..
  • the second virtual object V2 is arranged so that the entire second virtual object V2 fits in the superposition range SA.
  • the second virtual object V2 has a shape that is continuous from the portion arranged in the visible area Av of the first virtual object V1 and is extended with the same gradient. If the second virtual object V2 is arranged in the above posture and shape and extends beyond the superimposition range SA, the second virtual object V2 is arranged in a posture that fits in the superimposition range SA or is deformed into a shape that fits in the superimposition range SA.
  • the display generation unit 76 draws the non-visual information content CTi as superposed content CTs that superimpose the space above the road surface of the planned travel route in the non-visible area Ai and visible to the driver (see FIG. 13).
  • the non-visible information content CTi has a shape in which the route content CTr is extended in the air along the planned travel route of the non-visible area Ai.
  • the non-visual information content CTi is superimposed and displayed in association with the display position at the cut portion of the route content CTr, that is, the boundary point between the visible in-view area Av and the non-visual area Ai.
  • the non-visual information content CTi is different from the path content CTr in display modes such as brightness, transmittance, display color, and pattern. As a result, the non-visual information content CTi is visually distinguished from the route content CTr superimposed on the road surface of the visible area Av.
  • the non-visual information content CTi may have the same display mode as the route content CTr.
  • the HCU 100 superimposes and displays the route content CTr and the non-visual information content CTi that present the route to the destination set by the navigation device 60.
  • the route content CTr and the non-visual information content CTi that present the planned travel route of the vehicle A by the LTC or LCA may be displayed.
  • a point where a right or left turn or a lane change is made, a point where a plurality of roads such as an intersection are connected, and the like are set as specific points.
  • the HCU 100 displays the non-visual information content CTi as if it were floating above the guide point GP at a height that can be visually recognized by the driver.
  • the HCU 100 may display the non-visual information content CTi as if it were floating at a point on the front side of the guide point GP.
  • the HCU 100 may place the second virtual object V2 above the top point.
  • the non-visual information content CTi is drawn based on the second virtual object V2 arranged above the top point, it is larger than the case where it is superimposed above the guide point GP with respect to the same remaining distance Lr. Becomes larger.
  • the HCU 100 displays the entire non-visual information content CTi so as not to overlap the visible area Av above the visible area Av.
  • the HCU 100 may display a part of the non-visual information content CTi so as to overlap the visible area Av.
  • the non-visual information content CTi is displayed so as to partially overlap the path content CTr superimposed on the visible area Av.
  • the non-visual information content CTi is displayed as if it were floating at a point on the planned travel route in the visible area Av.
  • the display is such that a part of the non-visual information content CTi overlaps the visible area Av when it extends beyond the angle of view VA. Whether or not it protrudes from the angle of view VA may be determined by the display generation unit 76 based on the size of the width from the upper edge of the angle of view VA to the upper edge of the visible area Av.
  • the non-visible area Ai is the area of the road surface blocked by the uphill road
  • the non-visible area Ai is the area of the road surface blocked by the roadside structure on the curved road. You may.
  • the processing unit and processor of the above-described embodiment include one or more CPUs (Central Processing Units).
  • a processing unit and a processor may be a processing unit including a GPU (Graphics Processing Unit), a DFP (Data Flow Processor), and the like in addition to the CPU.
  • the processing unit and the processor may be a processing unit including an FPGA (Field-Programmable Gate Array) and an IP core specialized in specific processing such as learning and inference of AI.
  • Each arithmetic circuit unit of such a processor may be individually mounted on a printed circuit board, or may be mounted on an ASIC (Application Specific Integrated Circuit), an FPGA, or the like.
  • ASIC Application Specific Integrated Circuit
  • non-transitional substantive storage media such as a flash memory and a hard disk
  • the form of such a storage medium may also be changed as appropriate.
  • the storage medium may be in the form of a memory card or the like, and may be inserted into a slot portion provided in an in-vehicle ECU and electrically connected to a control circuit.
  • control unit and its method described in the present disclosure may be realized by a dedicated computer constituting a processor programmed to execute one or a plurality of functions embodied by a computer program.
  • the apparatus and method thereof described in the present disclosure may be realized by a dedicated hardware logic circuit.
  • the apparatus and method thereof described in the present disclosure may be realized by one or more dedicated computers configured by a combination of a processor that executes a computer program and one or more hardware logic circuits.
  • the computer program may be stored in a computer-readable non-transitional tangible recording medium as an instruction executed by the computer.
  • each section is expressed as, for example, S10. Further, each section can be divided into a plurality of subsections, while a plurality of sections can be combined into one section.
  • each section thus constructed can be referred to as a device, module, or means.

Abstract

According to the present invention, an in-view area (Av) visible to an occupant of a vehicle and an out-of-view area (Ai) invisible to the occupant in a road surface in a foreground are estimated by a display control device or a display control program that is used in a vehicle (A) and controls the superimposed display of contents by a head-up display (20)(S60). When a specific point (GP) is included in the out-of-view area, the superimposition display of, on the out-of-view area, route content (CTr) that is superimposed on the road surface and presents a planned route of the vehicle at the specific point is stopped, and out-of-view information content (CTi) that presents information related to the specific point is superimposed and displayed at a display position associated with a predetermined position on the planned route at a display height at which the out-of-view information content is at least partially displayed higher than the in-view area (S100).

Description

表示制御装置および表示制御プログラムDisplay control device and display control program 関連出願の相互参照Cross-reference of related applications
 本出願は、2019年6月5日に出願された日本国特許出願2019-105597号に基づくものであり、ここにその記載内容を参照により援用する。 This application is based on Japanese Patent Application No. 2019-105597 filed on June 5, 2019, and the description thereof is incorporated herein by reference.
 本開示は、虚像の表示を制御する表示制御装置および表示制御プログラムに関する。 The present disclosure relates to a display control device and a display control program that control the display of a virtual image.
 特許文献1には、ヘッドアップディスプレイによってコンテンツを重畳表示する車両用表示装置が提案されている。この車両用表示装置は、ドライバの前方視界に自車の走行位置から誘導地点までの経路を示すコンテンツを重畳表示させる。 Patent Document 1 proposes a display device for vehicles that superimposes and displays contents by a head-up display. This vehicle display device superimposes and displays the content indicating the route from the traveling position of the own vehicle to the guidance point in the front view of the driver.
WO 2015/118859 A1WO 2015/118859 A1
 特許文献1の技術では、前景中の乗員から見える領域にコンテンツを重畳表示させることが前提であると考えられる。しかし、道路構造等の周囲状況によっては、前景中のうちで乗員から視認可能な領域および視認不可能な領域の両方の情報をコンテンツにより提示する場合が起こり得る。このような状況においてもコンテンツを分かり易く表示することは、特許文献1には提案されていない。 It is considered that the technique of Patent Document 1 is premised on superimposing the content on the area visible to the occupant in the foreground. However, depending on the surrounding conditions such as the road structure, information on both the area visible to the occupant and the area invisible to the occupant in the foreground may be presented by the content. It is not proposed in Patent Document 1 to display the contents in an easy-to-understand manner even in such a situation.
 本開示の目的は、乗員に対して分かり易い表示が可能な表示制御装置および表示制御プログラムを提供することである。 An object of the present disclosure is to provide a display control device and a display control program capable of displaying in an easy-to-understand manner for occupants.
 本開示の一態様によると、表示制御装置は、車両において用いられ、ヘッドアップディスプレイによるコンテンツの重畳表示を制御する。表示制御装置は、前景中の路面のうち、車両の乗員から視認可能な視認内エリアと、乗員から視認不可能な視認外エリアとを推定する推定部と、特定地点での車両の進行予定経路を提示する経路コンテンツを路面に重畳表示させる表示制御部と、を備え、表示制御部は、特定地点が視認外エリアに含まれる場合には、視認外エリアへの経路コンテンツの重畳表示を停止し、特定地点に関する情報を提示する視認外情報コンテンツを、少なくとも一部が視認内エリアよりも上方に表示される表示高さで、進行予定経路上の所定位置に関連付けた表示位置に重畳表示させる。 According to one aspect of the present disclosure, the display control device is used in a vehicle and controls the superimposed display of contents by a head-up display. The display control device includes an estimation unit that estimates an invisible area that is visible to the occupants of the vehicle and an invisible area that is invisible to the occupants of the road surface in the foreground, and a planned travel route of the vehicle at a specific point. The display control unit is provided with a display control unit that superimposes and displays the route content on the road surface, and the display control unit stops the superimposition display of the route content on the non-visual area when a specific point is included in the non-visual area. , The non-visual information content that presents information about a specific point is superimposed and displayed on a display position associated with a predetermined position on the planned traveling route at a display height at least a part of which is displayed above the visible area.
 本開示の他の一態様によると、表示制御プログラムは、車両において用いられ、ヘッドアップディスプレイによるコンテンツの重畳表示を制御する。表示制御プログラムは、少なくとも1つの処理部に、前景中の路面のうち、車両の乗員から視認可能な視認内エリアと、乗員から視認不可能な視認外エリアとを推定し、特定地点が視認外エリアに含まれる場合には、路面に重畳されて特定地点での車両の進行予定経路を提示する経路コンテンツの視認外エリアへの重畳表示を停止し、特定地点に関する情報を提示する視認外情報コンテンツを、少なくとも一部が視認内エリアよりも上方に表示される表示高さで、進行予定経路上の所定位置に関連付けた表示位置に重畳表示させる、ことを含む処理を実行させる。 According to another aspect of the present disclosure, the display control program is used in the vehicle and controls the superimposed display of the content by the head-up display. The display control program estimates to at least one processing unit an invisible area visible to the occupants of the vehicle and an invisible area invisible to the occupants of the road surface in the foreground, and the specific point is not visible. When included in the area, the non-visual information content that is superimposed on the road surface and presents the planned route of the vehicle at a specific point, stops the superimposed display on the non-visible area, and presents information about the specific point. Is superimposed on the display position associated with the predetermined position on the scheduled travel path at the display height at which at least a part of the display is displayed above the visible area.
 本開示によれば、特定地点が視認外エリアに含まれる場合、経路コンテンツの視認外エリアへの重畳表示が停止され、視認外情報コンテンツが、少なくとも一部を視認内エリアよりも上方に位置付けられて重畳表示される。このため、乗員は、特定地点に関する情報を視認内エリアに重畳される経路コンテンツと区別して認識し得る。そして、視認外情報コンテンツは、進行予定経路上の所定位置に関連付けた表示位置に重畳表示されるので、進行予定経路上の情報を提示していることが、乗員に認識され易い。以上により、乗員に対して分かり易い表示が可能な表示制御装置および表示制御プログラムを提供できる。 According to the present disclosure, when a specific point is included in the non-visible area, the superimposed display of the route content on the non-visible area is stopped, and at least a part of the non-visible information content is positioned above the visible area. Is superimposed and displayed. Therefore, the occupant can recognize the information about the specific point separately from the route content superimposed on the visible area. Then, since the non-visual information content is superimposed and displayed on the display position associated with the predetermined position on the scheduled travel route, it is easy for the occupant to recognize that the information on the scheduled travel route is presented. As described above, it is possible to provide a display control device and a display control program capable of displaying in an easy-to-understand manner for the occupant.
 本開示についての上記および他の目的、特徴や利点は、添付図面を参照した下記詳細な説明から、より明確になる。添付図面において、
図1は、本開示の第1実施形態によるHCUを含む車載ネットワークの全体像を示す図である。 図2は、車両に搭載されるヘッドアップディスプレイの一例を示す図である。 図3は、HCUの概略的な構成の一例を示す図である。 図4は、表示生成部にて実施される表示レイアウトのシミュレーションの一例を、可視化して示す図である。 図5は、案内表示の一例を示す図である。 図6は、案内表示の一例を示す図である。 図7は、案内表示の一例を示す図である。 図8は、第1実施形態の表示制御方法を示すフローチャートである。 図9は、第2実施形態の案内表示の一例を示す図である。 図10は、第3実施形態の案内表示の一例を示す図である。 図11は、第4実施形態の案内表示の一例を示す図である。 図12は、第5実施形態の表示生成部にて実施される表示レイアウトのシミュレーションの一例を、可視化して示す図である。 図13は、第5実施形態の案内表示の一例を示す図である。 図14は、他の実施形態の表示生成部にて実施される表示レイアウトのシミュレーションの一例を、可視化して示す図である。 図15は、他の実施形態の案内表示の一例を示す図である。
The above and other objectives, features and advantages of the present disclosure will become clearer from the detailed description below with reference to the accompanying drawings. In the attached drawing
FIG. 1 is a diagram showing an overall image of an in-vehicle network including an HCU according to the first embodiment of the present disclosure. FIG. 2 is a diagram showing an example of a head-up display mounted on a vehicle. FIG. 3 is a diagram showing an example of a schematic configuration of the HCU. FIG. 4 is a diagram that visualizes and shows an example of a display layout simulation performed by the display generation unit. FIG. 5 is a diagram showing an example of a guidance display. FIG. 6 is a diagram showing an example of a guidance display. FIG. 7 is a diagram showing an example of a guidance display. FIG. 8 is a flowchart showing the display control method of the first embodiment. FIG. 9 is a diagram showing an example of the guidance display of the second embodiment. FIG. 10 is a diagram showing an example of a guidance display according to the third embodiment. FIG. 11 is a diagram showing an example of the guidance display of the fourth embodiment. FIG. 12 is a diagram that visualizes and shows an example of a display layout simulation performed by the display generation unit of the fifth embodiment. FIG. 13 is a diagram showing an example of the guidance display of the fifth embodiment. FIG. 14 is a diagram that visualizes and shows an example of a display layout simulation performed by the display generation unit of another embodiment. FIG. 15 is a diagram showing an example of a guidance display of another embodiment.
 (第1実施形態)
 本開示の第1実施形態による表示制御装置の機能は、図1および図2に示すHCU(Human Machine Interface Control Unit)100によって実現されている。HCU100は、車両Aにおいて用いられるHMI(Human Machine Interface)システム10を、ヘッドアップディスプレイ(以下、「HUD」)20等と共に構成している。HMIシステム10には、操作デバイス26およびDSM(Driver Status Monitor)27等がさらに含まれている。HMIシステム10は、車両Aの乗員(例えばドライバ等)によるユーザ操作を受け付ける入力インターフェース機能と、ドライバへ向けて情報を提示する出力インターフェース機能とを備えている。
(First Embodiment)
The function of the display control device according to the first embodiment of the present disclosure is realized by the HCU (Human Machine Interface Control Unit) 100 shown in FIGS. 1 and 2. The HCU 100 comprises an HMI (Human Machine Interface) system 10 used in the vehicle A together with a head-up display (hereinafter, “HUD”) 20 and the like. The HMI system 10 further includes an operation device 26, a DSM (Drive Status Monitor) 27, and the like. The HMI system 10 has an input interface function for accepting user operations by an occupant (for example, a driver) of the vehicle A, and an output interface function for presenting information to the driver.
 HMIシステム10は、車両Aに搭載された車載ネットワーク1の通信バス99に通信可能に接続されている。HMIシステム10は、車載ネットワーク1に設けられた複数のノードのうちの1つである。車載ネットワーク1の通信バス99には、例えば周辺監視センサ30、ロケータ40、DCM49、運転支援ECU(Electronic Control Unit)50、およびナビゲーション装置60等がそれぞれノードとして接続されている。通信バス99に接続されたこれらのノードは、相互に通信可能である。 The HMI system 10 is communicably connected to the communication bus 99 of the vehicle-mounted network 1 mounted on the vehicle A. The HMI system 10 is one of a plurality of nodes provided in the vehicle-mounted network 1. For example, a peripheral monitoring sensor 30, a locator 40, a DCM49, a driving support ECU (Electronic Control Unit) 50, a navigation device 60, and the like are connected to the communication bus 99 of the vehicle-mounted network 1 as nodes. These nodes connected to the communication bus 99 can communicate with each other.
 周辺監視センサ30は、車両Aの周辺環境を監視する自律センサである。周辺監視センサ30は、自車周囲の検出範囲から、歩行者、サイクリスト、人間以外の動物、および他車両等の移動物体、さらに路上の落下物、ガードレール、縁石、道路標識、走行区画線等の路面表示、および道路脇の構造物等の静止物体、を検出可能である。周辺監視センサ30は、車両Aの周囲の物体を検出した検出情報を、通信バス99を通じて、運転支援ECU50等に提供する。 The peripheral monitoring sensor 30 is an autonomous sensor that monitors the surrounding environment of the vehicle A. From the detection range around the own vehicle, the peripheral monitoring sensor 30 includes moving objects such as pedestrians, cyclists, non-human animals, and other vehicles, as well as falling objects, guardrails, curbs, road markings, traveling lane markings, and the like. It is possible to detect road markings and stationary objects such as roadside structures. The peripheral monitoring sensor 30 provides the detection information of detecting an object around the vehicle A to the driving support ECU 50 and the like through the communication bus 99.
 周辺監視センサ30は、物体検出のための検出構成として、フロントカメラ31およびミリ波レーダ32を有している。フロントカメラ31は、車両Aの前方範囲を撮影した撮像データ、および撮像データの解析結果の少なくとも一方を、検出情報として出力する。ミリ波レーダ32は、例えば車両Aの前後の各バンパーに互いに間隔を開けて複数配置されている。ミリ波レーダ32は、ミリ波または準ミリ波を、車両Aの前方範囲、前側方範囲、後方範囲および後側方範囲等へ向けて照射する。ミリ波レーダ32は、移動物体および静止物体等で反射された反射波を受信する処理により、検出情報を生成する。なお、ライダおよびソナー等の検出構成が、周辺監視センサ30に含まれていてもよい。 The peripheral monitoring sensor 30 has a front camera 31 and a millimeter wave radar 32 as a detection configuration for object detection. The front camera 31 outputs at least one of the imaging data obtained by photographing the front range of the vehicle A and the analysis result of the imaging data as detection information. A plurality of millimeter-wave radars 32 are arranged, for example, on the front and rear bumpers of the vehicle A at intervals from each other. The millimeter wave radar 32 irradiates the millimeter wave or the quasi-millimeter wave toward the front range, the front side range, the rear range, the rear side range, and the like of the vehicle A. The millimeter wave radar 32 generates detection information by a process of receiving reflected waves reflected by a moving object, a stationary object, or the like. The peripheral monitoring sensor 30 may include detection configurations such as a rider and sonar.
 ロケータ40は、複数の取得情報を組み合わせる複合測位により、車両Aの高精度な位置情報等を生成する。ロケータ40は、例えば複数車線のうちで、車両Aが走行する車線を特定可能である。ロケータ40は、GNSS(Global Navigation Satellite System)受信器41、慣性センサ42、高精度地図データベース(以下、「高精度地図DB」)43、およびロケータECU44を含む構成である。 The locator 40 generates highly accurate position information of vehicle A and the like by compound positioning that combines a plurality of acquired information. The locator 40 can specify, for example, the lane in which the vehicle A travels among a plurality of lanes. The locator 40 includes a GNSS (Global Navigation Satellite System) receiver 41, an inertial sensor 42, a high-precision map database (hereinafter, “high-precision map DB”) 43, and a locator ECU 44.
 GNSS受信器41は、複数の人工衛星(測位衛星)から送信された測位信号を受信する。GNSS受信器41は、GPS、GLONASS、Galileo、IRNSS、QZSS、Beidou等の衛星測位システムのうちで、少なくとも1つの衛星測位システムの各測位衛星から、測位信号を受信可能である。 The GNSS receiver 41 receives positioning signals transmitted from a plurality of artificial satellites (positioning satellites). The GNSS receiver 41 can receive a positioning signal from each positioning satellite of at least one satellite positioning system among satellite positioning systems such as GPS, GLONASS, Galileo, IRNSS, QZSS, and Beidou.
 慣性センサ42は、例えばジャイロセンサおよび加速度センサを有している。高精度地図DB43は、不揮発性メモリを主体に構成されており、通常のナビゲーションに用いられるよりも高精度な地図データ(以下、「高精度地図データ」)を記憶している。高精度地図データは、少なくとも高さ(z)方向の情報について、詳細な情報を保持している。高精度地図データには、道路の三次元形状情報(道路構造情報)、レーン数情報、各レーンに許容された進行方向を示す情報等、高度運転支援および自動運転に利用可能な情報が含まれている。 The inertial sensor 42 has, for example, a gyro sensor and an acceleration sensor. The high-precision map DB 43 is mainly composed of a non-volatile memory, and stores map data with higher accuracy than that used for normal navigation (hereinafter, “high-precision map data”). The high-precision map data holds detailed information at least for information in the height (z) direction. High-precision map data includes information that can be used for advanced driving support and autonomous driving, such as three-dimensional shape information of roads (road structure information), number of lanes, and information indicating the direction of travel allowed for each lane. ing.
 ロケータECU44は、プロセッサ、RAM、記憶部、入出力インターフェース、およびこれらを接続するバス等を備えたマイクロコンピュータを主体として含む構成である。ロケータECU44は、GNSS受信器41で受信する測位信号、慣性センサ42の計測結果、および通信バス99に出力された車速情報等を組み合わせ、車両Aの自車位置および進行方向等を逐次測位する。ロケータECU44は、測位結果に基づく車両Aの位置情報および方角情報を、通信バス99を通じて、HCU100、および運転支援ECU50等に提供する。 The locator ECU 44 has a configuration mainly including a microcomputer provided with a processor, a RAM, a storage unit, an input / output interface, a bus connecting these, and the like. The locator ECU 44 combines the positioning signal received by the GNSS receiver 41, the measurement result of the inertial sensor 42, the vehicle speed information output to the communication bus 99, and the like, and sequentially positions the own vehicle position and the traveling direction of the vehicle A. The locator ECU 44 provides the position information and the direction information of the vehicle A based on the positioning result to the HCU 100, the driving support ECU 50, and the like through the communication bus 99.
 なお、車速情報は、車両Aの現在の走行速度を示す情報であり、車両Aの各輪のハブ部分に設けられた車輪速センサの検出信号に基づいて生成される。車速情報を生成し、通信バス99に出力するノード(ECU)は、適宜変更されてよい。例えば、各輪の制動力配分を制御するブレーキ制御ECU、またはHCU100等の車載ECUが、各輪の車輪速センサと電気的に接続されており、車速情報の生成および通信バス99への出力を継続的に実施する。 The vehicle speed information is information indicating the current traveling speed of the vehicle A, and is generated based on the detection signal of the wheel speed sensor provided in the hub portion of each wheel of the vehicle A. The node (ECU) that generates vehicle speed information and outputs it to the communication bus 99 may be appropriately changed. For example, a brake control ECU that controls the distribution of braking force for each wheel, or an in-vehicle ECU such as the HCU100, is electrically connected to the wheel speed sensor of each wheel to generate vehicle speed information and output to the communication bus 99. Implement continuously.
 ロケータECU44は、HCU100、および運転支援ECU50等からの要求に応じて、必要とされた高精度地図データが高精度地図DB43にあるか否かを判定する。要求された高精度地図データが高精度地図DB43にある場合、ロケータECU44は、該当する高精度地図データを高精度地図DB43から読み出し、要求元となるECUに提供する。 The locator ECU 44 determines whether or not the required high-precision map data is in the high-precision map DB 43 in response to a request from the HCU 100, the driving support ECU 50, and the like. When the requested high-precision map data is in the high-precision map DB 43, the locator ECU 44 reads the corresponding high-precision map data from the high-precision map DB 43 and provides it to the request source ECU.
 DCM(Data Communication Module)49は、車両Aに搭載される通信モジュールである。DCM49は、LTE(Long Term Evolution)および5G等の通信規格に沿った無線通信により、車両Aの周囲の基地局との間で電波を送受信する。DCM49の搭載により、車両Aは、インターネットに接続可能なコネクテッドカーとなる。DCM49は、クラウド上に設けられたプローブサーバから、最新の高精度地図データを取得可能である。DCM49は、ロケータECU44と連携して、高精度地図DB43に格納された高精度地図データを、最新の情報に更新する。 The DCM (Data Communication Module) 49 is a communication module mounted on the vehicle A. The DCM49 transmits and receives radio waves to and from base stations around the vehicle A by wireless communication in accordance with communication standards such as LTE (Long Term Evolution) and 5G. By installing the DCM49, the vehicle A becomes a connected car that can connect to the Internet. The DCM49 can acquire the latest high-precision map data from a probe server provided on the cloud. The DCM49 cooperates with the locator ECU 44 to update the high-precision map data stored in the high-precision map DB 43 to the latest information.
 運転支援ECU50は、プロセッサ、RAM、記憶部、入出力インターフェース、およびこれらを接続するバス等を備えたコンピュータを主体として含む構成である。運転支援ECU50は、ドライバの運転操作を支援する運転支援機能を備えている。一例として、米国自動車技術会の規定する自動運転レベルにおいて、運転支援ECU50は、レベル2以下の部分的な自動走行制御(高度運転支援)を可能にする。 The operation support ECU 50 has a configuration mainly including a computer including a processor, a RAM, a storage unit, an input / output interface, and a bus connecting these. The driving support ECU 50 has a driving support function that supports the driving operation of the driver. As an example, at the automatic driving level specified by the American Society of Automotive Engineers of Japan, the driving support ECU 50 enables partially automatic driving control (advanced driving support) of level 2 or lower.
 運転支援ECU50は、周辺監視センサ30から取得する検出情報に基づき、車両Aの周囲の走行環境を認識する。運転支援ECU50は、走行環境認識のために実施した検出情報の解析結果を、解析済みの検出情報として、HCU100に提供する。一例として、運転支援ECU50は、車両Aが現在走行する車線(以下、「自車車線Lns」 図4参照)の左右の区画線または道路端の相対位置を、HCU100に提供可能である。なお、左右の方向は、水平面上に静止した車両Aの幅方向と一致する方向であり、車両Aの進行方向を基準として設定される。 The driving support ECU 50 recognizes the driving environment around the vehicle A based on the detection information acquired from the peripheral monitoring sensor 30. The driving support ECU 50 provides the HCU 100 with the analysis result of the detection information carried out for recognizing the driving environment as the analyzed detection information. As an example, the driving support ECU 50 can provide the HCU 100 with the relative positions of the left and right lane markings or road edges of the lane in which the vehicle A is currently traveling (hereinafter, "own lane Lns", see FIG. 4). The left-right direction is a direction that coincides with the width direction of the vehicle A stationary on the horizontal plane, and is set with reference to the traveling direction of the vehicle A.
 運転支援ECU50は、記憶部に記憶されたプログラムをプロセッサによって実行することにより、高度運転支援を実現する複数の機能を発揮可能である。例えば、運転支援ECU50は、ACC(Adaptive Cruise Control)制御部およびLTC制御部を有する。ACC制御部は、ACCの機能を実現する機能部である。ACC制御部は、目標車速で車両Aを定速走行させるか、または前走車との車間距離を維持しつつ車両Aを追従走行させる。LTC制御部は、LTC(Lane Trace Control)の機能を実現する機能部である。LTC制御部は、走行中の自車車線Lnsに沿って生成した予定走行ラインに従い、ACC制御部と連携して車両Aを自車車線内で走行させる。 The driving support ECU 50 can exert a plurality of functions for realizing advanced driving support by executing the program stored in the storage unit by the processor. For example, the driving support ECU 50 has an ACC (Adaptive Cruise Control) control unit and an LTC control unit. The ACC control unit is a functional unit that realizes the functions of the ACC. The ACC control unit causes the vehicle A to travel at a constant speed at the target vehicle speed, or causes the vehicle A to follow the vehicle A while maintaining the inter-vehicle distance from the vehicle in front. The LTC control unit is a functional unit that realizes the function of the LTC (Lane Trace Control). The LTC control unit causes the vehicle A to travel in the own lane in cooperation with the ACC control unit according to the planned traveling line generated along the running own lane Lns.
 ナビゲーション装置60は、設定される目的地までの経路を探索し、探索した経路に沿った走行を案内する。ナビゲーション装置60は、ナビ地図データベース(以下、ナビ地図DB)61、およびナビECU62を備える。 The navigation device 60 searches for a route to the set destination and guides the traveling along the searched route. The navigation device 60 includes a navigation map database (hereinafter, navigation map DB) 61 and a navigation ECU 62.
 ナビECU62は、プロセッサ、RAM、記憶部、入出力インターフェース、およびこれらを接続するバス等を備えたマイクロコンピュータを主体に構成されている。ナビECU62は、車両A(自車)の位置情報および方角情報を、通信バス99を通じてロケータECU44より取得する。ナビECU62は、通信バス99およびHCU100を通じて、操作デバイス26に入力された操作情報を取得し、ドライバ操作に基づく目的地を設定する。ナビECU62は、目的地までの複数経路を、例えば時間優先および距離優先等の条件を満たすように探索する。探索された複数経路のうちの1つが選択されると、ナビECU62は、当該設定経路に基づく経路情報を、関連するナビ地図データと共に、通信バス99を通じて、HCU100に提供する。 The navigation ECU 62 is mainly composed of a microcomputer provided with a processor, RAM, a storage unit, an input / output interface, a bus connecting these, and the like. The navigation ECU 62 acquires the position information and the direction information of the vehicle A (own vehicle) from the locator ECU 44 through the communication bus 99. The navigation ECU 62 acquires the operation information input to the operation device 26 through the communication bus 99 and the HCU 100, and sets the destination based on the driver operation. The navigation ECU 62 searches for a plurality of routes to the destination so as to satisfy conditions such as time priority and distance priority. When one of the plurality of searched routes is selected, the navigation ECU 62 provides the route information based on the set route to the HCU 100 through the communication bus 99 together with the related navigation map data.
 加えてナビECU62は、設定経路に含まれた右左折を行う交差点および分岐ポイント等の案内地点GPに車両Aが接近すると、案内実施要求を、HCU100へ向けて順次出力する。案内地点GPは、一例として交差点区間および分岐可能区間の各中央付近に設定される。なお、案内地点GPは、交差点区間および分岐可能区間の各手前側または各奥側に設定されてもよい。案内地点GPは、特定地点の一例である。 In addition, when the vehicle A approaches a guidance point GP such as an intersection or a turnout point included in the set route for turning left or right, the navigation ECU 62 sequentially outputs a guidance implementation request toward the HCU 100. The guide point GP is set near the center of each of the intersection section and the branchable section as an example. The guide point GP may be set on the front side or the back side of each of the intersection section and the branchable section. The guide point GP is an example of a specific point.
 案内実施要求は、ドライバへの経路案内に用いられる案内情報であり、具体的には、案内地点GPの位置情報と、案内地点GPにて車両Aが進むべき方向を示す情報とを含んでいる。案内実施要求は、車両Aから案内地点GPまでの残距離Lr(図4参照)が第1閾値(例えば300m程度)未満となったタイミングで出力される。HCU100は、ナビECU62からの案内実施要求の取得に基づき、経路案内に関連した情報提示を実施する。 The guidance implementation request is guidance information used for route guidance to the driver, and specifically includes information on the position of the guidance point GP and information indicating the direction in which the vehicle A should proceed at the guidance point GP. .. The guidance implementation request is output when the remaining distance Lr (see FIG. 4) from the vehicle A to the guidance point GP becomes less than the first threshold value (for example, about 300 m). The HCU 100 presents information related to route guidance based on the acquisition of the guidance implementation request from the navigation ECU 62.
 次に、HMIシステム10に含まれる操作デバイス26、DSM27、HUD20およびHCU100の各詳細を、図1および図2に基づき順に説明する。 Next, details of the operating devices 26, DSM27, HUD20, and HCU100 included in the HMI system 10 will be described in order based on FIGS. 1 and 2.
 操作デバイス26は、ドライバ等によるユーザ操作を受け付ける入力部である。操作デバイス26には、例えば運転支援機能および自動運転機能等について、起動および停止の切り替えを行うユーザ操作が入力される。具体的には、ステアリングホイールのスポーク部に設けられたステアスイッチ、ステアリングコラム部8に設けられた操作レバー、およびドライバの発話を検出する音声入力装置等が、操作デバイス26に含まれる。 The operation device 26 is an input unit that accepts user operations by a driver or the like. A user operation for switching between starting and stopping is input to the operation device 26, for example, for a driving support function and an automatic driving function. Specifically, the operation device 26 includes a steering switch provided on the spoke portion of the steering wheel, an operation lever provided on the steering column portion 8, a voice input device for detecting the driver's utterance, and the like.
 DSM27は、近赤外光源および近赤外カメラと、これらを制御する制御ユニットとを含む構成である。DSM27は、運転席のヘッドレスト部に近赤外カメラを向けた姿勢にて、例えばステアリングコラム部8の上面またはインスツルメントパネル9の上面等に設置されている。DSM27は、近赤外光源によって近赤外光を照射されたドライバの頭部を、近赤外カメラによって撮影する。近赤外カメラによる撮像画像は、制御ユニットによって画像解析される。制御ユニットは、アイポイントEPの位置および視線方向等の情報を撮像画像から抽出し、抽出した状態情報をHCU100へ向けて逐次出力する。 The DSM27 has a configuration including a near-infrared light source, a near-infrared camera, and a control unit for controlling them. The DSM 27 is installed in a posture in which the near-infrared camera is directed toward the headrest portion of the driver's seat, for example, on the upper surface of the steering column portion 8 or the upper surface of the instrument panel 9. The DSM27 uses a near-infrared camera to photograph the head of the driver irradiated with near-infrared light by a near-infrared light source. The image captured by the near-infrared camera is image-analyzed by the control unit. The control unit extracts information such as the position of the eye point EP and the line-of-sight direction from the captured image, and sequentially outputs the extracted state information to the HCU 100.
 HUD20は、メータディスプレイおよびセンターインフォメーションディスプレイ等と共に、複数の車載表示デバイスの1つとして、車両Aに搭載されている。HUD20は、HCU100と電気的に接続されており、HCU100によって生成された映像データを逐次取得する。HUD20は、映像データに基づき、例えばルート情報、標識情報、および各車載機能の制御情報等、車両Aに関連する種々の情報を、虚像Viを用いてドライバに提示する。 The HUD 20 is mounted on the vehicle A as one of a plurality of in-vehicle display devices together with a meter display, a center information display, and the like. The HUD 20 is electrically connected to the HCU 100 and sequentially acquires video data generated by the HCU 100. Based on the video data, the HUD 20 presents various information related to the vehicle A, such as route information, sign information, and control information of each vehicle-mounted function, to the driver using the virtual image Vi.
 HUD20は、ウィンドシールドWSの下方にて、インスツルメントパネル9内の収容空間に収容されている。HUD20は、虚像Viとして結像される光を、ウィンドシールドWSの投影範囲PAへ向けて投影する。ウィンドシールドWSに投影された光は、投影範囲PAにおいて運転席側へ反射され、ドライバによって知覚される。ドライバは、投影範囲PAを通して見える前景に、虚像Viが重畳された表示を視認する。 The HUD 20 is housed in the storage space inside the instrument panel 9 below the windshield WS. The HUD 20 projects the light formed as a virtual image Vi toward the projection range PA of the windshield WS. The light projected on the windshield WS is reflected toward the driver's seat side in the projection range PA and is perceived by the driver. The driver visually recognizes the display in which the virtual image Vi is superimposed on the foreground seen through the projection range PA.
 HUD20は、プロジェクタ21および拡大光学系22を備えている。プロジェクタ21は、LCD(Liquid Crystal Display)パネルおよびバックライトを有している。プロジェクタ21は、LCDパネルの表示面を拡大光学系22へ向けた姿勢にて、HUD20の筐体に固定されている。プロジェクタ21は、映像データの各フレーム画像をLCDパネルの表示面に表示し、当該表示面をバックライトによって透過照明することで、虚像Viとして結像される光を拡大光学系22へ向けて射出する。拡大光学系22は、合成樹脂またはガラス等からなる基材の表面にアルミニウム等の金属を蒸着させた凹面鏡を、少なくとも1つ含む構成である。拡大光学系22は、プロジェクタ21から射出された光を反射によって広げつつ、上方の投影範囲PAに投影する。 The HUD 20 includes a projector 21 and a magnifying optical system 22. The projector 21 has an LCD (Liquid Crystal Display) panel and a backlight. The projector 21 is fixed to the housing of the HUD 20 with the display surface of the LCD panel facing the magnifying optical system 22. The projector 21 displays each frame image of video data on the display surface of the LCD panel, and transmits and illuminates the display surface with a backlight to emit light formed as a virtual image Vi toward the magnifying optical system 22. To do. The magnifying optical system 22 is configured to include at least one concave mirror in which a metal such as aluminum is vapor-deposited on the surface of a base material made of synthetic resin or glass. The magnifying optical system 22 projects the light emitted from the projector 21 onto the upper projection range PA while spreading it by reflection.
 以上のHUD20には、画角VAが設定される。HUD20にて虚像Viを結像可能な空間中の仮想範囲を結像面ISとすると、画角VAは、運転者のアイポイントEPと結像面ISの外縁とを結ぶ仮想線に基づき規定される視野角である。画角VAは、アイポイントEPから見て、運転者が虚像Viを視認できる角度範囲となる。HUD20では、垂直方向における垂直画角よりも、水平方向における水平画角の方が大きくされている。アイポイントEPから見たとき、結像面ISと重なる前方範囲が画角VA内の範囲となる。 The angle of view VA is set for the above HUD20. Assuming that the virtual range in the space where the virtual image Vi can be imaged by the HUD 20 is the image plane IS, the angle of view VA is defined based on the virtual line connecting the driver's eye point EP and the outer edge of the image plane IS. The viewing angle. The angle of view VA is an angle range in which the driver can visually recognize the virtual image Vi when viewed from the eye point EP. In HUD20, the horizontal angle of view in the horizontal direction is larger than the vertical angle of view in the vertical direction. When viewed from the eye point EP, the front range that overlaps with the image plane IS is the range within the angle of view VA.
 HUD20は、重畳コンテンツCTs(図6等参照)および非重畳コンテンツを、虚像Viとして表示する。重畳コンテンツCTsは、拡張現実(Augmented Reality,以下「AR」)表示に用いられるAR表示物である。重畳コンテンツCTsの表示位置は、例えば路面の特定位置、前方車両、歩行者および道路標識等、前景に存在する特定の重畳対象に関連付けられている。重畳コンテンツCTsは、前景中にある特定の重畳対象に重畳表示され、当該重畳対象に相対固定されているように、重畳対象を追って、ドライバの見た目上で移動可能である。即ち、ドライバのアイポイントEPと、前景中の重畳対象と、重畳コンテンツCTsとの相対的な位置関係は、継続的に維持される。そのため、重畳コンテンツCTsの形状は、重畳対象の相対位置および形状に合わせて、所定の周期で継続的に更新されてよい。重畳コンテンツCTsは、非重畳コンテンツよりも水平に近い姿勢で表示され、例えばドライバから見た奥行方向(進行方向)に延伸した表示形状とされる。 The HUD 20 displays superimposed content CTs (see FIG. 6 and the like) and non-superimposed content as virtual image Vi. Superimposed content CTs are AR display objects used for augmented reality (hereinafter referred to as “AR”) display. The display position of the superimposed content CTs is associated with a specific superimposed object existing in the foreground, such as a specific position on the road surface, a vehicle in front, a pedestrian, and a road sign. The superimposed content CTs are superimposed and displayed on a specific superimposed object in the foreground, and can be moved in the appearance of the driver following the superimposed object so as to be relatively fixed to the superimposed object. That is, the relative positional relationship between the driver's eye point EP, the superposed object in the foreground, and the superposed content CTs is continuously maintained. Therefore, the shape of the superimposed content CTs may be continuously updated at a predetermined cycle according to the relative position and shape of the superimposed object. The superimposed content CTs are displayed in a posture closer to horizontal than the non-superimposed content, and have a display shape extending in the depth direction (traveling direction) as seen from the driver, for example.
 非重畳コンテンツは、前景に重畳表示される表示物のうちで、重畳コンテンツCTsを除いた非AR表示物である。非重畳コンテンツは、重畳コンテンツCTsとは異なり、重畳対象を特定されないで、前景に重畳表示される。非重畳コンテンツは、投影範囲PA内の決まった位置に表示されることで、ウィンドシールドWS等の車両構成に相対固定されているように表示される。 The non-superimposed content is a non-AR display object excluding the superimposed content CTs among the display objects superimposed and displayed in the foreground. Unlike the superimposed content CTs, the non-superimposed content is displayed superimposed on the foreground without specifying the superimposed target. The non-superimposed content is displayed at a fixed position in the projection range PA, so that it is displayed as if it is relatively fixed to the vehicle configuration such as the windshield WS.
 HCU100は、HMIシステム10において、HUD20を含む複数の車載表示デバイスによる表示を統合的に制御する電子制御装置である。HCU100は、処理部11、RAM12、記憶部13、入出力インターフェース14、およびこれらを接続するバス等を備えたコンピュータを主体として含む構成である。処理部11は、RAM12と結合された演算処理のためのハードウェアである。処理部11は、CPU(Central ProcessingUnit)およびGPU(Graphics Processing Unit)等の演算コアを少なくとも1つ含む構成である。処理部11は、FPGA(Field-Programmable Gate Array)および他の専用機能を備えたIPコア等をさらに含む構成であってよい。RAM12は、映像生成のためのビデオRAMを含む構成であってよい。処理部11は、RAM12へのアクセスにより、後述する各機能部の機能を実現するための種々の処理を実行する。記憶部13は、不揮発性の記憶媒体を含む構成である。記憶部13には、処理部11によって実行される種々のプログラム(表示制御プログラム等)が格納されている。 The HCU 100 is an electronic control device that integrally controls the display by a plurality of in-vehicle display devices including the HUD 20 in the HMI system 10. The HCU 100 mainly includes a computer including a processing unit 11, a RAM 12, a storage unit 13, an input / output interface 14, and a bus connecting them. The processing unit 11 is hardware for arithmetic processing combined with the RAM 12. The processing unit 11 has a configuration including at least one arithmetic core such as a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit). The processing unit 11 may be configured to further include an FPGA (Field-Programmable Gate Array) and an IP core having other dedicated functions. The RAM 12 may be configured to include a video RAM for video generation. By accessing the RAM 12, the processing unit 11 executes various processes for realizing the functions of the functional units described later. The storage unit 13 is configured to include a non-volatile storage medium. Various programs (display control programs, etc.) executed by the processing unit 11 are stored in the storage unit 13.
 図1~図3に示すHCU100は、記憶部13に記憶された表示制御プログラムを処理部11によって実行することで、HUD20によるコンテンツの重畳表示を制御するための複数の機能部を有する。具体的に、HCU100には、視点位置特定部71、ロケータ情報取得部72、案内情報取得部73、仮想レイアウト部75、および表示生成部76等の機能部が構築される。 The HCU 100 shown in FIGS. 1 to 3 has a plurality of functional units for controlling the superimposed display of the content by the HUD 20 by executing the display control program stored in the storage unit 13 by the processing unit 11. Specifically, the HCU 100 is constructed with functional units such as a viewpoint position specifying unit 71, a locator information acquisition unit 72, a guidance information acquisition unit 73, a virtual layout unit 75, and a display generation unit 76.
 視点位置特定部71は、DSM27から取得する状態情報に基づき、運転席に着座しているドライバのアイポイントEPの位置を特定する。視点位置特定部71は、アイポイントEPの位置を示す三次元の座標(以下、「アイポイント座標」)を生成し、生成したアイポイント座標を、仮想レイアウト部75に逐次提供する。 The viewpoint position specifying unit 71 identifies the position of the eye point EP of the driver seated in the driver's seat based on the state information acquired from the DSM 27. The viewpoint position specifying unit 71 generates three-dimensional coordinates (hereinafter, “eye point coordinates”) indicating the position of the eye point EP, and sequentially provides the generated eye point coordinates to the virtual layout unit 75.
 ロケータ情報取得部72は、車両Aについての最新の位置情報及び方角情報を、自車位置情報としてロケータECU44から取得する。加えてロケータ情報取得部72は、車両Aの周辺範囲の高精度地図データを、ロケータECU44から取得する。ロケータ情報取得部72は、取得した自車位置情報および高精度地図データを、仮想レイアウト部75に逐次提供する。 The locator information acquisition unit 72 acquires the latest position information and direction information about the vehicle A from the locator ECU 44 as own vehicle position information. In addition, the locator information acquisition unit 72 acquires high-precision map data of the peripheral range of the vehicle A from the locator ECU 44. The locator information acquisition unit 72 sequentially provides the acquired vehicle position information and high-precision map data to the virtual layout unit 75.
 外界情報取得部74は、運転支援ECU50から、車両Aの周辺範囲、特に、前方範囲についての検出情報を取得する。具体的に、外界情報取得部74は、自車車線Lnsの左右の区画線または道路端の相対位置を示す検出情報を取得する。外界情報取得部74は、取得した検出情報を仮想レイアウト部75に逐次提供する。なお、外界情報取得部74は、運転支援ECU50から取得する解析結果としての検出情報に替えて、フロントカメラ31の撮像データを、検出情報として取得してもよい。 The external world information acquisition unit 74 acquires detection information about the peripheral range of the vehicle A, particularly the front range, from the driving support ECU 50. Specifically, the outside world information acquisition unit 74 acquires detection information indicating the relative positions of the left and right lane markings or road edges of the own lane Lns. The external world information acquisition unit 74 sequentially provides the acquired detection information to the virtual layout unit 75. The external world information acquisition unit 74 may acquire the imaging data of the front camera 31 as the detection information instead of the detection information as the analysis result acquired from the driving support ECU 50.
 仮想レイアウト部75は、取得した種々の情報に基づき、情報提示に用いるコンテンツを選定する機能と、重畳コンテンツCTs(図6等参照)の表示レイアウトをシミュレートする機能とを備えている。 The virtual layout unit 75 has a function of selecting contents to be used for information presentation based on various acquired information and a function of simulating the display layout of superimposed contents CTs (see FIG. 6 and the like).
 仮想レイアウト部75は、ナビゲーション装置60から案内実施要求を取得した場合に、案内地点GPにおける経路案内に用いるコンテンツを選定する。具体的には、交差点等の分岐ポイントにおける右左折を案内するコンテンツ、所定距離の直進を案内するコンテンツ、および車線変更を案内するコンテンツ等が、適宜選定される。 The virtual layout unit 75 selects the content to be used for route guidance at the guidance point GP when the guidance implementation request is acquired from the navigation device 60. Specifically, content that guides a right or left turn at a branch point such as an intersection, content that guides a straight ahead of a predetermined distance, content that guides a lane change, and the like are appropriately selected.
 仮想レイアウト部75は、提供される種々の情報に基づき、重畳コンテンツCTsの表示レイアウトをシミュレーションする仮想レイアウト機能を実行する。仮想レイアウト部75は、ナビゲーション装置60から案内実施要求を取得した場合に、自車位置情報、高精度地図データおよび検出情報等に基づき、車両Aの現在の走行環境を仮想空間中に再現する。 The virtual layout unit 75 executes a virtual layout function that simulates the display layout of the superimposed content CTs based on various provided information. When the guidance implementation request is acquired from the navigation device 60, the virtual layout unit 75 reproduces the current traveling environment of the vehicle A in the virtual space based on the own vehicle position information, high-precision map data, detection information, and the like.
 詳記すると、図2~図4に示すように、表示生成部76は、仮想の三次元空間の基準位置に自車オブジェクトAOを設定する。表示生成部76は、高精度地図データの示す形状の道路モデルを、自車位置情報に基づき、自車オブジェクトAOに関連付けて、三次元空間にマッピングする。表示生成部76は、案内情報に基づく走行予定経路を道路モデル上に設定する。表示生成部76は、自車オブジェクトAOに関連付けて、仮想カメラ位置CPおよび重畳範囲SAを設定する。 More specifically, as shown in FIGS. 2 to 4, the display generation unit 76 sets the own vehicle object AO at the reference position in the virtual three-dimensional space. The display generation unit 76 maps the road model of the shape indicated by the high-precision map data to the three-dimensional space in association with the own vehicle object AO based on the own vehicle position information. The display generation unit 76 sets a planned travel route based on the guidance information on the road model. The display generation unit 76 sets the virtual camera position CP and the superimposition range SA in association with the own vehicle object AO.
 仮想カメラ位置CPは、運転者のアイポイントEPに対応する仮想位置である。表示生成部76は、視点位置特定部71にて取得される最新のアイポイント座標に基づき、自車オブジェクトAOに対する仮想カメラ位置CPを逐次補正する。重畳範囲SAは、虚像Viの重畳表示が可能となる範囲である。表示生成部76は、仮想カメラ位置CPと、記憶部13(図1参照)等に予め記憶された投影範囲PAの外縁位置(座標)情報とに基づき、仮想カメラ位置CPから前方を見たときに投影範囲PAの内側となる前方範囲を、重畳範囲SAとして設定する。重畳範囲SAは、HUD20の画角VAに対応している。 The virtual camera position CP is a virtual position corresponding to the driver's eye point EP. The display generation unit 76 sequentially corrects the virtual camera position CP with respect to the own vehicle object AO based on the latest eye point coordinates acquired by the viewpoint position specifying unit 71. The superimposition range SA is a range in which the virtual image Vi can be superposed and displayed. When the display generation unit 76 looks forward from the virtual camera position CP based on the virtual camera position CP and the outer edge position (coordinates) information of the projection range PA stored in advance in the storage unit 13 (see FIG. 1) or the like. The front range inside the projection range PA is set as the superimposition range SA. The superimposition range SA corresponds to the angle of view VA of HUD20.
 仮想レイアウト部75は、仮想空間中に第1仮想オブジェクトV1および第2仮想オブジェクトV2を配置する。第1仮想オブジェクトV1は、三次元空間の道路モデルの路面上に配置された走行予定経路に重なるように配置される。第1仮想オブジェクトV1は、後述する経路コンテンツCTrを虚像表示させる場合に、仮想空間中に設定される。第1仮想オブジェクトV1は、走行予定経路の仮想路面を平面的に覆うように配置される帯状のオブジェクトとされる。第1仮想オブジェクトV1は、少なくとも案内地点GPを含む走行区間内に配置される。第1仮想オブジェクトV1は、交差点の右左折シーンでは、図4に示すように進入車線と退出車線とを繋ぐ湾曲形状となる。第1仮想オブジェクトV1は、経路コンテンツCTrの位置および形状を規定する。すなわち、仮想カメラ位置CPから見た第1仮想オブジェクトV1の形状が、アイポイントEPから視認される経路コンテンツCTrの虚像形状となる。 The virtual layout unit 75 arranges the first virtual object V1 and the second virtual object V2 in the virtual space. The first virtual object V1 is arranged so as to overlap the planned travel route arranged on the road surface of the road model in the three-dimensional space. The first virtual object V1 is set in the virtual space when the path content CTr described later is displayed as a virtual image. The first virtual object V1 is a strip-shaped object arranged so as to cover the virtual road surface of the planned travel route in a plane. The first virtual object V1 is arranged in a traveling section including at least the guide point GP. The first virtual object V1 has a curved shape connecting the approach lane and the exit lane as shown in FIG. 4 in the right / left turn scene at the intersection. The first virtual object V1 defines the position and shape of the route content CTr. That is, the shape of the first virtual object V1 seen from the virtual camera position CP becomes the virtual image shape of the path content CTr visually recognized from the eye point EP.
 第1仮想オブジェクトV1の配置に際し、仮想レイアウト部75は、前景中の路面のうちでドライバから視認可能な視認内エリアAvと、視認不可能な視認外エリアAiとを、仮想空間中に設定した仮想カメラ位置CPおよび道路構造モデルに基づき推定する。仮想レイアウト部75は、仮想路面のうちで少なくとも第1仮想オブジェクトV1を配置する範囲に関して、視認内エリアAvおよび視認外エリアAiの推定を行う。例えば仮想レイアウト部75は、図4に示すように、重畳範囲SA内にて仮想カメラ位置CPから延ばした直線と交わる仮想路面を視認内エリアAvとし、第1仮想オブジェクトV1を配置する範囲内で当該直線と交わらない仮想路面を、視認外エリアAiとする。なお、仮想レイアウト部75は、仮想路面上に配置した第1仮想オブジェクトV1のうちで仮想カメラ位置CPから視認可能なオブジェクト部分および視認不可能なオブジェクト部分を推定することで、各エリアAv,Aiを間接的に推定する構成であってもよい。 When arranging the first virtual object V1, the virtual layout unit 75 sets the visible in-visible area Av visible to the driver and the invisible non-visible area Ai in the virtual space on the road surface in the foreground. Estimate based on virtual camera position CP and road structure model. The virtual layout unit 75 estimates the visible area Av and the non-visible area Ai with respect to the range in which at least the first virtual object V1 is arranged on the virtual road surface. For example, as shown in FIG. 4, the virtual layout unit 75 sets the virtual road surface intersecting the straight line extended from the virtual camera position CP in the superimposition range SA as the visible area Av, and within the range in which the first virtual object V1 is arranged. The virtual road surface that does not intersect the straight line is defined as the non-visual area Ai. The virtual layout unit 75 estimates the visible object portion and the invisible object portion from the virtual camera position CP in the first virtual object V1 arranged on the virtual road surface, so that each area Av, Ai May be configured to indirectly estimate.
 図4に示す例では、上り勾配路の先に平坦路が連なる構造の道路における視認内エリアAvおよび視認外エリアAiを示している。このような構造の道路では、上り勾配路を走行中に、平坦路が上り勾配路に遮られて視認不可能となる。したがって、仮想レイアウト部75は、上り勾配路の仮想路面を視認内エリアAvとし、平坦路の仮想路面を視認外エリアAiと推定することになる。なお、上り勾配路の先に、平坦路ではなく、下り勾配路または勾配率がより小さい上り勾配路等が連なる構造の道路の場合にも、手前の上り勾配路よりも先の仮想路面が視認外エリアAiとなり得る。仮想レイアウト部75は、推定部の一例である。 In the example shown in FIG. 4, the visible area Av and the non-visible area Ai on a road having a structure in which a flat road is connected to the end of an uphill road are shown. On a road having such a structure, the flat road is blocked by the uphill road and becomes invisible while traveling on the uphill road. Therefore, the virtual layout unit 75 estimates that the virtual road surface of the uphill road is the visible area Av and the virtual road surface of the flat road is the non-visual area Ai. In addition, even in the case of a road having a structure in which a downhill road or an uphill road having a smaller slope ratio is connected to the end of the uphill road, the virtual road surface ahead of the uphill road in front can be visually recognized. It can be the outer area Ai. The virtual layout unit 75 is an example of an estimation unit.
 第2仮想オブジェクトV2は、後述する視認外情報コンテンツCTiを虚像表示させる場合に、仮想空間中に設定される。より具体的には、第2仮想オブジェクトV2は、案内地点GPが仮想カメラ位置CPから不可視の視認外エリアAiに含まれる場合に、配置される。第2仮想オブジェクトV2は、仮想路面上に浮かぶ平面形状のオブジェクトとされる。第2仮想オブジェクトV2は、平面形状の平面を自車オブジェクト側に向けた状態で配置される。 The second virtual object V2 is set in the virtual space when the non-visual information content CTi, which will be described later, is displayed as a virtual image. More specifically, the second virtual object V2 is arranged when the guide point GP is included in the invisible non-visible area Ai from the virtual camera position CP. The second virtual object V2 is a plane-shaped object that floats on the virtual road surface. The second virtual object V2 is arranged with the plane of the plane shape facing the own vehicle object side.
 第2仮想オブジェクトV2は、仮想路面上に設定された案内地点GPの上方に配置される。詳記すると、第2仮想オブジェクトV2は、仮想空間中の水平面に平行な二次元座標上の位置(x,y)を、案内地点GPの当該二次元座標上における位置と同一に設定される。加えて、第2仮想オブジェクトV2の高さ(z)方向の位置は、第2仮想オブジェクトV2の全体を仮想カメラ位置CPから視認可能な高さ位置とされる。すなわち、第2仮想オブジェクトV2の下縁が、仮想カメラ位置CPと路面の頂上とを結ぶ直線よりも上方に位置付けられる。加えて、第2仮想オブジェクトV2の上縁は、重畳範囲SAの上縁よりも下方に位置付けられる。なお、第2仮想オブジェクトV2は、予め設定された初期サイズにて重畳範囲SAの上縁よりも上方にはみ出す場合、上下方向のサイズをより小さく設定されることで、重畳範囲SAの上縁より下方に収まるように調整される。 The second virtual object V2 is arranged above the guide point GP set on the virtual road surface. More specifically, the second virtual object V2 sets the position (x, y) on the two-dimensional coordinates parallel to the horizontal plane in the virtual space to be the same as the position on the two-dimensional coordinates of the guide point GP. In addition, the position of the second virtual object V2 in the height (z) direction is a height position where the entire second virtual object V2 can be visually recognized from the virtual camera position CP. That is, the lower edge of the second virtual object V2 is positioned above the straight line connecting the virtual camera position CP and the top of the road surface. In addition, the upper edge of the second virtual object V2 is positioned below the upper edge of the superposition range SA. When the second virtual object V2 protrudes above the upper edge of the superposition range SA with a preset initial size, the size in the vertical direction is set to be smaller than the upper edge of the superimposition range SA. Adjusted to fit below.
 加えて、仮想レイアウト部75は、ドライバから案内地点GPが視認可能となる視認可能地点VPの位置を推定する。仮想レイアウト部75は、予め設定されたドライバの視野範囲に基づいて、仮想カメラ位置CPから見たときに案内地点GPが視野範囲に入る地点を、視認可能地点VPと推定する。 In addition, the virtual layout unit 75 estimates the position of the visible point VP at which the guide point GP can be visually recognized from the driver. Based on the driver's field of view range set in advance, the virtual layout unit 75 estimates that the point where the guide point GP enters the field of view range when viewed from the virtual camera position CP is the visible point VP.
 視認可能地点VPは、通過してから案内地点GPに進入するまでの間に、案内地点GPを視認可能な状態が保たれる地点とされる。例えば、仮想レイアウト部75は、道路構造等に起因して通過後に再度案内地点GPを視認不可能となる地点を、視認可能地点VPとは推定しない。ただし、仮想レイアウト部75は、再度案内地点GPを視認不可能となる区間の距離が閾値を下回る場合には、案内地点GPを視認可能な状態が保たれるとみなす構成でもよい。 The visible point VP is a point where the guide point GP can be kept visible between the time of passing and the time of entering the guide point GP. For example, the virtual layout unit 75 does not presume that the point where the guide point GP becomes invisible again after passing due to the road structure or the like is the visible point VP. However, the virtual layout unit 75 may be configured to consider that the guide point GP is maintained in a visible state when the distance of the section in which the guide point GP cannot be seen again is less than the threshold value.
 なお、仮想レイアウト部75は、単に道路構造に基づいて視認可能地点VPを推定してもよい。この場合、例えば、車両Aから案内地点GPまでの区間で勾配の変化量が所定量以上となる地点が視認可能地点VPとされる。または、勾配の大きさが所定値以下となる地点が視認可能地点VPとされてもよい。また、車両Aから案内地点GPまでの区間で最も標高の高い地点が視認可能地点VPとされてもよい。 Note that the virtual layout unit 75 may simply estimate the visible point VP based on the road structure. In this case, for example, the visible point VP is a point in the section from the vehicle A to the guide point GP where the amount of change in the gradient is equal to or greater than a predetermined amount. Alternatively, a point where the magnitude of the gradient is equal to or less than a predetermined value may be regarded as a visible point VP. Further, the highest altitude point in the section from the vehicle A to the guide point GP may be regarded as the visible point VP.
 表示生成部76は、HUD20に逐次出力される映像データを生成する処理により、HUD20によるドライバへの情報提示を制御する。表示生成部76は、表示制御部の一例である。表示生成部76は、取得した種々の情報に基づき、コンテンツを描画する機能およびコンテンツの表示期間を制御する機能を有している。表示生成部76は、仮想レイアウト部75より取得するコンテンツの選定結果に基づき、映像データを構成する各フレーム画像に描画する元画像を決定する。表示生成部76は、重畳コンテンツCTs(図6等参照)の元画像をフレーム画像に描画する場合、アイポイントEPおよび重畳対象の各位置に応じて、フレーム画像における元画像の描画位置および描画形状を補正する。以上により、重畳コンテンツCTsは、アイポイントEPから見たとき、重畳対象に正しく重畳される位置および形状で表示されるようになる。 The display generation unit 76 controls the presentation of information to the driver by the HUD 20 by a process of generating video data that is sequentially output to the HUD 20. The display generation unit 76 is an example of a display control unit. The display generation unit 76 has a function of drawing the content and a function of controlling the display period of the content based on various acquired information. The display generation unit 76 determines the original image to be drawn in each frame image constituting the video data based on the selection result of the content acquired from the virtual layout unit 75. When drawing the original image of the superimposed content CTs (see FIG. 6 and the like) on the frame image, the display generation unit 76 draws the drawing position and drawing shape of the original image in the frame image according to the eye point EP and each position of the overlay target. To correct. As described above, the superimposed content CTs are displayed at the position and shape correctly superimposed on the superimposed object when viewed from the eye point EP.
 表示生成部76は、仮想レイアウト部75のコンテンツの選定結果と、仮想空間を用いたシミュレート結果としてのレイアウト情報等とに基づき、映像データに描画するコンテンツを選択する。一例として、表示生成部76は、経路案内処理に関連するコンテンツである経路コンテンツCTr(図5~図7参照)および視認外情報コンテンツCTi(図6参照)を描画し、ドライバに提示する。 The display generation unit 76 selects the content to be drawn on the video data based on the content selection result of the virtual layout unit 75 and the layout information as the simulation result using the virtual space. As an example, the display generation unit 76 draws the route content CTr (see FIGS. 5 to 7) and the non-visual information content CTi (see FIG. 6), which are contents related to the route guidance processing, and presents them to the driver.
 経路コンテンツCTrは、車両Aの走行予定経路の表示に用いられるコンテンツである。経路コンテンツCTrは、走行予定経路の路面を重畳対象とする重畳コンテンツCTsであり、表示シミュレーションにて配置される第1仮想オブジェクトV1に基づいて描画形状を決定される。 Route content CTr is content used to display the planned travel route of vehicle A. The route content CTr is the superimposed content CTs for which the road surface of the planned travel route is superimposed, and the drawing shape is determined based on the first virtual object V1 arranged in the display simulation.
 経路コンテンツCTrは、走行予定経路に沿った形状に描画され、車両Aの走行すべき車線や、右左折および車線変更の必要な地点等を示す。経路コンテンツCTrは、走行予定経路の車線の形状を象る描画形状であり、車両Aの進行方向に沿って帯状に延伸するシート形状である。経路コンテンツCTrは、車線が直線状の場合には直線状の態様となり、カーブ状の場合にはカーブに沿って湾曲した態様となる。また、経路コンテンツCTrは、交差点内においては、走行予定経路上の進入車線と退出車線とを繋ぐ態様となる。経路コンテンツCTrは、車両Aの走行に合わせて、アイポイントEPから見える路面形状に適合するように、所定の更新周期で描画形状を更新される。 The route content CTr is drawn in a shape along the planned travel route, and indicates the lane in which vehicle A should travel, the point where right / left turn and lane change are required, and the like. The route content CTr is a drawing shape that imitates the shape of the lane of the planned travel route, and is a seat shape that extends in a strip shape along the traveling direction of the vehicle A. When the lane is straight, the route content CTr has a linear shape, and when the lane is curved, the route content CTr has a curved shape along the curve. In addition, the route content CTr is a mode that connects the approach lane and the exit lane on the planned travel route within the intersection. The route content CTr updates the drawing shape at a predetermined update cycle so as to match the road surface shape seen from the eye point EP according to the traveling of the vehicle A.
 上記の経路コンテンツCTrの描画に際し、表示生成部76は、案内地点GPが視認外エリアAiに含まれる場合、視認外エリアAiへの経路コンテンツCTrの重畳表示を停止する。すなわち、表示生成部76は、経路コンテンツCTrを視認内エリアAvに対してのみ重畳し、視認外エリアAiに関しては、経路コンテンツCTrによる情報提示を行わない。表示生成部76は、表示シミュレーションの結果に基づき、第1仮想オブジェクトV1のうち視認内エリアAvに配置されるオブジェクト部分に対応するコンテンツ部分のみを、経路コンテンツCTrとして生成する。 When drawing the above-mentioned route content CTr, the display generation unit 76 stops the superimposed display of the route content CTr on the non-visible area Ai when the guide point GP is included in the non-visible area Ai. That is, the display generation unit 76 superimposes the route content CTr only on the visible area Av, and does not present information on the non-visual area Ai by the route content CTr. Based on the result of the display simulation, the display generation unit 76 generates only the content portion corresponding to the object portion arranged in the visible area Av of the first virtual object V1 as the route content CTr.
 視認外情報コンテンツCTiは、経路コンテンツCTrとは異なるコンテンツ態様にて視認外エリアAiの、特に案内地点GPに関する情報をドライバに提示するコンテンツである。視認外情報コンテンツCTiは、走行予定経路の路面上の空間を重畳対象とする重畳コンテンツCTsであり、表示シミュレーションにて配置される第2仮想オブジェクトV2に基づいて描画形状および描画位置を決定される。具体的には、仮想カメラ位置CPと第2仮想オブジェクトV2の各点とを結ぶ仮想線が交差する結像面IS上の位置に、視認外情報コンテンツCTiが結像される。これにより、視認外情報コンテンツCTiは、走行予定経路上の地点である案内地点GPの位置に関連付けられた表示位置に描画される。視認外情報コンテンツCTiは、案内地点GPが視認外エリアAiにあり、且つ視認可能地点VPから案内地点GPまでの距離が閾値未満である場合に生成される。 The non-visible information content CTi is a content that presents information about the non-visible area Ai, particularly the guide point GP, to the driver in a content mode different from the route content CTr. The non-visual information content CTi is superimposed content CTs that superimpose the space on the road surface of the planned travel route, and the drawing shape and drawing position are determined based on the second virtual object V2 arranged in the display simulation. .. Specifically, the non-visual information content CTi is imaged at a position on the image plane IS where the virtual lines connecting the virtual camera position CP and each point of the second virtual object V2 intersect. As a result, the non-visual information content CTi is drawn at the display position associated with the position of the guide point GP, which is a point on the planned travel route. The non-visible information content CTi is generated when the guide point GP is in the non-visible area Ai and the distance from the visible point VP to the guide point GP is less than the threshold value.
 視認外情報コンテンツCTiは、案内地点GPにおいて車両Aの進行すべき方向を、案内地点GPに関する情報として提示する。図6に示す例では、視認外情報コンテンツCTiは、矩形状のオブジェクトの表面に案内地点GP付近の進行経路の形状を簡易的に示す矢印(左折方向に湾曲した矢印)が描かれたコンテンツとして描画される。視認外情報コンテンツCTiは、視認内エリアAvの路面から上方に離れた表示高さに描画されて、経路コンテンツCTrに重ならない表示位置に表示される。視認外情報コンテンツCTiは、案内地点GPの上方で、ドライバから視認できる高さにて路面から浮いているように表示される。視認外情報コンテンツCTiは、車両Aの走行に合わせて、アイポイントEPから見える案内地点GPの上方の空間位置に留まって表示されるように、所定の更新周期で描画形状および描画位置を更新される。 The non-visual information content CTi presents the direction in which the vehicle A should travel at the guidance point GP as information regarding the guidance point GP. In the example shown in FIG. 6, the non-visual information content CTi is a content in which an arrow (an arrow curved in the left turn direction) that simply indicates the shape of the traveling path near the guide point GP is drawn on the surface of the rectangular object. It is drawn. The non-visual information content CTi is drawn at a display height away from the road surface in the visible area Av, and is displayed at a display position that does not overlap with the route content CTr. The non-visual information content CTi is displayed above the guide point GP as if it were floating from the road surface at a height visible to the driver. The non-visual information content CTi is updated in drawing shape and drawing position at a predetermined update cycle so that it stays in the space position above the guide point GP seen from the eye point EP and is displayed according to the traveling of the vehicle A. To.
 表示生成部76は、車両Aの案内地点GPまでの残距離Lrに応じて、上述した経路コンテンツCTrおよび視認外情報コンテンツCTiの表示状態を変化させる。この表示状態の変化について、図4~図7を参照しながら以下説明する。 The display generation unit 76 changes the display state of the above-mentioned route content CTr and non-visual information content CTi according to the remaining distance Lr to the guide point GP of the vehicle A. This change in the display state will be described below with reference to FIGS. 4 to 7.
 表示生成部76は、案内地点GPまでの残距離Lrが第1閾値未満且つ第2閾値(例えば100m程度)以上の走行区間では、経路コンテンツCTrのみを視認外情報コンテンツCTiに先立って表示させる(図5参照)。表示生成部76は、案内地点GPが視認外エリアAiに含まれている場合であっても、視認外情報コンテンツCTiを非表示とする。これにより表示生成部76は、案内地点GPから比較的離れている段階では、ドライバから視認可能な路面上の走行予定経路のみをドライバに提示する。 The display generation unit 76 displays only the route content CTr prior to the non-visual information content CTi in the traveling section where the remaining distance Lr to the guide point GP is less than the first threshold value and the second threshold value (for example, about 100 m) or more (for example, about 100 m). (See FIG. 5). The display generation unit 76 hides the non-visual information content CTi even when the guide point GP is included in the non-visual area Ai. As a result, the display generation unit 76 presents only the planned travel route on the road surface visible to the driver to the driver at the stage relatively far from the guide point GP.
 表示生成部76は、案内地点GPまでの残距離Lrが第2閾値未満となった場合、経路コンテンツCTrと視認外情報コンテンツCTiの両方を表示させる(図6参照)。これにより表示生成部76は、案内地点GPに比較的接近した段階では、ドライバから視認不可能な案内地点GPの情報も含めてドライバに提示する。図6に示す例では、視認内エリアAvを超えた先にて左折が必要である旨が、視認外情報コンテンツCTiによって提示されている。 When the remaining distance Lr to the guide point GP is less than the second threshold value, the display generation unit 76 displays both the route content CTr and the non-visual information content CTi (see FIG. 6). As a result, the display generation unit 76 presents the information of the guide point GP, which cannot be seen by the driver, to the driver at the stage when the guide point GP is relatively close to the guide point GP. In the example shown in FIG. 6, the non-visual information content CTi indicates that a left turn is required beyond the visible area Av.
 また、表示生成部76は、車両Aの走行に伴って案内地点GPが視認可能となった場合、視認外情報コンテンツCTiを非表示とする。そして、表示生成部76は、視認内エリアAvに含まれる状態となった案内地点GPにおける走行予定経路を、案内地点GPに重畳される経路コンテンツCTrを生成することで提示する(図7参照)。例えば、車両Aが上り勾配路から平坦路へと移る際、案内地点GPは視認可能となる。表示生成部76は、視認可能地点VPへの車両Aの到達により、視認可能となったことを判断する。 Further, the display generation unit 76 hides the non-visual information content CTi when the guide point GP becomes visible as the vehicle A travels. Then, the display generation unit 76 presents the planned travel route at the guide point GP that is included in the visible area Av by generating the route content CTr superimposed on the guide point GP (see FIG. 7). .. For example, when the vehicle A moves from an uphill road to a flat road, the guide point GP becomes visible. The display generation unit 76 determines that the vehicle A has become visible when the vehicle A reaches the visible point VP.
 次に、表示制御プログラムに基づき、経路案内処理に関連した各表示を切り替える表示制御方法の詳細を、図8に示すフローチャートに基づき、図3および図5~図7を参照しつつ、以下説明する。図8に示す表示制御処理は、例えば車両電源のオン状態への切り替えにより、起動処理等を終えたHCU100により、開始される。 Next, the details of the display control method for switching each display related to the route guidance processing based on the display control program will be described below with reference to FIGS. 3 and 5 to 7 based on the flowchart shown in FIG. .. The display control process shown in FIG. 8 is started by the HCU 100 that has completed the start-up process or the like, for example, by switching the vehicle power supply to the on state.
 まずHCU100は、S10にて、ナビECU62からの情報に基づいて目的地が設定されているか否かを判定する。目的地が設定されていないと判定された場合には、目的地が設定されるまでS10の判定を繰り返す。目的地が設定されていると判定された場合には、S20へと進む。 First, the HCU 100 determines in S10 whether or not the destination is set based on the information from the navigation ECU 62. If it is determined that the destination has not been set, the determination in S10 is repeated until the destination is set. If it is determined that the destination has been set, the process proceeds to S20.
 S20では、ナビECU62からの案内実施要求が有るか否かを判定する。換言すれば、車両Aから案内地点GPまでの残距離Lrが第1閾値未満となったか否かを判定する。案内実施要求が無いと判定されると、案内実施要求を取得するまでS20の判定を繰り返す。一方で案内実施要求有と判定した場合には、S30へと進む。 In S20, it is determined whether or not there is a guidance implementation request from the navigation ECU 62. In other words, it is determined whether or not the remaining distance Lr from the vehicle A to the guide point GP is less than the first threshold value. If it is determined that there is no guidance implementation request, the determination in S20 is repeated until the guidance implementation request is obtained. On the other hand, if it is determined that there is a guidance implementation request, the process proceeds to S30.
 S30では、表示レイアウトのシミュレーションを実行し、路面の視認内エリアAvおよび視認外エリアAiの推定を行う。各エリアAv、Aiを推定すると、S40へと進み、経路コンテンツCTrを視認内エリアAvにのみ重畳表示する。すなわち、視認外エリアAiへの経路コンテンツCTrの重畳を中断する。重畳表示を実行すると、S50へと進む。 In S30, the display layout is simulated to estimate the visible area Av and the non-visible area Ai of the road surface. When each area Av and Ai are estimated, the process proceeds to S40, and the route content CTr is superimposed and displayed only on the visible area Av. That is, the superimposition of the route content CTr on the non-visual area Ai is interrupted. When the superimposed display is executed, the process proceeds to S50.
 S50では、ロケータECU44からの自車位置情報およびナビECU62からの案内地点GPの位置情報に基づき、車両Aから案内地点GPまでの残距離Lrが第2閾値未満となったか否かを判定する。残距離Lrが第2閾値以上であると判定している間は、S30、S40の処理を繰り返し、走行に伴う各エリアAv,Aiの変化に合わせて経路コンテンツCTrの描画形状を更新していく。一方で残距離Lrが第2閾値未満であると判定した場合には、S60へと進む。 In S50, it is determined whether or not the remaining distance Lr from the vehicle A to the guide point GP is less than the second threshold value based on the own vehicle position information from the locator ECU 44 and the position information of the guide point GP from the navigation ECU 62. While it is determined that the remaining distance Lr is equal to or higher than the second threshold value, the processes of S30 and S40 are repeated, and the drawing shape of the route content CTr is updated according to the change of each area Av and Ai accompanying the running. .. On the other hand, if it is determined that the remaining distance Lr is less than the second threshold value, the process proceeds to S60.
 S60では、各エリアAv,Aiの推定を再度実施してS70へと進む。S70では、S60にて推定した各エリアAv,Aiと案内地点GPの位置情報とに基づき、案内地点GPが視認内エリアAvに含まれるか否かを判定する。案内地点GPが視認内エリアAvに含まれる場合には、S80へと進み、S40と同様に視認内エリアAvに経路コンテンツCTrを重畳表示してS110へと進む。 In S60, the estimation of each area Av and Ai is performed again, and the process proceeds to S70. In S70, it is determined whether or not the guide point GP is included in the visible area Av based on the respective areas Av and Ai estimated in S60 and the position information of the guide point GP. When the guide point GP is included in the visible area Av, the process proceeds to S80, and the route content CTr is superimposed and displayed on the visible area Av in the same manner as S40, and the process proceeds to S110.
 一方で、S70にて案内地点GPが視認外エリアAiに含まれると判定すると、S90へと進む。S90では、案内地点GPから視認可能地点VPまでの距離が閾値未満であるか否かを判定する。閾値以上であると判定された場合には、S80へと進む。すなわち、視認可能地点VPが案内地点GPから比較的遠い場合には、視認外情報コンテンツCTiの表示を停止する。一方で、案内地点GPから視認可能地点VPまでの距離が閾値未満であると判定された場合には、S100へと進む。 On the other hand, if it is determined in S70 that the guide point GP is included in the non-visual area Ai, the process proceeds to S90. In S90, it is determined whether or not the distance from the guide point GP to the visible point VP is less than the threshold value. If it is determined that the threshold value is equal to or higher than the threshold value, the process proceeds to S80. That is, when the visible point VP is relatively far from the guide point GP, the display of the non-visible information content CTi is stopped. On the other hand, if it is determined that the distance from the guide point GP to the visible point VP is less than the threshold value, the process proceeds to S100.
 S100では、視認内エリアAvに重畳される経路コンテンツCTrに加えて、視認外情報コンテンツCTiを重畳表示する。S100の表示処理を実行すると、S110へと進む。 In S100, in addition to the route content CTr superimposed on the visible area Av, the non-visual information content CTi is superimposed and displayed. When the display process of S100 is executed, the process proceeds to S110.
 S110では、経路案内表示の終了条件が成立したか否かを判定する。終了条件は、例えば案内地点GPの通過や、案内地点GPよりも進行方向前方に設定された案内終了地点の通過等に基づき成立したと判定される。終了条件が成立していないと判定している間は、S60~S100の処理を繰り返して、経路案内に関わる重畳コンテンツCTs(経路コンテンツCTrおよび視認外情報コンテンツCTi)の描画形状および表示状態を更新していく。一方で、終了条件が成立したと判定した場合には、S120へと進み、経路案内に関わる重畳コンテンツCTsを非表示として、一連の処理を終了する。 In S110, it is determined whether or not the end condition of the route guidance display is satisfied. It is determined that the end condition is satisfied based on, for example, the passage of the guide point GP or the passage of the guide end point set ahead of the guide point GP in the traveling direction. While it is determined that the end condition is not satisfied, the processes of S60 to S100 are repeated to update the drawing shape and display state of the superimposed content CTs (route content CTr and non-visual information content CTi) related to the route guidance. I will do it. On the other hand, when it is determined that the end condition is satisfied, the process proceeds to S120, the superimposed content CTs related to the route guidance are hidden, and the series of processes is ended.
 次に第1実施形態のHCU100の構成および作用効果について説明する。 Next, the configuration and action / effect of the HCU100 of the first embodiment will be described.
 HCU100の表示生成部76は、案内地点GPが視認外エリアAiに含まれる場合には、視認外エリアAiへの経路コンテンツCTrの重畳表示を停止する。表示生成部76は、視認外情報コンテンツCTiを視認内エリアAvよりも上方に表示される表示高さで、案内地点GPに関連付けた表示位置に重畳表示させる。 When the guide point GP is included in the non-visible area Ai, the display generation unit 76 of the HCU 100 stops the superimposed display of the route content CTr on the non-visible area Ai. The display generation unit 76 superimposes and displays the non-visual information content CTi on the display position associated with the guide point GP at the display height displayed above the visible area Av.
 これによれば、案内地点GPが視認外エリアAiに含まれる場合、経路コンテンツCTrの視認外エリアAiへの重畳表示が停止され、視認外情報コンテンツCTiが、視認内エリアAvよりも上方に位置付けられて重畳表示される。このため、乗員であるドライバは、案内地点GPに関する情報を視認内エリアAvに重畳される経路コンテンツCTrと区別して認識し得る。そして、視認外情報コンテンツCTiは、進行予定経路上の所定位置である案内地点GPに関連付けた表示位置に重畳表示されるので、進行予定経路上の情報を提示していることが、乗員に認識され易い。以上により、ドライバに対して分かり易い表示が可能なHCU100および表示制御プログラムを提供できる。且つ、視認外エリアAiに位置する案内地点GPの情報を、視認外情報コンテンツCTiによって前もってドライバに提示することができるので、HCU100は利便性の高い表示が可能である。 According to this, when the guidance point GP is included in the non-visible area Ai, the superimposed display of the route content CTr on the non-visible area Ai is stopped, and the non-visible information content CTi is positioned above the visible area Av. Is superimposed and displayed. Therefore, the driver who is a occupant can recognize the information about the guide point GP separately from the route content CTr superimposed on the visible area Av. Then, since the non-visual information content CTi is superimposed and displayed on the display position associated with the guide point GP which is a predetermined position on the scheduled travel route, the occupant recognizes that the information on the scheduled travel route is presented. Easy to do. From the above, it is possible to provide the HCU 100 and the display control program capable of displaying the driver in an easy-to-understand manner. Moreover, since the information of the guide point GP located in the non-visible area Ai can be presented to the driver in advance by the non-visible information content CTi, the HCU 100 can be displayed with high convenience.
 表示生成部76は、視認可能地点VPから案内地点GPまでの距離が閾値を下回る場合に視認外情報コンテンツCTiを表示させる。このため、表示生成部76は、案内地点GPを視認可能になってから案内地点GPに到達するまでの時間が比較的短い状況下で、案内地点GPの情報を前もって確実に提示できる。したがって、表示生成部76は、ドライバに対して安心感を与えることが可能である。 The display generation unit 76 displays the non-visual information content CTi when the distance from the visible point VP to the guide point GP is less than the threshold value. Therefore, the display generation unit 76 can surely present the information of the guide point GP in advance under the situation that the time from when the guide point GP becomes visible to the time when the guide point GP is reached is relatively short. Therefore, the display generation unit 76 can give a sense of security to the driver.
 また、表示生成部76は、視認可能地点VPから案内地点GPまでの距離が閾値を上回る場合には、視認外情報コンテンツCTiの表示を停止する。これによれば、表示生成部76は、案内地点GPの情報を前もって提示する必要性が比較的小さい状況下では、視認外情報コンテンツCTiの表示を回避できる。したがって、表示生成部76は、画角VA内が表示物により煩雑になることを抑制できる。 Further, when the distance from the visible point VP to the guide point GP exceeds the threshold value, the display generation unit 76 stops the display of the non-visible information content CTi. According to this, the display generation unit 76 can avoid the display of the non-visual information content CTi in a situation where the need to present the information of the guide point GP in advance is relatively small. Therefore, the display generation unit 76 can prevent the inside of the angle of view VA from becoming complicated by the displayed object.
 表示生成部76は、視認外情報コンテンツCTiの全体を視認内エリアAvに重畳された経路コンテンツCTrより上方で経路コンテンツCTrに重ならない表示位置に表示させる。これによれば、視認外情報コンテンツCTiと経路コンテンツCTrとが離れて表示されるので、表示生成部76は、より見易い表示を提供できる。特に第1実施形態の視認外情報コンテンツCTiは、経路コンテンツCTrの上縁部の直上に表示されるので、経路コンテンツCTrと連続した経路上の情報を提示していることが分かり易い。 The display generation unit 76 displays the entire non-visual information content CTi at a display position above the route content CTr superimposed on the visible area Av and not overlapping the route content CTr. According to this, since the non-visual information content CTi and the route content CTr are displayed apart from each other, the display generation unit 76 can provide a display that is easier to see. In particular, since the non-visual information content CTi of the first embodiment is displayed directly above the upper edge of the route content CTr, it is easy to understand that the information on the route continuous with the route content CTr is presented.
 表示生成部76は、視認外情報コンテンツCTiを、案内地点GPの位置に関連付けた表示位置に重畳表示させる。これによれば、視認外情報コンテンツCTiが案内地点GPに関連する表示であることをより明確に提示することができる。 The display generation unit 76 superimposes and displays the non-visual information content CTi on the display position associated with the position of the guide point GP. According to this, it is possible to more clearly present that the non-visual information content CTi is a display related to the guide point GP.
 表示生成部76は、ドライバが案内地点GPを視認可能となった場合に、視認外情報コンテンツCTiを非表示とする。これによれば、表示生成部76は、視認外情報コンテンツCTiが不要となった場合に非表示とすることで、画角VA内が表示物によって煩雑になることを抑制することができる。 The display generation unit 76 hides the non-visual information content CTi when the driver can visually recognize the guide point GP. According to this, the display generation unit 76 hides the non-visual information content CTi when it is no longer needed, so that it is possible to prevent the inside of the angle of view VA from becoming complicated by the displayed object.
 表示生成部76は、経路コンテンツCTrを視認外情報コンテンツCTiに先立って表示させる。これによれば、表示生成部76はより車両Aから遠い側の表示となる視認外情報コンテンツCTiについて、経路コンテンツCTrに遅れて表示させることができる。故に、視認外エリアAiから比較的遠く、必要性の小さい段階で視認外情報コンテンツCTiが表示され、画角VA内が煩雑になることを回避できる。 The display generation unit 76 displays the route content CTr prior to the non-visual information content CTi. According to this, the display generation unit 76 can display the non-visual information content CTi, which is displayed on the side farther from the vehicle A, behind the route content CTr. Therefore, it is possible to avoid that the non-visual information content CTi is displayed at a stage where it is relatively far from the non-visual area Ai and the necessity is small, and the inside of the angle of view VA becomes complicated.
 (第2実施形態)
 第2実施形態では、第1実施形態におけるHCU100の変形例について説明する。図9において第1実施形態の図面中と同一符号を付した構成要素は、同様の構成要素であり、同様の作用効果を奏するものである。第2実施形態のHCU100は、視認外情報コンテンツCTiの表示態様が第1実施形態と相違する。
(Second Embodiment)
In the second embodiment, a modified example of the HCU 100 in the first embodiment will be described. The components having the same reference numerals as those in the drawings of the first embodiment in FIG. 9 are the same components and have the same effects. The HCU 100 of the second embodiment is different from the first embodiment in the display mode of the non-visual information content CTi.
 第2実施形態の表示生成部76は、視認外情報コンテンツCTiのアニメーション表示を実施する。第2実施形態において、視認外情報コンテンツCTiは、案内地点GPでの進行予定方向である左方向を指す直線的な矢印形状のコンテンツとされる(図9参照)。視認外情報コンテンツCTiは、案内地点GPでの進行方向に向かって移動するようにアニメーション表示される。例えば、視認外情報コンテンツCTiは、点線で示す移動開始位置から左方向に向かって連続的に滑らかに移動するように描画される。移動終了位置まで移動すると、視認外情報コンテンツCTiは、消失して再度移動開始位置に出現するか、左方向への移動よりも速く移動開始位置へと戻るように移動した後、再度左方向への移動するようにアニメーション表示される。 The display generation unit 76 of the second embodiment implements an animation display of the non-visual information content CTi. In the second embodiment, the non-visual information content CTi is a content having a linear arrow shape pointing to the left direction, which is the planned traveling direction at the guide point GP (see FIG. 9). The non-visual information content CTi is animated and displayed so as to move in the traveling direction at the guidance point GP. For example, the non-visual information content CTi is drawn so as to continuously and smoothly move to the left from the movement start position indicated by the dotted line. When moving to the movement end position, the non-visual information content CTi disappears and reappears at the movement start position, or moves so as to return to the movement start position faster than the movement to the left, and then moves to the left again. Animated to move.
 アニメーション表示において、視認外情報コンテンツCTiは、移動開始位置を案内地点GPの上方位置とされ、この位置を起点に移動するように表示される。または、視認外情報コンテンツCTiは、移動終了位置を案内地点GPの上方位置とされてもよく、移動開始位置から移動終了位置までの間に案内地点GPの上方を通過するように表示されてもよい。 In the animation display, the non-visual information content CTi has the movement start position as the upper position of the guide point GP, and is displayed so as to move from this position as the starting point. Alternatively, the non-visual information content CTi may have the movement end position as a position above the guide point GP, or may be displayed so as to pass above the guide point GP between the movement start position and the movement end position. Good.
 第2実施形態の表示生成部76は、視認外情報コンテンツCTiを案内地点GPにおける進行予定方向に向かって移動するようにアニメーション表示させるので、視認外情報コンテンツCTiの動きを利用して案内情報をドライバに提示できる。したがって、表示生成部76は、より直感的で且つ分かり易い情報提示が可能となる。 Since the display generation unit 76 of the second embodiment animates the non-visual information content CTi so as to move toward the scheduled direction of travel at the guidance point GP, the guidance information is displayed using the movement of the non-visual information content CTi. Can be presented to the driver. Therefore, the display generation unit 76 can present information in a more intuitive and easy-to-understand manner.
 (第3実施形態)
 第3実施形態では、第1実施形態におけるHCU100の変形例について説明する。図10において第1実施形態の図面中と同一符号を付した構成要素は、同様の構成要素であり、同様の作用効果を奏するものである。第3実施形態のHCU100は、視認外情報コンテンツCTiの表示態様が第1実施形態と相違する。
(Third Embodiment)
In the third embodiment, a modification of the HCU 100 in the first embodiment will be described. In FIG. 10, the components having the same reference numerals as those in the drawings of the first embodiment are the same components and have the same effects. The HCU 100 of the third embodiment is different from the first embodiment in the display mode of the non-visual information content CTi.
 第3実施形態において、視認外情報コンテンツCTiは、案内地点GPの道路形状を、案内情報として提示する。図10に示す例では、視認外情報コンテンツCTiは、案内地点GPが設定された交差点の上空からの平面視を、模式的に図示するコンテンツとされる。 In the third embodiment, the non-visual information content CTi presents the road shape of the guidance point GP as guidance information. In the example shown in FIG. 10, the non-visual information content CTi is content that schematically illustrates a plan view from the sky of an intersection where the guide point GP is set.
 (第4実施形態)
 第4実施形態では、第1実施形態におけるHCU100の変形例について説明する。図11において第1実施形態の図面中と同一符号を付した構成要素は、同様の構成要素であり、同様の作用効果を奏するものである。第4実施形態のHCU100は、視認外情報コンテンツCTiの表示態様が第1実施形態と相違する。
(Fourth Embodiment)
In the fourth embodiment, a modification of the HCU 100 in the first embodiment will be described. The components having the same reference numerals as those in the drawings of the first embodiment in FIG. 11 are the same components and have the same effects. The HCU 100 of the fourth embodiment is different from the first embodiment in the display mode of the non-visual information content CTi.
 第4実施形態において、視認外情報コンテンツCTiは、案内地点GPを含む路面がドライバから見えないことに対する警告を、案内情報として提示する。図11に示す例では、視認外情報コンテンツCTiは、円形状を呈するオブジェクトの表面にエクスクラメーションマークが描かれたコンテンツとして描画される。 In the fourth embodiment, the non-visual information content CTi presents a warning as guidance information that the road surface including the guidance point GP cannot be seen by the driver. In the example shown in FIG. 11, the non-visual information content CTi is drawn as content in which an exclamation mark is drawn on the surface of an object having a circular shape.
 (第5実施形態)
 第5実施形態では、第1実施形態におけるHCU100の変形例について説明する。図12、13において第1実施形態の図面中と同一符号を付した構成要素は、同様の構成要素であり、同様の作用効果を奏するものである。
(Fifth Embodiment)
In the fifth embodiment, a modification of the HCU 100 in the first embodiment will be described. The components having the same reference numerals as those in the drawings of the first embodiment in FIGS. 12 and 13 are the same components and have the same effects.
 第5実施形態において、仮想レイアウト部75は、第1仮想オブジェクトV1と同様に走行予定経路を辿る形状の第2仮想オブジェクトV2を配置する(図12参照)。第2仮想オブジェクトV2は、視認外エリアAiの上方に浮かぶ帯状のオブジェクトとされる。第2仮想オブジェクトV2の先端部は、重畳範囲SAに収まる矢印形状とされる。第2仮想オブジェクトV2は、視認外エリアAiにおける走行予定経路の仮想路面を平面的に覆うように配置された帯状のオブジェクトを、仮想カメラ位置CPから視認可能な位置まで持ち上げた姿勢で配置される。第2仮想オブジェクトV2は、その全体が重畳範囲SAに収まるように配置される。第2仮想オブジェクトV2は、第1仮想オブジェクトV1の視認内エリアAvに配置された部分から連続して、同じ勾配で延長された形状を呈する。なお、上記の姿勢および形状で配置すると重畳範囲SAからはみ出る場合、第2仮想オブジェクトV2は、重畳範囲SAに収まる姿勢で配置されるか、または重畳範囲SAに収まる形状に変形される。 In the fifth embodiment, the virtual layout unit 75 arranges the second virtual object V2 having a shape that follows the planned travel route in the same manner as the first virtual object V1 (see FIG. 12). The second virtual object V2 is a band-shaped object that floats above the non-visible area Ai. The tip of the second virtual object V2 has an arrow shape that fits within the superposition range SA. The second virtual object V2 is arranged in a posture in which a strip-shaped object arranged so as to cover the virtual road surface of the planned travel route in the non-visible area Ai in a plane is lifted from the virtual camera position CP to a visible position. .. The second virtual object V2 is arranged so that the entire second virtual object V2 fits in the superposition range SA. The second virtual object V2 has a shape that is continuous from the portion arranged in the visible area Av of the first virtual object V1 and is extended with the same gradient. If the second virtual object V2 is arranged in the above posture and shape and extends beyond the superimposition range SA, the second virtual object V2 is arranged in a posture that fits in the superimposition range SA or is deformed into a shape that fits in the superimposition range SA.
 表示生成部76は、視認外情報コンテンツCTiを、視認外エリアAiにおける走行予定経路の路面の上方で且つドライバから視認可能な空間を重畳対象とする重畳コンテンツCTsとして描画する(図13参照)。視認外情報コンテンツCTiは、視認外エリアAiの走行予定経路に沿って、経路コンテンツCTrを空中に延長したような形状とされる。視認外情報コンテンツCTiは、経路コンテンツCTrの切れ目の部分、すなわち視認内エリアAvと視認外エリアAiの境界地点に表示位置を関連付けられて重畳表示される。視認外情報コンテンツCTiは、輝度、透過率、表示色、および模様等の表示態様を、経路コンテンツCTrと異なるものとされる。これにより視認外情報コンテンツCTiは、視認内エリアAvの路面に重畳された経路コンテンツCTrとより明確に区別されて視認される。なお、視認外情報コンテンツCTiは、上述の表示態様が経路コンテンツCTrと同等とされてもよい。 The display generation unit 76 draws the non-visual information content CTi as superposed content CTs that superimpose the space above the road surface of the planned travel route in the non-visible area Ai and visible to the driver (see FIG. 13). The non-visible information content CTi has a shape in which the route content CTr is extended in the air along the planned travel route of the non-visible area Ai. The non-visual information content CTi is superimposed and displayed in association with the display position at the cut portion of the route content CTr, that is, the boundary point between the visible in-view area Av and the non-visual area Ai. The non-visual information content CTi is different from the path content CTr in display modes such as brightness, transmittance, display color, and pattern. As a result, the non-visual information content CTi is visually distinguished from the route content CTr superimposed on the road surface of the visible area Av. The non-visual information content CTi may have the same display mode as the route content CTr.
 (他の実施形態)
 上述の実施形態において、HCU100は、ナビゲーション装置60にて設定された目的地への経路を提示する経路コンテンツCTrおよび視認外情報コンテンツCTiを重畳表示させるとした。これに代えて、LTCやLCA等による車両Aの走行予定経路を提示する経路コンテンツCTrおよび視認外情報コンテンツCTiを表示する構成としてもよい。この場合、右左折または車線変更を行う地点、および交差点等の複数の道路が接続された地点などが、特定地点として設定される。
(Other embodiments)
In the above-described embodiment, the HCU 100 superimposes and displays the route content CTr and the non-visual information content CTi that present the route to the destination set by the navigation device 60. Instead of this, the route content CTr and the non-visual information content CTi that present the planned travel route of the vehicle A by the LTC or LCA may be displayed. In this case, a point where a right or left turn or a lane change is made, a point where a plurality of roads such as an intersection are connected, and the like are set as specific points.
 上述の実施形態において、HCU100は、視認外情報コンテンツCTiをドライバから視認できる高さにて案内地点GPの上方に浮いているように表示するとした。これに代えて、HCU100は、視認外情報コンテンツCTiを案内地点GPよりも手前側の地点に浮いているように表示してもよい。例えば、図14に示すように、案内地点GPの手前に標高のより高い地点(頂上地点)が存在する場合、HCU100は、第2仮想オブジェクトV2を頂上地点の上方に配置してもよい。この場合、視認外情報コンテンツCTiは、頂上地点の上方に配置された第2仮想オブジェクトV2に基づいて描画されるので、案内地点GPの上方に重畳された場合よりも、同じ残距離Lrに対する大きさが大きくなる。 In the above-described embodiment, the HCU 100 displays the non-visual information content CTi as if it were floating above the guide point GP at a height that can be visually recognized by the driver. Instead of this, the HCU 100 may display the non-visual information content CTi as if it were floating at a point on the front side of the guide point GP. For example, as shown in FIG. 14, when there is a higher altitude point (top point) in front of the guide point GP, the HCU 100 may place the second virtual object V2 above the top point. In this case, since the non-visual information content CTi is drawn based on the second virtual object V2 arranged above the top point, it is larger than the case where it is superimposed above the guide point GP with respect to the same remaining distance Lr. Becomes larger.
 上述の実施形態において、HCU100は、視認外情報コンテンツCTiの全体を、視認内エリアAvの上方で視認内エリアAvに重ならないように表示するとした。これに代えて、HCU100は、視認外情報コンテンツCTiの一部が視認内エリアAvに重なるように表示してもよい。この場合、視認外情報コンテンツCTiは、図15に示すように、一部が視認内エリアAvに重畳された経路コンテンツCTrに重なって表示される。これにより、視認外情報コンテンツCTiは、視認内エリアAvにおける走行予定経路上の地点に浮いたように表示される。視認外情報コンテンツCTiは、視認内エリアAvに全体を重ならないように表示すると画角VAからはみ出る場合に、一部が視認内エリアAvに重なるような表示とされる。画角VAからはみ出るか否かは、画角VAの上縁から視認内エリアAvの上縁までの幅の大きさ等に基づき表示生成部76が判定すればよい。 In the above-described embodiment, the HCU 100 displays the entire non-visual information content CTi so as not to overlap the visible area Av above the visible area Av. Instead of this, the HCU 100 may display a part of the non-visual information content CTi so as to overlap the visible area Av. In this case, as shown in FIG. 15, the non-visual information content CTi is displayed so as to partially overlap the path content CTr superimposed on the visible area Av. As a result, the non-visual information content CTi is displayed as if it were floating at a point on the planned travel route in the visible area Av. When the non-visual information content CTi is displayed so as not to overlap the visible area Av as a whole, the display is such that a part of the non-visual information content CTi overlaps the visible area Av when it extends beyond the angle of view VA. Whether or not it protrudes from the angle of view VA may be determined by the display generation unit 76 based on the size of the width from the upper edge of the angle of view VA to the upper edge of the visible area Av.
 上述に実施形態では、視認外エリアAiが上り勾配路によって遮られる路面のエリアである場合について説明したが、視認外エリアAiは、カーブ路における道路脇の構造物によって遮られる路面のエリアであってもよい。 In the above-described embodiment, the case where the non-visible area Ai is the area of the road surface blocked by the uphill road has been described, but the non-visible area Ai is the area of the road surface blocked by the roadside structure on the curved road. You may.
 上述の実施形態の処理部およびプロセッサは、1つまたは複数のCPU(Central Processing Unit)を含む。こうした処理部およびプロセッサは、CPUに加えて、GPU(Graphics Processing Unit)およびDFP(Data Flow Processor)等を含む処理部であってよい。さらに処理部およびプロセッサは、FPGA(Field-Programmable Gate Array)、並びにAIの学習および推論等の特定処理に特化したIPコア等を含む処理部であってもよい。こうしたプロセッサの各演算回路部は、プリント基板に個別に実装された構成であってもよく、またはASIC(Application Specific Integrated Circuit)およびFPGA等に実装された構成であってもよい。 The processing unit and processor of the above-described embodiment include one or more CPUs (Central Processing Units). Such a processing unit and a processor may be a processing unit including a GPU (Graphics Processing Unit), a DFP (Data Flow Processor), and the like in addition to the CPU. Further, the processing unit and the processor may be a processing unit including an FPGA (Field-Programmable Gate Array) and an IP core specialized in specific processing such as learning and inference of AI. Each arithmetic circuit unit of such a processor may be individually mounted on a printed circuit board, or may be mounted on an ASIC (Application Specific Integrated Circuit), an FPGA, or the like.
 制御プログラムを記憶するメモリ装置には、フラッシュメモリおよびハードディスク等の種々の非遷移的実体的記憶媒体(non-transitory tangible storage medium)が採用可能である。こうした記憶媒体の形態も、適宜変更されてよい。例えば記憶媒体は、メモリカード等の形態であり、車載ECUに設けられたスロット部に挿入されて、制御回路に電気的に接続される構成であってよい。 As the memory device for storing the control program, various non-transitional substantive storage media (non-transition tangible storage media) such as a flash memory and a hard disk can be adopted. The form of such a storage medium may also be changed as appropriate. For example, the storage medium may be in the form of a memory card or the like, and may be inserted into a slot portion provided in an in-vehicle ECU and electrically connected to a control circuit.
 本開示に記載の制御部およびその手法は、コンピュータプログラムにより具体化された1つ乃至は複数の機能を実行するようにプログラムされたプロセッサを構成する専用コンピュータにより、実現されてもよい。あるいは、本開示に記載の装置およびその手法は、専用ハードウェア論理回路により、実現されてもよい。もしくは、本開示に記載の装置およびその手法は、コンピュータプログラムを実行するプロセッサと1つ以上のハードウェア論理回路との組み合わせにより構成された1つ以上の専用コンピュータにより、実現されてもよい。また、コンピュータプログラムは、コンピュータにより実行されるインストラクションとして、コンピュータ読み取り可能な非遷移有形記録媒体に記憶されていてもよい。 The control unit and its method described in the present disclosure may be realized by a dedicated computer constituting a processor programmed to execute one or a plurality of functions embodied by a computer program. Alternatively, the apparatus and method thereof described in the present disclosure may be realized by a dedicated hardware logic circuit. Alternatively, the apparatus and method thereof described in the present disclosure may be realized by one or more dedicated computers configured by a combination of a processor that executes a computer program and one or more hardware logic circuits. Further, the computer program may be stored in a computer-readable non-transitional tangible recording medium as an instruction executed by the computer.
 ここで、この出願に記載されるフローチャート、あるいは、フローチャートの処理は、複数のセクション(あるいはステップと言及される)から構成され、各セクションは、たとえば、S10と表現される。さらに、各セクションは、複数のサブセクションに分割されることができる、一方、複数のセクションが合わさって一つのセクションにすることも可能である。さらに、このように構成される各セクションは、デバイス、モジュール、ミーンズとして言及されることができる。 Here, the flowchart described in this application, or the processing of the flowchart, is composed of a plurality of sections (or referred to as steps), and each section is expressed as, for example, S10. Further, each section can be divided into a plurality of subsections, while a plurality of sections can be combined into one section. In addition, each section thus constructed can be referred to as a device, module, or means.
 本開示は、実施例に準拠して記述されたが、本開示は当該実施例や構造に限定されるものではないと理解される。本開示は、様々な変形例や均等範囲内の変形をも包含する。加えて、様々な組み合わせや形態、さらには、それらに一要素のみ、それ以上、あるいはそれ以下、を含む他の組み合わせや形態をも、本開示の範疇や思想範囲に入るものである。 Although this disclosure has been described in accordance with the examples, it is understood that the disclosure is not limited to the examples and structures. The present disclosure also includes various modifications and modifications within an equal range. In addition, various combinations and forms, as well as other combinations and forms that include only one element, more, or less, are also within the scope of the present disclosure.

Claims (9)

  1.  車両(A)において用いられ、ヘッドアップディスプレイ(20)によるコンテンツの重畳表示を制御する表示制御装置であって、
     前景中の路面のうち、前記車両の乗員から視認可能な視認内エリア(Av)と、前記乗員から視認不可能な視認外エリア(Ai)とを推定する推定部(75)と、
     特定地点(GP)での前記車両の進行予定経路を提示する経路コンテンツ(CTr)を前記路面に重畳表示させる表示制御部(76)と、
     を備え、
     前記表示制御部は、
     前記特定地点が前記視認外エリアに含まれる場合には、前記視認外エリアへの前記経路コンテンツの重畳表示を停止し、前記特定地点に関する情報を提示する視認外情報コンテンツ(CTi)を、少なくとも一部が前記視認内エリアよりも上方に表示される表示高さで、前記進行予定経路上の所定位置に関連付けた表示位置に重畳表示させる表示制御装置。
    A display control device used in a vehicle (A) that controls superimposed display of content by a head-up display (20).
    Of the road surface in the foreground, an estimation unit (75) that estimates an invisible area (Av) that can be seen by the occupant of the vehicle and an out-of-sight area (Ai) that cannot be seen by the occupant.
    A display control unit (76) that superimposes and displays route content (CTr) that presents the planned travel route of the vehicle at a specific point (GP) on the road surface.
    With
    The display control unit
    When the specific point is included in the non-visible area, at least one non-visible information content (CTi) that stops the superimposed display of the route content on the non-visible area and presents information about the specific point is provided. A display control device that superimposes a display on a display position associated with a predetermined position on the scheduled travel path at a display height at which a unit is displayed above the visible area.
  2.  前記表示制御部は、前記乗員が前記特定地点を視認可能となる視認可能地点(VP)から前記特定地点までの距離が閾値を下回る場合に、前記視認外情報コンテンツを表示させる請求項1に記載の表示制御装置。 The display control unit according to claim 1, wherein when the distance from the visible point (VP) at which the occupant can visually recognize the specific point is less than the threshold value, the non-visual information content is displayed. Display control device.
  3.  前記表示制御部は、前記視認可能地点から前記特定地点までの距離が前記閾値を上回る場合には、前記視認外情報コンテンツの表示を停止する請求項2に記載の表示制御装置。 The display control device according to claim 2, wherein the display control unit stops displaying the non-visual information content when the distance from the visible point to the specific point exceeds the threshold value.
  4.  前記表示制御部は、前記視認外情報コンテンツの全体を前記視認内エリアに重畳された前記経路コンテンツより上方で前記経路コンテンツに重ならない表示位置に表示させる請求項1から請求項3のいずれか1項に記載の表示制御装置。 Any one of claims 1 to 3, wherein the display control unit displays the entire non-visual information content at a display position above the route content superimposed on the visual area and does not overlap the route content. The display control device described in the section.
  5.  前記表示制御部は、前記視認外情報コンテンツを、前記進行予定経路上の前記特定地点の位置に関連付けた表示位置に重畳表示させる請求項1から請求項4のいずれか1項に記載の表示制御装置。 The display control according to any one of claims 1 to 4, wherein the display control unit superimposes and displays the non-visual information content on a display position associated with the position of the specific point on the scheduled travel path. apparatus.
  6.  前記表示制御部は、前記乗員が前記特定地点を視認可能となった場合に、前記視認外情報コンテンツを非表示とする請求項1から請求項5のいずれか1項に記載の表示制御装置。 The display control device according to any one of claims 1 to 5, wherein the display control unit hides the non-visual information content when the occupant can visually recognize the specific point.
  7.  前記表示制御部は、前記視認内エリアに重畳させる前記経路コンテンツを、前記視認外情報コンテンツに先立って表示させる請求項1から請求項6のいずれか1項に記載の表示制御装置。 The display control device according to any one of claims 1 to 6, wherein the display control unit displays the route content superimposed on the visible area in advance of the non-visual information content.
  8.  前記表示制御部は、前記視認外情報コンテンツを、前記特定地点における前記車両の進行予定方向に移動させる請求項1から請求項7のいずれか1項に記載の表示制御装置。 The display control device according to any one of claims 1 to 7, wherein the display control unit moves the non-visual information content in the planned traveling direction of the vehicle at the specific point.
  9.  車両(A)において用いられ、ヘッドアップディスプレイ(20)によるコンテンツの重畳表示を制御する表示制御プログラムであって、
     少なくとも1つの処理部(11)に、
     前景中の路面のうち、前記車両の乗員から視認可能な視認内エリア(Av)と、前記乗員から視認不可能な視認外エリア(Ai)とを推定し(S60)、
     特定地点(GP)が前記視認外エリアに含まれる場合には、前記路面に重畳されて前記特定地点での前記車両の進行予定経路を提示する経路コンテンツ(CTr)の前記視認外エリアへの重畳表示を停止し、前記特定地点に関する情報を提示する視認外情報コンテンツ(CTi)を、少なくとも一部が前記視認内エリアよりも上方に表示される表示高さで、前記進行予定経路上の所定位置に関連付けた表示位置に重畳表示させる(S100)、
     ことを含む処理を実行させる表示制御プログラム。

     
    A display control program used in a vehicle (A) that controls superimposed display of content on a head-up display (20).
    In at least one processing unit (11)
    Of the road surface in the foreground, the visible in-visible area (Av) visible to the occupant of the vehicle and the non-visible area (Ai) invisible to the occupant are estimated (S60).
    When the specific point (GP) is included in the non-visible area, the route content (CTr) superimposed on the road surface and presenting the planned travel route of the vehicle at the specific point is superimposed on the non-visible area. A predetermined position on the planned travel path at a display height at which at least a part of the non-visual information content (CTi) that stops the display and presents information about the specific point is displayed above the visible area. (S100), superimposed on the display position associated with
    A display control program that executes processing including that.

PCT/JP2020/012383 2019-06-05 2020-03-19 Display control device and display control program WO2020246114A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2019105597A JP7014206B2 (en) 2019-06-05 2019-06-05 Display control device and display control program
JP2019-105597 2019-06-05

Publications (1)

Publication Number Publication Date
WO2020246114A1 true WO2020246114A1 (en) 2020-12-10

Family

ID=73649501

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/012383 WO2020246114A1 (en) 2019-06-05 2020-03-19 Display control device and display control program

Country Status (2)

Country Link
JP (1) JP7014206B2 (en)
WO (1) WO2020246114A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010156608A (en) * 2008-12-26 2010-07-15 Toshiba Corp Automotive display system and display method
JP2015128956A (en) * 2014-01-08 2015-07-16 パイオニア株式会社 Head-up display, control method, program and storage medium
WO2018051912A1 (en) * 2016-09-14 2018-03-22 パナソニックIpマネジメント株式会社 Display apparatus

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010156608A (en) * 2008-12-26 2010-07-15 Toshiba Corp Automotive display system and display method
JP2015128956A (en) * 2014-01-08 2015-07-16 パイオニア株式会社 Head-up display, control method, program and storage medium
WO2018051912A1 (en) * 2016-09-14 2018-03-22 パナソニックIpマネジメント株式会社 Display apparatus

Also Published As

Publication number Publication date
JP2020196417A (en) 2020-12-10
JP7014206B2 (en) 2022-02-01

Similar Documents

Publication Publication Date Title
WO2021006060A1 (en) Display control device and display control program
JP7052786B2 (en) Display control device and display control program
WO2020246113A1 (en) Display control device and display control program
US20220118983A1 (en) Display control device and display control program product
US20220058998A1 (en) Display control device and non-transitory computer-readable storage medium for display control on head-up display
WO2020208989A1 (en) Display control device and display control program
US11850940B2 (en) Display control device and non-transitory computer-readable storage medium for display control on head-up display
JP7338735B2 (en) Display control device and display control program
JP7243660B2 (en) Display control device and display control program
CN110888432B (en) Display system, display control method, and storage medium
JP7283448B2 (en) Display controller and display control program
JP7111137B2 (en) Display controller and display control program
JP7111121B2 (en) Display control device and display control program
WO2021065735A1 (en) Display control device and display control program
WO2020246114A1 (en) Display control device and display control program
JP7092158B2 (en) Display control device and display control program
JP2021094965A (en) Display control device and display control program
JP2021037895A (en) Display control system, display control device, and display control program
JP7420165B2 (en) Display control device and display control program
JP2021060808A (en) Display control system and display control program
JP7255429B2 (en) Display controller and display control program
JP2020138609A (en) Display control device for vehicle, display control method for vehicle, and display control program for vehicle
JP7259802B2 (en) Display control device, display control program and in-vehicle system
JP7416114B2 (en) Display control device and display control program
JP2021066197A (en) Display control apparatus, display control program and on-vehicle system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20818681

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20818681

Country of ref document: EP

Kind code of ref document: A1