US20220113547A1 - Display control device, image display system, mobile body, display control method, and non-transitory computer-readable medium - Google Patents
Display control device, image display system, mobile body, display control method, and non-transitory computer-readable medium Download PDFInfo
- Publication number
- US20220113547A1 US20220113547A1 US17/560,755 US202117560755A US2022113547A1 US 20220113547 A1 US20220113547 A1 US 20220113547A1 US 202117560755 A US202117560755 A US 202117560755A US 2022113547 A1 US2022113547 A1 US 2022113547A1
- Authority
- US
- United States
- Prior art keywords
- correction amount
- display
- display position
- image
- attitude angle
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims description 17
- 238000012937 correction Methods 0.000 claims abstract description 218
- 230000008859 change Effects 0.000 claims abstract description 105
- 230000001133 acceleration Effects 0.000 claims abstract description 89
- 238000001514 detection method Methods 0.000 claims abstract description 27
- 238000005259 measurement Methods 0.000 claims description 59
- 230000007423 decrease Effects 0.000 claims description 11
- 238000012545 processing Methods 0.000 description 56
- 238000010586 diagram Methods 0.000 description 24
- 230000000007 visual effect Effects 0.000 description 18
- 239000004973 liquid crystal related substance Substances 0.000 description 15
- 238000004364 calculation method Methods 0.000 description 14
- 238000013459 approach Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 238000006073 displacement reaction Methods 0.000 description 2
- 230000007480 spreading Effects 0.000 description 2
- 206010034719 Personality change Diseases 0.000 description 1
- 238000007792 addition Methods 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000000446 fuel Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0179—Display position adjusting means not related to the information to be displayed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3179—Video signal processing therefor
- H04N9/3185—Geometric adjustment, e.g. keystone or convergence
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
- B60K35/23—Head-up displays [HUD]
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/80—Arrangements for controlling instruments
- B60K35/81—Arrangements for controlling instruments for controlling displays
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q3/00—Arrangement of lighting devices for vehicle interiors; Lighting devices specially adapted for vehicle interiors
- B60Q3/20—Arrangement of lighting devices for vehicle interiors; Lighting devices specially adapted for vehicle interiors for lighting specific fittings of passenger or driving compartments; mounted on specific fittings of passenger or driving compartments
- B60Q3/208—Sun roofs; Windows
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q3/00—Arrangement of lighting devices for vehicle interiors; Lighting devices specially adapted for vehicle interiors
- B60Q3/80—Circuits; Control arrangements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/14—Display of multiple viewports
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
- G09G5/38—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory with means for controlling the display position
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/64—Constructional details of receivers, e.g. cabinets or dust covers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3191—Testing thereof
- H04N9/3194—Testing thereof including sensor feedback
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/16—Type of output information
- B60K2360/167—Vehicle dynamics information
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/20—Optical features of instruments
- B60K2360/23—Optical features of instruments using reflectors
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/20—Optical features of instruments
- B60K2360/33—Illumination features
- B60K2360/334—Projection means
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0179—Display position adjusting means not related to the information to be displayed
- G02B2027/0183—Adaptation to parameters characterising the motion of the vehicle
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/06—Adjustment of display parameters
- G09G2320/068—Adjustment of display parameters for control of viewing angle adjustment
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/0464—Positioning
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/0464—Positioning
- G09G2340/0471—Vertical positioning
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2380/00—Specific applications
- G09G2380/10—Automotive applications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
- G09G3/36—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source using liquid crystals
- G09G3/3611—Control of matrices with row and column drivers
Definitions
- the present disclosure relates to a display control device, an image display system, a mobile body, a display control method, and a non-transitory computer-readable medium.
- a head-up display device mounted on a mobile body such as a vehicle is known (for example, see JP-A-H01-293239).
- the head-up display device disclosed in JP-A-H01-293239 projects information from an image display device onto a front shield of a vehicle, thereby displaying information in a visual field of an observer in a superimposed manner.
- the head-up display device calculates an attitude angle of the vehicle by detecting an acceleration of the vehicle, and changes a display position of a superimposed image in accordance with the attitude angle.
- a control device for a vehicle lamp that performs automatic leveling control for automatically adjusting an irradiation direction of a vehicle headlamp in accordance with an inclination angle of a vehicle (for example, see WO-A1-2016/114159).
- WO-A1-2016/114159 discloses that an optical axis angle of a vehicle lamp is adjusted based on a change in an attitude angle during stop of a vehicle and a change in the attitude angle during traveling of the vehicle.
- the present disclosure has been devised in view of the above circumstances, and an object thereof is to provide a display control device, an image display system, a mobile body, a display control method, and a program capable of improving control of a display position of an image.
- the present disclosure provides a display control device configured to control a display position of an image in an image projector configured to project the image onto a display object of a mobile body
- the display control device including: a processor; and a memory storing instructions that, when executed by the processor, cause the display control device to perform operations including: setting a correction amount used for correction of the display position; and controlling the display position of the image based on the correction amount, wherein the setting the correction amount includes: acquiring a detection value of an acceleration acting on the mobile body; calculating an attitude angle of the mobile body based on the detection value of the acceleration; and setting the correction amount of the display position for controlling the display position of the image to be projected onto the display object in accordance with the attitude angle, and wherein the correction amount of the display position is set by adjusting a correction amount per predetermined unit time in accordance with a change amount of the attitude angle in a predetermined period.
- the present disclosure provides an image display system to be mounted on a mobile body, the image display system including: an image projector configured to project an image onto a display object of the mobile body; and the display control device described above.
- the present disclosure provides a mobile body including the image display system described above, wherein the display object includes a window shield of the mobile body.
- the present disclosure provides a display control method for controlling a display position of an image in an image projector configured to project the image onto a display object of a mobile body, the display control method including: acquiring a detection value of an acceleration acting on the mobile body; calculating an attitude angle of the mobile body based on the detection value of the acceleration; and setting a correction amount of the display position for controlling the display position of the image to be projected onto the display object in accordance with the attitude angle, wherein the correction amount of the display position is set by adjusting a correction amount per predetermined unit time, in accordance with a change amount of the attitude angle in a predetermined period.
- the present disclosure provides a non-transitory computer-readable medium storing a program, when executed by a processor, causing a computer to execute the display control method described above.
- FIG. 1 is a conceptual diagram illustrating an example of a configuration of an image display system including a display control device according to an embodiment.
- FIG. 2 is a conceptual diagram of a vehicle including the image display system according to the embodiment.
- FIG. 3A is an illustrative diagram for illustrating a gravitational acceleration that acts when the vehicle is not inclined at the time of stop.
- FIG. 3B is an illustrative diagram for illustrating a gravitational acceleration that acts when the vehicle is inclined at the time of stop.
- FIG. 4A is an illustrative diagram for illustrating a motion acceleration that acts when the vehicle is not inclined during traveling.
- FIG. 4B is an illustrative diagram for illustrating a motion acceleration that acts when the vehicle is inclined during traveling.
- FIG. 5A is a schematic diagram of a vehicle that is not inclined as viewed from a lateral side.
- FIG. 5B is a conceptual diagram illustrating a visual field of a user who drives the vehicle in a state shown in FIG. 5A .
- FIG. 6A is a schematic diagram of a vehicle that is inclined upward as viewed from a lateral side.
- FIG. 6B is a conceptual diagram illustrating a visual field of a user who drives the vehicle in a state shown in FIG. 6A .
- FIG. 7A is a schematic diagram of a vehicle that is inclined downward as viewed from a lateral side.
- FIG. 7B is a conceptual diagram illustrating a visual field of a user who drives the vehicle in a state shown in FIG. 7A .
- FIG. 8 is a flowchart illustrating an operation of display position control at the time of stop in the display control device according to the embodiment.
- FIG. 9 is a flowchart illustrating an operation of display position control during traveling in the display control device according to the embodiment.
- FIG. 10 is a flowchart illustrating an operation of display position control in the display control device according to the embodiment in a case of shifting from stop to traveling.
- FIG. 11 is an illustrative table illustrating an example of a correction amount of a display position corresponding to a deviation of an attitude angle measurement value during traveling and a change amount of the attitude angle according to the embodiment.
- a user when control is performed to change a display position in accordance with a change in an attitude angle of a mobile body such as a vehicle, a user may experience a feeling of discomfort in visual recognition. For example, in a case where a correction amount of the display position is large, the user may experience a feeling of discomfort in appearance when the display position is suddenly changed.
- a display control device capable of improving visibility by appropriately adjusting a correction amount of a display position in accordance with a change amount of an attitude angle, and an image display system including the display control device are exemplified.
- a vehicle such as an automobile is assumed as an example of a mobile body, and a configuration example of an image display system mounted on the vehicle and a display control device in the image display system will be described.
- FIG. 1 is a conceptual diagram illustrating an example of a configuration of an image display system according to an embodiment.
- FIG. 2 is a conceptual diagram of a vehicle including the image display system according to the embodiment.
- an image display system 10 according to the present embodiment includes, for example, a head-up display (HUD) provided in a vehicle 100 serving as an example of a mobile body. That is, the vehicle 100 includes a mobile body main body and the image display system 10 provided in the mobile body main body.
- HUD head-up display
- the image display system 10 is installed in a vehicle interior of the vehicle 100 so as to project an image onto a front shield 101 (an example of a window shield) of the vehicle 100 from below.
- a front shield 101 an example of a window shield
- the image display system 10 is disposed in a dashboard 102 below the front shield 101 .
- a user 200 visually recognizes a virtual image 300 , which is projected in a target space 400 set in front of the vehicle 100 (outside the vehicle), through the front shield 101 .
- the “virtual image” referred to here means an image formed as if an object actually exists by a divergent light beam when light emitted from the image display system 10 is diverged by a display object such as the front shield 101 . Therefore, the user 200 who is driving the vehicle 100 can see the virtual image 300 , which corresponds to an image projected by the image display system 10 , overlapping a real space spreading in front of the vehicle 100 .
- the image display system 10 it is possible to cause the user 200 to visually recognize various types of driving support information such as vehicle speed information, navigation information, pedestrian information, preceding vehicle information, lane departure information, and vehicle condition information as the virtual image 300 . Accordingly, the user 200 can visually acquire the driving support information only by a slight movement of a line of sight from a state where the line of sight is directed to a front side of the front shield 101 .
- the virtual image 300 formed in target space 400 includes at least two types of virtual images, that is, a first virtual image 301 and a second virtual image 302 .
- the “first virtual image” referred to here relates to, for example, information indicating a traveling direction of the vehicle 100 as navigation information.
- As the first virtual image 301 an arrow indicating a right turn or a left turn can be presented on a road surface 600 .
- the first virtual image 301 of this type is a virtual image corresponding to an image displayed using augmented reality (AR) technology, and is superimposed and displayed at a specific position in a real scene (the road surface 600 , a building, a surrounding vehicle, a pedestrian, and the like) viewed from the user 200 .
- the “second virtual image” relates to, for example, information indicating a state of the vehicle 100 as instrument information.
- vehicle speed information or the like indicating a current traveling speed (vehicle speed) of the vehicle 100 can be presented. Specific examples of the first virtual image 301 and the second virtual image 302 will be described later.
- the virtual image 300 formed in the target space 400 is formed on a virtual plane 501 intersecting an optical axis 500 of the image display system 10 .
- the image display system 10 includes a main unit 1 including an image projection unit 30 (an example of an image projector).
- the image projection unit 30 forms an image 700 and projects the formed image 700 onto the front shield 101 , thereby forming the virtual image 300 corresponding to the image 700 in the target space 400 .
- the image projection unit 30 includes an image forming unit 2 and a projection unit 3 .
- the image forming unit 2 includes a display surface 20 , and forms the image 700 on the display surface 20 .
- the image forming unit 2 projects the formed image onto the projection unit 3 by output light.
- the projection unit 3 projects the image projected from the image forming unit 2 onto the front shield 101 .
- an attitude of the main unit 1 changes with an attitude of the vehicle 100 due to a load of the vehicle 100 . Since the image projection unit 30 is mounted in the main unit 1 , an attitude of the image projection unit 30 is the same as the attitude of the main unit 1 . Therefore, the attitude of the main unit 1 is also the attitude of the image projection unit 30 .
- the main unit 1 is also in a forward-inclined attitude; in a case where the vehicle 100 is in a backward-inclined attitude such as when an occupant is present in a rear seat or when luggage is placed in a trunk, the main unit 1 is also in a backward-inclined attitude.
- the attitude of the main unit 1 of the image display system 10 an attitude angle of the image projection unit 30
- a position of the virtual image 300 projected by the image display system 10 in the target space 400 also changes.
- the first virtual image 301 may be displayed in a superimposed manner at a position deviated from a specific position where the first virtual image 301 should be originally superimposed in a real scene viewed from the user 200 .
- a display position of the virtual image 300 is adjusted by adjusting a display position of the image 700 on the front shield 101 in accordance with an attitude angle of the main unit 1 .
- the image display system 10 can superimpose and display, for example, the first virtual image 301 at the specific position where the first virtual image 301 should be originally superimposed in the real scene viewed from the user 200 .
- the image display system 10 includes the image projection unit 30 and a processing unit 50 .
- a component (the processing unit 50 ) other than the image projection unit 30 is mounted (accommodated) in the main unit 1 is described, but the present disclosure is not limited thereto.
- the processing unit 50 may not be included in the main unit 1 .
- the main unit 1 is fixed in the dashboard 102 of the vehicle 100 .
- the processing unit 50 may be configured separately from the image projection unit 30 , and may be configured as a separate housing device that is not mounted on the main body unit 1 .
- the main unit 1 may include a plurality of housings.
- the image forming unit 2 of the image projection unit 30 includes, for example, a liquid crystal panel 21 (LCD: Liquid Crystal Display) and a light source device 22 .
- the liquid crystal panel 21 is disposed on a front side of the light source device 22 .
- a front surface (a surface on a side opposite to the light source device 22 ) of the liquid crystal panel 21 constitutes the display surface 20 on which the image 700 is formed.
- the light source device 22 is used as a backlight of the liquid crystal panel 21 . Light from the light source device 22 passes through the liquid crystal panel 21 from a back side of the liquid crystal panel 21 and is output from the image forming unit 2 .
- the light source device 22 is a surface light source that irradiates substantially the entire area of a back surface of the liquid crystal panel 21 with light using a solid-state light emitting element such as a light emitting diode or a laser diode.
- the image forming unit 2 when the light source device 22 emits light in a state where the image 700 is displayed on the liquid crystal panel 21 , light output toward a front side from the light source device 22 passes through the liquid crystal panel 21 and is output toward the front side from the front surface (the display surface 20 ) of the liquid crystal panel 21 . At this time, the light output toward the front side from the display surface 20 is light (image light) reflecting the image 700 displayed on the liquid crystal panel 21 . Therefore, when the display surface 20 is viewed from the front side, the image 700 appears to be displayed on the display surface 20 , and the image 700 is formed on the display surface 20 .
- the image forming unit 2 is not limited to such a configuration.
- the image forming unit 2 may be configured to form the image 700 by performing scanning with laser light from a back surface of the display surface 20 of the image forming unit 2 .
- the projection unit 3 of the image projection unit 30 includes a first mirror 31 and a second mirror 32 .
- the first mirror 31 and the second mirror 32 are arranged in an order of the first mirror 31 and the second mirror 32 on an optical path of the output light from the image forming unit 2 .
- the first mirror 31 reflects the output light of the image forming unit 2 toward the second mirror 32 .
- the second mirror 32 reflects, toward an upper side (that is, toward the front shield 101 ), the output light of the image forming unit 2 reflected by the first mirror 31 .
- the projection unit 3 enlarges or reduces the image 700 displayed on the display surface 20 of the image forming unit 2 to an appropriate size, and projects the enlarged or reduced image 700 onto the front shield 101 as a projection image.
- the virtual image 300 is displayed in the target space 400 . That is, in the visual field of the user 200 driving the vehicle 100 , the virtual image 300 of the image 700 projected from the image display system 10 is displayed in a manner of being superimposed on an actual scene spreading in front of the vehicle 100 .
- the processing unit 50 includes a position correction unit 4 and a display control unit 51 .
- the processing unit 50 is configured with a computer or the like including a processor and a memory, and implements various functions, for example, by the processor executing a predetermined program held in the memory.
- the processor may include a micro processing unit (MPU), a central processing unit (CPU), a digital signal processor (DSP), a graphical processing unit (GPU), and the like.
- the memory may include a random access memory (RAM), a read only memory (ROM), and the like.
- the program may be provided through a telecommunication line such as the Internet, or may be provided by being recorded in a recording medium such as a memory card.
- the processing unit 50 may be provided in a control unit such as an electronic control unit (ECU) that controls each unit of the vehicle.
- ECU electronice control unit
- the position correction unit 4 and the display control unit 51 may be configured with separate processors, or at least a part of functions of the position correction unit 4 and the display control unit 51 may be shared by one processor.
- the position correction unit 4 calculates an attitude of the main unit 1 (more specifically, an attitude angle of the vehicle 100 ) based on a detection value of an acceleration sensor 52 , calculates a correction amount for changing the display position of the image 700 on the display surface 20 based on the calculated attitude angle, and outputs the correction amount to the display control unit 51 .
- the display control unit 51 controls the image forming unit 2 to form an arbitrary image 700 on the display surface 20 .
- the display control unit 51 controls the display position of the image 700 on the display surface 20 .
- the display control unit 51 adjusts the display position of the image 700 on the display surface 20 based on the correction amount from the position correction unit 4 , and changes the display position in accordance with the attitude angle. Accordingly, the display control unit 51 controls the display position of the image 700 on the front shield 101 . As a result, a position of the virtual image 300 projected to a display area of the target space 400 is controlled.
- the acceleration sensor 52 detects an acceleration (gravitational acceleration and motion acceleration) acting on the vehicle 100 .
- the acceleration sensor 52 includes, for example, a triaxial acceleration sensor having an X axis, a Y axis, and a Z axis orthogonal to one another.
- the acceleration sensor 52 is attached to the vehicle 100 in an arbitrary attitude, and detects an acceleration vector generated in the vehicle 100 .
- the motion acceleration is an acceleration generated in the vehicle 100 by acceleration or deceleration due to traveling of the vehicle 100 . That is, the motion acceleration is an acceleration obtained by excluding the gravitational acceleration from the acceleration acting on the vehicle 100 .
- the motion acceleration is generated, for example, in a direction opposite to an acceleration direction of the vehicle 100 .
- the acceleration acting on the vehicle 100 and the calculation of the attitude angle based on the acceleration will be described later.
- the position correction unit 4 includes a correction unit 41 and an attitude angle calculation unit 43 .
- the attitude angle calculation unit 43 calculates the attitude angle of the main unit 1 based on time-series data of the detection value of the acceleration sensor 52 by software processing. More specifically, the attitude angle calculation unit 43 calculates the attitude angle of the vehicle 100 based on the time-series data of the detection value of the acceleration sensor 52 , and sets the calculated attitude angle as the attitude angle of the main unit 1 .
- the correction unit 41 calculates a correction value for changing the display position of the image 700 on the display surface 20 , based on the attitude angle calculated by the attitude angle calculation unit 43 (that is, the attitude angle of the main unit 1 ) by software processing, and corrects display position control performed by the display control unit 51 .
- the correction unit 41 controls the display control unit 51 to change the position of the image 700 on the display surface 20 , so as to absorb (reduce) a change in the position of the virtual image 300 in the target space 400 due to a change in the attitude angle of the main unit 1 .
- the display control unit 51 displays (renders) arbitrary video content on the liquid crystal panel 21 while controlling the display position of the image 700 on the display surface 20 by software processing. Accordingly, an arbitrary image 700 is formed at a predetermined position on the display surface 20 .
- the position correction unit 4 and the display control unit 51 control the display position of the image to change the position of the image 700 on the display surface 20 , thereby changing the position of the image 700 projected onto the front shield 101 , and as a result, the position of the virtual image 300 projected to the display area of the target space 400 is also changed.
- the image display system 10 can control the position where the virtual image 300 is formed by changing the display position of the image 700 on the display surface 20 in accordance with the change.
- the first virtual image 301 can be corrected to the specific position where the first virtual image 301 should be originally superimposed in the real scene viewed from the user 200 , and the user 200 can visually recognize the first virtual image 301 .
- FIG. 3A is an illustrative diagram for illustrating a gravitational acceleration that acts when the vehicle is not inclined at the time of stop.
- FIG. 3B is an illustrative diagram for illustrating a gravitational acceleration that acts when the vehicle is inclined at the time of stop.
- the attitude angle calculation unit 43 of the position correction unit 4 calculates an attitude angle based on a detection value of the acceleration sensor 52 , thereby performing measurement of an attitude angle.
- an up-down axis Az direction (up-down direction), a front-rear axis Ax direction (front-rear direction), and a left-right axis Ay direction (left-right direction) are defined as a coordinate system (vehicle coordinate system) in the vehicle 100 .
- the three-axis vehicle coordinate system is a virtual axis fixed to the vehicle 100 .
- an acceleration component is also generated in the left-right axis Ay direction when the vehicle 100 is inclined in the left-right direction with respect to a traveling direction of the vehicle 100 .
- the acceleration sensor 52 detects accelerations in the up-down axis Az direction, the front-rear axis Ax direction, and the left-right axis Ay direction.
- attitude angle is calculated as inclination of the reference plane of the vehicle 100 with respect to the road surface 600 or inclination of the up-down axis Az of the vehicle 100 from a vertical line in a gravitational direction of the earth.
- attitude angle may be calculated using acceleration components in two directions of the up-down axis Az direction and the front-rear axis Ax direction, that is, the up-down direction and an orthogonal direction orthogonal to the up-down direction, without using an acceleration component in the left-right axis Ay direction.
- an acceleration detection value G of the acceleration sensor 52 (that is, a detection value of the gravitational acceleration) includes only an acceleration component Gz in the up-down axis Az direction (see FIG. 3A ).
- FIG. 3B illustrates a state where the vehicle 100 is inclined rearward (a vehicle front portion faces obliquely upward) in cases such as one where luggage is loaded in a rear luggage compartment. Therefore, the acceleration detection value G of the acceleration sensor 52 has the acceleration component Gz in the up-down axis Az direction and an acceleration component Gx in the front-rear axis Ax direction (see FIG. 3B ).
- the attitude angle calculation unit 43 an attitude angle ⁇ calculated using the stop algorithm is obtained by the following equation (1).
- the stop algorithm described above it is possible to calculate and observe the measurement value of the attitude angle during stop of the vehicle 100 and a change amount in the measurement value in real time.
- a predetermined period such as several seconds to several minutes
- the change amount is calculated based on a time average value of the attitude angle.
- the attitude angle measurement value may be appropriately corrected so as not to include an inclination angle of the road surface, for example, by obtaining a difference between the attitude angle measurement values at predetermined time intervals and calculating an attitude angle from which a component of the inclination angle of the road surface is removed.
- FIG. 4A is an illustrative diagram for illustrating a motion acceleration that acts when a vehicle is not inclined during traveling.
- FIG. 4B is an illustrative diagram for illustrating a motion acceleration that acts when the vehicle is inclined during traveling.
- the attitude angle is calculated in accordance with a ratio of change amounts of the motion acceleration in the three axes of the up-down axis Az direction, the front-rear axis Ax direction, and the left-right axis Ay direction of the vehicle 100 during traveling.
- an algorithm for calculating the attitude angle during traveling of the vehicle 100 is referred to as a “traveling algorithm”.
- an acceleration detection value ⁇ G of the acceleration sensor 52 (that is, a detection value of the motion acceleration) has only an acceleration component ⁇ Gx in the front-rear axis Ax direction (see FIG. 4A ).
- change amounts of the motion acceleration are represented as ⁇ G, ⁇ Gx, and the like.
- FIG. 4B illustrates a state where the vehicle 100 is inclined rearward (the vehicle front portion faces obliquely upward) in cases such as one where luggage is loaded in the rear luggage compartment. Therefore, the acceleration detection value ⁇ G of the acceleration sensor 52 has the acceleration component ⁇ Gx in the front-rear axis Ax direction and an acceleration component ⁇ Gz in the up-down axis Az direction (see FIG. 4B ).
- the attitude angle calculation unit 43 an attitude angle ⁇ calculated using the traveling algorithm is obtained by the following equation (2).
- the traveling algorithm described above it is possible to calculate the measurement value of the attitude angle during traveling of the vehicle 100 and a change amount in the measurement value. At this time, for example, an average value of attitude angle measurement values in a predetermined period such as several seconds to several minutes is obtained, and the change amount is calculated based on a time average value of the attitude angle.
- FIG. 5A is a schematic diagram of a vehicle that is not inclined with respect to a road surface (in a state of being parallel to the road surface) as viewed from a lateral side.
- FIG. 5B is a conceptual diagram illustrating a visual field of a user who drives the vehicle in the state shown in FIG. 5A .
- the image forming unit 2 and the projection unit 3 project and display the image 700 formed on the display surface 20 onto the front shield 101 , thereby projecting the virtual image 300 corresponding to the image 700 to the target space 400 .
- the first virtual image 301 such as navigation information shows an arrow indicating a “left turn” on an intersection (T-shaped road) in front of the vehicle 100 .
- the second virtual image 302 such as instrument information displays a traveling speed of “50 km/h” as current vehicle speed information of the vehicle 100 .
- the display control unit 51 determines content of the first virtual image 301 (orientation, position, and the like of the arrow) and content of the second virtual image 302 (the vehicle speed and the like). In addition, the display control unit 51 also determines the position of the image 700 on the display surface 20 of the liquid crystal panel 21 . When the position of the image 700 on the display surface 20 changes, the position of the virtual image 300 projected to a display area 401 of the target space 400 also changes.
- the correction unit 41 of the position correction unit 4 generates a correction amount for changing the display position of the image 700 on the display surface 20 , based on an attitude angle calculated by the attitude angle calculation unit 43 (that is, the attitude angle of the main unit 1 ), and outputs the correction amount to the display control unit 51 .
- the display control unit 51 controls the position where the image 700 is to be displayed based on the correction amount of the display position acquired from the correction unit 41 . By this control, the position of the virtual image 300 projected to the display area 401 of the target space 400 is corrected in accordance with the attitude angle of the main unit 1 .
- the processing unit 50 including the position correction unit 4 and the display control unit 51 calculates, for at least the first virtual image 301 , a correction amount of the display position so as to absorb (reduce) a change in position of the virtual image 300 in the target space 400 due to a change in the attitude angle of the main unit 1 . Then, the processing unit 50 controls the display position in accordance with the correction amount. Accordingly, the position of the image 700 on the display surface 20 is changed.
- the processing unit 50 displays the virtual image 300 at a default display position without changing the position of the virtual image 300 (the first virtual image 301 ) projected to the display area 401 of the target space 400 .
- the default display position of the first virtual image 301 is a substantially central portion of the display area 401 , that is, a position through which the optical axis 500 (see FIG. 5A ) passes.
- an area in the target space 400 where the virtual image 300 can be projected is represented as the display area 401 .
- the first virtual image 301 represents an arrow indicating a “left turn” at a T-shaped road in front of the vehicle 100 . That is, in the visual field of the user 200 , the first virtual image 301 is displayed so as to be superimposed on the T-shaped road in the real scene in the display area 401 . In addition, the second virtual image 302 is displayed at a position that is a lower left corner of the display area 401 (see FIG. 5B ).
- FIG. 6A is a schematic diagram of a vehicle that is inclined upward with respect to a road surface as viewed from a lateral side.
- FIG. 6B is a conceptual diagram illustrating a visual field of a user who drives the vehicle in the state shown in FIG. 6A .
- the processing unit 50 changes the position of the virtual image 300 (the first virtual image 301 ) projected to the display area 401 of the target space 400 from the default display position.
- the display area 401 and the first virtual image 301 move upward in the visual field of the user 200 .
- a display area 401 (Y) is formed at a position shifted upward with respect to a display area 401 (X) in a default state. Accordingly, at the default display position, a first virtual image 301 (X) is displayed substantially at a central portion of the display area 401 (Y). Therefore, in the visual field of the user 200 , the first virtual image 301 (X) is displayed so as to be superimposed at a position shifted forward (toward a back side) from the T-shaped road in the real scene.
- the display area 401 and the first virtual image 301 before the movement have reference numerals thereof assigned with an “X”, and the display area 401 and the first virtual image 301 after the movement have reference numerals thereof assigned with a “Y”, so that those before the movement and those after the movement are distinguished from each other.
- the processing unit 50 changes the position of the image 700 on the display surface 20 so that the display position of the virtual image 300 is shifted downward. Accordingly, as illustrated in FIG. 6A , the position of the first virtual image 301 projected to the target space 400 moves downward, and in the display area 401 (Y), the first virtual image 301 (Y) is displayed at a position shifted downward with respect to the first virtual image 301 (X) in the default state. As a result, in the visual field of the user 200 , as illustrated in FIG. 6B , the first virtual image 301 (Y) is displayed so as to be superimposed on the T-shaped road in the real scene in the display area 401 (Y). In addition, the second virtual image 302 is displayed at a position that is a lower left corner of the display area 401 (Y) (see FIG. 6B ).
- FIG. 7A is a schematic diagram of a vehicle that is inclined downward with respect to a road surface as viewed from a lateral side.
- FIG. 7B is a conceptual diagram illustrating a visual field of a user who drives the vehicle in the state shown in FIG. 7A .
- the display area 401 and the first virtual image 301 move downward in the visual field of the user 200 . That is, as illustrated in FIG. 7B , the display area 401 (Y) is formed at a position shifted downward with respect to the display area 401 (X) in the default state.
- the first virtual image 301 (X) is displayed substantially at the central portion of the display area 401 (Y). Therefore, in the visual field of the user 200 , the first virtual image 301 (X) is displayed so as to be superimposed at a position shifted rearward (toward a near side) from the T-shaped road in the real scene.
- the processing unit 50 changes the position of the image 700 on the display surface 20 so that the display position of the virtual image 300 is shifted upward. Accordingly, as illustrated in FIG. 7A , the position of the first virtual image 301 projected to the target space 400 moves forward, and in the display area 401 (Y), the first virtual image 301 (Y) is displayed at a position shifted upward with respect to the first virtual image 301 (X) in the default state. As a result, in the visual field of the user 200 , as illustrated in FIG. 6B , the first virtual image 301 (Y) is displayed so as to be superimposed on the T-shaped road in the real scene in the display area 401 (Y). In addition, the second virtual image 302 is displayed at a position that is a lower left corner of the display area 401 (Y) (see FIG. 7B ).
- a head-up display device mounted on the vehicle 100 since the virtual image 300 is projected and superimposed on the road surface 600 , an image displayed on an upper side of the display area 401 is projected far, and an image displayed on a lower side of the display area 401 is projected near. Therefore, when changing a display position of an image to be superimposed thereon, it is preferable to define a correction amount of the display position by angle in accordance with a change amount of an attitude angle. At this time, a range of the display area 401 is, for example, about 3 degrees in the up-down direction, and the position of the virtual image 300 superimposed on the road surface 600 greatly changes even by a small angle change of the display position.
- an attitude angle at the time of stop is detected using the stop algorithm to calculate a change amount of the attitude angle, and display position correction is performed so that the change in the attitude angle is reflected in a display position of a projection image.
- an attitude angle at the time of traveling is detected using the traveling algorithm to calculate a change amount of the attitude angle, and the display position of the projection image is corrected in accordance with the change in the attitude angle.
- a correction amount of the display position per predetermined unit time is adjusted in accordance with a change amount of the attitude angle in a predetermined period so that the display position does not change greatly at one time within the visual field of the user.
- a correction amount per one time for correcting the display position is adjusted, and a correction amount per one time is made smaller than a total correction amount up to a control target value, for example, by performing the display position correction in a plurality of times. Accordingly, the feeling of discomfort the user experiences in the visual field of is reduced.
- a first example illustrates an operation of changing a display position in a plurality of times when a change amount of an attitude angle with respect to a calculation value of a previous measurement is large (for example, 0.3 degree or more) and a correction amount for display positions before and after the update is equal to or greater than a predetermined value.
- the processing unit 50 divides the correction amount of the display position into predetermined values, and steadily changes the display position at a plurality of timings.
- a correction amount of the display position per unit time is set by equally dividing the total correction amount up to the control target value. With respect to the correction amount per unit time, it is not limited to setting the correction amount equally in each of a plurality of periods into which a period for correcting the display position is divided, and an arbitrary value may be set in each of the divided periods.
- the correction amount of the display position it is possible to adopt various modes such as setting the correction amount per one time for correcting the display position to a predetermined fixed value smaller than the total correction amount, setting the number of divisions with respect to the total correction amount to a fixed value, and varying the correction amount per one time and/or the number of divisions in accordance with a magnitude of the total correction amount.
- the change amount of the attitude angle is 0.5 degree
- the display position is shifted at 0.05 degree/second for 10 times in a period of 10 seconds.
- the total correction amount of the display position is a total movement amount of the display position that is changed in accordance with the change amount of the attitude angle, and normally corresponds to a movement amount from a current position to a control target position for canceling the change of the attitude angle with respect to the road surface.
- a correction amount of a display position is represented by a change amount of an irradiation angle of light for projecting a virtual image, and a displacement (the number of pixels, the number of lines, or the like) on a display screen of an image forming unit corresponding to an angle is given as a control value from the processing unit 50 to the image projection unit 30 .
- a displacement amount on the display screen of the image forming unit may be different depending on a position in a display area of a target space.
- the correction amount per one time for correcting the display position is reduced and the correction up to the control target value is not performed at one time. Accordingly, a mode is established in which the image projected from the image projection unit moves in a stepwise manner. Accordingly, it is possible to prevent the image from moving greatly at one time, and it is possible to prevent a feeling of discomfort in appearance for the user.
- a second example is a modification of the first example, and illustrates an operation of gradually changing a display position such that a correction amount is large in an initial stage and then the correction amount is reduced steadily as approaching a control target position in a case where correction of the display position is performed in a plurality of times. That is, when changing the display position in a plurality of times, the display position is steadily changed with a predetermined time constant.
- the processing unit 50 divides a correction amount of the display position, for example, by using a logarithmic function, and steadily changes the display position at a plurality of timings.
- a correction amount of the display position per unit time is set to decrease with elapse of time with respect to a total correction amount up to a control target value.
- the correction amount of the display position it is possible to adopt various modes such as setting the correction amount that steadily decreases from a large state to a small state by each predetermined unit time, and steadily lengthening, from a short state to a long state, the timing of correction by the correction amount per one time as a predetermined fixed value or variable value.
- a correction amount per second is steadily reduced to 0.1 degree, 0.05 degree, 0.025 degree, 0.0125 degree, . . . , and the display position is shifted such that the display position changes greatly (quickly) in the initial stage and then gradually (slowly) changes.
- a correction amount per one time for correcting the display position is reduced with elapse of time without performing the correction up to the control target value at one time. Accordingly, a mode is established in which an image projected from an image projection unit moves quickly in the initial stage and steadily slows down as approaching a target position. Accordingly, it is possible to prevent the image from moving greatly in an instant, and it is possible to prevent a feeling of discomfort in appearance for the user.
- a period in which a display position is corrected may be divided into a plurality of periods, and a correction amount per unit time may be equally divided or set to an arbitrary value in each of the periods after the division, or the correction amount per unit time may be set to decrease with elapse of time in an entire correction period.
- various modifications can be applied as long as a method is used in which the correction amount per one time for correcting the display position is made smaller than the total correction amount up to the control target value.
- a third example shows an operation of changing a display position at one time in performing correction of the display position when image display of a virtual image such as that of navigation information is turned off for a predetermined time or more.
- the processing unit 50 switches a correction mode of the display position and immediately changes the display position to a control target position when there is a period in which the virtual image is not rendered for a predetermined time or more.
- the correction mode of the display position is switched from a stepwise display position correction to an instant display position correction.
- a correction amount of the display position is switched to a correction amount for correcting to a control target value at one time.
- the display position is corrected to the control target position at one time regardless of a change amount of an attitude angle, so that it is possible to quickly and appropriately control the display position.
- FIG. 8 is a flowchart illustrating an operation of display position control at the time of stop in the display control device according to the embodiment.
- the processing unit 50 measures an attitude angle of the vehicle 100 during stop based on a detection value of a gravitational acceleration by using the above-described stop algorithm (S 11 ).
- S 11 a detection value of a gravitational acceleration by using the above-described stop algorithm
- S 12 a measurement value of the attitude angle by the attitude angle calculation unit 43 changes (S 13 ).
- the processing unit 50 calculates a change amount of the attitude angle of the vehicle 100 at this time (S 14 ).
- the processing unit 50 When obtaining the change amount of the attitude angle, the processing unit 50 calculates the change amount in accordance with, for example, an average value of attitude angle measurement values in units of several minutes in consideration of various influences such as disturbance, noise, and measurement error, and updates the attitude angle measurement value. Then, the processing unit 50 controls the image forming unit 2 to execute the display position control processing while adjusting a correction amount corresponding to the change amount of the attitude angle as described above, and changes a display position of a projection image by the projection unit 3 (S 15 ).
- FIG. 9 is a flowchart illustrating an operation of display position control at the time of traveling in the display control device according to the embodiment.
- the processing unit 50 measures an attitude angle of the vehicle 100 during traveling based on a detection value of a motion acceleration by using the above-described traveling algorithm (S 21 ).
- a measurement value of the attitude angle by the attitude angle calculation unit 43 changes (S 23 ).
- the processing unit 50 calculates a change amount of the attitude angle of the vehicle 100 at this time (S 24 ).
- the processing unit 50 calculates the change amount in accordance with, for example, an average value of attitude angle measurement values in units of several minutes in consideration of various influences such as disturbance, noise, and measurement error, and updates the attitude angle measurement value. Then, the processing unit 50 controls the image forming unit 2 to execute the display position control processing while adjusting a correction amount in accordance with the change amount of the attitude angle as described above, and changes a display position of a projection image by the projection unit 3 (S 25 ).
- FIG. 10 is a flowchart illustrating an operation of display position control in the display control device according to the embodiment in a case of shifting from stop to traveling.
- the operation example of FIG. 10 illustrates a case where an attitude change occurs during stop and the vehicle shifts to traveling within a short period of time. For example, this corresponds to cases such as one where a person gets in and out of the vehicle while the vehicle is stopped and traveling starts immediately.
- the processing unit 50 measures an attitude angle of the vehicle 100 during stop based on a detection value of a gravitational acceleration by using the stop algorithm (S 31 ).
- a load change occurs due to an increase or decrease in the number of occupants (S 32 ), and the vehicle 100 starts traveling before the processing unit 50 updates the attitude angle measurement value (S 33 ).
- the processing unit 50 measures an attitude angle of the vehicle 100 during traveling based on a detection value of a motion acceleration by using the traveling algorithm (S 34 ).
- the measurement value of the attitude angle by the attitude angle calculation unit 43 changes (S 35 ).
- the processing unit 50 calculates a change amount of the attitude angle of the vehicle 100 at this time (S 36 ).
- the processing unit 50 calculates the change amount in accordance with, for example, an average value of attitude angle measurement values in units of several minutes in consideration of various influences such as disturbance, noise, and measurement error, and updates the attitude angle measurement value. Then, the processing unit 50 controls the image forming unit 2 to execute the display position control processing while adjusting a correction amount in accordance with the change amount of the attitude angle as described above, and changes a display position of a projection image by the projection unit 3 (S 37 ).
- the change amount is calculated by measuring the attitude angle of the vehicle, and the correction amount is adjusted in accordance with the change amount of the attitude angle, thereby enabling control of the display position of the projection image.
- FIG. 11 is an illustrative table illustrating an example of a correction amount of a display position corresponding to a deviation in an attitude angle measurement value during traveling and a change amount of the attitude angle according to the embodiment.
- the processing unit 50 changes the correction amount of the display position in accordance with the deviation in the attitude angle measurement value during traveling.
- the processing unit 50 switches an adjustment operation of the correction amount in accordance with the change amount of the attitude angle.
- the change amount of the attitude angle is calculated by obtaining an average value of attitude angle measurement values in a predetermined period such as several seconds to several minutes.
- a deviation of the attitude angle measurement value during traveling is large and variation of the detected attitude angle is large, it is assumed that influence of disturbance or the like is large, and it is considered that reliability of the attitude angle measurement value is low.
- the deviation of the attitude angle measurement value is small, it is considered that a sensor output for attitude angle measurement is stable and the reliability of the attitude angle measurement value is high.
- the processing unit 50 sets a predetermined first threshold TH 1 and a predetermined second threshold TH 2 (TH 1 ⁇ TH 2 ) as deviation thresholds in order to determine a magnitude of the deviation of the attitude angle measurement value.
- a predetermined first threshold TH 1 and a predetermined second threshold TH 2 TH 1 ⁇ TH 2
- the processing unit 50 sets the correction amount in accordance with a value of the attitude angle after change so as to offset the attitude angle change amount, and changes the display position.
- the processing unit 50 sets the correction amount by using an intermediate value of the attitude angles before and after change as a control target value, and changes the display position.
- the “intermediate value” set as the control target value may be an arbitrary value that is greater than zero and is up to the value (corresponding to the attitude angle change amount) of the attitude angle after change, and the value is not limited.
- the intermediate value may be a value (median value) in the middle of the attitude angles before and after change.
- the deviation threshold is not limited to the two examples described above, and one or three or more thresholds may be provided. Further, the number of arbitrary values of the intermediate value and the deviation threshold corresponding thereto are not limited to one, and may be plural.
- a deviation threshold at which the deviation of the attitude angle is large and the display position is not corrected, may be separately set as a third threshold TH 3 .
- the third threshold TH 3 is set to a value greater than the first threshold TH 1 and equal to or less than the second threshold TH 2 .
- the second threshold TH 2 is equal to the third threshold TH 3 .
- the processing unit 50 switches a control mode of the display position in accordance with the change amount of the attitude angle. For example, when the change amount of the attitude angle is equal to or greater than a predetermined value and equal to or greater than a predetermined change amount threshold, the display position needs to be changed greatly, and accordingly the processing unit 50 performs such display position control processing as in the second example described above in which the display position is changed greatly in an initial stage and then changed stepwise gradually.
- the processing unit 50 performs such display position control processing as in the first example described above in which the display position is changed stepwise linearly.
- the total correction amount with respect to the attitude angle change is set to an intermediate value before and after change, and a change amount of a display image due to the display position correction is reduced. Further, when the deviation of the attitude angle measurement value is large, the correction amount is set to zero so that the display position correction is not performed. Accordingly, it is possible to appropriately correct the display position in accordance with the reliability based on the variation of the attitude angle measurement value. At this time, in a case of a state where the reliability of the attitude angle measurement value is not very high (medium degree), the correction amount is reduced to an intermediate value, and excessive correction of the display position can be prevented. In addition, when the reliability of the attitude angle measurement value is low, the display position is not corrected, and a failure of the display position correction due to external noise or the like can be prevented.
- the display position correction is performed in which the position is changed steadily at a constant speed following the procedure of the first example described above, and when the change amount of the attitude angle is relatively large, the display position correction is performed in which the position is changed steadily with a time constant following the procedure of the second example described above. Accordingly, when the change amount of the attitude angle is relatively large, the display position can be controlled so as to move quickly in an initial stage and approach the control target position steadily and slowly, and it looks as if the image changes smoothly for the user. In addition, when the change amount of the attitude angle is relatively small, the display position can be controlled so as to approach the control target position gradually at a constant speed, and it looks as if the image changes quickly and smoothly for the user. In this way, the display position can be smoothly controlled in accordance with a magnitude of the change amount of the attitude angle without giving the user a feeling of discomfort in appearance.
- the display control device controls a display position of an image in the image projection unit 30 that projects the image onto a display object such as the front shield 101 of the vehicle 100 serving as an example of a mobile body.
- the display control device includes the processing unit 50 that performs processing related to correction of the display position.
- the processing unit 50 includes the position correction unit 4 that sets a correction amount used for correction of the display position, and the display control unit 51 that controls the display position of the image based on the correction amount set by the position correction unit 4 .
- the position correction unit 4 acquires a detection value of an acceleration acting on the vehicle 100 from the acceleration sensor 52 , and calculates an attitude angle of the vehicle 100 based on the acquired detection value of the acceleration.
- the position correction unit 4 sets the correction amount of the display position for controlling the display position of the image to be projected on the display object in accordance with the attitude angle.
- the correction amount of the display position in the position correction unit 4 is set by adjusting a correction amount per predetermined unit time in accordance with a change amount of the attitude angle in a predetermined period. Accordingly, it is possible to control the display position of the image in accordance with the change amount of the attitude angle, and it is possible to prevent a problem in appearance for the user.
- the position correction unit 4 sets a correction amount per one time for correcting the display position to be smaller than a total correction amount up to a control target value. Accordingly, it is possible to prevent a projected image from moving greatly at one time, and it is possible to prevent a feeling of discomfort in appearance for the user.
- the position correction unit 4 corrects the display position in a plurality of times, and reduces the correction amount per one time for correcting the display position. Accordingly, it is possible to prevent a projected image from moving greatly at one time, and it is possible to prevent a feeling of discomfort in appearance for the user.
- the position correction unit 4 sets the correction amount of the display position per unit time by equally dividing the total correction amount up to the control target value. Accordingly, the display position can be controlled so that the image steadily approaches a control target position, and it looks as if the image changes quickly and smoothly for the user.
- the position correction unit 4 sets the correction amount of the display position per unit time to decrease with elapse of time, with respect to the total correction amount up to the control target value. Accordingly, the display position can be controlled so as to move quickly in an initial stage and approach the control target position steadily and slowly, and it looks as if the image changes smoothly for the user.
- the position correction unit 4 sets the correction amount of the display position per unit time by equally dividing the total correction amount up to the control target value, or sets the correction amount of the display position per unit time to an arbitrary value.
- the processing unit 50 sets the correction amount of the display position per unit time to decrease with elapse of time. Accordingly, the display position can be smoothly controlled in accordance with a magnitude of the change amount of the attitude angle without giving the user a feeling of discomfort in appearance.
- the position correction unit 4 adjusts the correction amount per one time for correcting the display position in accordance with a deviation of a measurement value of the attitude angle in a predetermined period. Accordingly, it is possible to appropriately correct the display position in accordance with reliability based on variation of the attitude angle measurement value.
- the position correction unit 4 sets the correction amount by using an intermediate value before and after change of the attitude angle as the control target value. Accordingly, in a case of a state where the reliability of the attitude angle measurement value is not so high, the correction amount can be reduced to prevent excessive correction of the display position.
- the position correction unit 4 sets the correction amount of the display position to zero. Accordingly, in a case of a state where the reliability of the attitude angle measurement value is low, the display position is not corrected, and a failure of correction due to external noise or the like can be prevented.
- the position correction unit 4 switches the correction amount of the display position to a correction amount for correcting to the control target value at one time. Accordingly, in a case of a timing at which display of the image is turned off, the display position is corrected to the control target position at one time, so that it is possible to quickly and appropriately control the display position.
- the position correction unit 4 calculates the attitude angle of the vehicle 100 based on acceleration components of a gravitational acceleration in at least two directions including an up-down direction of the vehicle 100 and an orthogonal direction orthogonal to the up-down direction. Accordingly, it is possible to appropriately measure an attitude angle during stop of a mobile body.
- the position correction unit 4 calculates the attitude angle of the vehicle 100 based on acceleration components of a motion acceleration in at least two directions including an up-down direction of the vehicle 100 and an orthogonal direction orthogonal to the up-down direction. Accordingly, it is possible to appropriately measure an attitude angle during traveling of a mobile body.
- the position correction unit 4 may be capable of switching, by setting of a user, a correction mode of the display position between a mode in which correction up to the control target value is performed in a stepwise manner and a mode in which correction up to the control target value is performed at one time.
- the user in the mode in which the position correction unit 4 performs the correction up to the control target value in a stepwise manner, the user may be able to set the correction amount per one time for correcting the display position.
- the image display system is mounted on the vehicle 100 serving as an example of a mobile body, and includes the image projection unit 30 that projects an image onto a display object such as the front shield 101 of the vehicle 100 , and the display control device that includes the position correction unit 4 described above.
- an image display system capable of appropriately controlling a display position of an image in accordance with a change amount of an attitude angle.
- the vehicle 100 serving as an example of a mobile body includes the image display system described above.
- the display object in the mobile body is a windshield such as the front shield 101 of the vehicle 100 . Accordingly, it is possible to provide a mobile body capable of appropriately controlling a display position of an image in accordance with a change amount of an attitude angle.
- the present disclosure has an effect of improving control of a display position of an image, and is useful as, for example, a display control device of a display unit using a head-up display device or the like, an image display system, a mobile body, a display control method, and a program.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Mechanical Engineering (AREA)
- General Physics & Mathematics (AREA)
- Transportation (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Optics & Photonics (AREA)
- Geometry (AREA)
- Instrument Panels (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
Description
- This application is a continuation of PCT International Patent Application No. PCT/JP2020/007880 filed on Feb. 26, 2020, which claims the benefit of priority of Japanese Patent Application No. 2019-120438 filed on Jun. 27, 2019, the entire contents of which are incorporated herein by reference.
- The present disclosure relates to a display control device, an image display system, a mobile body, a display control method, and a non-transitory computer-readable medium.
- As an example of an image display system that projects and displays an image on a display object, a head-up display device mounted on a mobile body such as a vehicle is known (for example, see JP-A-H01-293239). The head-up display device disclosed in JP-A-H01-293239 projects information from an image display device onto a front shield of a vehicle, thereby displaying information in a visual field of an observer in a superimposed manner. The head-up display device calculates an attitude angle of the vehicle by detecting an acceleration of the vehicle, and changes a display position of a superimposed image in accordance with the attitude angle.
- In addition, there is known a control device for a vehicle lamp that performs automatic leveling control for automatically adjusting an irradiation direction of a vehicle headlamp in accordance with an inclination angle of a vehicle (for example, see WO-A1-2016/114159). WO-A1-2016/114159 discloses that an optical axis angle of a vehicle lamp is adjusted based on a change in an attitude angle during stop of a vehicle and a change in the attitude angle during traveling of the vehicle.
- In an image display system using a head-up display device or the like, there is a demand for further improvement in control of a display position of an image.
- The present disclosure has been devised in view of the above circumstances, and an object thereof is to provide a display control device, an image display system, a mobile body, a display control method, and a program capable of improving control of a display position of an image.
- As an aspect, the present disclosure provides a display control device configured to control a display position of an image in an image projector configured to project the image onto a display object of a mobile body, the display control device including: a processor; and a memory storing instructions that, when executed by the processor, cause the display control device to perform operations including: setting a correction amount used for correction of the display position; and controlling the display position of the image based on the correction amount, wherein the setting the correction amount includes: acquiring a detection value of an acceleration acting on the mobile body; calculating an attitude angle of the mobile body based on the detection value of the acceleration; and setting the correction amount of the display position for controlling the display position of the image to be projected onto the display object in accordance with the attitude angle, and wherein the correction amount of the display position is set by adjusting a correction amount per predetermined unit time in accordance with a change amount of the attitude angle in a predetermined period.
- As an aspect, the present disclosure provides an image display system to be mounted on a mobile body, the image display system including: an image projector configured to project an image onto a display object of the mobile body; and the display control device described above.
- As an aspect, the present disclosure provides a mobile body including the image display system described above, wherein the display object includes a window shield of the mobile body.
- As an aspect, the present disclosure provides a display control method for controlling a display position of an image in an image projector configured to project the image onto a display object of a mobile body, the display control method including: acquiring a detection value of an acceleration acting on the mobile body; calculating an attitude angle of the mobile body based on the detection value of the acceleration; and setting a correction amount of the display position for controlling the display position of the image to be projected onto the display object in accordance with the attitude angle, wherein the correction amount of the display position is set by adjusting a correction amount per predetermined unit time, in accordance with a change amount of the attitude angle in a predetermined period.
- As an aspect, the present disclosure provides a non-transitory computer-readable medium storing a program, when executed by a processor, causing a computer to execute the display control method described above.
- According to the present disclosure, it is possible to improve control of a display position of an image.
-
FIG. 1 is a conceptual diagram illustrating an example of a configuration of an image display system including a display control device according to an embodiment. -
FIG. 2 is a conceptual diagram of a vehicle including the image display system according to the embodiment. -
FIG. 3A is an illustrative diagram for illustrating a gravitational acceleration that acts when the vehicle is not inclined at the time of stop. -
FIG. 3B is an illustrative diagram for illustrating a gravitational acceleration that acts when the vehicle is inclined at the time of stop. -
FIG. 4A is an illustrative diagram for illustrating a motion acceleration that acts when the vehicle is not inclined during traveling. -
FIG. 4B is an illustrative diagram for illustrating a motion acceleration that acts when the vehicle is inclined during traveling. -
FIG. 5A is a schematic diagram of a vehicle that is not inclined as viewed from a lateral side. -
FIG. 5B is a conceptual diagram illustrating a visual field of a user who drives the vehicle in a state shown inFIG. 5A . -
FIG. 6A is a schematic diagram of a vehicle that is inclined upward as viewed from a lateral side. -
FIG. 6B is a conceptual diagram illustrating a visual field of a user who drives the vehicle in a state shown inFIG. 6A . -
FIG. 7A is a schematic diagram of a vehicle that is inclined downward as viewed from a lateral side. -
FIG. 7B is a conceptual diagram illustrating a visual field of a user who drives the vehicle in a state shown inFIG. 7A . -
FIG. 8 is a flowchart illustrating an operation of display position control at the time of stop in the display control device according to the embodiment. -
FIG. 9 is a flowchart illustrating an operation of display position control during traveling in the display control device according to the embodiment. -
FIG. 10 is a flowchart illustrating an operation of display position control in the display control device according to the embodiment in a case of shifting from stop to traveling. -
FIG. 11 is an illustrative table illustrating an example of a correction amount of a display position corresponding to a deviation of an attitude angle measurement value during traveling and a change amount of the attitude angle according to the embodiment. - Hereinafter, embodiments in which a display control device, an image display system, a mobile body, a display control method, and a program according to the present disclosure are specifically disclosed will be described in detail with reference to the drawings as appropriate. However, an unnecessary detailed description may be omitted. For example, a detailed description of a well-known matter or a repeated description of substantially the same configuration may be omitted. This is to avoid unnecessary redundancy of the following description and to facilitate understanding of those skilled in the art. Note that the accompanying drawings and the following description are provided for a thorough understanding of the present disclosure by those skilled in the art, and are not intended to limit the subject matter recited in the claims.
- (Introduction to Present Disclosure)
- In an image display system using a head-up display device or the like, when control is performed to change a display position in accordance with a change in an attitude angle of a mobile body such as a vehicle, a user may experience a feeling of discomfort in visual recognition. For example, in a case where a correction amount of the display position is large, the user may experience a feeling of discomfort in appearance when the display position is suddenly changed.
- Therefore, in the present disclosure, a display control device capable of improving visibility by appropriately adjusting a correction amount of a display position in accordance with a change amount of an attitude angle, and an image display system including the display control device are exemplified.
- (Overview of Embodiment)
- In the following embodiment, a vehicle such as an automobile is assumed as an example of a mobile body, and a configuration example of an image display system mounted on the vehicle and a display control device in the image display system will be described.
-
FIG. 1 is a conceptual diagram illustrating an example of a configuration of an image display system according to an embodiment.FIG. 2 is a conceptual diagram of a vehicle including the image display system according to the embodiment. As illustrated inFIGS. 1 and 2 , animage display system 10 according to the present embodiment includes, for example, a head-up display (HUD) provided in avehicle 100 serving as an example of a mobile body. That is, thevehicle 100 includes a mobile body main body and theimage display system 10 provided in the mobile body main body. - The
image display system 10 is installed in a vehicle interior of thevehicle 100 so as to project an image onto a front shield 101 (an example of a window shield) of thevehicle 100 from below. In the example ofFIG. 2 , theimage display system 10 is disposed in adashboard 102 below thefront shield 101. - As illustrated in
FIG. 2 , with display of theimage display system 10, auser 200 visually recognizes avirtual image 300, which is projected in atarget space 400 set in front of the vehicle 100 (outside the vehicle), through thefront shield 101. The “virtual image” referred to here means an image formed as if an object actually exists by a divergent light beam when light emitted from theimage display system 10 is diverged by a display object such as thefront shield 101. Therefore, theuser 200 who is driving thevehicle 100 can see thevirtual image 300, which corresponds to an image projected by theimage display system 10, overlapping a real space spreading in front of thevehicle 100. Therefore, according to theimage display system 10, it is possible to cause theuser 200 to visually recognize various types of driving support information such as vehicle speed information, navigation information, pedestrian information, preceding vehicle information, lane departure information, and vehicle condition information as thevirtual image 300. Accordingly, theuser 200 can visually acquire the driving support information only by a slight movement of a line of sight from a state where the line of sight is directed to a front side of thefront shield 101. - In the
image display system 10 according to the present embodiment, thevirtual image 300 formed intarget space 400 includes at least two types of virtual images, that is, a firstvirtual image 301 and a secondvirtual image 302. The “first virtual image” referred to here relates to, for example, information indicating a traveling direction of thevehicle 100 as navigation information. As the firstvirtual image 301, an arrow indicating a right turn or a left turn can be presented on aroad surface 600. The firstvirtual image 301 of this type is a virtual image corresponding to an image displayed using augmented reality (AR) technology, and is superimposed and displayed at a specific position in a real scene (theroad surface 600, a building, a surrounding vehicle, a pedestrian, and the like) viewed from theuser 200. The “second virtual image” relates to, for example, information indicating a state of thevehicle 100 as instrument information. As the secondvirtual image 302, vehicle speed information or the like indicating a current traveling speed (vehicle speed) of thevehicle 100 can be presented. Specific examples of the firstvirtual image 301 and the secondvirtual image 302 will be described later. - In the
image display system 10, thevirtual image 300 formed in thetarget space 400 is formed on avirtual plane 501 intersecting anoptical axis 500 of theimage display system 10. - As illustrated in
FIG. 1 , theimage display system 10 according to the present embodiment includes amain unit 1 including an image projection unit 30 (an example of an image projector). Theimage projection unit 30 forms animage 700 and projects the formedimage 700 onto thefront shield 101, thereby forming thevirtual image 300 corresponding to theimage 700 in thetarget space 400. Theimage projection unit 30 includes animage forming unit 2 and aprojection unit 3. - The
image forming unit 2 includes adisplay surface 20, and forms theimage 700 on thedisplay surface 20. Theimage forming unit 2 projects the formed image onto theprojection unit 3 by output light. Theprojection unit 3 projects the image projected from theimage forming unit 2 onto thefront shield 101. - In a state where the
main unit 1 including theimage forming unit 2 and theprojection unit 3 is mounted on thevehicle 100, for example, an attitude of themain unit 1 changes with an attitude of thevehicle 100 due to a load of thevehicle 100. Since theimage projection unit 30 is mounted in themain unit 1, an attitude of theimage projection unit 30 is the same as the attitude of themain unit 1. Therefore, the attitude of themain unit 1 is also the attitude of theimage projection unit 30. - Specifically, for example, in a case where the
vehicle 100 is in a forward-inclined attitude such as when an occupant is present in a front seat such as a driver's seat, themain unit 1 is also in a forward-inclined attitude; in a case where thevehicle 100 is in a backward-inclined attitude such as when an occupant is present in a rear seat or when luggage is placed in a trunk, themain unit 1 is also in a backward-inclined attitude. When the attitude of themain unit 1 of the image display system 10 (an attitude angle of the image projection unit 30) changes, a position of thevirtual image 300 projected by theimage display system 10 in thetarget space 400 also changes. For this reason, for example, in a case where thevehicle 100 is in a forward-inclined attitude or a backward-inclined attitude, the firstvirtual image 301, for example, may be displayed in a superimposed manner at a position deviated from a specific position where the firstvirtual image 301 should be originally superimposed in a real scene viewed from theuser 200. - Accordingly, a display position of the
virtual image 300 is adjusted by adjusting a display position of theimage 700 on thefront shield 101 in accordance with an attitude angle of themain unit 1. For this reason, for example, even when thevehicle 100 is in a forward-inclined attitude or a backward-inclined attitude, theimage display system 10 can superimpose and display, for example, the firstvirtual image 301 at the specific position where the firstvirtual image 301 should be originally superimposed in the real scene viewed from theuser 200. - (Configuration of Embodiment)
- As illustrated in
FIG. 1 , theimage display system 10 according to the present embodiment includes theimage projection unit 30 and aprocessing unit 50. In the present embodiment, an example in which a component (the processing unit 50) other than theimage projection unit 30 is mounted (accommodated) in themain unit 1 is described, but the present disclosure is not limited thereto. Theprocessing unit 50 may not be included in themain unit 1. Themain unit 1 is fixed in thedashboard 102 of thevehicle 100. Theprocessing unit 50 may be configured separately from theimage projection unit 30, and may be configured as a separate housing device that is not mounted on themain body unit 1. Themain unit 1 may include a plurality of housings. - The
image forming unit 2 of theimage projection unit 30 includes, for example, a liquid crystal panel 21 (LCD: Liquid Crystal Display) and alight source device 22. Theliquid crystal panel 21 is disposed on a front side of thelight source device 22. A front surface (a surface on a side opposite to the light source device 22) of theliquid crystal panel 21 constitutes thedisplay surface 20 on which theimage 700 is formed. Thelight source device 22 is used as a backlight of theliquid crystal panel 21. Light from thelight source device 22 passes through theliquid crystal panel 21 from a back side of theliquid crystal panel 21 and is output from theimage forming unit 2. Thelight source device 22 is a surface light source that irradiates substantially the entire area of a back surface of theliquid crystal panel 21 with light using a solid-state light emitting element such as a light emitting diode or a laser diode. - In the
image forming unit 2, when thelight source device 22 emits light in a state where theimage 700 is displayed on theliquid crystal panel 21, light output toward a front side from thelight source device 22 passes through theliquid crystal panel 21 and is output toward the front side from the front surface (the display surface 20) of theliquid crystal panel 21. At this time, the light output toward the front side from thedisplay surface 20 is light (image light) reflecting theimage 700 displayed on theliquid crystal panel 21. Therefore, when thedisplay surface 20 is viewed from the front side, theimage 700 appears to be displayed on thedisplay surface 20, and theimage 700 is formed on thedisplay surface 20. - Although a configuration in which the
image forming unit 2 includes the liquid crystal panel 201 is exemplified, theimage forming unit 2 is not limited to such a configuration. For example, theimage forming unit 2 may be configured to form theimage 700 by performing scanning with laser light from a back surface of thedisplay surface 20 of theimage forming unit 2. - The
projection unit 3 of theimage projection unit 30 includes afirst mirror 31 and asecond mirror 32. Thefirst mirror 31 and thesecond mirror 32 are arranged in an order of thefirst mirror 31 and thesecond mirror 32 on an optical path of the output light from theimage forming unit 2. Thefirst mirror 31 reflects the output light of theimage forming unit 2 toward thesecond mirror 32. Thesecond mirror 32 reflects, toward an upper side (that is, toward the front shield 101), the output light of theimage forming unit 2 reflected by thefirst mirror 31. - With this configuration, the
projection unit 3 enlarges or reduces theimage 700 displayed on thedisplay surface 20 of theimage forming unit 2 to an appropriate size, and projects the enlarged orreduced image 700 onto thefront shield 101 as a projection image. As a result, thevirtual image 300 is displayed in thetarget space 400. That is, in the visual field of theuser 200 driving thevehicle 100, thevirtual image 300 of theimage 700 projected from theimage display system 10 is displayed in a manner of being superimposed on an actual scene spreading in front of thevehicle 100. - The
processing unit 50 includes aposition correction unit 4 and adisplay control unit 51. Theprocessing unit 50 is configured with a computer or the like including a processor and a memory, and implements various functions, for example, by the processor executing a predetermined program held in the memory. The processor may include a micro processing unit (MPU), a central processing unit (CPU), a digital signal processor (DSP), a graphical processing unit (GPU), and the like. The memory may include a random access memory (RAM), a read only memory (ROM), and the like. Although a case where the program is recorded in advance in the memory of theprocessing unit 50 is illustrated here, the program may be provided through a telecommunication line such as the Internet, or may be provided by being recorded in a recording medium such as a memory card. Theprocessing unit 50 may be provided in a control unit such as an electronic control unit (ECU) that controls each unit of the vehicle. Theposition correction unit 4 and thedisplay control unit 51 may be configured with separate processors, or at least a part of functions of theposition correction unit 4 and thedisplay control unit 51 may be shared by one processor. - The
position correction unit 4 calculates an attitude of the main unit 1 (more specifically, an attitude angle of the vehicle 100) based on a detection value of anacceleration sensor 52, calculates a correction amount for changing the display position of theimage 700 on thedisplay surface 20 based on the calculated attitude angle, and outputs the correction amount to thedisplay control unit 51. - The
display control unit 51 controls theimage forming unit 2 to form anarbitrary image 700 on thedisplay surface 20. In addition, thedisplay control unit 51 controls the display position of theimage 700 on thedisplay surface 20. At this time, thedisplay control unit 51 adjusts the display position of theimage 700 on thedisplay surface 20 based on the correction amount from theposition correction unit 4, and changes the display position in accordance with the attitude angle. Accordingly, thedisplay control unit 51 controls the display position of theimage 700 on thefront shield 101. As a result, a position of thevirtual image 300 projected to a display area of thetarget space 400 is controlled. - The
acceleration sensor 52 detects an acceleration (gravitational acceleration and motion acceleration) acting on thevehicle 100. Theacceleration sensor 52 includes, for example, a triaxial acceleration sensor having an X axis, a Y axis, and a Z axis orthogonal to one another. Theacceleration sensor 52 is attached to thevehicle 100 in an arbitrary attitude, and detects an acceleration vector generated in thevehicle 100. The motion acceleration is an acceleration generated in thevehicle 100 by acceleration or deceleration due to traveling of thevehicle 100. That is, the motion acceleration is an acceleration obtained by excluding the gravitational acceleration from the acceleration acting on thevehicle 100. The motion acceleration is generated, for example, in a direction opposite to an acceleration direction of thevehicle 100. The acceleration acting on thevehicle 100 and the calculation of the attitude angle based on the acceleration will be described later. - The
position correction unit 4 includes acorrection unit 41 and an attitudeangle calculation unit 43. The attitudeangle calculation unit 43 calculates the attitude angle of themain unit 1 based on time-series data of the detection value of theacceleration sensor 52 by software processing. More specifically, the attitudeangle calculation unit 43 calculates the attitude angle of thevehicle 100 based on the time-series data of the detection value of theacceleration sensor 52, and sets the calculated attitude angle as the attitude angle of themain unit 1. - The
correction unit 41 calculates a correction value for changing the display position of theimage 700 on thedisplay surface 20, based on the attitude angle calculated by the attitude angle calculation unit 43 (that is, the attitude angle of the main unit 1) by software processing, and corrects display position control performed by thedisplay control unit 51. For at least the firstvirtual image 301, thecorrection unit 41 controls thedisplay control unit 51 to change the position of theimage 700 on thedisplay surface 20, so as to absorb (reduce) a change in the position of thevirtual image 300 in thetarget space 400 due to a change in the attitude angle of themain unit 1. - The
display control unit 51 displays (renders) arbitrary video content on theliquid crystal panel 21 while controlling the display position of theimage 700 on thedisplay surface 20 by software processing. Accordingly, anarbitrary image 700 is formed at a predetermined position on thedisplay surface 20. Theposition correction unit 4 and thedisplay control unit 51 control the display position of the image to change the position of theimage 700 on thedisplay surface 20, thereby changing the position of theimage 700 projected onto thefront shield 101, and as a result, the position of thevirtual image 300 projected to the display area of thetarget space 400 is also changed. - As described above, when the attitude of the
main unit 1 changes, theimage display system 10 can control the position where thevirtual image 300 is formed by changing the display position of theimage 700 on thedisplay surface 20 in accordance with the change. For example, the firstvirtual image 301 can be corrected to the specific position where the firstvirtual image 301 should be originally superimposed in the real scene viewed from theuser 200, and theuser 200 can visually recognize the firstvirtual image 301. - (Measurement of Attitude Angle)
- Next, an acceleration acting on the
vehicle 100 and measurement of an attitude angle calculated based on the acceleration will be described. -
FIG. 3A is an illustrative diagram for illustrating a gravitational acceleration that acts when the vehicle is not inclined at the time of stop.FIG. 3B is an illustrative diagram for illustrating a gravitational acceleration that acts when the vehicle is inclined at the time of stop. The attitudeangle calculation unit 43 of theposition correction unit 4 calculates an attitude angle based on a detection value of theacceleration sensor 52, thereby performing measurement of an attitude angle. In the present embodiment, an up-down axis Az direction (up-down direction), a front-rear axis Ax direction (front-rear direction), and a left-right axis Ay direction (left-right direction) are defined as a coordinate system (vehicle coordinate system) in thevehicle 100. The three-axis vehicle coordinate system is a virtual axis fixed to thevehicle 100. Although the left-right axis Ay in a direction perpendicular to a paper surface is not illustrated in the drawing, an acceleration component is also generated in the left-right axis Ay direction when thevehicle 100 is inclined in the left-right direction with respect to a traveling direction of thevehicle 100. Theacceleration sensor 52 detects accelerations in the up-down axis Az direction, the front-rear axis Ax direction, and the left-right axis Ay direction. - In the present embodiment, when an Ax-Ay plane including the front-rear axis Ax and the left-right axis Ay is a reference plane of the
vehicle 100 and the reference plane is parallel to theroad surface 600, a calculation value (measurement value) of the attitude angle is zero. The attitude angle is calculated as inclination of the reference plane of thevehicle 100 with respect to theroad surface 600 or inclination of the up-down axis Az of thevehicle 100 from a vertical line in a gravitational direction of the earth. Note that the attitude angle may be calculated using acceleration components in two directions of the up-down axis Az direction and the front-rear axis Ax direction, that is, the up-down direction and an orthogonal direction orthogonal to the up-down direction, without using an acceleration component in the left-right axis Ay direction. - When the
vehicle 100 is stopped, as shown inFIGS. 3A and 3B , the attitude angle is calculated in accordance with a ratio of the gravitational acceleration in three axes of the up-down axis Az direction, the front-rear axis Ax direction, and the left-right axis Ay direction of thevehicle 100 during stop. Hereinafter, an algorithm for calculating the attitude angle during stop of thevehicle 100 will be referred to as a “stop algorithm”. When the attitude of thevehicle 100 during stop is not inclined in the front-rear direction with respect to theroad surface 600, the gravitational acceleration acting on thevehicle 100 acts only in the up-down axis Az direction of thevehicle 100. Therefore, an acceleration detection value G of the acceleration sensor 52 (that is, a detection value of the gravitational acceleration) includes only an acceleration component Gz in the up-down axis Az direction (seeFIG. 3A ). - On the other hand, when the attitude of the
vehicle 100 during stop is inclined in, for example, the front-rear direction with respect to theroad surface 600, the gravitational acceleration acting on thevehicle 100 acts in both the up-down axis Az direction and the front-rear axis Ax direction of thevehicle 100.FIG. 3B illustrates a state where thevehicle 100 is inclined rearward (a vehicle front portion faces obliquely upward) in cases such as one where luggage is loaded in a rear luggage compartment. Therefore, the acceleration detection value G of theacceleration sensor 52 has the acceleration component Gz in the up-down axis Az direction and an acceleration component Gx in the front-rear axis Ax direction (seeFIG. 3B ). In the attitudeangle calculation unit 43, an attitude angle β calculated using the stop algorithm is obtained by the following equation (1). -
- According to the stop algorithm described above, it is possible to calculate and observe the measurement value of the attitude angle during stop of the
vehicle 100 and a change amount in the measurement value in real time. In practice, for example, an average value of attitude angle measurement values in a predetermined period such as several seconds to several minutes is obtained, and the change amount is calculated based on a time average value of the attitude angle. - In a case where the
road surface 600 is inclined, for example, when thevehicle 100 is stopped on a slope, the attitude angle of thevehicle 100 during stop may not be correctly measured. In such a case, the attitude angle measurement value may be appropriately corrected so as not to include an inclination angle of the road surface, for example, by obtaining a difference between the attitude angle measurement values at predetermined time intervals and calculating an attitude angle from which a component of the inclination angle of the road surface is removed. -
FIG. 4A is an illustrative diagram for illustrating a motion acceleration that acts when a vehicle is not inclined during traveling.FIG. 4B is an illustrative diagram for illustrating a motion acceleration that acts when the vehicle is inclined during traveling. When thevehicle 100 is traveling, as illustrated inFIGS. 4A and 4B , the attitude angle is calculated in accordance with a ratio of change amounts of the motion acceleration in the three axes of the up-down axis Az direction, the front-rear axis Ax direction, and the left-right axis Ay direction of thevehicle 100 during traveling. Hereinafter, an algorithm for calculating the attitude angle during traveling of thevehicle 100 is referred to as a “traveling algorithm”. When the attitude of thevehicle 100 traveling forward is not inclined in the front-rear direction with respect to theroad surface 600, the motion acceleration acting on thevehicle 100 acts only in the front-rear axis Ax direction of thevehicle 100. Therefore, an acceleration detection value ΔG of the acceleration sensor 52 (that is, a detection value of the motion acceleration) has only an acceleration component ΔGx in the front-rear axis Ax direction (seeFIG. 4A ). In the traveling algorithm, since the motion acceleration is calculated based on a difference between the acceleration detection values at predetermined time intervals, change amounts of the motion acceleration are represented as ΔG, ΔGx, and the like. - On the other hand, when the attitude of the
vehicle 100 traveling forward is inclined in, for example, the front-rear direction with respect to theroad surface 600, the motion acceleration acting on thevehicle 100 acts in both the up-down axis Az direction and the front-rear axis Ax direction of thevehicle 100.FIG. 4B illustrates a state where thevehicle 100 is inclined rearward (the vehicle front portion faces obliquely upward) in cases such as one where luggage is loaded in the rear luggage compartment. Therefore, the acceleration detection value ΔG of theacceleration sensor 52 has the acceleration component ΔGx in the front-rear axis Ax direction and an acceleration component ΔGz in the up-down axis Az direction (seeFIG. 4B ). In the attitudeangle calculation unit 43, an attitude angle β calculated using the traveling algorithm is obtained by the following equation (2). -
- According to the traveling algorithm described above, it is possible to calculate the measurement value of the attitude angle during traveling of the
vehicle 100 and a change amount in the measurement value. At this time, for example, an average value of attitude angle measurement values in a predetermined period such as several seconds to several minutes is obtained, and the change amount is calculated based on a time average value of the attitude angle. - (Display Position Control)
- Next, display position control for the
image 700 performed by theprocessing unit 50 including theposition correction unit 4 and thedisplay control unit 51 will be described. -
FIG. 5A is a schematic diagram of a vehicle that is not inclined with respect to a road surface (in a state of being parallel to the road surface) as viewed from a lateral side.FIG. 5B is a conceptual diagram illustrating a visual field of a user who drives the vehicle in the state shown inFIG. 5A . Theimage forming unit 2 and theprojection unit 3 project and display theimage 700 formed on thedisplay surface 20 onto thefront shield 101, thereby projecting thevirtual image 300 corresponding to theimage 700 to thetarget space 400. In the illustrated example, in thevirtual image 300, the firstvirtual image 301 such as navigation information shows an arrow indicating a “left turn” on an intersection (T-shaped road) in front of thevehicle 100. In addition, the secondvirtual image 302 such as instrument information displays a traveling speed of “50 km/h” as current vehicle speed information of thevehicle 100. - When the virtual image 300 (the first
virtual image 301 and the second virtual image 302) as in the illustrated example is to be projected to thetarget space 400, thedisplay control unit 51 determines content of the first virtual image 301 (orientation, position, and the like of the arrow) and content of the second virtual image 302 (the vehicle speed and the like). In addition, thedisplay control unit 51 also determines the position of theimage 700 on thedisplay surface 20 of theliquid crystal panel 21. When the position of theimage 700 on thedisplay surface 20 changes, the position of thevirtual image 300 projected to adisplay area 401 of thetarget space 400 also changes. - The
correction unit 41 of theposition correction unit 4 generates a correction amount for changing the display position of theimage 700 on thedisplay surface 20, based on an attitude angle calculated by the attitude angle calculation unit 43 (that is, the attitude angle of the main unit 1), and outputs the correction amount to thedisplay control unit 51. Thedisplay control unit 51 controls the position where theimage 700 is to be displayed based on the correction amount of the display position acquired from thecorrection unit 41. By this control, the position of thevirtual image 300 projected to thedisplay area 401 of thetarget space 400 is corrected in accordance with the attitude angle of themain unit 1. Theprocessing unit 50 including theposition correction unit 4 and thedisplay control unit 51 calculates, for at least the firstvirtual image 301, a correction amount of the display position so as to absorb (reduce) a change in position of thevirtual image 300 in thetarget space 400 due to a change in the attitude angle of themain unit 1. Then, theprocessing unit 50 controls the display position in accordance with the correction amount. Accordingly, the position of theimage 700 on thedisplay surface 20 is changed. - More specifically, as illustrated in
FIGS. 5A and 5B , in a state where the attitude angle of thevehicle 100 is a reference angle (for example, 0 degree), theprocessing unit 50 displays thevirtual image 300 at a default display position without changing the position of the virtual image 300 (the first virtual image 301) projected to thedisplay area 401 of thetarget space 400. Here, the default display position of the firstvirtual image 301 is a substantially central portion of thedisplay area 401, that is, a position through which the optical axis 500 (seeFIG. 5A ) passes. In the illustrated example, an area in thetarget space 400 where thevirtual image 300 can be projected is represented as thedisplay area 401. Here, the firstvirtual image 301 represents an arrow indicating a “left turn” at a T-shaped road in front of thevehicle 100. That is, in the visual field of theuser 200, the firstvirtual image 301 is displayed so as to be superimposed on the T-shaped road in the real scene in thedisplay area 401. In addition, the secondvirtual image 302 is displayed at a position that is a lower left corner of the display area 401 (seeFIG. 5B ). -
FIG. 6A is a schematic diagram of a vehicle that is inclined upward with respect to a road surface as viewed from a lateral side.FIG. 6B is a conceptual diagram illustrating a visual field of a user who drives the vehicle in the state shown inFIG. 6A . When the attitude angle of thevehicle 100 deviates from the reference angle and thevehicle 100 is inclined, theprocessing unit 50 changes the position of the virtual image 300 (the first virtual image 301) projected to thedisplay area 401 of thetarget space 400 from the default display position. As illustrated inFIGS. 6A and 6B , for example, when thevehicle 100 is in a state of a backward-inclined attitude, thedisplay area 401 and the firstvirtual image 301 move upward in the visual field of theuser 200. That is, as illustrated inFIG. 6B , a display area 401 (Y) is formed at a position shifted upward with respect to a display area 401 (X) in a default state. Accordingly, at the default display position, a first virtual image 301 (X) is displayed substantially at a central portion of the display area 401 (Y). Therefore, in the visual field of theuser 200, the first virtual image 301 (X) is displayed so as to be superimposed at a position shifted forward (toward a back side) from the T-shaped road in the real scene. Here, thedisplay area 401 and the firstvirtual image 301 before the movement have reference numerals thereof assigned with an “X”, and thedisplay area 401 and the firstvirtual image 301 after the movement have reference numerals thereof assigned with a “Y”, so that those before the movement and those after the movement are distinguished from each other. - In the case of the backward inclined state, the
processing unit 50 changes the position of theimage 700 on thedisplay surface 20 so that the display position of thevirtual image 300 is shifted downward. Accordingly, as illustrated inFIG. 6A , the position of the firstvirtual image 301 projected to thetarget space 400 moves downward, and in the display area 401 (Y), the first virtual image 301 (Y) is displayed at a position shifted downward with respect to the first virtual image 301 (X) in the default state. As a result, in the visual field of theuser 200, as illustrated inFIG. 6B , the first virtual image 301 (Y) is displayed so as to be superimposed on the T-shaped road in the real scene in the display area 401 (Y). In addition, the secondvirtual image 302 is displayed at a position that is a lower left corner of the display area 401 (Y) (seeFIG. 6B ). -
FIG. 7A is a schematic diagram of a vehicle that is inclined downward with respect to a road surface as viewed from a lateral side.FIG. 7B is a conceptual diagram illustrating a visual field of a user who drives the vehicle in the state shown inFIG. 7A . As illustrated inFIGS. 7A and 7B , for example, when thevehicle 100 is in a state of a forward-inclined attitude, thedisplay area 401 and the firstvirtual image 301 move downward in the visual field of theuser 200. That is, as illustrated inFIG. 7B , the display area 401 (Y) is formed at a position shifted downward with respect to the display area 401 (X) in the default state. Accordingly, at the default display position, the first virtual image 301 (X) is displayed substantially at the central portion of the display area 401 (Y). Therefore, in the visual field of theuser 200, the first virtual image 301 (X) is displayed so as to be superimposed at a position shifted rearward (toward a near side) from the T-shaped road in the real scene. - In the case of the forward inclined state, the
processing unit 50 changes the position of theimage 700 on thedisplay surface 20 so that the display position of thevirtual image 300 is shifted upward. Accordingly, as illustrated inFIG. 7A , the position of the firstvirtual image 301 projected to thetarget space 400 moves forward, and in the display area 401 (Y), the first virtual image 301 (Y) is displayed at a position shifted upward with respect to the first virtual image 301 (X) in the default state. As a result, in the visual field of theuser 200, as illustrated inFIG. 6B , the first virtual image 301 (Y) is displayed so as to be superimposed on the T-shaped road in the real scene in the display area 401 (Y). In addition, the secondvirtual image 302 is displayed at a position that is a lower left corner of the display area 401 (Y) (seeFIG. 7B ). - In a case of a head-up display device mounted on the
vehicle 100, since thevirtual image 300 is projected and superimposed on theroad surface 600, an image displayed on an upper side of thedisplay area 401 is projected far, and an image displayed on a lower side of thedisplay area 401 is projected near. Therefore, when changing a display position of an image to be superimposed thereon, it is preferable to define a correction amount of the display position by angle in accordance with a change amount of an attitude angle. At this time, a range of thedisplay area 401 is, for example, about 3 degrees in the up-down direction, and the position of thevirtual image 300 superimposed on theroad surface 600 greatly changes even by a small angle change of the display position. - In the present embodiment, for example, in the
vehicle 100 during stop, an attitude angle at the time of stop is detected using the stop algorithm to calculate a change amount of the attitude angle, and display position correction is performed so that the change in the attitude angle is reflected in a display position of a projection image. Then, when thevehicle 100 travels, an attitude angle at the time of traveling is detected using the traveling algorithm to calculate a change amount of the attitude angle, and the display position of the projection image is corrected in accordance with the change in the attitude angle. - (Details of Display Position Control Processing)
- In performing display position control for the
virtual image 300 in accordance with an attitude angle of thevehicle 100 by display position control performed by theprocessing unit 50, in a case where a change amount of the attitude angle is large and position correction equal to or greater than a predetermined value is required, if a sudden movement of the image is caused by changing a display position thereof at one time, the user experiences a feeling of discomfort in visually recognizing the image. Therefore, in the present embodiment, a correction amount of the display position per predetermined unit time is adjusted in accordance with a change amount of the attitude angle in a predetermined period so that the display position does not change greatly at one time within the visual field of the user. Specifically, when the change amount of the attitude angle is equal to or greater than a predetermined value, a correction amount per one time for correcting the display position is adjusted, and a correction amount per one time is made smaller than a total correction amount up to a control target value, for example, by performing the display position correction in a plurality of times. Accordingly, the feeling of discomfort the user experiences in the visual field of is reduced. - [First Example of Correction Amount Adjustment]
- A first example illustrates an operation of changing a display position in a plurality of times when a change amount of an attitude angle with respect to a calculation value of a previous measurement is large (for example, 0.3 degree or more) and a correction amount for display positions before and after the update is equal to or greater than a predetermined value. In this case, the
processing unit 50 divides the correction amount of the display position into predetermined values, and steadily changes the display position at a plurality of timings. As described above, in the first example, a correction amount of the display position per unit time is set by equally dividing the total correction amount up to the control target value. With respect to the correction amount per unit time, it is not limited to setting the correction amount equally in each of a plurality of periods into which a period for correcting the display position is divided, and an arbitrary value may be set in each of the divided periods. - With respect to the correction amount of the display position, it is possible to adopt various modes such as setting the correction amount per one time for correcting the display position to a predetermined fixed value smaller than the total correction amount, setting the number of divisions with respect to the total correction amount to a fixed value, and varying the correction amount per one time and/or the number of divisions in accordance with a magnitude of the total correction amount. Specifically, for example, when the change amount of the attitude angle is 0.5 degree, the display position is shifted at 0.05 degree/second for 10 times in a period of 10 seconds.
- Here, the total correction amount of the display position is a total movement amount of the display position that is changed in accordance with the change amount of the attitude angle, and normally corresponds to a movement amount from a current position to a control target position for canceling the change of the attitude angle with respect to the road surface. In a head-up display device, a correction amount of a display position is represented by a change amount of an irradiation angle of light for projecting a virtual image, and a displacement (the number of pixels, the number of lines, or the like) on a display screen of an image forming unit corresponding to an angle is given as a control value from the
processing unit 50 to theimage projection unit 30. Since an image visually recognized by the user is formed in a three-dimensional space, in the display position control, even if a correction amount of the same angle is used, a displacement amount on the display screen of the image forming unit may be different depending on a position in a display area of a target space. - In the first example, when the change amount of the attitude angle of the vehicle is equal to or greater than a predetermined value and the attitude is greatly changed, in the display position control, the correction amount per one time for correcting the display position is reduced and the correction up to the control target value is not performed at one time. Accordingly, a mode is established in which the image projected from the image projection unit moves in a stepwise manner. Accordingly, it is possible to prevent the image from moving greatly at one time, and it is possible to prevent a feeling of discomfort in appearance for the user.
- [Second Example of Correction Amount Adjustment]
- A second example is a modification of the first example, and illustrates an operation of gradually changing a display position such that a correction amount is large in an initial stage and then the correction amount is reduced steadily as approaching a control target position in a case where correction of the display position is performed in a plurality of times. That is, when changing the display position in a plurality of times, the display position is steadily changed with a predetermined time constant. In this case, the
processing unit 50 divides a correction amount of the display position, for example, by using a logarithmic function, and steadily changes the display position at a plurality of timings. As described above, in the second example, a correction amount of the display position per unit time is set to decrease with elapse of time with respect to a total correction amount up to a control target value. - With respect to the correction amount of the display position, it is possible to adopt various modes such as setting the correction amount that steadily decreases from a large state to a small state by each predetermined unit time, and steadily lengthening, from a short state to a long state, the timing of correction by the correction amount per one time as a predetermined fixed value or variable value. Specifically, for example, when the change amount of the attitude angle is 0.5 degree, a correction amount per second is steadily reduced to 0.1 degree, 0.05 degree, 0.025 degree, 0.0125 degree, . . . , and the display position is shifted such that the display position changes greatly (quickly) in the initial stage and then gradually (slowly) changes.
- In the second example, when a change amount of an attitude angle of a vehicle is equal to or greater than a predetermined value and an attitude is greatly changed, in the display position control, a correction amount per one time for correcting the display position is reduced with elapse of time without performing the correction up to the control target value at one time. Accordingly, a mode is established in which an image projected from an image projection unit moves quickly in the initial stage and steadily slows down as approaching a target position. Accordingly, it is possible to prevent the image from moving greatly in an instant, and it is possible to prevent a feeling of discomfort in appearance for the user.
- Note that the first example and the second example may be combined. For example, a period in which a display position is corrected may be divided into a plurality of periods, and a correction amount per unit time may be equally divided or set to an arbitrary value in each of the periods after the division, or the correction amount per unit time may be set to decrease with elapse of time in an entire correction period. As described above, with respect to the correction amount of the display position, various modifications can be applied as long as a method is used in which the correction amount per one time for correcting the display position is made smaller than the total correction amount up to the control target value.
- [Third Example of Correction Amount Adjustment]
- A third example shows an operation of changing a display position at one time in performing correction of the display position when image display of a virtual image such as that of navigation information is turned off for a predetermined time or more. For example, in an image display system, when navigation information is projected and displayed so as to look like being superimposed on a road surface, the navigation information is not always displayed, but is intermittently displayed at an appropriate timing depending on a traveling position of a vehicle such as an intersection. In this case, even in the middle of steadily changing the display position by the first example or the second example, the
processing unit 50 switches a correction mode of the display position and immediately changes the display position to a control target position when there is a period in which the virtual image is not rendered for a predetermined time or more. That is, when the image display is stopped for a predetermined time or more, the correction mode of the display position is switched from a stepwise display position correction to an instant display position correction. As described above, in the third example, when there is a period in which an image is not rendered for a predetermined time or more, a correction amount of the display position is switched to a correction amount for correcting to a control target value at one time. - In the third example, in a case of a timing at which display of a projection image is turned off, the display position is corrected to the control target position at one time regardless of a change amount of an attitude angle, so that it is possible to quickly and appropriately control the display position.
- [Control Procedure of Display Position]
- Here, as an example of a control procedure of a display position according to the present embodiment, an operation example of display position control in each of a stopped state and a traveling state will be described.
-
FIG. 8 is a flowchart illustrating an operation of display position control at the time of stop in the display control device according to the embodiment. When thevehicle 100 is in a stopped state, theprocessing unit 50 measures an attitude angle of thevehicle 100 during stop based on a detection value of a gravitational acceleration by using the above-described stop algorithm (S11). At this time, when a load change occurs due to an increase or decrease in luggage, an increase or decrease in the number of occupants, or the like (S12), a measurement value of the attitude angle by the attitudeangle calculation unit 43 changes (S13). Theprocessing unit 50 calculates a change amount of the attitude angle of thevehicle 100 at this time (S14). When obtaining the change amount of the attitude angle, theprocessing unit 50 calculates the change amount in accordance with, for example, an average value of attitude angle measurement values in units of several minutes in consideration of various influences such as disturbance, noise, and measurement error, and updates the attitude angle measurement value. Then, theprocessing unit 50 controls theimage forming unit 2 to execute the display position control processing while adjusting a correction amount corresponding to the change amount of the attitude angle as described above, and changes a display position of a projection image by the projection unit 3 (S15). -
FIG. 9 is a flowchart illustrating an operation of display position control at the time of traveling in the display control device according to the embodiment. When thevehicle 100 is in a traveling state, theprocessing unit 50 measures an attitude angle of thevehicle 100 during traveling based on a detection value of a motion acceleration by using the above-described traveling algorithm (S21). At this time, when a load change occurs due to a decrease in fuel such as gasoline or a movement of an occupant during traveling (S22), a measurement value of the attitude angle by the attitudeangle calculation unit 43 changes (S23). Theprocessing unit 50 calculates a change amount of the attitude angle of thevehicle 100 at this time (S24). When obtaining the change amount of the attitude angle, theprocessing unit 50 calculates the change amount in accordance with, for example, an average value of attitude angle measurement values in units of several minutes in consideration of various influences such as disturbance, noise, and measurement error, and updates the attitude angle measurement value. Then, theprocessing unit 50 controls theimage forming unit 2 to execute the display position control processing while adjusting a correction amount in accordance with the change amount of the attitude angle as described above, and changes a display position of a projection image by the projection unit 3 (S25). -
FIG. 10 is a flowchart illustrating an operation of display position control in the display control device according to the embodiment in a case of shifting from stop to traveling. The operation example ofFIG. 10 illustrates a case where an attitude change occurs during stop and the vehicle shifts to traveling within a short period of time. For example, this corresponds to cases such as one where a person gets in and out of the vehicle while the vehicle is stopped and traveling starts immediately. In a state where thevehicle 100 is stopped, theprocessing unit 50 measures an attitude angle of thevehicle 100 during stop based on a detection value of a gravitational acceleration by using the stop algorithm (S31). At this time, a load change occurs due to an increase or decrease in the number of occupants (S32), and thevehicle 100 starts traveling before theprocessing unit 50 updates the attitude angle measurement value (S33). When thevehicle 100 enters a traveling state, theprocessing unit 50 measures an attitude angle of thevehicle 100 during traveling based on a detection value of a motion acceleration by using the traveling algorithm (S34). In this case, since the vehicle travels after the load change occurs at the time of stopping, the measurement value of the attitude angle by the attitudeangle calculation unit 43 changes (S35). Theprocessing unit 50 calculates a change amount of the attitude angle of thevehicle 100 at this time (S36). When obtaining the change amount of the attitude angle, theprocessing unit 50 calculates the change amount in accordance with, for example, an average value of attitude angle measurement values in units of several minutes in consideration of various influences such as disturbance, noise, and measurement error, and updates the attitude angle measurement value. Then, theprocessing unit 50 controls theimage forming unit 2 to execute the display position control processing while adjusting a correction amount in accordance with the change amount of the attitude angle as described above, and changes a display position of a projection image by the projection unit 3 (S37). - According to the procedures of the operation examples described above, in each of the case where the vehicle is stopped, the case where the vehicle is traveling, and the case where the vehicle is immediately shifted from stop to traveling, the change amount is calculated by measuring the attitude angle of the vehicle, and the correction amount is adjusted in accordance with the change amount of the attitude angle, thereby enabling control of the display position of the projection image.
- [Fourth Example of Correction Amount Adjustment]
- Next, as a fourth example of the correction amount adjustment, an operation of performing the correction amount adjustment in accordance with a deviation in an attitude angle measurement value by using the traveling algorithm will be described.
-
FIG. 11 is an illustrative table illustrating an example of a correction amount of a display position corresponding to a deviation in an attitude angle measurement value during traveling and a change amount of the attitude angle according to the embodiment. Theprocessing unit 50 changes the correction amount of the display position in accordance with the deviation in the attitude angle measurement value during traveling. In addition, theprocessing unit 50 switches an adjustment operation of the correction amount in accordance with the change amount of the attitude angle. - When calculating the change amount of the attitude angle of the vehicle during traveling, as described above, the change amount of the attitude angle is calculated by obtaining an average value of attitude angle measurement values in a predetermined period such as several seconds to several minutes. At this time, when a deviation of the attitude angle measurement value during traveling is large and variation of the detected attitude angle is large, it is assumed that influence of disturbance or the like is large, and it is considered that reliability of the attitude angle measurement value is low. In contrast, when the deviation of the attitude angle measurement value is small, it is considered that a sensor output for attitude angle measurement is stable and the reliability of the attitude angle measurement value is high.
- The
processing unit 50 sets a predetermined first threshold TH1 and a predetermined second threshold TH2 (TH1<TH2) as deviation thresholds in order to determine a magnitude of the deviation of the attitude angle measurement value. In accordance with the deviation of the attitude angle measurement value during traveling, when the deviation of the attitude angle measurement value during traveling is less than the first threshold TH1, the reliability of the attitude angle measurement value is high, and thus theprocessing unit 50 sets the correction amount in accordance with a value of the attitude angle after change so as to offset the attitude angle change amount, and changes the display position. In addition, when the deviation of the attitude angle measurement value during traveling is equal to or greater than the first threshold TH1 and less than the second threshold TH2 (between TH1 and TH2), the reliability of the attitude angle measurement value is at a medium degree, and thus theprocessing unit 50 sets the correction amount by using an intermediate value of the attitude angles before and after change as a control target value, and changes the display position. In this case, the “intermediate value” set as the control target value may be an arbitrary value that is greater than zero and is up to the value (corresponding to the attitude angle change amount) of the attitude angle after change, and the value is not limited. Preferably, the intermediate value may be a value (median value) in the middle of the attitude angles before and after change. Then, a total correction amount corresponding to the control target value of the set intermediate value is calculated, and the display position is corrected. The deviation threshold is not limited to the two examples described above, and one or three or more thresholds may be provided. Further, the number of arbitrary values of the intermediate value and the deviation threshold corresponding thereto are not limited to one, and may be plural. In addition, a deviation amount of the attitude angle measurement value and the control target value may be interlocked with each other. For example, based on a predetermined function such as control target value=attitude angle change amount×A/deviation amount (A is a weighting coefficient), the control target value may be set to be large when the deviation amount is small, and the control target value may be set to be small as the deviation amount is large. - When the deviation of the attitude angle measurement value during traveling is equal to or greater than the second threshold TH2, the reliability of the attitude angle measurement value is low, and thus the
processing unit 50 sets the correction amount to zero and does not correct the display position. A deviation threshold, at which the deviation of the attitude angle is large and the display position is not corrected, may be separately set as a third threshold TH3. For example, the third threshold TH3 is set to a value greater than the first threshold TH1 and equal to or less than the second threshold TH2. In the case of the example shown inFIG. 11 , the second threshold TH2 is equal to the third threshold TH3. - At this time, regarding adjustment of the correction amount of the display position, the
processing unit 50 switches a control mode of the display position in accordance with the change amount of the attitude angle. For example, when the change amount of the attitude angle is equal to or greater than a predetermined value and equal to or greater than a predetermined change amount threshold, the display position needs to be changed greatly, and accordingly theprocessing unit 50 performs such display position control processing as in the second example described above in which the display position is changed greatly in an initial stage and then changed stepwise gradually. When the change amount of the attitude angle is equal to or larger than the predetermined value and less than the predetermined change amount threshold, the total correction amount of the display position is small, and accordingly theprocessing unit 50 performs such display position control processing as in the first example described above in which the display position is changed stepwise linearly. - In the fourth example, when the deviation of the attitude angle measurement value is large, the total correction amount with respect to the attitude angle change is set to an intermediate value before and after change, and a change amount of a display image due to the display position correction is reduced. Further, when the deviation of the attitude angle measurement value is large, the correction amount is set to zero so that the display position correction is not performed. Accordingly, it is possible to appropriately correct the display position in accordance with the reliability based on the variation of the attitude angle measurement value. At this time, in a case of a state where the reliability of the attitude angle measurement value is not very high (medium degree), the correction amount is reduced to an intermediate value, and excessive correction of the display position can be prevented. In addition, when the reliability of the attitude angle measurement value is low, the display position is not corrected, and a failure of the display position correction due to external noise or the like can be prevented.
- When the change amount of the attitude angle is relatively small, the display position correction is performed in which the position is changed steadily at a constant speed following the procedure of the first example described above, and when the change amount of the attitude angle is relatively large, the display position correction is performed in which the position is changed steadily with a time constant following the procedure of the second example described above. Accordingly, when the change amount of the attitude angle is relatively large, the display position can be controlled so as to move quickly in an initial stage and approach the control target position steadily and slowly, and it looks as if the image changes smoothly for the user. In addition, when the change amount of the attitude angle is relatively small, the display position can be controlled so as to approach the control target position gradually at a constant speed, and it looks as if the image changes quickly and smoothly for the user. In this way, the display position can be smoothly controlled in accordance with a magnitude of the change amount of the attitude angle without giving the user a feeling of discomfort in appearance.
- As described above, in the present embodiment, the display control device controls a display position of an image in the
image projection unit 30 that projects the image onto a display object such as thefront shield 101 of thevehicle 100 serving as an example of a mobile body. The display control device includes theprocessing unit 50 that performs processing related to correction of the display position. Theprocessing unit 50 includes theposition correction unit 4 that sets a correction amount used for correction of the display position, and thedisplay control unit 51 that controls the display position of the image based on the correction amount set by theposition correction unit 4. Theposition correction unit 4 acquires a detection value of an acceleration acting on thevehicle 100 from theacceleration sensor 52, and calculates an attitude angle of thevehicle 100 based on the acquired detection value of the acceleration. Theposition correction unit 4 sets the correction amount of the display position for controlling the display position of the image to be projected on the display object in accordance with the attitude angle. The correction amount of the display position in theposition correction unit 4 is set by adjusting a correction amount per predetermined unit time in accordance with a change amount of the attitude angle in a predetermined period. Accordingly, it is possible to control the display position of the image in accordance with the change amount of the attitude angle, and it is possible to prevent a problem in appearance for the user. - In addition, in the present embodiment, in the setting of the correction amount of the display position, when the change amount of the attitude angle is equal to or larger than a predetermined value, the
position correction unit 4 sets a correction amount per one time for correcting the display position to be smaller than a total correction amount up to a control target value. Accordingly, it is possible to prevent a projected image from moving greatly at one time, and it is possible to prevent a feeling of discomfort in appearance for the user. - In addition, in the present embodiment, when the change amount of the attitude angle is equal to or greater than a predetermined value, the
position correction unit 4 corrects the display position in a plurality of times, and reduces the correction amount per one time for correcting the display position. Accordingly, it is possible to prevent a projected image from moving greatly at one time, and it is possible to prevent a feeling of discomfort in appearance for the user. - In addition, in the setting of the correction amount per one time for correcting the display position in the present embodiment, the
position correction unit 4 sets the correction amount of the display position per unit time by equally dividing the total correction amount up to the control target value. Accordingly, the display position can be controlled so that the image steadily approaches a control target position, and it looks as if the image changes quickly and smoothly for the user. - In addition, in the setting of the correction amount per one time for correcting the display position in the present embodiment, the
position correction unit 4 sets the correction amount of the display position per unit time to decrease with elapse of time, with respect to the total correction amount up to the control target value. Accordingly, the display position can be controlled so as to move quickly in an initial stage and approach the control target position steadily and slowly, and it looks as if the image changes smoothly for the user. - In addition, in the setting of the correction amount per one time for correcting the display position in the present embodiment, when the change amount of the attitude angle is equal to or greater than a predetermined value and equal to or greater than a predetermined change amount threshold, the
position correction unit 4 sets the correction amount of the display position per unit time by equally dividing the total correction amount up to the control target value, or sets the correction amount of the display position per unit time to an arbitrary value. In addition, when the change amount of the attitude angle is equal to or greater than the predetermined value and less than the change amount threshold, theprocessing unit 50 sets the correction amount of the display position per unit time to decrease with elapse of time. Accordingly, the display position can be smoothly controlled in accordance with a magnitude of the change amount of the attitude angle without giving the user a feeling of discomfort in appearance. - In addition, in setting the correction amount of the display position in the present embodiment, the
position correction unit 4 adjusts the correction amount per one time for correcting the display position in accordance with a deviation of a measurement value of the attitude angle in a predetermined period. Accordingly, it is possible to appropriately correct the display position in accordance with reliability based on variation of the attitude angle measurement value. - In addition, in the present embodiment, when the deviation of the attitude angle measurement value is equal to or greater than a first threshold of a predetermined deviation threshold and less than a second threshold greater than the first threshold, the
position correction unit 4 sets the correction amount by using an intermediate value before and after change of the attitude angle as the control target value. Accordingly, in a case of a state where the reliability of the attitude angle measurement value is not so high, the correction amount can be reduced to prevent excessive correction of the display position. - In addition, in the present embodiment, when the deviation of the attitude angle measurement value is equal to or greater than a third threshold of the predetermined deviation threshold, the
position correction unit 4 sets the correction amount of the display position to zero. Accordingly, in a case of a state where the reliability of the attitude angle measurement value is low, the display position is not corrected, and a failure of correction due to external noise or the like can be prevented. - In addition, in the present embodiment, when there is a period in which an image to be projected onto a display object is not rendered for a predetermined time or more, the
position correction unit 4 switches the correction amount of the display position to a correction amount for correcting to the control target value at one time. Accordingly, in a case of a timing at which display of the image is turned off, the display position is corrected to the control target position at one time, so that it is possible to quickly and appropriately control the display position. - In addition, in the present embodiment, when the
vehicle 100 is stopped, theposition correction unit 4 calculates the attitude angle of thevehicle 100 based on acceleration components of a gravitational acceleration in at least two directions including an up-down direction of thevehicle 100 and an orthogonal direction orthogonal to the up-down direction. Accordingly, it is possible to appropriately measure an attitude angle during stop of a mobile body. - In addition, in the present embodiment, when the
vehicle 100 is traveling, theposition correction unit 4 calculates the attitude angle of thevehicle 100 based on acceleration components of a motion acceleration in at least two directions including an up-down direction of thevehicle 100 and an orthogonal direction orthogonal to the up-down direction. Accordingly, it is possible to appropriately measure an attitude angle during traveling of a mobile body. - In addition, in the present embodiment, the
position correction unit 4 may be capable of switching, by setting of a user, a correction mode of the display position between a mode in which correction up to the control target value is performed in a stepwise manner and a mode in which correction up to the control target value is performed at one time. In addition, in the mode in which theposition correction unit 4 performs the correction up to the control target value in a stepwise manner, the user may be able to set the correction amount per one time for correcting the display position. - In addition, in the present embodiment, the image display system is mounted on the
vehicle 100 serving as an example of a mobile body, and includes theimage projection unit 30 that projects an image onto a display object such as thefront shield 101 of thevehicle 100, and the display control device that includes theposition correction unit 4 described above. - Accordingly, it is possible to provide an image display system capable of appropriately controlling a display position of an image in accordance with a change amount of an attitude angle.
- In addition, in the present embodiment, the
vehicle 100 serving as an example of a mobile body includes the image display system described above. The display object in the mobile body is a windshield such as thefront shield 101 of thevehicle 100. Accordingly, it is possible to provide a mobile body capable of appropriately controlling a display position of an image in accordance with a change amount of an attitude angle. - Although various embodiments have been described above with reference to the drawings, it is needless to say that the present disclosure is not limited to such examples. It will be apparent to those skilled in the art that various alterations, modifications, substitutions, additions, deletions, and equivalents can be conceived within the scope of the claims, and it should be understood that such changes also belong to the technical scope of the present disclosure. Components in the various embodiments described above may be combined optionally in a range without deviating from the spirit of the invention.
- The present application is based on Japanese Patent Application No. 2019-120438 filed on Jun. 27, 2019, the contents of which are incorporated herein by reference.
- The present disclosure has an effect of improving control of a display position of an image, and is useful as, for example, a display control device of a display unit using a head-up display device or the like, an image display system, a mobile body, a display control method, and a program.
Claims (20)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2019120438 | 2019-06-27 | ||
JP2019-120438 | 2019-06-27 | ||
PCT/JP2020/007880 WO2020261642A1 (en) | 2019-06-27 | 2020-02-26 | Display control device, image display system, mobile body, display control method, and program |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2020/007880 Continuation WO2020261642A1 (en) | 2019-06-27 | 2020-02-26 | Display control device, image display system, mobile body, display control method, and program |
Publications (2)
Publication Number | Publication Date |
---|---|
US20220113547A1 true US20220113547A1 (en) | 2022-04-14 |
US11860372B2 US11860372B2 (en) | 2024-01-02 |
Family
ID=74059975
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/560,755 Active 2040-10-05 US11860372B2 (en) | 2019-06-27 | 2021-12-23 | Display control device, image display system, mobile body, display control method, and non-transitory computer-readable medium |
Country Status (5)
Country | Link |
---|---|
US (1) | US11860372B2 (en) |
JP (1) | JP7478919B2 (en) |
CN (1) | CN114025983B (en) |
DE (1) | DE112020003146T5 (en) |
WO (1) | WO2020261642A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20220111730A1 (en) * | 2020-10-13 | 2022-04-14 | Subaru Corporation | Vehicular display apparatus |
US11948227B1 (en) * | 2023-04-18 | 2024-04-02 | Toyota Motor Engineering & Manufacturing North America, Inc. | Eliminating the appearance of vehicles and/or other objects when operating an autonomous vehicle |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR3126932A1 (en) * | 2021-09-14 | 2023-03-17 | Psa Automobiles Sa | Floor image projection systems |
CN116243880B (en) * | 2023-05-11 | 2023-07-25 | 江苏泽景汽车电子股份有限公司 | Image display method, electronic equipment and storage medium |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110134498A1 (en) * | 2009-12-08 | 2011-06-09 | Denso Corporation | Headup display device and method for controlling the same |
US20160216521A1 (en) * | 2013-10-22 | 2016-07-28 | Nippon Seiki Co., Ltd. | Vehicle information projection system and projection device |
US20170297477A1 (en) * | 2015-01-14 | 2017-10-19 | Koito Manufacturing Co., Ltd. | Control device for vehicle lamp, and vehicle lamp system |
US20190139286A1 (en) * | 2016-08-29 | 2019-05-09 | Maxell, Ltd. | Head up display |
US20190333481A1 (en) * | 2017-02-28 | 2019-10-31 | Denso Corporation | Display control device and display control method |
US20200124851A1 (en) * | 2018-10-19 | 2020-04-23 | Honda Motor Co., Ltd. | Display device, display control method, and storage medium |
Family Cites Families (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH01293239A (en) | 1988-05-19 | 1989-11-27 | Canon Inc | Head up display device |
JP2010160272A (en) * | 2009-01-07 | 2010-07-22 | Canon Inc | Display control device and control method thereof |
JP2010256878A (en) * | 2009-03-30 | 2010-11-11 | Equos Research Co Ltd | Information display device |
JP2011197510A (en) * | 2010-03-23 | 2011-10-06 | Epson Imaging Devices Corp | Liquid crystal display device, electronic apparatus and luminance control method for light source |
JP5964332B2 (en) * | 2012-02-03 | 2016-08-03 | パイオニア株式会社 | Image display device, image display method, and image display program |
JP5990998B2 (en) * | 2012-04-23 | 2016-09-14 | セイコーエプソン株式会社 | Virtual image display device |
CN104956665B (en) * | 2013-01-28 | 2018-05-22 | Jvc建伍株式会社 | Grenade instrumentation and method for correcting image |
JP6223630B2 (en) * | 2015-04-17 | 2017-11-01 | 三菱電機株式会社 | Display control apparatus, display system, display control method, and display control program |
JP2016222061A (en) * | 2015-05-28 | 2016-12-28 | 日本精機株式会社 | Display system for vehicle |
DE112016003357B4 (en) * | 2015-08-26 | 2021-11-04 | Fujifilm Corporation | Projection type display device, projection display method and projection display program |
EP3264160B1 (en) * | 2016-03-24 | 2019-08-28 | Panasonic Intellectual Property Management Co., Ltd. | Headup display device and vehicle |
WO2017179453A1 (en) * | 2016-04-14 | 2017-10-19 | 旭硝子株式会社 | Inspecting device and inspecting method |
JP6311823B2 (en) * | 2017-04-25 | 2018-04-18 | 株式会社Jvcケンウッド | Image display device and image display method |
JP7007714B2 (en) | 2017-12-28 | 2022-01-25 | アクア株式会社 | refrigerator |
-
2020
- 2020-02-26 CN CN202080046518.2A patent/CN114025983B/en active Active
- 2020-02-26 WO PCT/JP2020/007880 patent/WO2020261642A1/en active Application Filing
- 2020-02-26 JP JP2021527352A patent/JP7478919B2/en active Active
- 2020-02-26 DE DE112020003146.2T patent/DE112020003146T5/en active Pending
-
2021
- 2021-12-23 US US17/560,755 patent/US11860372B2/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110134498A1 (en) * | 2009-12-08 | 2011-06-09 | Denso Corporation | Headup display device and method for controlling the same |
US20160216521A1 (en) * | 2013-10-22 | 2016-07-28 | Nippon Seiki Co., Ltd. | Vehicle information projection system and projection device |
US20170297477A1 (en) * | 2015-01-14 | 2017-10-19 | Koito Manufacturing Co., Ltd. | Control device for vehicle lamp, and vehicle lamp system |
US20190139286A1 (en) * | 2016-08-29 | 2019-05-09 | Maxell, Ltd. | Head up display |
US20190333481A1 (en) * | 2017-02-28 | 2019-10-31 | Denso Corporation | Display control device and display control method |
US20200124851A1 (en) * | 2018-10-19 | 2020-04-23 | Honda Motor Co., Ltd. | Display device, display control method, and storage medium |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20220111730A1 (en) * | 2020-10-13 | 2022-04-14 | Subaru Corporation | Vehicular display apparatus |
US11948227B1 (en) * | 2023-04-18 | 2024-04-02 | Toyota Motor Engineering & Manufacturing North America, Inc. | Eliminating the appearance of vehicles and/or other objects when operating an autonomous vehicle |
Also Published As
Publication number | Publication date |
---|---|
WO2020261642A1 (en) | 2020-12-30 |
CN114025983A (en) | 2022-02-08 |
US11860372B2 (en) | 2024-01-02 |
JPWO2020261642A1 (en) | 2020-12-30 |
DE112020003146T5 (en) | 2022-04-07 |
CN114025983B (en) | 2024-09-17 |
JP7478919B2 (en) | 2024-05-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11860372B2 (en) | Display control device, image display system, mobile body, display control method, and non-transitory computer-readable medium | |
JP6731644B2 (en) | Display position correction device, display device including display position correction device, and moving body including display device | |
JP6201690B2 (en) | Vehicle information projection system | |
CN110308556B (en) | Image forming system, image correcting system, image displaying method, moving object, and non-transitory computer-readable medium | |
CN111954902A (en) | Video display system, video display method, program, and moving object provided with video display system | |
US20190379841A1 (en) | Apparatus and method for displaying information | |
JP7005115B2 (en) | Display device for vehicles | |
US11945309B2 (en) | Display system | |
US20210109357A1 (en) | Display system, display device and display control method | |
US11305692B2 (en) | Display system | |
JP2019164318A (en) | Video display system, video display method, program, and movable body including video display system | |
US20220028307A1 (en) | Gradient change detection system, display system using same, and storage medium that stores program for moving body | |
JP4929768B2 (en) | Visual information presentation device and visual information presentation method | |
US11619811B2 (en) | Image display system, moving body, image display method, and program | |
US20220080832A1 (en) | Display system | |
GB2571923A (en) | Apparatus and method for correcting for changes in vehicle orientation | |
JP7145509B2 (en) | VIDEO DISPLAY SYSTEM, VIDEO DISPLAY METHOD, PROGRAM AND MOBILE BODY | |
KR102324280B1 (en) | Head-up display system based on vehicle driving direction | |
JP7228761B2 (en) | Image display system, moving object, image display method and program | |
JP6933009B2 (en) | Head-up display device | |
US20230168502A1 (en) | Display system and vibration detection system | |
JP7253719B2 (en) | Vehicle equipped with a display device | |
US11922836B2 (en) | Rendering system, display system, display control system, and rendering method | |
JP7422322B2 (en) | Attitude angle processing device, image display system, attitude angle processing method and program | |
US20230098787A1 (en) | Display system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
AS | Assignment |
Owner name: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD., JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:INUKAI, FUMIHITO;MORI, TOSHIYA;TSUJI, MASANAGA;AND OTHERS;SIGNING DATES FROM 20211115 TO 20211117;REEL/FRAME:059738/0254 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT RECEIVED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
AS | Assignment |
Owner name: PANASONIC AUTOMOTIVE SYSTEMS CO., LTD., JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.;REEL/FRAME:066703/0252 Effective date: 20240207 |