WO2023145909A1 - 虚像表示装置 - Google Patents

虚像表示装置 Download PDF

Info

Publication number
WO2023145909A1
WO2023145909A1 PCT/JP2023/002750 JP2023002750W WO2023145909A1 WO 2023145909 A1 WO2023145909 A1 WO 2023145909A1 JP 2023002750 W JP2023002750 W JP 2023002750W WO 2023145909 A1 WO2023145909 A1 WO 2023145909A1
Authority
WO
WIPO (PCT)
Prior art keywords
luminance
image
display
virtual image
display device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2023/002750
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
克彦 森下
良介 小澤
洋一 夷
美樹 田中
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kyocera Corp
Original Assignee
Kyocera Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kyocera Corp filed Critical Kyocera Corp
Priority to US18/833,765 priority Critical patent/US20250157435A1/en
Priority to EP23747119.8A priority patent/EP4471488A4/en
Priority to JP2023577050A priority patent/JPWO2023145909A1/ja
Publication of WO2023145909A1 publication Critical patent/WO2023145909A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/3406—Control of illumination source
    • G09G3/342—Control of illumination source using several illumination sources separately controlled corresponding to different display panel areas, e.g. along one dimension such as lines
    • G09G3/3426—Control of illumination source using several illumination sources separately controlled corresponding to different display panel areas, e.g. along one dimension such as lines the different display panel areas being distributed in two dimensions, e.g. matrix
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/36—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source using liquid crystals
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/10—Intensity circuits
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0118—Head-up displays characterised by optical features comprising devices for improving the contrast of the display / brillance control visibility
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
    • G02B30/26—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type
    • G02B30/30—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type involving parallax barriers
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/0626—Adjustment of display parameters for control of overall brightness
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2360/00—Aspects of the architecture of display systems
    • G09G2360/14—Detecting light within display terminals, e.g. using a single or a plurality of photosensors
    • G09G2360/144—Detecting light within display terminals, e.g. using a single or a plurality of photosensors the light being ambient light
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2360/00—Aspects of the architecture of display systems
    • G09G2360/14—Detecting light within display terminals, e.g. using a single or a plurality of photosensors
    • G09G2360/145—Detecting light within display terminals, e.g. using a single or a plurality of photosensors the light originating from the display screen
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2380/00—Specific applications
    • G09G2380/10—Automotive applications

Definitions

  • the present disclosure relates to a virtual image display device.
  • Patent Document 1 A conventional virtual image display device is described in Patent Document 1, for example.
  • a virtual image display device of the present disclosure includes a display unit having a display surface for displaying an image; an optical system that projects the image light emitted from the display surface so as to form a virtual image in a user's field of view; a measuring unit for measuring background luminance; Control for changing the luminance of the image displayed on the display surface between the background luminance measured by the measuring unit and a predetermined luminance higher than the background luminance, based on the gradation-luminance characteristics of the display unit. including the part.
  • FIG. 1 is a diagram showing the configuration of a virtual image display device according to an embodiment of the present disclosure
  • FIG. 2 is a side view showing a vehicle equipped with the virtual image display device of FIG. 1
  • 4 is a graph showing the relationship between input gradation and display luminance in a display device
  • 4 is a graph showing the relationship between input gradation and display luminance in the virtual image display device according to the embodiment of the present disclosure
  • 4 is a graph for explaining correspondence between input grayscales and display brightness stored in a lookup table
  • FIG. 4 is a diagram showing a display area of a liquid crystal display panel
  • FIG. 1 is a diagram showing the configuration of a virtual image display device according to an embodiment of the present disclosure
  • FIG. 2 is a side view showing a vehicle equipped with the virtual image display device of FIG. 1
  • 4 is a graph showing the relationship between input gradation and display luminance in a display device
  • 4 is a graph showing the relationship between input gradation and display luminance in the virtual image display device
  • FIG. 4 is a diagram showing a light emitting area of a backlight; It is a graph which shows the luminance histogram of an information display image. 4 is a graph showing a luminance histogram of a background image; FIG. 11 is a diagram showing a configuration of a modification of the virtual image display device according to the embodiment of the present disclosure;
  • FIG. 1 is a diagram showing the configuration of a virtual image display device according to an embodiment of the present disclosure
  • FIG. 2 is a side view showing a vehicle equipped with the virtual image display device of FIG. 3 is a graph showing the relationship between input gradation and display luminance in a display device
  • FIG. 4 is a graph showing the relationship between input gradation and display luminance in a virtual image display device according to an embodiment of the present disclosure
  • FIG. 5 is a graph for explaining the correspondence between the input gradation and the display luminance stored in the lookup table.
  • 6A is a diagram showing the display area of the liquid crystal display panel
  • FIG. 6B is a diagram showing the light emitting area of the backlight
  • FIG. 6A is a diagram showing the display area of the liquid crystal display panel
  • FIG. 6B is a diagram showing the light emitting area of the backlight
  • FIG. 6A is a diagram showing the display area of the liquid crystal display panel
  • FIG. 6B is a diagram showing the light emitting area of the
  • FIG. 7A is a graph showing the luminance histogram of the information display image
  • FIG. 3 is a graph showing a luminance histogram of a background image
  • FIG. 6 shows a plan view of the liquid crystal display panel and the backlight when viewed from a direction orthogonal to the display surface of the display section.
  • FIG. 8 is a diagram showing the configuration of a modification of the virtual image display device according to the embodiment of the present disclosure.
  • the virtual image display device 1 of this embodiment includes a display unit 2, an optical system 3, a measurement unit 4, and a control unit 5, as shown in FIG.
  • the virtual image display device 1 may be mounted on a vehicle 10 as shown in FIG.
  • FIG. 2 shows the case where the vehicle 10 is a passenger car, the vehicle 10 is not limited to a passenger car, and may be an automobile such as a truck, a bus, a two-wheeled vehicle, and a trolleybus. Further, the vehicle 10 is not limited to an automobile, and may be a railroad vehicle, an industrial vehicle, a household vehicle, or a fixed-wing aircraft that runs on a runway.
  • the display unit 2 has a display surface 2a that displays an image (also referred to as an input image) input from the outside (for example, the control unit 5).
  • the display unit 2 emits image light representing an input image from the display surface 2a.
  • the display unit 2 may include a transmissive display device or a self-luminous display device.
  • the transmissive display device may be a liquid crystal display device including a liquid crystal display panel and a backlight.
  • the liquid crystal display panel may be, for example, an IPS (In-Plane Switching) method, an FFS (Fringe Field Switching) method, a VA (Vertical Alignment) method, or an ECB (Electrically Controlled Birefringence) method.
  • the backlight may be a direct backlight or an edge-lit backlight.
  • the self-luminous display device may be, for example, a self-luminous display device including a plurality of self-luminous elements arranged two-dimensionally.
  • the self-luminous element for example, a light-emitting diode (Light Emitting Diode; LED) element, an organic light-emitting diode (Organic Light Emitting Diode; OLED) element, or a semiconductor laser (Laser Diode; LD) element may be a self-luminous element such as an element.
  • a light-emitting diode Light Emitting Diode; LED
  • an organic light-emitting diode Organic Light Emitting Diode
  • OLED Organic Light Emitting Diode
  • LD semiconductor laser
  • the measuring unit 4 measures the background luminance (cd/m 2 ) in the visual field of the user 6 .
  • the measurement unit 4 may include a luminance meter whose light receiving surface faces forward in the field of view of the user 6 .
  • the measurement unit 4 may include an image sensor whose imaging surface is directed forward in the field of view of the user 6 .
  • the image sensor may be configured by, for example, a CCD (Charge Coupled Device) image sensor, a CMOS (Complementary Metal Oxide Semiconductor) image sensor, or the like.
  • the background brightness may be an average value of brightness in the captured image of the image sensor.
  • the weights (coefficients such as 0.299 and 0.587) of each color tone component R, G, and B in luminance Y are not limited to the above values, and may be arbitrarily set according to human visual characteristics.
  • the measurement unit 4 is arranged above the head of the user 6 , it may be arranged on the dashboard of the vehicle 10 . It may be arranged outside the vehicle 10 as long as the background luminance can be measured.
  • the measurement unit 4 outputs the measured background brightness to the control unit 5 .
  • the measurement unit 4 and the control unit 5 are connected via wired communication or wireless communication.
  • the measurement unit 4 and the control unit 5 may be connected via a network of the vehicle such as CAN (Control Area Network).
  • the measurement unit 4 captures an image of the background in the visual field of the user 6, and calculates the background brightness based on the image data of the background obtained by imaging.
  • the measurement unit 4 may determine the weather (sunny, cloudy, rainy, snowy, etc.) around the vehicle 10 based on image data obtained by imaging.
  • the measurement unit 4 may determine the condition of the road surface (dry, wet, covered with snow, etc.) based on image data obtained by imaging.
  • the background brightness in the field of view of the user 6 may be the peripheral brightness of a facility in which the virtual image display device 1 is mounted, such as a vehicle.
  • the optical system 3 projects the image light emitted from the display surface 2a into the field of view of the user 6 as a virtual image 7.
  • the optical system 3 is positioned on the optical path of the image light emitted from the display section 2 .
  • the optical system 3 may be configured including optical members 3a and 3b, as shown in FIG.
  • the number of optical members constituting the optical system 3 is not limited to two, and may be one or three or more.
  • the optical member may include a reflective member including a free-form surface mirror, a convex mirror, or a concave mirror.
  • Optical members may include refractive members including convex or concave lenses. Convex lenses include biconvex lenses, plano-convex lenses, and convex meniscus lenses.
  • Concave lenses include biconcave lenses, plano-concave lenses, and concave meniscus lenses.
  • the optical member is not limited to a reflective member or a refractive member, and may include various other optical members. As shown in FIG. 1, when the virtual image display device 1 is mounted on a vehicle 10, the windshield of the vehicle 10 may constitute a part of the optical system 3 as the optical member 3b.
  • the control unit 5 is connected to each component of the virtual image display device 1 and controls each component.
  • the control unit 5 is configured as a processor, for example.
  • the control unit 5 may be configured including one or more processors.
  • the processor may include a general-purpose processor that loads a specific program to execute a specific function, and a dedicated processor that specializes in specific processing.
  • a dedicated processor may include an Application Specific Integrated Circuit (ASIC).
  • the processor may include a Programmable Logic Device (PLD).
  • the PLD may include an FPGA (Field-Programmable Gate Array).
  • the control unit 5 may be an SoC (System-on-a-Chip) or SiP (System In a Package) in which one or more processors cooperate.
  • the control unit 5 may include a storage unit.
  • the storage unit may store various information related to the operation of the virtual image display device 1, such as a program for operating each component of the virtual image display device 1, a lookup table (LUT), and the like.
  • the storage unit may be composed of, for example, a semiconductor memory or the like.
  • the storage section may function as a work memory for the control section 5 .
  • the measurement unit 4 may output image data obtained by capturing an image of the background in the field of view of the user 6 to the control unit 5 without measuring the background brightness within the device.
  • the control unit 5 may calculate the background luminance of the visual field of the user 6 based on the image data acquired from the measurement unit 4 .
  • the control unit 5 determines the weather around the vehicle 10 (sunny, cloudy, rainy, snowy, etc.) and the condition of the road surface (dry, wet, snowy, etc.). At least one may be determined.
  • the control unit 5 includes an external communication device, and may acquire information about the weather around the vehicle 10, the condition of the road surface, etc. from the network via the external communication device.
  • an input value (also called input gradation) VIN of an image signal or the like and an output value (also called display luminance) VOUT have a linear relationship represented by a linear function.
  • V OUT V IN ⁇ ( ⁇ is a real number different from 1 ) has a non-linear relationship.
  • the value of the power index ⁇ is also referred to as the ⁇ value.
  • the ⁇ value may be, for example, 2.2, 3.0, or other real numbers.
  • FIG. 3 shows an example in which the input gradation VIN is represented by 8 bits (256 gradations), the number of bits of the input gradation VIN may be set arbitrarily.
  • the display device is a virtual image display device, the user 6 may not be able to properly view the virtual image 7 because it is difficult for the user 6 to view pixels with display brightness lower than the background brightness, as indicated by broken lines in FIG. In the example shown in FIG. 4, the user 6 has difficulty visually recognizing pixels with a display luminance of less than 2000 cd/m 2 , that is, an input gradation of less than about 185, and thus may not be able to properly view the virtual image 7 .
  • the virtual image display device 1 of the present embodiment as indicated by the solid line in FIG. is changed between the background luminance (also referred to as the first luminance) V1 measured by the measuring unit 4 and a predetermined luminance (also referred to as the second luminance) V2 higher than the first luminance V1, based on ing.
  • the virtual image display device 1 raises the display luminance V OUT so that the minimum luminance V MIN in the display luminance V OUT becomes the background luminance V1, and then reduces the display luminance V OUT to the gradation level of the display unit 2 ⁇ Based on the luminance characteristics, the luminance is changed between the minimum luminance V MIN and the predetermined luminance V2.
  • the virtual image display device 1 can set the brightness of the image displayed on the display surface 2a to be equal to or higher than the background brightness V1, the user 6 can appropriately recognize the virtual image 7 even when the background brightness V1 is high.
  • the minimum luminance V MIN may be equal to or higher than the background luminance V1, and may not be equal to the background luminance V1.
  • FIG. 4 shows an example in which the first luminance V1 is 2000 cd/ m2 and the second luminance V2 is 4000 cd/ m2 . It goes without saying that the first brightness V1 varies according to the background of the user 6 and that the second brightness V2 can be set to any value greater than the first brightness V1.
  • the control unit 5 may determine the difference between the second luminance V2 and the first luminance V1 based on the first luminance V1. This allows the user 6 to visually recognize the virtual image 7 with a wide dynamic range even when the first luminance V1 changes.
  • the controller 5 may increase the difference between the second luminance V2 and the first luminance V1 as the first luminance V1 increases. This allows the user 6 to visually recognize the virtual image 7 with a wide dynamic range even when the first luminance V1 changes.
  • the control unit 5 may determine the difference between the second luminance V2 and the first luminance V1 based on the time. For example, when the time is in the daytime period (for example, 9:00 to 15:00), the control unit 5 controls the difference between the second luminance V2 and the first luminance V1 as compared to when the time is in other time periods. can be increased. This allows the user 6 to visually recognize the virtual image 7 with a wide dynamic range even when the background luminance V1 is high during the daytime.
  • the control unit 5 may determine the difference between the second luminance V2 and the first luminance V1 based on the weather around the vehicle 10. For example, when the weather is sunny or snowy, the controller 5 may increase the difference between the second luminance V2 and the first luminance V1 compared to when the weather is cloudy or rainy. This allows the user 6 to visually recognize the virtual image 7 with a wide dynamic range even when the background brightness V1 is high under sunny or snowy weather.
  • the control unit 5 may determine the difference between the second luminance V2 and the first luminance V1 based on the condition of the road surface. For example, when the road surface is covered with snow, the controller 5 may increase the difference between the second luminance V2 and the first luminance V1 compared to when the road surface is dry or wet. This allows the user 6 to visually recognize the virtual image 7 with a wide dynamic range even when the background luminance V1 due to the snow-covered road surface is high.
  • the control unit 5 may change the gradation-luminance characteristics, that is, the ⁇ value, based on the first luminance V1. As a result, even when the first luminance V1 changes, the luminance of the display image can be corrected in accordance with the human visual characteristics, so that the user 6 can appropriately recognize the virtual image 7. Become.
  • the control unit 5 may decrease the ⁇ value when the first luminance V1 is smaller than the first predetermined value.
  • the controller 5 may increase the ⁇ value when the first luminance V1 is greater than a second predetermined value that is equal to or greater than the first predetermined value.
  • the amount of decrease in the ⁇ value may be determined based on the difference between the first luminance V1 and the first predetermined value.
  • the amount of increase in the ⁇ value may be determined based on the difference between the first luminance V1 and the second predetermined value.
  • the virtual image display device 1 may have an LUT that associates the gradation value of the input image with the luminance value of the display image for each of the plurality of values of the first luminance V1.
  • the LUT may store a plurality of correspondences between input gradation VIN and display luminance VOUT as shown in FIG.
  • FIG. 5 shows four mappings C1, C2, C3, C4 between input grayscale V IN and display luminance V OUT , the number of mappings stored in the LUT is less than four. may be five or more.
  • the LUT may be stored in a storage section included in the control section 5.
  • the luminance value of the displayed image may be stored as a voltage value applied to each pixel.
  • the control unit 5 selects one of the plurality of associations based on the first luminance V1 measured by the measurement unit 4, and based on the selected association and the first luminance V1 and the second luminance V2 may be used to control the brightness of the displayed image.
  • the display unit 2 may be a liquid crystal display device including a liquid crystal display panel 21 and a backlight 22, as shown in FIGS.
  • the liquid crystal display panel 21 includes the display surface 2 a of the display section 2 .
  • the liquid crystal display panel 21 may have a plurality of display areas 21a obtained by dividing the display surface 2a into a plurality of areas, as shown in FIG. 6A.
  • the backlight 22 may have a plurality of light emitting areas 22a respectively corresponding to the plurality of display areas 21a.
  • the plurality of light emitting regions 22a may be individually switchable between a light emitting state and a non-light emitting state.
  • the plurality of light emitting regions 22a may be individually controllable in light emission luminance, as is called a local dimming method.
  • FIG. 6A shows an example of an image displayed on the display surface 2a when viewed from a direction perpendicular to the display surface 2a.
  • the image displayed on the display surface 2a may be an image obtained by inverting at least one of the image shown in FIG. 6A horizontally and vertically.
  • the backlight 22 may be a direct type backlight positioned on the back side of the liquid crystal display panel 21 and having a plurality of light sources arranged two-dimensionally facing the liquid crystal display panel 21 .
  • a direct type backlight positioned on the back side of the liquid crystal display panel 21 and having a plurality of light sources arranged two-dimensionally facing the liquid crystal display panel 21 .
  • an LED element, an OLED element, an LD element, or the like can be used as the light source of the direct backlight.
  • the backlight 22 is not limited to a direct type backlight, and may include an edge light type backlight and a liquid crystal shutter positioned in front of the backlight.
  • the liquid crystal shutter can control the light transmittance according to the applied voltage.
  • the liquid crystal shutter may be composed of a plurality of pixels and configured to control the light transmittance of each pixel.
  • the liquid crystal shutter can form a region with high light transmittance or a region with low light transmittance in any shape.
  • An edge-lit backlight has a plurality of light sources arranged around the periphery of the backlight.
  • the light source of the edge light type backlight for example, an LED element, an OLED element, an LD element, a cold cathode fluorescent lamp, a halogen lamp, a xenon lamp, or the like can be used.
  • the number of display areas 21a included in the display surface 2a may be set arbitrarily.
  • the number of display areas 21a may be the same as the number of light emitting areas of the backlight 22, for example.
  • the number of light emitting regions of the backlight 22 may be the number of light sources of the backlight 22, for example.
  • the backlight 22 is an edge-light type backlight
  • the number of light emitting regions of the backlight 22 may be the number of pixels of the liquid crystal shutter.
  • the control unit 5 may set each of the plurality of light-emitting regions 22a to the light-emitting state or the non-light-emitting state based on the image data of the plurality of partial images displayed in each of the plurality of display regions 21a.
  • a light-emitting region 22a1 corresponding to the display region 21a displaying a partial image (also referred to as an information display image) S1 including navigation information (lane guidance, navigation guidance, distance warning, pedestrian detection, etc.) for the user 6 is set to a light-emitting state.
  • the light-emitting region 22a2 corresponding to the display region 21a displaying the partial image (also referred to as the background image) S2 other than the information display image into a non-light-emitting state, the deterioration of the visibility of the information display image S1 due to light leakage is suppressed. This makes it possible to make the information display image S1 stand out.
  • the control unit 5 may determine whether the partial image is the information display image S1 or the background image S2 based on the gradation-pixel number histogram of the partial image displayed in each display area 21a.
  • the gradation-pixel number histogram is a histogram in which the vertical axis is the number of pixels and the horizontal axis is the gradation.
  • the gradation can be calculated from the color tone components R, G, and B of each pixel of the partial image.
  • the gradation may be an amount obtained by superimposing the tone components R, G, and B of each pixel of the partial image, eg, 0.299R+0.587G+0.114B.
  • the control unit 5 may determine a partial image in which the number of pixels whose gradation is equal to or less than a predetermined threshold value T is less than N% of the total number of pixels in the partial image as the information display image S1 (see FIG. 7A).
  • the control unit 5 may determine a partial image in which the number of pixels whose gradation is equal to or less than a predetermined threshold value T is equal to or greater than N% of the total number of pixels in the partial image as the background image S2 (see FIG. 7B).
  • the backlight may be controlled to be extinguished so as to be in a non-light emitting state.
  • the threshold T can be set arbitrarily, but when the gradation is 256 gradations, the threshold T may be 5, 10, or 15, for example. Also, N may be 90, 95, or 99, for example.
  • the control unit 5 may control the light emission brightness of the light emission region 22a1 based on the first brightness V1.
  • the controller 5 may increase the light emission luminance of the light emitting region 22a1 as the first luminance V1 increases. This allows the user 6 to visually recognize the virtual image 7 with a wide dynamic range even when the first luminance V1 changes.
  • the control unit 5 may control the light emission brightness of the light emission region 22a1 based on the time of day, weather around the vehicle 10, road surface conditions, and the like.
  • the control unit 5 may control the light emission brightness of the light emission region 22a1 based on the time. For example, when the time is daytime (9:00 to 15:00), the control unit 5 may increase the light emission luminance of the light emitting region 22a1 compared to other time periods. . This allows the user 6 to visually recognize the virtual image 7 with a wide dynamic range even when the background luminance V1 is high during the daytime.
  • the control unit 5 may control the light emission brightness of the light emission region 22a1 based on the weather around the vehicle 10. For example, when the weather is sunny or snowy, the control unit 5 may increase the light emission brightness of the light emitting region 22a1 compared to when the weather is cloudy or rainy. This allows the user 6 to visually recognize the virtual image 7 with a wide dynamic range even when the background brightness V1 is high under sunny or snowy weather.
  • the control unit 5 may control the light emission brightness of the light emission area 22a1 based on the road surface condition. For example, when the road surface is covered with snow, the controller 5 may increase the light emission brightness of the light emitting region 22a1 compared to when the road surface is dry or wet. This allows the user 6 to visually recognize the virtual image 7 with a wide dynamic range even when the background luminance V1 due to the snow-covered road surface is high.
  • the virtual image display device 1A of the present modification differs from the virtual image display device 1 in the configuration of the display unit 2, and the other configurations are the same. Therefore, the detailed description of the similar configuration is omitted.
  • the display unit 2 includes a liquid crystal display panel 21, a backlight 22, and a parallax barrier 23.
  • the liquid crystal display panel 21 displays a mixed image on the display surface 2a.
  • the mixed image includes a left-eye image viewed by the user's left eye and a right-eye image viewed by the user's right eye.
  • the left-eye image and the right-eye image have parallax with each other.
  • the parallax barrier 23 is configured to divide the image light representing the mixed image emitted from the display surface 2a into left-eye image light representing the left-eye image and right-eye image light representing the right-eye image light.
  • there is 8 shows an example in which the parallax barrier 23 is positioned in front of the display surface 2a (to the right in FIG. 8), but the parallax barrier 23 is positioned between the liquid crystal display panel 21 and the backlight 22.
  • the parallax barrier 23 has a plurality of light blocking surfaces 23a.
  • the plurality of light shielding surfaces 23a shield image light emitted from the display surface 2a.
  • the plurality of light blocking surfaces 23a define open areas 23b between adjacent light blocking surfaces 23a, as shown in FIG.
  • the aperture region 23b has a higher light transmittance than the light shielding surface 23a.
  • the light-shielding surface 23a has a lower light transmittance than the opening region 23b.
  • the opening region 23b is a portion through which light incident on the parallax barrier 23 is transmitted.
  • the opening region 23b transmits light with a transmittance equal to or greater than the first predetermined value.
  • the first predetermined value may be, for example, 100%, or a value close to 100%.
  • the light shielding surface 23a is a portion that shields and does not transmit light incident on the parallax barrier 23 . In other words, the light shielding surface 23a is a portion that shields the image displayed on the display surface 2a.
  • the light blocking surface 23a blocks light with a transmittance equal to or lower than the second predetermined value.
  • the second predetermined value may be, for example, 0% or a value close to 0%.
  • the ratio of the second predetermined value to the first predetermined value may be, for example, 1/100 or 1/1000.
  • the parallax barrier 23 may be composed of a film or plate-like member having a transmittance of less than the second predetermined value.
  • the light shielding surface 23a is composed of a film or a plate-like member.
  • the opening region 23b is composed of an opening provided in a film or plate-like member.
  • the film may be made of resin, or may be made of another material.
  • the plate member may be made of resin, metal, or the like, or may be made of another material.
  • the parallax barrier 23 is not limited to a film or a plate-like member, and may be composed of other types of members.
  • the parallax barrier 23 may have a light-shielding base material, or may contain a light-shielding additive in the base material.
  • the parallax barrier 23 may be composed of liquid crystal shutters.
  • the opening region 23b may be a region having a transmittance of a first predetermined value or more
  • the light shielding surface 23a may be a region having a transmittance of a second predetermined value or less.
  • the optical system 3 may be configured so that image light representing a left-eye image is incident on the left eye of the user 6 and image light representing a right-eye image is incident on the right eye of the user 6 .
  • FIG. 8 shows an example in which the optical system 3 is composed of the optical members 3a and 3b. Well, it may be three or more.
  • the control unit 5 sets the brightness of the mixed image displayed on the display surface 2a to the first brightness V1 measured by the measurement unit 4 based on the gradation-brightness characteristics of the display unit 2, which is higher than the first brightness V1. It is changed between the second luminance V2.
  • the virtual image display device 1A can allow the user 6 to appropriately stereoscopically view the virtual image 7 even when the first luminance V1 in the visual field of the user 6 is high.
  • the virtual image display device of the present disclosure even when the background luminance in the user's field of view is high, the user can appropriately view the virtual image.
  • the virtual image display device can be implemented in the following configurations (1) to (8).
  • a display unit having a display surface for displaying an image; an optical system that projects the image light emitted from the display surface so as to form a virtual image in a user's field of view; a measuring unit for measuring background luminance; Control for changing the luminance of the image displayed on the display surface between the background luminance measured by the measuring unit and a predetermined luminance higher than the background luminance, based on the gradation-luminance characteristics of the display unit. and a virtual image display device.
  • control unit changes the gradation-luminance characteristic based on the background luminance.
  • the display unit includes a liquid crystal display panel including the display surface and a backlight;
  • the liquid crystal display panel has a plurality of display areas obtained by dividing the display surface into a plurality of areas, the backlight has a plurality of light-emitting regions respectively corresponding to the plurality of display regions; (1) to (4) above, wherein the control unit puts each of the plurality of light-emitting regions into a light-emitting state or a non-light-emitting state based on image data of a plurality of partial images to be displayed in the plurality of display regions, respectively;
  • the virtual image display device according to any one of
  • the control unit determines whether each of the plurality of partial images is an information presentation image including navigation information for the user or a background image other than the information presentation image.
  • the virtual image display device according to (5) above, wherein it is determined whether the background image is an image, and the light-emitting region corresponding to the display region displaying the background image is placed in a non-light-emitting state.
  • control unit controls the light emission brightness of a light emission region corresponding to a display region displaying the information presentation image based on the background brightness.
  • control unit controls the luminance of the image based on the background luminance in correspondence with the gradation-luminance characteristics stored in advance.
  • the present disclosure is not limited to the above-described embodiments, and various modifications, improvements, etc. are possible without departing from the gist of the present disclosure. It goes without saying that all or part of each of the above-described embodiments can be appropriately combined within a non-contradictory range.
  • a head-up display mounted on a vehicle has been exemplified as the virtual image display device
  • the present invention is not limited to this, and may be a head-mounted display mounted on the user's head.
  • the virtual image display device of the present disclosure can be applied to a display device that realizes augmented reality that augments the real world by adding information to the real environment.
  • Reference Signs List 1 1A virtual image display device 2 display unit 2a display surface 21 liquid crystal display panel 21a display area 22 backlight 22a, 22a1, 22a2 light emitting area 23 parallax barrier 23a light shielding surface 23b opening area 3 optical system 3a optical member 3b optical member 4 measurement unit 5 control unit 6 user 7 virtual image 10 vehicle V1 background luminance (first luminance) V2 predetermined luminance (second luminance)

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Crystallography & Structural Chemistry (AREA)
  • Chemical & Material Sciences (AREA)
  • Computing Systems (AREA)
  • Geometry (AREA)
  • Computer Graphics (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
PCT/JP2023/002750 2022-01-27 2023-01-27 虚像表示装置 Ceased WO2023145909A1 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US18/833,765 US20250157435A1 (en) 2022-01-27 2023-01-27 Virtual image display device
EP23747119.8A EP4471488A4 (en) 2022-01-27 2023-01-27 VIRTUAL IMAGE DISPLAY DEVICE
JP2023577050A JPWO2023145909A1 (cg-RX-API-DMAC7.html) 2022-01-27 2023-01-27

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2022010847 2022-01-27
JP2022-010847 2022-01-27

Publications (1)

Publication Number Publication Date
WO2023145909A1 true WO2023145909A1 (ja) 2023-08-03

Family

ID=87471624

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2023/002750 Ceased WO2023145909A1 (ja) 2022-01-27 2023-01-27 虚像表示装置

Country Status (4)

Country Link
US (1) US20250157435A1 (cg-RX-API-DMAC7.html)
EP (1) EP4471488A4 (cg-RX-API-DMAC7.html)
JP (1) JPWO2023145909A1 (cg-RX-API-DMAC7.html)
WO (1) WO2023145909A1 (cg-RX-API-DMAC7.html)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2025047810A1 (ja) * 2023-08-31 2025-03-06 京セラ株式会社 虚像表示装置および移動体

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009008722A (ja) 2007-06-26 2009-01-15 Univ Of Tsukuba 3次元ヘッドアップディスプレイ装置
JP2015178297A (ja) * 2014-03-19 2015-10-08 アイシン・エィ・ダブリュ株式会社 ヘッドアップディスプレイ装置
JP2020087050A (ja) * 2018-11-27 2020-06-04 ソニー株式会社 表示制御装置、表示制御方法及び表示制御プログラム
JP2020194117A (ja) * 2019-05-29 2020-12-03 株式会社デンソー 虚像表示装置
JP2020202543A (ja) * 2019-06-13 2020-12-17 ローム株式会社 映像信号送信装置及び映像信号受信装置

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003259363A (ja) * 2002-02-27 2003-09-12 Denso Corp ナイトビジョン装置
JP2018118580A (ja) * 2017-01-24 2018-08-02 株式会社デンソー 車両用表示装置
JP6617734B2 (ja) * 2017-02-22 2019-12-11 株式会社デンソー 車両用表示装置
WO2019046334A1 (en) * 2017-08-29 2019-03-07 Pcms Holdings, Inc. SYSTEM AND METHOD FOR COMPENSATING REAL WORLD LIGHTING CHANGES IN INCREASED REALITY
KR102046220B1 (ko) * 2017-09-06 2019-11-19 고려대학교 산학협력단 디스플레이 시인성 개선 방법 및 장치
DE102019003039A1 (de) * 2019-04-26 2020-10-29 Daimler Ag Vorrichtung und Verfahren zur Projektion von Bilddaten auf eine Projektionsfläche einer Fahrzeugscheibe
US11968759B2 (en) * 2020-05-29 2024-04-23 Rohm Co., Ltd. Dimming data transmission device
US11735138B2 (en) * 2021-04-22 2023-08-22 GM Global Technology Operations LLC Dual image plane HUD with automated illuminance setting for AR graphics displayed in far virtual image plane

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009008722A (ja) 2007-06-26 2009-01-15 Univ Of Tsukuba 3次元ヘッドアップディスプレイ装置
JP2015178297A (ja) * 2014-03-19 2015-10-08 アイシン・エィ・ダブリュ株式会社 ヘッドアップディスプレイ装置
JP2020087050A (ja) * 2018-11-27 2020-06-04 ソニー株式会社 表示制御装置、表示制御方法及び表示制御プログラム
JP2020194117A (ja) * 2019-05-29 2020-12-03 株式会社デンソー 虚像表示装置
JP2020202543A (ja) * 2019-06-13 2020-12-17 ローム株式会社 映像信号送信装置及び映像信号受信装置

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2025047810A1 (ja) * 2023-08-31 2025-03-06 京セラ株式会社 虚像表示装置および移動体

Also Published As

Publication number Publication date
JPWO2023145909A1 (cg-RX-API-DMAC7.html) 2023-08-03
US20250157435A1 (en) 2025-05-15
EP4471488A1 (en) 2024-12-04
EP4471488A4 (en) 2025-08-20

Similar Documents

Publication Publication Date Title
US10923003B2 (en) Light source apparatus, display apparatus, vehicle, three-dimensional projection apparatus, three-dimensional projection system, image projection apparatus, and image display apparatus
CN110799894B (zh) 三维显示装置、三维显示系统、移动体和三维显示方法
US20240355241A1 (en) Aerial image display device
JP2017223933A (ja) スクリーンと発光量子ロッドを用いた光源とを備えたイメージプロジェクタ
JP7332747B2 (ja) 表示装置および移動体
CN113039785A (zh) 三维显示装置、三维显示系统、平视显示器以及移动体
EP4471488A1 (en) Virtual image display device
CN116134366A (zh) 三维显示装置
US10606076B2 (en) Dual-image head-up display
JP2020101694A (ja) 3次元表示装置、ヘッドアップディスプレイシステム、及び移動体
US11966051B2 (en) Three-dimensional display device, three-dimensional display system, head-up display system, and movable object
CN116235241A (zh) 三维显示装置、三维显示方法、三维显示系统以及移动体
US12457316B1 (en) Three-dimensional display device and display method
US20260100168A1 (en) Virtual image display device, movable body, method for driving virtual image display device, and program
JP7536693B2 (ja) 3次元表示装置、ヘッドアップディスプレイおよび移動体
WO2025147948A1 (en) Method and system for correcting nonuniformity of near-eye display
US20250182656A1 (en) Circuit Device And Display System
EP4187310A1 (en) Three-dimensional display device, head-up display, and mobile object
WO2025047810A1 (ja) 虚像表示装置および移動体
WO2024070986A1 (ja) 空中像表示装置
CN119495264A (zh) 背光源控制方法、装置、设备及计算机可读存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23747119

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2023577050

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 18833765

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2023747119

Country of ref document: EP

Effective date: 20240827

WWP Wipo information: published in national office

Ref document number: 18833765

Country of ref document: US

WWW Wipo information: withdrawn in national office

Ref document number: 2023747119

Country of ref document: EP